-- Logs begin at Tue 2022-07-26 03:22:18 UTC, end at Tue 2022-07-26 06:09:51 UTC. -- Jul 26 04:15:31.766503 n-d-848886-16 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 04:15:31.776094 n-d-848886-16 devstack@n-api.service[103945]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 04:15:31 2022] *** Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: nodename: n-d-848886-16 Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: machine: x86_64 Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: clock source: unix Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: pcre jit disabled Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: detected number of CPU cores: 4 Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: current working directory: / Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: detected binary path: /usr/bin/uwsgi-core Jul 26 04:15:31.778048 n-d-848886-16 devstack@n-api.service[103945]: your processes number limit is 47680 Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: your memory page size is 4096 bytes Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: detected max file descriptor number: 2048 Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: lock engine: pthread robust mutexes Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: thunder lock: enabled Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 04:15:31.778815 n-d-848886-16 devstack@n-api.service[103945]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 04:15:31.818838 n-d-848886-16 devstack@n-api.service[103945]: Python main interpreter initialized at 0x55a2507899c0 Jul 26 04:15:31.818838 n-d-848886-16 devstack@n-api.service[103945]: python threads support enabled Jul 26 04:15:31.818838 n-d-848886-16 devstack@n-api.service[103945]: your server socket listen backlog is limited to 100 connections Jul 26 04:15:31.818838 n-d-848886-16 devstack@n-api.service[103945]: your mercy for graceful operations on workers is 90 seconds Jul 26 04:15:31.819234 n-d-848886-16 devstack@n-api.service[103945]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 04:15:31.819234 n-d-848886-16 devstack@n-api.service[103945]: *** Operational MODE: preforking *** Jul 26 04:15:31.819508 n-d-848886-16 devstack@n-api.service[103945]: *** uWSGI is running in multiple interpreter mode *** Jul 26 04:15:31.819508 n-d-848886-16 devstack@n-api.service[103945]: spawned uWSGI master process (pid: 103945) Jul 26 04:15:31.819701 n-d-848886-16 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 04:15:31.821116 n-d-848886-16 devstack@n-api.service[103945]: spawned uWSGI worker 1 (pid: 103946, cores: 1) Jul 26 04:15:31.821116 n-d-848886-16 devstack@n-api.service[103945]: spawned uWSGI worker 2 (pid: 103947, cores: 1) Jul 26 04:15:31.821116 n-d-848886-16 devstack@n-api.service[103945]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 04:15:32.474796 n-d-848886-16 devstack@n-api.service[103946]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:15:32.481228 n-d-848886-16 devstack@n-api.service[103947]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:15:33.574313 n-d-848886-16 devstack@n-api.service[103946]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:15:33.574313 n-d-848886-16 devstack@n-api.service[103946]: from cryptography.utils import int_from_bytes Jul 26 04:15:33.574977 n-d-848886-16 devstack@n-api.service[103946]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:15:33.574977 n-d-848886-16 devstack@n-api.service[103946]: from cryptography.utils import int_from_bytes Jul 26 04:15:33.581799 n-d-848886-16 devstack@n-api.service[103947]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:15:33.581799 n-d-848886-16 devstack@n-api.service[103947]: from cryptography.utils import int_from_bytes Jul 26 04:15:33.582322 n-d-848886-16 devstack@n-api.service[103947]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:15:33.582322 n-d-848886-16 devstack@n-api.service[103947]: from cryptography.utils import int_from_bytes Jul 26 04:15:36.168017 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:15:36.168546 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:15:36.168706 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:15:36.169072 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:15:36.169331 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:15:36.169721 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.170042 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.170392 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.170714 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.170812 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:15:36.171190 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.171284 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:15:36.171378 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.171568 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:15:36.171747 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.172083 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.172416 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.172539 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:15:36.172681 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.172800 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:15:36.173000 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173190 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173330 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-16 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173517 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173658 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173841 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.173966 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174171 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174310 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174523 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174619 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174839 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.174957 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.175164 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.175277 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.175483 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.175581 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.175812 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.176017 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.176127 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177147 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177244 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177320 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-16 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177397 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177463 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177534 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177611 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177683 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177749 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177829 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177904 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.177975 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178211 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178340 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178539 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178652 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178844 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.178950 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.179215 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.179346 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.179638 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-16 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.179741 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.179949 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180051 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180254 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180348 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180568 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180666 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180883 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.180976 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181187 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181281 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181505 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181593 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181807 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.181901 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182128 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182251 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182458 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182568 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182828 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.182923 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-16 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183146 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183232 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183456 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183589 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183766 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.183862 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184068 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184162 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184378 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184467 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184686 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.184787 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185012 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185121 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185317 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185500 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185619 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185709 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.185887 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186035 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186195 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186311 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186528 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186623 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186852 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.186945 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.187176 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.187780 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.187960 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.188214 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.188510 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.188612 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.188827 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.188915 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189146 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189234 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189449 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189542 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189756 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.189891 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190008 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190104 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190344 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190444 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190668 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190755 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.190974 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191063 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191280 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191381 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191531 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191625 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191780 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.191899 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192098 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192221 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192419 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192514 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192723 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.192821 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193026 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193217 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193312 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193470 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193616 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193777 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.193917 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194117 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194239 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194460 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194549 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194768 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.194867 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195093 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195221 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195459 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195572 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195721 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.195835 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196023 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196133 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196325 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196413 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196647 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196748 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.196954 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197042 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197257 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197354 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197522 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197618 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197823 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.197918 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198125 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198278 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198469 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198573 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198774 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.198872 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199080 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199174 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199384 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199480 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199686 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199773 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.199992 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200088 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200297 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200385 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200603 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200697 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200850 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.200944 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201149 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201236 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201449 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201535 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201768 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.201876 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202070 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202177 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202398 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202496 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202702 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.202809 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.203619 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.203919 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204008 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204225 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204322 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204532 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204621 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204838 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.204934 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205165 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205278 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205472 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205579 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205776 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.205873 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206079 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206200 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206410 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206507 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206711 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.206795 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207028 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207123 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207331 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207417 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207635 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207720 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.207935 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208034 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208240 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208334 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208543 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208637 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208858 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.208957 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209160 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209252 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209461 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209556 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209763 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.209866 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210068 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210242 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210390 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210477 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210692 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210794 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.210992 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211080 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211290 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211383 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211589 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211681 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211888 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.211974 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212190 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212278 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212505 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212595 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212806 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.212900 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213104 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213192 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213403 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213504 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213704 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.213799 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.214002 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.214090 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.214326 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.214418 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.214624 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.214711 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.214924 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.215020 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.215220 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.215377 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.215552 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.215697 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.215855 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.215956 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.216160 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.216262 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.216465 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.216572 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.216764 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.216865 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.217081 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:15:36.217170 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.217411 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.217509 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.217742 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.217848 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.218070 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.218178 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.218414 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.218513 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.218810 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219156 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219291 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219477 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219642 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219791 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.219963 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220110 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220278 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220443 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220593 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220767 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.220921 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221080 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221233 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221422 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221550 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221773 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.221869 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222088 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222222 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222442 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222530 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222764 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.222865 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223076 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223164 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223389 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223478 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223701 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.223799 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224009 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224108 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224324 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224420 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224637 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224725 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.224956 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225052 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225264 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225350 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225572 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225663 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225880 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.225978 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226209 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226315 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226525 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226640 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226866 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.226966 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227174 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227276 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227484 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227582 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227790 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.227885 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228106 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228212 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228415 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228511 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228723 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.228816 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229028 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229140 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229333 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229428 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229638 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229733 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.229939 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230043 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230267 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230363 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230573 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230667 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.230895 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.231022 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.231209 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.231304 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.231520 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.231616 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232081 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232191 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232400 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232495 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232708 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.232802 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233014 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233108 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233320 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233414 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233624 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233718 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.233929 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.234033 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.234806 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.234922 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.235192 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.235525 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.235649 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.235839 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.235954 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236148 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236279 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236473 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236615 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236783 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.236924 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237088 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237260 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237425 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237571 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237704 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.237883 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238015 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238216 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238354 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238530 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238666 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238836 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.238993 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239148 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239307 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239457 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239618 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239762 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.239954 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240085 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240285 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240397 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240603 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240742 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.240904 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241055 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241226 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241367 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241543 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241683 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241849 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.241998 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242145 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242299 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242476 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242617 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242783 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.242939 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243078 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243213 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243383 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243531 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243677 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243831 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.243975 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244111 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244275 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244436 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244560 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244658 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244865 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.244953 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245191 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245278 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245502 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245591 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245806 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.245897 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246110 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246229 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246442 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246539 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246757 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.246864 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247062 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247159 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247368 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247464 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247676 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247772 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.247979 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248084 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248281 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248385 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248583 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248681 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248885 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.248991 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.249187 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.249291 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.249510 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.249614 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.250408 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.250519 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.250774 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251151 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251245 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251463 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251550 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251776 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.251864 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252124 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252212 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252432 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252527 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252776 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.252863 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253097 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253183 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253407 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253505 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253726 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.253812 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254036 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254128 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254380 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254478 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254694 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.254789 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255004 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255094 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255313 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255411 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255623 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255724 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.255934 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256046 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256242 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256348 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256549 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256636 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256855 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.256952 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257171 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257259 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257478 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257564 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257796 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.257881 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258097 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258197 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258447 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258532 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258758 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.258844 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259079 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259174 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259385 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259471 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259699 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.259785 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260008 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260095 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260321 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260408 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260629 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260724 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.260938 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261024 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261245 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261331 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261554 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261648 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261867 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.261959 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262193 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262298 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262495 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262591 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262798 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.262884 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263106 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263199 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263414 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263508 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263720 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.263817 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264021 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264106 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264324 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264412 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264638 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264735 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.264946 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.265032 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.265250 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.265344 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.265588 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266029 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266126 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266385 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266502 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266698 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.266786 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267020 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267113 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267331 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267491 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267638 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267726 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.267942 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268035 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268246 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268345 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268559 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268646 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268871 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.268990 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269175 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269274 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269476 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269573 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269788 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.269895 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270095 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270208 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270424 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270521 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270726 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.270869 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271020 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271159 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271338 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271487 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271650 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271789 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.271962 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272104 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272271 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272410 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272574 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272720 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.272879 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273019 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273190 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273328 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273494 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273641 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273785 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.273922 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274082 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274259 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274411 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274510 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274734 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.274821 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275043 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275131 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275343 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275440 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275650 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275738 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.275955 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276042 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276263 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276355 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276577 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276668 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.276887 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277149 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277261 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277489 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277578 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277803 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.277897 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278109 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278231 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278454 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278550 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278771 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.278859 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279081 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279170 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279389 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279485 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279713 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.279801 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280020 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280118 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280328 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280426 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280634 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280720 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.280937 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.281047 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.281283 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.281590 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.281707 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.281898 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282037 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282233 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282546 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282634 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282852 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.282940 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283155 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283257 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283458 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283547 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283762 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.283849 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284077 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284174 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284383 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284472 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284695 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.284783 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285000 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285090 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285324 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285426 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285633 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285721 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.285935 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286030 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286262 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286353 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286569 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286663 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286877 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.286973 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287189 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287351 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287495 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287635 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287787 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.287958 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288094 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288239 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288376 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288512 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288648 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288795 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.288931 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289067 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289280 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289416 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289568 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289717 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289856 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.289992 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.290124 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.290280 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.290433 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.290579 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.290872 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291006 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291143 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291279 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291492 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291637 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291783 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.291923 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292059 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292202 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292351 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292486 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292629 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292766 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.292900 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293046 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293181 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293317 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293463 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293601 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293759 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.293906 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294051 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294208 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294378 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294467 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294683 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294777 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.294983 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295069 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295287 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295380 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295586 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295681 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295882 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.295975 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.296190 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.296304 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.296490 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.296595 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.297324 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.297418 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.297702 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298024 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298124 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298361 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298457 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298690 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.298777 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299001 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299100 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299310 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299405 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299616 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299702 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.299924 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300017 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300229 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300316 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300529 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300614 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300832 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.300975 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301135 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301228 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301441 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301528 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301742 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.301830 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302049 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302136 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302376 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302462 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302679 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302813 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.302978 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303079 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303284 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303370 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303587 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303674 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303885 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.303977 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304185 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304279 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304489 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304583 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304788 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.304873 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305089 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305185 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305393 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305481 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305693 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305780 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.305990 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306084 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306315 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306415 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306635 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306733 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.306948 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307057 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307247 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307345 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307555 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307644 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307853 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.307944 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.308210 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.308333 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.308523 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.308833 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.308928 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.309144 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.309390 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.309477 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.309749 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.309961 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.310056 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.310382 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.310558 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.310689 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.310992 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.311085 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.311317 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.311628 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.311713 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.311937 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.312215 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.312361 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.313297 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.313392 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.313797 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.313897 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.314110 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.314449 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.314538 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.314766 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.314918 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315079 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315246 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315395 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315611 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315698 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.315933 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316019 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316305 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316406 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316617 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316703 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.316929 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317023 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317241 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317335 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317552 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317638 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317868 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.317960 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318197 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318287 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318510 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318598 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318827 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.318921 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319139 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319235 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319444 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319531 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319748 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.319834 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320054 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320146 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320365 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320459 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320674 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.320759 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321007 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321093 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321331 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321487 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321658 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321754 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.321984 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322070 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322315 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322408 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322625 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322788 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.322936 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323030 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323245 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323332 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323549 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323644 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323855 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.323971 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324163 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324284 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324475 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324596 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324785 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.324908 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325095 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325214 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325406 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325519 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325712 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.325828 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326021 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326173 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326352 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326486 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326658 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326793 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.326984 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327100 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327294 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327427 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327597 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327737 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.327904 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.328093 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.328522 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.328620 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.328834 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.328928 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329142 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329238 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329563 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329650 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329878 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.329966 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330213 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330316 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330542 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330629 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330872 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.330957 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331202 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331310 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331507 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331605 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331823 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.331916 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332131 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332226 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332457 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332542 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332785 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.332879 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333101 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333194 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333418 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333513 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333725 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.333809 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334030 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334118 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334365 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334455 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334691 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334776 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.334995 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335081 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335302 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335422 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335609 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335750 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.335935 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336062 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336238 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336385 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336560 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336711 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.336975 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337064 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337284 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337389 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337589 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337676 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.337906 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338005 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338236 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338327 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338566 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338663 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338874 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.338969 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339185 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339272 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339495 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339582 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339805 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.339905 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340111 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340198 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340416 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340502 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340740 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.340838 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341045 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341139 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341361 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341446 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341674 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341768 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.341975 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342061 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342322 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342412 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342630 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342724 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.342946 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.343032 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.343254 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.343340 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.343582 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.343891 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344092 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344181 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344445 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344602 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344758 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.344854 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345081 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345172 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345410 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345509 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345719 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.345808 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346025 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346113 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346421 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346545 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346669 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346766 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.346976 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347065 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347305 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347417 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347609 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347698 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.347922 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348031 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348227 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348329 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348530 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348617 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348835 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.348923 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349136 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349225 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349440 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349527 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349748 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.349836 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350052 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350142 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350380 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350481 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350686 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.350774 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351009 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351105 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351312 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351416 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351637 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351744 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.351940 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352029 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352240 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352328 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352541 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352638 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352843 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.352930 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353187 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353274 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353491 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353591 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353812 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.353900 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354129 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354242 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354475 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354578 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354786 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.354886 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355098 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355187 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355426 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355523 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355740 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.355829 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356056 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356142 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356372 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356484 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356678 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.356777 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357232 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357338 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357547 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357649 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357851 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.357955 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358176 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358289 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358484 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358574 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358792 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.358880 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.359095 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.359703 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.360153 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.360473 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.360563 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.360792 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.360879 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361112 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361204 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361426 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361520 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361744 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.361843 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362058 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362166 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362393 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362490 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362709 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.362797 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363017 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363107 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363366 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363455 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363674 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.363808 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364006 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364095 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364324 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364419 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364649 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364747 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.364966 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365052 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365276 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365376 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365593 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365693 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365906 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.365993 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366247 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366339 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366565 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366655 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366880 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.366981 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367194 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367282 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367507 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367660 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367820 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.367908 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368129 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368279 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368443 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368540 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368754 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.368848 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369065 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369152 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369379 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369586 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369674 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.369918 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370005 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370260 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370351 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370578 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370664 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370889 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.370979 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371205 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371304 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371518 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371607 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371834 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.371935 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372144 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372241 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372461 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372668 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372763 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.372987 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373077 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373326 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373422 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373658 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373747 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.373989 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.374079 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.374331 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.374434 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.374651 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.374740 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.375556 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.375883 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.375971 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376195 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376284 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376511 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376637 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376825 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.376962 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377132 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377250 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377457 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377569 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377770 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.377887 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378076 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378237 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378427 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378550 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378737 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.378861 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379174 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379338 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379488 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379606 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379799 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.379926 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380105 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380257 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380417 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380586 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380728 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.380906 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381053 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381218 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381388 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381545 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381708 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.381862 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382003 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382181 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382346 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382505 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382667 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.382817 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383127 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383215 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383434 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383528 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383746 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.383839 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384058 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384146 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384366 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384452 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384678 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384783 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.384982 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385071 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385308 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385395 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385616 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385716 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.385924 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386011 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386253 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386346 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386562 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386665 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386868 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.386970 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387178 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387278 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387482 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387579 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387848 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.387990 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388087 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388167 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388390 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388558 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388701 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.388914 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389057 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389258 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389403 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389573 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389714 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.389880 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.390020 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.390238 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.390388 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.390599 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.390927 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391163 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391322 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391463 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391610 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391762 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.391900 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392119 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392261 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392405 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392551 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392689 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392827 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.392962 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393098 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393255 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393401 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393538 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393747 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.393894 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394058 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394227 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394392 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394533 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394705 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.394846 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395010 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395160 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395339 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395481 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395648 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395789 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.395954 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396103 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396261 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396403 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396573 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396713 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.396878 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397026 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397175 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397311 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397470 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397560 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397774 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.397874 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398083 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398194 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398414 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398502 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398726 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.398824 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399030 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399126 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399340 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399442 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399644 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399733 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.399950 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400039 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400258 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400354 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400578 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400667 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400901 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.400988 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401206 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401308 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401518 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401607 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401826 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.401915 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402145 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402292 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402482 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402578 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402789 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.402875 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403098 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403186 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403410 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403504 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403729 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.403957 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404055 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404292 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404378 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404609 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404702 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.404939 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405066 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405270 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405380 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405578 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405700 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.405885 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.406023 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.406500 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.406605 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.406826 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.406959 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407151 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407312 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407476 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407650 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407793 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.407983 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408142 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408315 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408403 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408641 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408728 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.408964 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409130 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409285 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409374 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409604 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409692 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.409922 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410021 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410262 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410354 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410577 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410666 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410890 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.410986 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411199 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411296 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411508 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411597 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411816 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.411905 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412128 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412232 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412439 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412550 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412742 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.412831 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413048 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413136 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413354 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413456 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413664 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413753 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.413971 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414068 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414298 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414406 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414605 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414693 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.414912 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415000 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415219 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415312 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415526 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415615 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415838 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.415927 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416144 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416233 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416450 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416538 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416754 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.416843 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417059 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417155 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417364 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417492 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417698 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.417787 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418081 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418234 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418379 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418469 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418688 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.418832 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419005 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419094 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419331 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419419 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419642 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419740 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.419967 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420056 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420266 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420353 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420570 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420668 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420873 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.420963 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.421179 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.421269 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.421493 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.421582 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.422377 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.422487 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.422700 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.422801 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423048 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423144 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423359 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423447 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423663 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423752 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.423967 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424058 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424271 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424359 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424575 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424663 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424883 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.424972 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425184 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425272 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425486 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425584 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425789 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.425877 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426091 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426196 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426422 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426533 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426723 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.426812 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427033 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427130 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427334 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427432 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427636 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427746 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.427935 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428024 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428234 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428324 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428533 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428621 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428867 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.428963 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429199 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429290 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429509 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429597 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429828 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.429924 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430136 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430259 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430478 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430568 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430783 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.430871 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431103 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431192 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431422 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431521 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431731 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.431829 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432035 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432122 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432363 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432452 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432688 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432835 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.432979 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.433092 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.433288 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.433386 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.433530 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:15:36.433628 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.433885 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.434210 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.434535 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.434857 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.435160 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.435482 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.435794 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.436108 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.436420 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.436726 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.437058 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.437950 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.438292 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.438602 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.438909 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.439217 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.439527 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.439833 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.440139 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.440448 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.440759 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.441085 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.441407 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.441711 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.442036 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.442385 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.442732 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.443041 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.443379 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.443703 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.444012 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.444319 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.444622 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:15:36.444860 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:15:36.588141 n-d-848886-16 devstack@n-api.service[103946]: INFO dbcounter [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Registered counter for database nova_api Jul 26 04:15:36.598651 n-d-848886-16 devstack@n-api.service[103947]: INFO dbcounter [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Registered counter for database nova_api Jul 26 04:15:36.608823 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_db.sqlalchemy.engines [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.616225 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writer thread running {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.619005 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_db.sqlalchemy.engines [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.625515 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writer thread running {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.673323 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.context [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=103946) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:15:36.677197 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:15:36.678816 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:15:36.679628 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:15:36.681069 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.context [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=103947) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:15:36.681609 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:15:36.683586 n-d-848886-16 devstack@n-api.service[103946]: INFO dbcounter [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Registered counter for database nova_cell0 Jul 26 04:15:36.685495 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_concurrency.lockutils [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:15:36.687116 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_concurrency.lockutils [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:15:36.688244 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_concurrency.lockutils [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:15:36.689042 n-d-848886-16 devstack@n-api.service[103946]: INFO dbcounter [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Registered counter for database nova_cell1 Jul 26 04:15:36.690207 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_concurrency.lockutils [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:15:36.692177 n-d-848886-16 devstack@n-api.service[103947]: INFO dbcounter [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Registered counter for database nova_cell0 Jul 26 04:15:36.696993 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_db.sqlalchemy.engines [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.698295 n-d-848886-16 devstack@n-api.service[103947]: INFO dbcounter [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Registered counter for database nova_cell1 Jul 26 04:15:36.698485 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_db.sqlalchemy.engines [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.705319 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writer thread running {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.705466 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_db.sqlalchemy.engines [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.706963 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writer thread running {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.709057 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_db.sqlalchemy.engines [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.711452 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writer thread running {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.849360 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writer thread running {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.849797 n-d-848886-16 devstack@n-api.service[103946]: INFO dbcounter [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Registered counter for database nova_cell0 Jul 26 04:15:36.858817 n-d-848886-16 devstack@n-api.service[103947]: INFO dbcounter [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Registered counter for database nova_cell0 Jul 26 04:15:36.858984 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_db.sqlalchemy.engines [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.864319 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writer thread running {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:36.868146 n-d-848886-16 devstack@n-api.service[103947]: DEBUG oslo_db.sqlalchemy.engines [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:15:36.872761 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writer thread running {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:15:37.203042 n-d-848886-16 devstack@n-api.service[103947]: WARNING keystonemiddleware.auth_token [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:15:37.204538 n-d-848886-16 devstack@n-api.service[103946]: WARNING keystonemiddleware.auth_token [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:15:37.211062 n-d-848886-16 devstack@n-api.service[103947]: WARNING keystonemiddleware.auth_token [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:15:37.211869 n-d-848886-16 devstack@n-api.service[103946]: WARNING keystonemiddleware.auth_token [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:15:37.552846 n-d-848886-16 devstack@n-api.service[103947]: WARNING keystonemiddleware.auth_token [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:15:37.553623 n-d-848886-16 devstack@n-api.service[103946]: WARNING keystonemiddleware.auth_token [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:15:37.558757 n-d-848886-16 devstack@n-api.service[103947]: WARNING keystonemiddleware.auth_token [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:15:37.559563 n-d-848886-16 devstack@n-api.service[103946]: WARNING keystonemiddleware.auth_token [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:15:37.564626 n-d-848886-16 devstack@n-api.service[103947]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2507899c0 pid: 103947 (default app) Jul 26 04:15:37.565370 n-d-848886-16 devstack@n-api.service[103946]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2507899c0 pid: 103946 (default app) Jul 26 04:15:37.566707 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:15:37.567904 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-14ff90a2-efc3-46aa-b4fc-943c2d0880ae None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 26 04:15:37.568312 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Jul 26 04:15:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:16:53.088703 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:16:53.089948 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jul 26 04:16:53.091898 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:16:53.101633 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_api:SELECT=3 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:53.102702 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_cell0:SELECT=3 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:53.103868 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_cell1:SELECT=3 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:53.104757 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:53.965003 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-07d840c3-81cb-4586-9aed-6bf6a03f1e73 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:16:53.996581 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-07d840c3-81cb-4586-9aed-6bf6a03f1e73 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.900224 Jul 26 04:16:54.009129 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jul 26 04:16:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:16:56.218268 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:16:56.219278 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-fc105a47-0401-4646-91ac-039734c46b5b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 26 04:16:56.219949 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 2/4] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:16:56.695919 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-3aba68c8-9b43-46fd-92ff-5cc5829deac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:16:56.716735 n-d-848886-16 devstack@n-api.service[103947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:16:56.716735 n-d-848886-16 devstack@n-api.service[103947]: warnings.warn(msg) Jul 26 04:16:56.746494 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-3aba68c8-9b43-46fd-92ff-5cc5829deac4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520669 Jul 26 04:16:56.747660 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 3/5] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:16:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:16:56.972468 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-c586e25a-cd6a-4814-a67c-9bcb48316bda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:16:56.976858 n-d-848886-16 devstack@n-api.service[103946]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:16:56.976858 n-d-848886-16 devstack@n-api.service[103946]: warnings.warn(msg) Jul 26 04:16:56.996816 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_api:SELECT=3 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:56.997918 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_cell0:SELECT=3 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:56.998693 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_cell1:SELECT=3 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:56.999403 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:16:57.046310 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-c586e25a-cd6a-4814-a67c-9bcb48316bda admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290647 Jul 26 04:16:57.047172 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 3/6] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jul 26 04:16:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:16:59.312268 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-3aba68c8-9b43-46fd-92ff-5cc5829deac4 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:16:59.313300 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-3aba68c8-9b43-46fd-92ff-5cc5829deac4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 26 04:16:59.313699 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 4/7] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:00.084427 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-73a3942d-2849-4089-a086-7ba6a1338fd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "name": "ds512M"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:00.106751 n-d-848886-16 devstack@n-api.service[103946]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:17:00.106751 n-d-848886-16 devstack@n-api.service[103946]: warnings.warn(msg) Jul 26 04:17:00.138661 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-73a3942d-2849-4089-a086-7ba6a1338fd8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.818296 Jul 26 04:17:00.139984 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 4/8] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:16:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:00.154584 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-79dd1052-beec-4f32-ad14-38025693a834 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:00.157465 n-d-848886-16 devstack@n-api.service[103947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:17:00.157465 n-d-848886-16 devstack@n-api.service[103947]: warnings.warn(msg) Jul 26 04:17:00.193710 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-79dd1052-beec-4f32-ad14-38025693a834 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043269 Jul 26 04:17:00.201665 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 5/9] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jul 26 04:17:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:02.670117 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-73a3942d-2849-4089-a086-7ba6a1338fd8 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:02.671204 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-73a3942d-2849-4089-a086-7ba6a1338fd8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 26 04:17:02.671995 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:03.266031 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-3d077e2b-f125-472f-a28d-85e08e781715 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:03.290720 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-3d077e2b-f125-472f-a28d-85e08e781715 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.612356 Jul 26 04:17:03.291961 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 6/11] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:03.303207 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-84f9445f-a7ab-472e-9443-0d80518145cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:03.329132 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-84f9445f-a7ab-472e-9443-0d80518145cc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029283 Jul 26 04:17:03.338716 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 6/12] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jul 26 04:17:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:05.702853 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-3d077e2b-f125-472f-a28d-85e08e781715 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:05.703998 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-3d077e2b-f125-472f-a28d-85e08e781715 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 26 04:17:05.704664 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 7/13] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:06.089684 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-1bb78216-f66a-47b4-bb4f-0ebf060e0782 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "id": "d3", "name": "ds2G"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:06.110251 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-1bb78216-f66a-47b4-bb4f-0ebf060e0782 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.399765 Jul 26 04:17:06.110789 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 7/14] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:17:06.123372 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-e9594ba4-d4fd-4989-8fe2-0b9c40fbbaf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:06.149150 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-e9594ba4-d4fd-4989-8fe2-0b9c40fbbaf3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029753 Jul 26 04:17:06.150478 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 8/15] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jul 26 04:17:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:08.406651 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-1bb78216-f66a-47b4-bb4f-0ebf060e0782 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:08.407674 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-1bb78216-f66a-47b4-bb4f-0ebf060e0782 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006464 Jul 26 04:17:08.430339 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 8/16] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:08.928978 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:08.948922 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524191 Jul 26 04:17:08.949454 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 9/17] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:08.961673 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-cfdf1e7b-ce9a-41a2-8339-ee1a168bd84f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:08.988379 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-cfdf1e7b-ce9a-41a2-8339-ee1a168bd84f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030606 Jul 26 04:17:08.988875 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 9/18] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jul 26 04:17:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:11.303738 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:11.305270 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Jul 26 04:17:11.316760 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 10/19] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:11.835804 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-66626457-352a-41a0-8512-4f579cc58d65 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:11.862412 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-66626457-352a-41a0-8512-4f579cc58d65 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.549475 Jul 26 04:17:11.875301 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 10/20] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jul 26 04:17:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:14.283306 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:14.284245 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-a2007fdd-5cf9-4a57-ab7d-501fcf63997f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 26 04:17:14.284636 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 11/21] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:14.764354 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-a3597912-b866-4fc2-a5ed-20104bcd5fe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:14.786540 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-a3597912-b866-4fc2-a5ed-20104bcd5fe9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495486 Jul 26 04:17:14.787385 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 11/22] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:14.802740 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-32ea0fe0-b303-45d5-8fdf-dcc892b0bad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:14.829468 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-32ea0fe0-b303-45d5-8fdf-dcc892b0bad3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031209 Jul 26 04:17:14.830043 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 12/23] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jul 26 04:17:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:17.896351 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-a3597912-b866-4fc2-a5ed-20104bcd5fe9 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:17.897549 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-a3597912-b866-4fc2-a5ed-20104bcd5fe9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Jul 26 04:17:17.898023 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:17:18.319902 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-9950f75c-d974-4394-81bd-ca98fcc44d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:18.340119 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-9950f75c-d974-4394-81bd-ca98fcc44d44 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434384 Jul 26 04:17:18.340749 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 13/25] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:17:18.355336 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-0c82aeb9-5338-44b7-9c1a-9343e6589111 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:18.380319 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-0c82aeb9-5338-44b7-9c1a-9343e6589111 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028846 Jul 26 04:17:18.380894 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 13/26] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jul 26 04:17:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:20.649164 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-9950f75c-d974-4394-81bd-ca98fcc44d44 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:20.650348 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-9950f75c-d974-4394-81bd-ca98fcc44d44 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Jul 26 04:17:20.650958 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:21.056713 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-dab33059-0271-4b3b-93af-8b4424579eea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:21.078025 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-dab33059-0271-4b3b-93af-8b4424579eea admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420828 Jul 26 04:17:21.078602 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 14/28] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:21.090654 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-eaf9b27d-a96f-40a5-858f-090a0396eaf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:21.114536 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-eaf9b27d-a96f-40a5-858f-090a0396eaf7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027867 Jul 26 04:17:21.115102 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 15/29] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jul 26 04:17:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:23.336914 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-dab33059-0271-4b3b-93af-8b4424579eea admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:23.338128 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-dab33059-0271-4b3b-93af-8b4424579eea admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jul 26 04:17:23.338583 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 15/30] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:23.780240 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-7a9c6252-b0f7-448a-a030-4e834b84b283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:23.785825 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:17:23.803448 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-7a9c6252-b0f7-448a-a030-4e834b84b283 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458258 Jul 26 04:17:23.804262 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 16/31] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:23.816778 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-d7f1ade1-7f3b-4678-a210-5e739a857757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:23.843831 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-d7f1ade1-7f3b-4678-a210-5e739a857757 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030787 Jul 26 04:17:23.844465 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 16/32] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jul 26 04:17:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:26.081130 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-7a9c6252-b0f7-448a-a030-4e834b84b283 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:26.082140 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-7a9c6252-b0f7-448a-a030-4e834b84b283 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 26 04:17:26.082564 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:26.526447 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:26.549980 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461328 Jul 26 04:17:26.550894 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 17/34] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jul 26 04:17:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:17:26.563946 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-97ff24e6-6cfd-4ab4-b09e-77dbcce342f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:26.589748 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-97ff24e6-6cfd-4ab4-b09e-77dbcce342f8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030792 Jul 26 04:17:26.591065 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 18/35] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jul 26 04:17:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:17:49.978764 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:49.979791 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 26 04:17:49.980194 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:49.990645 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:17:50.368757 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4a36504b-a934-40a3-b3b6-220f08a7df02 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:50.387510 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4a36504b-a934-40a3-b3b6-220f08a7df02 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401291 Jul 26 04:17:50.388059 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jul 26 04:17:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:51.460322 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:51.461324 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-3cbb6dd6-b37f-4448-9724-bfb4807ee55e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 26 04:17:51.461719 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:52.004411 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-239a3bf9-a4fa-4f0d-9041-0052d01fc53a admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:52.009958 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.wsgi [None req-239a3bf9-a4fa-4f0d-9041-0052d01fc53a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-239a3bf9-a4fa-4f0d-9041-0052d01fc53a admin admin] Request method failure captured: Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Accept: application/json Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Accept-Encoding: gzip, deflate Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Connection: keep-alive Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Content-Length: 0 Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Host: 10.222.0.43 Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: Openstack-System-Scope: None Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: User-Agent: python-novaclient Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Auth-Token: gAAAAABi32rvcYyq_3sNicKezs_XYqs6SfBvGKOPECxqGzzbuewuQBquiYjQTtWNcsTj2C0u0azRexkFdvPdszP7Z_NaIAJ-yV8RpirwRsFqjA2ZFHExrgs_wl9LeQEp0rmlzgTTSEMkOhcdVuEgnueyeijMqfCFhIuXrUpbvInVoQZHEARHy8U Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Id: None Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Name: None Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Identity-Status: Confirmed Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Is-Admin-Project: True Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Id: default Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Name: Default Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Name: admin Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Role: member,reader,admin Jul 26 04:17:52.013200 n-d-848886-16 devstack@n-api.service[103947]: X-Roles: member,reader,admin Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant: admin Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Name: admin Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-User: admin Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Id: default Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Name: Default Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: X-User-Name: admin Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: method: > Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: exception: Flavor 42 could not be found. Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: action_args: {'id': '42'} Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:52.015851 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:52.016973 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.018741 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-239a3bf9-a4fa-4f0d-9041-0052d01fc53a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:52.020032 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-239a3bf9-a4fa-4f0d-9041-0052d01fc53a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391668 Jul 26 04:17:52.020032 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:17:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:52.025238 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-b3719097-d28d-4844-8109-0e3b25d67d91 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:52.029347 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:17:52.049002 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-b3719097-d28d-4844-8109-0e3b25d67d91 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027367 Jul 26 04:17:52.049544 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 20/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:52.059778 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-a2d7d66b-af5d-45ad-8512-639bd2125be8 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:52.083802 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-a2d7d66b-af5d-45ad-8512-639bd2125be8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027552 Jul 26 04:17:52.084325 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 21/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:52.094232 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-0e59b0ae-5076-4cd9-aece-e1568e86c1b4 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:52.100457 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.wsgi [None req-0e59b0ae-5076-4cd9-aece-e1568e86c1b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-0e59b0ae-5076-4cd9-aece-e1568e86c1b4 admin admin] Request method failure captured: Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Accept: application/json Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Accept-Encoding: gzip, deflate Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Connection: keep-alive Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Content-Length: 0 Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Host: 10.222.0.43 Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: Openstack-System-Scope: None Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: User-Agent: python-novaclient Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Auth-Token: gAAAAABi32rvcYyq_3sNicKezs_XYqs6SfBvGKOPECxqGzzbuewuQBquiYjQTtWNcsTj2C0u0azRexkFdvPdszP7Z_NaIAJ-yV8RpirwRsFqjA2ZFHExrgs_wl9LeQEp0rmlzgTTSEMkOhcdVuEgnueyeijMqfCFhIuXrUpbvInVoQZHEARHy8U Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Id: None Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Name: None Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Identity-Status: Confirmed Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Is-Admin-Project: True Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Id: default Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Name: Default Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Name: admin Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Role: member,reader,admin Jul 26 04:17:52.103764 n-d-848886-16 devstack@n-api.service[103946]: X-Roles: member,reader,admin Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant: admin Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Name: admin Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-User: admin Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Id: default Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Name: Default Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: X-User-Name: admin Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: method: > Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: exception: Flavor 42 could not be found. Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: action_args: {'id': '42'} Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:52.105366 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:52.106354 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:52.107602 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-0e59b0ae-5076-4cd9-aece-e1568e86c1b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:52.109538 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-0e59b0ae-5076-4cd9-aece-e1568e86c1b4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015211 Jul 26 04:17:52.109538 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 21/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:17:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:53.067639 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-a2d7d66b-af5d-45ad-8512-639bd2125be8 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:53.068638 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-a2d7d66b-af5d-45ad-8512-639bd2125be8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 26 04:17:53.069022 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 22/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:53.588588 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-d9829201-0c02-49ba-95c1-5009d034d1c9 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:53.594724 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.wsgi [None req-d9829201-0c02-49ba-95c1-5009d034d1c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-d9829201-0c02-49ba-95c1-5009d034d1c9 admin admin] Request method failure captured: Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Accept: application/json Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Accept-Encoding: gzip, deflate Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Connection: keep-alive Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Content-Length: 0 Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Host: 10.222.0.43 Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: Openstack-System-Scope: None Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: User-Agent: python-novaclient Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Auth-Token: gAAAAABi32rwq-duLzghTpU8nn5fZ40rBM23VMsRGMBg1YhMyJL_-clLCHhEJB4CJNKm4kS107bajw9EmZ9upbjIulxiqrABXpRvJ8VxJR0e6fXdgZP6c91s1AwoWHwpgk8LYGBx16bxUMqk34kCQdz7WhdfU1v_3KyaKz6I90HKo1nUHFgoO-M Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Id: None Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Name: None Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Identity-Status: Confirmed Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Is-Admin-Project: True Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Id: default Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Name: Default Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Name: admin Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Role: member,reader,admin Jul 26 04:17:53.596308 n-d-848886-16 devstack@n-api.service[103946]: X-Roles: member,reader,admin Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant: admin Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Name: admin Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-User: admin Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Id: default Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Name: Default Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: X-User-Name: admin Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: method: > Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: exception: Flavor 84 could not be found. Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: action_args: {'id': '84'} Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:53.597806 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:53.598777 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.600110 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-d9829201-0c02-49ba-95c1-5009d034d1c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:53.601317 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-d9829201-0c02-49ba-95c1-5009d034d1c9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390815 Jul 26 04:17:53.601317 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:17:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:53.607267 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-ce6201ea-69b6-4041-afa2-05c5bdf211e3 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:53.622012 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-ce6201ea-69b6-4041-afa2-05c5bdf211e3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018204 Jul 26 04:17:53.622498 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:53.631927 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-65dac14d-9f0c-46d2-804a-1de4da0d54f8 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:53.649295 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-65dac14d-9f0c-46d2-804a-1de4da0d54f8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020918 Jul 26 04:17:53.649814 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:53.659455 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-efefa42a-9c90-49cb-9bd9-63d66e489b1f admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:53.665081 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.wsgi [None req-efefa42a-9c90-49cb-9bd9-63d66e489b1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-efefa42a-9c90-49cb-9bd9-63d66e489b1f admin admin] Request method failure captured: Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Accept: application/json Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Accept-Encoding: gzip, deflate Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Connection: keep-alive Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Content-Length: 0 Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Host: 10.222.0.43 Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: Openstack-System-Scope: None Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: User-Agent: python-novaclient Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Auth-Token: gAAAAABi32rwq-duLzghTpU8nn5fZ40rBM23VMsRGMBg1YhMyJL_-clLCHhEJB4CJNKm4kS107bajw9EmZ9upbjIulxiqrABXpRvJ8VxJR0e6fXdgZP6c91s1AwoWHwpgk8LYGBx16bxUMqk34kCQdz7WhdfU1v_3KyaKz6I90HKo1nUHFgoO-M Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Id: None Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Name: None Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Identity-Status: Confirmed Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Is-Admin-Project: True Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Id: default Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Name: Default Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Name: admin Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Role: member,reader,admin Jul 26 04:17:53.666604 n-d-848886-16 devstack@n-api.service[103947]: X-Roles: member,reader,admin Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant: admin Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Name: admin Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-User: admin Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Id: default Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Name: Default Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: X-User-Name: admin Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: method: > Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: exception: Flavor 84 could not be found. Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: action_args: {'id': '84'} Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:53.668192 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:53.669283 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:53.670647 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-efefa42a-9c90-49cb-9bd9-63d66e489b1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:53.672105 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-efefa42a-9c90-49cb-9bd9-63d66e489b1f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012585 Jul 26 04:17:53.672105 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:17:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:54.763456 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-65dac14d-9f0c-46d2-804a-1de4da0d54f8 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:54.764464 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-65dac14d-9f0c-46d2-804a-1de4da0d54f8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 26 04:17:54.766060 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 24/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:55.291824 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c20ace71-b7e8-45df-aa53-6d67fa408a3a admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:55.298187 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.wsgi [None req-c20ace71-b7e8-45df-aa53-6d67fa408a3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c20ace71-b7e8-45df-aa53-6d67fa408a3a admin admin] Request method failure captured: Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Accept: application/json Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Accept-Encoding: gzip, deflate Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Connection: keep-alive Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Content-Length: 0 Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Host: 10.222.0.43 Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: Openstack-System-Scope: None Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: User-Agent: python-novaclient Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Auth-Token: gAAAAABi32ryonj4Ba_7jdmZypUT-gcGJZiQw7wKdpUhLe5cz3-Kyvat3-BmmAki9E0NLvHej-z1wDMifSTb7vBCpaQulfpfDddh_7b-GJWAE2ANO9T2HQDaZjNAdI6x2nmY_JJr-RRCd-tdw_JAyBERctgAsx5xjfSwVBsJxP_raYfAmmOyPlE Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Id: None Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Domain-Name: None Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Identity-Status: Confirmed Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Is-Admin-Project: True Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Id: default Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Domain-Name: Default Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Project-Name: admin Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Role: member,reader,admin Jul 26 04:17:55.299712 n-d-848886-16 devstack@n-api.service[103947]: X-Roles: member,reader,admin Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant: admin Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-Tenant-Name: admin Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-User: admin Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Id: default Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-User-Domain-Name: Default Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: X-User-Name: admin Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: method: > Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: exception: Flavor 451 could not be found. Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: action_args: {'id': '451'} Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:55.301331 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:55.302420 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.303783 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c20ace71-b7e8-45df-aa53-6d67fa408a3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:55.305085 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-c20ace71-b7e8-45df-aa53-6d67fa408a3a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395720 Jul 26 04:17:55.305085 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 25/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:17:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:55.310544 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-4388be31-428b-468c-8128-21c19ad58271 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:55.325707 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-4388be31-428b-468c-8128-21c19ad58271 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018664 Jul 26 04:17:55.326230 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 25/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:55.335266 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:55.350144 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018269 Jul 26 04:17:55.350698 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jul 26 04:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:17:55.360473 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-68580b29-67ec-4c01-8baf-25c0bde7cacc admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:55.365761 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.wsgi [None req-68580b29-67ec-4c01-8baf-25c0bde7cacc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-68580b29-67ec-4c01-8baf-25c0bde7cacc admin admin] Request method failure captured: Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Accept: application/json Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Accept-Encoding: gzip, deflate Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Connection: keep-alive Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Content-Length: 0 Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Host: 10.222.0.43 Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Openstack-Api-Version: compute 2.90 Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: Openstack-System-Scope: None Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: User-Agent: python-novaclient Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Auth-Token: gAAAAABi32ryonj4Ba_7jdmZypUT-gcGJZiQw7wKdpUhLe5cz3-Kyvat3-BmmAki9E0NLvHej-z1wDMifSTb7vBCpaQulfpfDddh_7b-GJWAE2ANO9T2HQDaZjNAdI6x2nmY_JJr-RRCd-tdw_JAyBERctgAsx5xjfSwVBsJxP_raYfAmmOyPlE Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Id: None Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Domain-Name: None Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Identity-Status: Confirmed Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Is-Admin-Project: True Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Id: default Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Domain-Name: Default Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Project-Name: admin Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Role: member,reader,admin Jul 26 04:17:55.367271 n-d-848886-16 devstack@n-api.service[103946]: X-Roles: member,reader,admin Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17ca8074c0214e8f9327ac6df4a7c9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant: admin Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Id: 17ca8074c0214e8f9327ac6df4a7c9af Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-Tenant-Name: admin Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-User: admin Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Id: default Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-User-Domain-Name: Default Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-User-Id: 4a0120ed218a44fea3645c696cbf6dee Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: X-User-Name: admin Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: method: > Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: exception: Flavor 451 could not be found. Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: action_args: {'id': '451'} Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:17:55.368842 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:55.369646 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: ERROR nova.api.openstack.wsgi Jul 26 04:17:55.370995 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-68580b29-67ec-4c01-8baf-25c0bde7cacc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:17:55.372222 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-68580b29-67ec-4c01-8baf-25c0bde7cacc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012260 Jul 26 04:17:55.372222 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 26/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:17:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:17:56.340281 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:56.341289 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 26 04:17:56.341682 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:56.859901 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-a61dd65f-e356-441d-963d-398c8dee80a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:56.879010 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-a61dd65f-e356-441d-963d-398c8dee80a3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400629 Jul 26 04:17:56.879742 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 27/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jul 26 04:17:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:57.846475 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:57.847485 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 26 04:17:57.847882 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:17:58.379358 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-ebe639d1-e8e1-4eef-b1da-18c7ad45d8ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:58.398142 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-ebe639d1-e8e1-4eef-b1da-18c7ad45d8ab admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.413154 Jul 26 04:17:58.398704 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 28/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jul 26 04:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:17:59.375116 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:17:59.376402 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002837 Jul 26 04:17:59.376803 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:17:59.898030 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-92f72f81-f5f6-4c97-a2e3-fad06c89c140 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:17:59.916905 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-92f72f81-f5f6-4c97-a2e3-fad06c89c140 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399914 Jul 26 04:17:59.917445 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 29/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jul 26 04:17:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:18:00.891856 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:00.892860 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 26 04:18:00.893504 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 30/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:18:01.424095 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-6707a917-befc-4a90-bbe8-69fa0eb2f562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:18:01.442347 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-6707a917-befc-4a90-bbe8-69fa0eb2f562 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410345 Jul 26 04:18:01.443187 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 30/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jul 26 04:18:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:18:02.413514 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:02.414617 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 26 04:18:02.415053 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 31/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:18:02.938525 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-bce88373-7e25-46f6-a8f7-3e5adf5687ec admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:02.958649 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-bce88373-7e25-46f6-a8f7-3e5adf5687ec admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404739 Jul 26 04:18:02.959176 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 31/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Jul 26 04:18:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:18:54.390591 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.391609 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-4f5e3c88-9bc1-4554-87ef-67c91fcc0e0d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 26 04:18:54.392004 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:18:54.402931 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:18:54.785371 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-305a7773-0bcb-4bca-bc6a-61262b1dd30d admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.805502 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-305a7773-0bcb-4bca-bc6a-61262b1dd30d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407045 Jul 26 04:18:54.806036 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 32/64] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:18:54.829227 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-1ff14ce3-c3a1-4f7e-bb0d-9860926b4115 admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.833308 n-d-848886-16 devstack@n-api.service[103947]: DEBUG dbcounter [-] [103947] Writing DB stats nova_api:SELECT=14 {{(pid=103947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:18:54.838996 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-1ff14ce3-c3a1-4f7e-bb0d-9860926b4115 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013418 Jul 26 04:18:54.839508 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 33/65] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:18:54.851121 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-c4299afc-b142-4c07-a743-9cbbf6d493aa admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.858683 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-c4299afc-b142-4c07-a743-9cbbf6d493aa admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011084 Jul 26 04:18:54.859178 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 33/66] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:18:54.870300 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.878256 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011525 Jul 26 04:18:54.878757 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 34/67] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:18:54.889762 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-d427a2a0-64d1-46d5-979f-87999cfbd710 admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:18:54.898179 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-d427a2a0-64d1-46d5-979f-87999cfbd710 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011924 Jul 26 04:18:54.898709 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 34/68] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jul 26 04:18:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:24:27.346466 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:24:27.347543 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jul 26 04:24:27.347942 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:24:27.493065 n-d-848886-16 devstack@n-api.service[103946]: DEBUG dbcounter [-] [103946] Writing DB stats nova_api:SELECT=6 {{(pid=103946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:24:27.632042 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:24:27.634406 n-d-848886-16 devstack@n-api.service[103946]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:24:27.634406 n-d-848886-16 devstack@n-api.service[103946]: warnings.warn(msg) Jul 26 04:24:27.636161 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:24:27.636610 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:24:27.637377 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:24:27.637797 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:24:27.676959 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-3a5d4994-f3eb-4e03-83c2-bac7b869b22e admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.188973 Jul 26 04:24:27.677508 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 35/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:24:27 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:24:28.498673 n-d-848886-16 devstack@n-api.service[103947]: DEBUG nova.api.openstack.wsgi [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] Calling method '>' {{(pid=103947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:24:28.499685 n-d-848886-16 devstack@n-api.service[103947]: INFO nova.api.openstack.requestlog [None req-c91957e5-b757-4355-af86-027f1800afda admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 26 04:24:28.500078 n-d-848886-16 devstack@n-api.service[103947]: [pid: 103947|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jul 26 04:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:24:28.694559 n-d-848886-16 devstack@n-api.service[103946]: DEBUG nova.api.openstack.wsgi [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] Calling method '>' {{(pid=103946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:24:28.697006 n-d-848886-16 devstack@n-api.service[103946]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:24:28.697006 n-d-848886-16 devstack@n-api.service[103946]: warnings.warn(msg) Jul 26 04:24:28.698786 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:24:28.699490 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:24:28.700284 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:24:28.700716 n-d-848886-16 devstack@n-api.service[103946]: DEBUG oslo_concurrency.lockutils [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:24:28.723933 n-d-848886-16 devstack@n-api.service[103946]: INFO nova.api.openstack.requestlog [None req-95fc9ae8-750c-4894-a68a-61e77e0c43fd admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.086034 Jul 26 04:24:28.724417 n-d-848886-16 devstack@n-api.service[103946]: [pid: 103946|app: 0|req: 36/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:24:28 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:25:15.885600 n-d-848886-16 devstack@n-api.service[103945]: Tue Jul 26 04:25:15 2022 - graceful shutdown triggered... Jul 26 04:25:15.886119 n-d-848886-16 devstack@n-api.service[103947]: Gracefully killing worker 2 (pid: 103947)... Jul 26 04:25:15.885723 n-d-848886-16 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 04:25:15.887064 n-d-848886-16 devstack@n-api.service[103946]: Gracefully killing worker 1 (pid: 103946)... Jul 26 04:25:16.886268 n-d-848886-16 devstack@n-api.service[103945]: worker 1 buried after 1 seconds Jul 26 04:25:16.886268 n-d-848886-16 devstack@n-api.service[103945]: worker 2 buried after 1 seconds Jul 26 04:25:16.886268 n-d-848886-16 devstack@n-api.service[103945]: goodbye to uWSGI. Jul 26 04:25:16.887826 n-d-848886-16 systemd[1]: devstack@n-api.service: Succeeded. Jul 26 04:25:16.889560 n-d-848886-16 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 04:25:16.892440 n-d-848886-16 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 04:25:16.910772 n-d-848886-16 devstack@n-api.service[119477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 04:25:16 2022] *** Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: nodename: n-d-848886-16 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: machine: x86_64 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: clock source: unix Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: pcre jit disabled Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: detected number of CPU cores: 4 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: current working directory: / Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: detected binary path: /usr/bin/uwsgi-core Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: your processes number limit is 47680 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: your memory page size is 4096 bytes Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: detected max file descriptor number: 2048 Jul 26 04:25:16.938822 n-d-848886-16 devstack@n-api.service[119477]: lock engine: pthread robust mutexes Jul 26 04:25:16.939967 n-d-848886-16 devstack@n-api.service[119477]: thunder lock: enabled Jul 26 04:25:16.939967 n-d-848886-16 devstack@n-api.service[119477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 04:25:16.939967 n-d-848886-16 devstack@n-api.service[119477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 04:25:16.979333 n-d-848886-16 devstack@n-api.service[119477]: Python main interpreter initialized at 0x55b27721f9c0 Jul 26 04:25:16.979333 n-d-848886-16 devstack@n-api.service[119477]: python threads support enabled Jul 26 04:25:16.979333 n-d-848886-16 devstack@n-api.service[119477]: your server socket listen backlog is limited to 100 connections Jul 26 04:25:16.979333 n-d-848886-16 devstack@n-api.service[119477]: your mercy for graceful operations on workers is 90 seconds Jul 26 04:25:16.979781 n-d-848886-16 devstack@n-api.service[119477]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 04:25:16.979781 n-d-848886-16 devstack@n-api.service[119477]: *** Operational MODE: preforking *** Jul 26 04:25:16.980026 n-d-848886-16 devstack@n-api.service[119477]: *** uWSGI is running in multiple interpreter mode *** Jul 26 04:25:16.980026 n-d-848886-16 devstack@n-api.service[119477]: spawned uWSGI master process (pid: 119477) Jul 26 04:25:16.980234 n-d-848886-16 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 04:25:16.982570 n-d-848886-16 devstack@n-api.service[119477]: spawned uWSGI worker 1 (pid: 119487, cores: 1) Jul 26 04:25:16.982570 n-d-848886-16 devstack@n-api.service[119477]: spawned uWSGI worker 2 (pid: 119488, cores: 1) Jul 26 04:25:16.982570 n-d-848886-16 devstack@n-api.service[119477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 04:25:17.657433 n-d-848886-16 devstack@n-api.service[119488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:25:17.658898 n-d-848886-16 devstack@n-api.service[119487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:25:18.820119 n-d-848886-16 devstack@n-api.service[119488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:25:18.820119 n-d-848886-16 devstack@n-api.service[119488]: from cryptography.utils import int_from_bytes Jul 26 04:25:18.820756 n-d-848886-16 devstack@n-api.service[119488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:25:18.820756 n-d-848886-16 devstack@n-api.service[119488]: from cryptography.utils import int_from_bytes Jul 26 04:25:18.827394 n-d-848886-16 devstack@n-api.service[119487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:25:18.827394 n-d-848886-16 devstack@n-api.service[119487]: from cryptography.utils import int_from_bytes Jul 26 04:25:18.827860 n-d-848886-16 devstack@n-api.service[119487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:25:18.827860 n-d-848886-16 devstack@n-api.service[119487]: from cryptography.utils import int_from_bytes Jul 26 04:25:21.208023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:25:21.208641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:25:21.208827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:25:21.209194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:25:21.209450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:25:21.209840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.210181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.210515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.210841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.211170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.211484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.211812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.212133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.212457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.212721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.213038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.213366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-16 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.213689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.214179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.214509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.214833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.215140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.215465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.215772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.216279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.217311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.217739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.218059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.218429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.218763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.219074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.219386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.219702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.220034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.220345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.220782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-16 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.221080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.221393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.221707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.222136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.222474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.222790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.223112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.223450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.223759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.224086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.224406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.224723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.225040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.225343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.225653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.225964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.226392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.226687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.226992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.227247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.227557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.227877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.228195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.228516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.228767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.229017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.229336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.229654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.229962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.230294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.230605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.230914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.231223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.231532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.231840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.232355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.232540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.232855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.233177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.233485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.233804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.234220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.234478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.234784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.235124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.235222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:25:21.235633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.235719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:25:21.235818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.235967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:25:21.236072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.236335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:25:21.236436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.236612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:25:21.236706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.236938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.237039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.237255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.237395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.237572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.237670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.238914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.239160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.239257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.239531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.239735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.239837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.240184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.240320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.240498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.240801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.240958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.241112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.241396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.241492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.241718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-848886-16 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.242955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.243249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.243350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.243560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.243878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.244032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.244199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.244524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.244761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.244924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.245103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.245240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.245415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.245737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.245882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.246045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.246371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.246473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.246699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.246963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.247059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.247307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.247667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.247928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.248875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.249934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.250937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.251937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-848886-16 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.252963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.253589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.253751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.253884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.253973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.254606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.254787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.254900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.255090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.255231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.255407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.255558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.255742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.255883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.256075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.256208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.256392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.256518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.256708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.256861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.257026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.257119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.257358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.257450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.257671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.257780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.257986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.258078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.258295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.258389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.258612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.258718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.258937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.259037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.259260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.259362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.259585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.259689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.259841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.259940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.260094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.260238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.260417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.260551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.260739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.260871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.261054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.261201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.261368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.261525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.261679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.261836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.261999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.262201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.262340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.262567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.262718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.262868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.262967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.263196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.263948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.264093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.264232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.264453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.264556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.264648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.264795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.264952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.265081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.265262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.265372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.265597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.265696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.265913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.266010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.266326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.266452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.266577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.266676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.266894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.267030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.267214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.267320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.267532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.267629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.267847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.267938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.268181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.268349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.268493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.268583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.268804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.268901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.269121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.269211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.269442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.269539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.269751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.269847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.270007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.270099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.270340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.270433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.270652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.270749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.270975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.271066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.271280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.271369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.271593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.271754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.271898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.271989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.272203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.272555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.272781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.272879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.273094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.273184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.273406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.273503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.273716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.273815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.274029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.274127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.274364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.274467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.274676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.274780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.274985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.275124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.275294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.275408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.275605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.275706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.275914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.276013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.276226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.276324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.276539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.276635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.276850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.276940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.277163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.277262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.277474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.277571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.277783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.277873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.278093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.278217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.278428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.278529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.278740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.278830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.279650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.279763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.279993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.280091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.280308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.280406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.280622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.280714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.280945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.281043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.281250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.281381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.281563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.281708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.281889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.281990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.282224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.282333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.282538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.282636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.282847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.282937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.283157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.283255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.283466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.283558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.283773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.283868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.284077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.284188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.284381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.284478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.284681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.284771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.284988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.285124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.285296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.285392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.285602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.285704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.285907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.286012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.286237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.286343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.286565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.286655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:25:21.286874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.286975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.287892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.288888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.289869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.290851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.291789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.292968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.293926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.294024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.294258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.294371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.295948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.296896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.297847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.298854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.299797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.300961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.301914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.302968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.303885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.304840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.305991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.306950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.307050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.307269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.307368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.307580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.307721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.308930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.309840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.310916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.311868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.312949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.313934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.314095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.314271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.314758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.314866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.314961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.315996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.316945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.317889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.318926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.319890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.320880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.321827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.322825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.323971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.324986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.325202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.325301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.325521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.325609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.326514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.326690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.326804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.326898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.326983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.327933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.328980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.329941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.330897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.331832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.332976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.333912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.334987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.335879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.336860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.337949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.338907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.339936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.340892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.341084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.341182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.341429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.342943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.343912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.344844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.345939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.346976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.347930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.348956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.349171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.349279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.349496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.349612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.349855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.350865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.351827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.352986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.353920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.354961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.355921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.356852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.357154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.357281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.357458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.357615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.357933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.358909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.359942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.360881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.361818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.362839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.363955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.364887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.365933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.366907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.367884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.368960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.369906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.370963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.371183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.371379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.371486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.371695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.371809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.372804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.373947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.374938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.375911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.376950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.377977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.378801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.379940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.380983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.381929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.382909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.383849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.384799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.385939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.386045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.386779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.386907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.386907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.387957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.388145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.388238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.389998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.390955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.391877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.392826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.393972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.394924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.395885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.396990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.397200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.397672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.397781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.397995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.398976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.399936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.400967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.401182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.401279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.401496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.401588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.401823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.402919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.403978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.404931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.405982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.406978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.407917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.408897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.409849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.410819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.411972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.412924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.413955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.414203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.414300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.414510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.414720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.414828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.415801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.416993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.417921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.418959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.419098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.419274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.419402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.420931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.421177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.421371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.421685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.421825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.421945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.422795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.423959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.424997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.425912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.426863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.427796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.428936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.429948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.430908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.431812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.432800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.433863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.434874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.435983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.436304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.436396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.436625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.436727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.436942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.437995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.438979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.439933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.440868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.441806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.442991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.443950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.444964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.445132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.445280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.445423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.445836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.445999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.446998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.447997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.448977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.449917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.450059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.450300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.450392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.450555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.450648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.451415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.451513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.451762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.451864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.452830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.453968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.454921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.455953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.456880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.457796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.458952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.459960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.460879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.461817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.462986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.463930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.464982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.465944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.466293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.466482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.466618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.466712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.488860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.489899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.490867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.491903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.492656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.493617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.493617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.493617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.493617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.494826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.494997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.495178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.495391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.495657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.495905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.496130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.496341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.496502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.496687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.496841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.497013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.497013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.497498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.497684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.498538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.498538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.498939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.498939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.499933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.500850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.501222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.501371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.501656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.501816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.501976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.502180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.504650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.504832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.505595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.506695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.508558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.509617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.510901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.511411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.511411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.511411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.511411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.512018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.512448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.512787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.513143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.513538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.513911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.514273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.514662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.514997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.515326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.515654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.515973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:25:21.516228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:25:21.549851 n-d-848886-16 devstack@n-api.service[119488]: INFO dbcounter [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Registered counter for database nova_api Jul 26 04:25:21.570145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_db.sqlalchemy.engines [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.576728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writer thread running {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.579127 n-d-848886-16 devstack@n-api.service[119487]: INFO dbcounter [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Registered counter for database nova_api Jul 26 04:25:21.600108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_db.sqlalchemy.engines [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.606959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writer thread running {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.633105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.context [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119488) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:25:21.637237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:25:21.638909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:25:21.639705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:25:21.641952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:25:21.643999 n-d-848886-16 devstack@n-api.service[119488]: INFO dbcounter [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Registered counter for database nova_cell0 Jul 26 04:25:21.648321 n-d-848886-16 devstack@n-api.service[119488]: INFO dbcounter [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Registered counter for database nova_cell1 Jul 26 04:25:21.657921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_db.sqlalchemy.engines [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.662401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_db.sqlalchemy.engines [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.664449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writer thread running {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.664788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.context [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119487) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:25:21.668979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:25:21.671413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:25:21.672240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:25:21.674546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:25:21.676612 n-d-848886-16 devstack@n-api.service[119487]: INFO dbcounter [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Registered counter for database nova_cell0 Jul 26 04:25:21.680728 n-d-848886-16 devstack@n-api.service[119487]: INFO dbcounter [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Registered counter for database nova_cell1 Jul 26 04:25:21.689735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_db.sqlalchemy.engines [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.692226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_db.sqlalchemy.engines [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.697789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writer thread running {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.700078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writer thread running {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.810019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writer thread running {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.824287 n-d-848886-16 devstack@n-api.service[119488]: INFO dbcounter [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Registered counter for database nova_cell0 Jul 26 04:25:21.831871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_db.sqlalchemy.engines [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.836803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writer thread running {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:21.855907 n-d-848886-16 devstack@n-api.service[119487]: INFO dbcounter [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Registered counter for database nova_cell0 Jul 26 04:25:21.863176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_db.sqlalchemy.engines [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:25:21.868161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writer thread running {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:25:22.166710 n-d-848886-16 devstack@n-api.service[119488]: WARNING keystonemiddleware.auth_token [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:25:22.174412 n-d-848886-16 devstack@n-api.service[119488]: WARNING keystonemiddleware.auth_token [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:25:22.195113 n-d-848886-16 devstack@n-api.service[119487]: WARNING keystonemiddleware.auth_token [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:25:22.202983 n-d-848886-16 devstack@n-api.service[119487]: WARNING keystonemiddleware.auth_token [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:25:22.527173 n-d-848886-16 devstack@n-api.service[119488]: WARNING keystonemiddleware.auth_token [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:25:22.533747 n-d-848886-16 devstack@n-api.service[119488]: WARNING keystonemiddleware.auth_token [None req-aaf46d27-77a9-495e-adde-28d84d9b605e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:25:22.539062 n-d-848886-16 devstack@n-api.service[119488]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b27721f9c0 pid: 119488 (default app) Jul 26 04:25:22.547655 n-d-848886-16 devstack@n-api.service[119487]: WARNING keystonemiddleware.auth_token [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:25:22.553689 n-d-848886-16 devstack@n-api.service[119487]: WARNING keystonemiddleware.auth_token [None req-573f5a86-d53d-4d64-9f28-d9d04b8eb641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:25:22.559073 n-d-848886-16 devstack@n-api.service[119487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b27721f9c0 pid: 119487 (default app) Jul 26 04:26:10.114797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.116270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.122766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.124573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.479510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.480327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.481058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:10.482924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:11.644000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:11.645733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:11.646204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:11.646986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:11.647427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:11.702911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b8498940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:11.708398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0847f1ef-2c90-4350-adf1-9c7d3bf60f54 tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.599222 Jul 26 04:26:11.715858 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:11.715858 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:11.735404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1/1] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Jul 26 04:26:10 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:11.754799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:11.755271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:11.756084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:11.756520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:11.812891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-717d24d5-0ce2-497c-b382-69220be4aa79 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.340980 Jul 26 04:26:11.826267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:26:10 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:12.088638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '.version_select at 0x7f38b8499ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.091356 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.091356 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.100842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119488) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 04:26:12.101993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.102453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.132921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94cb4c75-a6b3-4edf-8cd5-deb70cf1150f tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.133332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.133944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.134185 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.134185 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:12.136729 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-94cb4c75-a6b3-4edf-8cd5-deb70cf1150f tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94cb4c75-a6b3-4edf-8cd5-deb70cf1150f tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin] Request method failure captured: Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zi-hmsLI4kNoJO6z3ZWA8pfGQJRFur2_cldd-0UMnq_tnrjK6_GWTt8osqDd4kI3vnSaChr25RFEvNkEbui7EVgAYzDLJK4A8jLnq0x-3Ut3P7M3A2v0HhVmyMetIM1f4RyrFgXdvHOhb7yzrKgAA3ozDHWPK75uZ3Pnz5gt9oyM4 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 13e5ae9560c94973863999bb6b6f882a Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:12.151231 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/13e5ae9560c94973863999bb6b6f882a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/13e5ae9560c94973863999bb6b6f882a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/13e5ae9560c94973863999bb6b6f882a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_13e5ae9560c94973863999bb6b6f882a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 13e5ae9560c94973863999bb6b6f882a Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3ef59756e5ea44d3b821a02df97a3eb4 Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid timestamp for date invalid_time Jul 26 04:26:12.152386 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'invalid_time'} Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:12.152989 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.153911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94cb4c75-a6b3-4edf-8cd5-deb70cf1150f tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:12.156030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.156030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.156210 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-94cb4c75-a6b3-4edf-8cd5-deb70cf1150f tempest-InstanceUsageAuditLogNegativeTestJSON-416876874 tempest-InstanceUsageAuditLogNegativeTestJSON-416876874-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.324069 Jul 26 04:26:12.158349 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Jul 26 04:26:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:26:12.160737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-705883ba-20d4-4630-9116-99a78d2d68a3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.423660 Jul 26 04:26:12.170246 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:26:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:12.371765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-870573356", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:12.383098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Calling method '.version_select at 0x7f38b8499280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.387201 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.387201 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.390915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.392366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.420098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.421220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.435713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.436295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.442976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a7b58f87-2954-494d-aa01-a0dac970331c tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.270986 Jul 26 04:26:12.454978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3/5] 10.222.0.43 () {60 vars in 1208 bytes} [Tue Jul 26 04:26:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:12.462171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.463287 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.463287 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.464778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.465413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.466418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.468014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.496710 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76cbbb70-9fe5-412c-9990-6503313a4ccf tempest-AZAdminV2TestJSON-120389691 tempest-AZAdminV2TestJSON-120389691-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.040407 Jul 26 04:26:12.508635 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 4/6] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:26:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:12.513931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b830df70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.518680 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.518680 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.520013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.520476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.521413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:12.521840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:12.562678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-113bbb5b-8a5c-423f-998e-2cbb60c32f0f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.052538 Jul 26 04:26:12.563450 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 5/7] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jul 26 04:26:12 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:12.881305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e45efc6b-c0ee-4510-8144-80f3ddfd44d2 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:12.882134 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.882134 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.883314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e45efc6b-c0ee-4510-8144-80f3ddfd44d2 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ab5a11f4d29f45d49b24dd6a1dbcaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d28559792c43268a63b4198e4fb348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e45efc6b-c0ee-4510-8144-80f3ddfd44d2 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Request method failure captured: Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfbEuECqs6pr3xiYg4HhGgNxWSjua4OQ0f8vEd7iDUFfhCB-AZ4fn6b_DuO1yx4Qa3a_GDWI3TDrl6MepgNMKO4tQTXESinQ5DZWZUbqWJzwX0x8X6fxvHsThfrXpdKiwO1dXaDPGcVU9YYaxQPuMUHccGTzv0qF63Dy8bqJBlE_o Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d0d28559792c43268a63b4198e4fb348 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:12.886728 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d0d28559792c43268a63b4198e4fb348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d0d28559792c43268a63b4198e4fb348 Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ab5a11f4d29f45d49b24dd6a1dbcaadd Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:12.887853 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:12.888390 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:12.890804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e45efc6b-c0ee-4510-8144-80f3ddfd44d2 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:12.891853 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e45efc6b-c0ee-4510-8144-80f3ddfd44d2 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.323129 Jul 26 04:26:12.891853 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 6/8] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:26:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:12.893506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c7bc894-536b-4685-96f5-b57e6131d472 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1322823198", "name": "tempest-test_aggregate-1227878155"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:12.931766 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:12.931766 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:12.932855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-5c7bc894-536b-4685-96f5-b57e6131d472 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid 3c7c81fb-ce0a-49c4-863f-a803772090ff for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:13.010901 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c7bc894-536b-4685-96f5-b57e6131d472 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.118531 Jul 26 04:26:13.018485 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 7/9] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Jul 26 04:26:12 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:13.020382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b82665e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:13.027174 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:13.027174 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:13.028386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:13.028889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:13.029675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:13.030773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:13.056425 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-715ef62e-99e3-42ed-9e5b-2f9fe32850d7 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.043308 Jul 26 04:26:13.063906 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 8/10] 10.222.0.43 () {58 vars in 1145 bytes} [Tue Jul 26 04:26:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:13.068876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1804054-1a1a-43f6-b217-02c5a544b787 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:13.069759 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:13.069759 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:13.070799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b1804054-1a1a-43f6-b217-02c5a544b787 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ab5a11f4d29f45d49b24dd6a1dbcaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d28559792c43268a63b4198e4fb348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1804054-1a1a-43f6-b217-02c5a544b787 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Request method failure captured: Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2004:26:12 HTTP/1.1 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfbEuECqs6pr3xiYg4HhGgNxWSjua4OQ0f8vEd7iDUFfhCB-AZ4fn6b_DuO1yx4Qa3a_GDWI3TDrl6MepgNMKO4tQTXESinQ5DZWZUbqWJzwX0x8X6fxvHsThfrXpdKiwO1dXaDPGcVU9YYaxQPuMUHccGTzv0qF63Dy8bqJBlE_o Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d0d28559792c43268a63b4198e4fb348 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:13.072406 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0d28559792c43268a63b4198e4fb348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d0d28559792c43268a63b4198e4fb348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d0d28559792c43268a63b4198e4fb348 Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ab5a11f4d29f45d49b24dd6a1dbcaadd Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:13.073488 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '2022-07-26 04:26:12'} Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:13.074588 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:13.075567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1804054-1a1a-43f6-b217-02c5a544b787 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:13.079205 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b1804054-1a1a-43f6-b217-02c5a544b787 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852 tempest-InstanceUsageAuditLogNegativeTestJSON-52269852-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 04:26:12" status: 403 len: 128 microversion: 2.1 time: 0.009063 Jul 26 04:26:13.079205 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 9/11] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 04:26:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2004%3A26%3A12 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:13.080333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-750b5526-255c-4304-8fab-c0709ad48341 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:13.081134 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:13.081134 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:13.098339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-750b5526-255c-4304-8fab-c0709ad48341 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.022164 Jul 26 04:26:13.101902 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 10/12] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:26:13 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:13.111424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc5d8785-6882-4508-84ae-38bb1f55ef80 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:13.115179 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:13.115179 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:13.130546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc5d8785-6882-4508-84ae-38bb1f55ef80 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:13.131011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc5d8785-6882-4508-84ae-38bb1f55ef80 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:13.387879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:26:13.714576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:26:13.715619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:26:13.716248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:26:13.718208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:26:13.718767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:26:13.739991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:13.740785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:13.742005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:13.743949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:13.792346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:13.815305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:13.843456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:26:13.851769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:26:14.001783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c36814f0-3dc8-42e8-9bc8-c0ab12d800b2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842083 Jul 26 04:26:14.002487 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3/13] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:26:14.314786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc5d8785-6882-4508-84ae-38bb1f55ef80 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 1.205781 Jul 26 04:26:14.316470 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 11/14] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:14.336450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c299dc19-1f42-43ee-b254-e4880a79c0a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:14.337323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c299dc19-1f42-43ee-b254-e4880a79c0a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:14.621569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aae80799-63e6-4cbc-a31e-aa88ed38fca6 tempest-AZAdminNegativeTestJSON-908682210 tempest-AZAdminNegativeTestJSON-908682210-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:14.624747 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:14.624747 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:14.625978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aae80799-63e6-4cbc-a31e-aa88ed38fca6 tempest-AZAdminNegativeTestJSON-908682210 tempest-AZAdminNegativeTestJSON-908682210-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '341ebd9e615047a592bce3d024a93d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548e4e52d8d6489cb3a566562f63c008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aae80799-63e6-4cbc-a31e-aa88ed38fca6 tempest-AZAdminNegativeTestJSON-908682210 tempest-AZAdminNegativeTestJSON-908682210-project] Request method failure captured: Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zj773uzzD89d49ILuKl5KFKtW-Pb-fvkFDxOxdGAFDwERPNkFW8AjAloOBo14NflguAQQmz3x1hQ0OrhPTtp-InUvPOSmUa9N6Ztt8KjM0xi96OSoYe5WcrGOno86e4w7pVsABJY2zRWSKropw0ad-366Bs_CIJeL9Axohb-toPzA Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 548e4e52d8d6489cb3a566562f63c008 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AZAdminNegativeTestJSON-908682210 Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:14.633466 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/548e4e52d8d6489cb3a566562f63c008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/548e4e52d8d6489cb3a566562f63c008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/548e4e52d8d6489cb3a566562f63c008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_548e4e52d8d6489cb3a566562f63c008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AZAdminNegativeTestJSON-908682210 Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 548e4e52d8d6489cb3a566562f63c008 Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-908682210 Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AZAdminNegativeTestJSON-908682210-project Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 341ebd9e615047a592bce3d024a93d8e Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AZAdminNegativeTestJSON-908682210-project Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 04:26:14.634893 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:14.635654 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 04:26:14.636640 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:14.642911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aae80799-63e6-4cbc-a31e-aa88ed38fca6 tempest-AZAdminNegativeTestJSON-908682210 tempest-AZAdminNegativeTestJSON-908682210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:14.644960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aae80799-63e6-4cbc-a31e-aa88ed38fca6 tempest-AZAdminNegativeTestJSON-908682210 tempest-AZAdminNegativeTestJSON-908682210-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.640780 Jul 26 04:26:14.647325 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 4/15] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:26:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 644 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:15.728477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1821704911", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "availability_zone": "tempest-test_az-1322823198"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:15.783145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:15.783688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:15.784568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:15.785010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:15.932773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:26:16.408828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:26:16.409428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:26:16.410305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:26:16.410937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:26:16.411567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:26:16.428028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:16.430352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:16.432487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:16.433939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:16.486109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Getting quotas for project 386785fcb6d14ee59bfd23b3ce537450. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:16.507229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Getting quotas for user f73e4f89266342e38205a01de85fa114 and project 386785fcb6d14ee59bfd23b3ce537450. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:16.533012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:26:16.536325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:26:16.632464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2298e375-1035-4afb-a8f5-1fe014899858 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.861752 Jul 26 04:26:16.635596 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 5/16] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:26:16.656654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b81dc245-af33-4f0e-bb28-fd34996727c7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:16.659541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b81dc245-af33-4f0e-bb28-fd34996727c7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:16.801776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c299dc19-1f42-43ee-b254-e4880a79c0a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:16.823746 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c299dc19-1f42-43ee-b254-e4880a79c0a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1212 microversion: 2.1 time: 2.491747 Jul 26 04:26:16.824919 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 12/17] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:14 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1212 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:17.003750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b81dc245-af33-4f0e-bb28-fd34996727c7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:17.081941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b81dc245-af33-4f0e-bb28-fd34996727c7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1243 microversion: 2.1 time: 0.438621 Jul 26 04:26:17.100570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 6/18] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:16 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1243 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:17.847741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:17.848491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:17.874696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:17.875962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:17.882065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:17.882655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:18.110007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32de8942-ee3c-4d25-952f-21630f47450b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:18.110499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32de8942-ee3c-4d25-952f-21630f47450b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:18.352573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32de8942-ee3c-4d25-952f-21630f47450b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:18.380045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:18.388665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32de8942-ee3c-4d25-952f-21630f47450b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1243 microversion: 2.1 time: 0.287890 Jul 26 04:26:18.393752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 7/19] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:18 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1243 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:18.428813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efadca97-9f79-4d5e-a5b4-da59dc874b62 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1270 microversion: 2.1 time: 0.585017 Jul 26 04:26:18.431987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 13/20] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:17 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1270 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:19.417327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:19.418007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:19.431664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:19.432126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:19.432920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:19.433365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:19.455350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:19.457333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:19.472323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:19.477921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:19.479370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:19.481019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:19.921781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:19.991647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6363473-8d63-4763-ade2-01bb58f63898 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1299 microversion: 2.1 time: 0.583415 Jul 26 04:26:20.001292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 8/21] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:19 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1299 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:20.090079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:20.101873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aeac5d6b-56b9-4235-a9f3-5c1639825e34 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1270 microversion: 2.1 time: 0.652591 Jul 26 04:26:20.108729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 14/22] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:19 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1270 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:21.018781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.020879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:21.035122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:21.042361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:21.043814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:21.052475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:21.211876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9037aa3-2da4-455a-899a-3752579c2fe9 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-308810889", "id": 770982482, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:21.216235 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:21.216235 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:21.280902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:21.289539 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0344dd0-0183-4587-9849-06a8828d3d02 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1297 microversion: 2.1 time: 0.275496 Jul 26 04:26:21.297301 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 15/23] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1297 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:21.315250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.317731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9037aa3-2da4-455a-899a-3752579c2fe9 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.615025 Jul 26 04:26:21.319029 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 9/24] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:20 2022] POST /compute/v2.1/flavors => generated 426 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:21.320216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:21.332388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c1e34b3-ed1c-4f07-a926-3b64f6bdaaaf tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.333529 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:21.333529 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:21.344618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:21.348706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:21.349633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:21.350089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:21.421375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6c1e34b3-ed1c-4f07-a926-3b64f6bdaaaf tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/770982482" status: 202 len: 0 microversion: 2.1 time: 0.094300 Jul 26 04:26:21.422522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 10/25] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:21 2022] DELETE /compute/v2.1/flavors/770982482 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:21.432155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-438cc7e7-226f-41d0-b15b-a8bd683c7908 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.512968 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-438cc7e7-226f-41d0-b15b-a8bd683c7908 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086168 Jul 26 04:26:21.513467 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 11/26] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:21.534921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6997f669-8b2c-4428-a98f-00a371c36917 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-82687881", "id": 249856618, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:21.566085 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6997f669-8b2c-4428-a98f-00a371c36917 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034968 Jul 26 04:26:21.572281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 12/27] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:21 2022] POST /compute/v2.1/flavors => generated 412 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:21.585078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-754ba39f-6881-49f8-bca0-548ef4a48f1d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.612869 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-754ba39f-6881-49f8-bca0-548ef4a48f1d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.031707 Jul 26 04:26:21.625523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 13/28] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:21.644122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c66e6cc9-c29a-406c-8ae0-bec3026fb073 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.690140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:21.693643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c66e6cc9-c29a-406c-8ae0-bec3026fb073 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/249856618" status: 202 len: 0 microversion: 2.1 time: 0.054475 Jul 26 04:26:21.694648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:21 2022] DELETE /compute/v2.1/flavors/249856618 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:21.705133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1667f867-c524-471d-b82c-bcedec426678 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.710674 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf849e61-1ff0-4d5a-ae42-4ef6681fe9b4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1270 microversion: 2.1 time: 0.398105 Jul 26 04:26:21.713307 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1270 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:21.749820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1667f867-c524-471d-b82c-bcedec426678 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049961 Jul 26 04:26:21.750901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:21.775262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ba6aca0-7b46-469b-baa3-55f50e7f55b7 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-96826592", "id": 1597259754, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:21.781313 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:21.781313 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:21.880265 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ba6aca0-7b46-469b-baa3-55f50e7f55b7 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.109560 Jul 26 04:26:21.880876 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 17/32] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:21 2022] POST /compute/v2.1/flavors => generated 427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:21.893855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dfcd4413-fc79-4b83-b9c6-42d640c2bf8e tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:21.939875 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dfcd4413-fc79-4b83-b9c6-42d640c2bf8e tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1597259754" status: 202 len: 0 microversion: 2.1 time: 0.050807 Jul 26 04:26:21.941772 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:21 2022] DELETE /compute/v2.1/flavors/1597259754 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:21.949965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1df000a4-dd2d-4531-b582-7e9363f22183 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:22.087404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1df000a4-dd2d-4531-b582-7e9363f22183 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.136048 Jul 26 04:26:22.091520 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 18/34] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:22.110141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3073c3b0-34ff-4d5e-877f-609906dfbc74 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-647850681", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:22.177846 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3073c3b0-34ff-4d5e-877f-609906dfbc74 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.072286 Jul 26 04:26:22.205941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e9e5f554-11de-4446-b977-d72bf72726ca tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:22.205941 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:22.205941 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:22.206414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 17/35] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:22 2022] POST /compute/v2.1/flavors => generated 506 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:22.348598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e9e5f554-11de-4446-b977-d72bf72726ca tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/7812530c-0acc-4e67-a077-35fd8e1b2ccc" status: 202 len: 0 microversion: 2.1 time: 0.154899 Jul 26 04:26:22.358788 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:26:22 2022] DELETE /compute/v2.1/flavors/7812530c-0acc-4e67-a077-35fd8e1b2ccc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:22.380605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:22.392339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:22.445350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:22.448441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:22.449514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:22.457703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:22.643024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5889d00b-001b-4330-81bb-24b9a3db97df tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Action: 'create', calling method: .version_select at 0x7f38b7117f70>, body: {"keypair": {"name": "tempest-keypair-1768157117", "type": "ssh", "user_id": "722dbf54d2974136b63a4b7212dc4910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ610sc+5Jgxrbzm3OwhKCTwRee4HkoEewDhHluT7JgeNOT5C1d/8+wOK4VG2AHatOj4GoUtLVVD3whGmzaK24aE17ZB2FPnjxHaLm9Ict75hEfhebVea8nWRJdwMFNSFg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:22.753985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5889d00b-001b-4330-81bb-24b9a3db97df tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:22.771479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5889d00b-001b-4330-81bb-24b9a3db97df tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for user 6941f2b17e624aa7b18a24622c2d6333 and project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:22.809315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:22.848125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-caadaa4e-f87c-4773-95c7-d2d43ebd7d48 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1297 microversion: 2.1 time: 0.480835 Jul 26 04:26:22.866785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:22 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1297 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:22.876149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce43375a-178d-4ed0-ae04-c65c4046a147 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:22.894034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:22.905912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce43375a-178d-4ed0-ae04-c65c4046a147 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036597 Jul 26 04:26:22.924237 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 21/38] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:22.931727 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5889d00b-001b-4330-81bb-24b9a3db97df tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.678285 Jul 26 04:26:22.932802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:22.933242 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 18/39] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:26:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 680 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 26 04:26:22.933463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:22.950234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:22.952463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:22.953704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:22.954252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:22.981254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-efe31c06-2293-472d-bc67-9079449cef83 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1734240969", "id": "57dca461-761b-4928-b472-4dcaf4a7ee02", "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:23.051731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:23.062685 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-efe31c06-2293-472d-bc67-9079449cef83 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.127880 Jul 26 04:26:23.071181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 19/40] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:22 2022] POST /compute/v2.1/flavors => generated 507 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:23.105518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b768ce0-2f33-41cf-a65e-530a7ece6cd0 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Action: 'create', calling method: .version_select at 0x7f38b7109550>, body: {"keypair": {"name": "tempest-keypair-1958422217", "type": "ssh", "user_id": "722dbf54d2974136b63a4b7212dc4910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR6k2FnsS8N3D+UgtP9PbCgAd/2RedsGFNaMTmokCQ7FP230IvGjISTxaxy+tlsfLVyHeInzNTz9RNZlqSlvgHPDqqJiIDDxa/IgVG5viMyNBabSwauZu71TqmXYNpDAQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:23.186894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7b768ce0-2f33-41cf-a65e-530a7ece6cd0 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:23.210072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7b768ce0-2f33-41cf-a65e-530a7ece6cd0 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for user 6941f2b17e624aa7b18a24622c2d6333 and project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:23.308932 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b768ce0-2f33-41cf-a65e-530a7ece6cd0 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.233572 Jul 26 04:26:23.311836 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 20/41] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:26:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:26:23.323791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-989c8bf3-4823-4e3b-ac0c-211b1e4b33ae tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.387289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-989c8bf3-4823-4e3b-ac0c-211b1e4b33ae tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/57dca461-761b-4928-b472-4dcaf4a7ee02" status: 202 len: 0 microversion: 2.1 time: 0.072294 Jul 26 04:26:23.394341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 21/42] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:26:23 2022] DELETE /compute/v2.1/flavors/57dca461-761b-4928-b472-4dcaf4a7ee02 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:23.403686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6143fc4-9830-4168-8655-54cf1a771385 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Calling method '.version_select at 0x7f38b7075dc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.425572 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6143fc4-9830-4168-8655-54cf1a771385 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1768157117?user_id=722dbf54d2974136b63a4b7212dc4910" status: 200 len: 512 microversion: 2.10 time: 0.024921 Jul 26 04:26:23.429083 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 22/43] 10.222.0.43 () {60 vars in 1340 bytes} [Tue Jul 26 04:26:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1768157117?user_id=722dbf54d2974136b63a4b7212dc4910 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:23.450330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f7fe2e14-9549-45b9-bf76-2486f75de380 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.531477 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f7fe2e14-9549-45b9-bf76-2486f75de380 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100946 Jul 26 04:26:23.538491 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:23.548742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f9cd092-b93a-443d-9593-04506d5e6323 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Action: 'create', calling method: .version_select at 0x7f38b70e6040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1021777566", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASTjHXFjYuiszONSE8EkFi0wP6fawzA3TSiOTJlnXmrTCEGS3mtWzGc5+z5ca4LZwGEpKNyDX11P95O8jIfZAgkRqsKhChg7AfQpfUnqewmhSACcCNmuT9K0RPYQvaAmw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:23.591135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0f9cd092-b93a-443d-9593-04506d5e6323 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:23.596850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0f9cd092-b93a-443d-9593-04506d5e6323 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Getting quotas for user 6941f2b17e624aa7b18a24622c2d6333 and project 5b3aa01d9b9e4a0c9890e2fe0df6e99a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:23.641930 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f9cd092-b93a-443d-9593-04506d5e6323 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.101565 Jul 26 04:26:23.643825 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 24/45] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:26:23 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:26:23.658121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3037e9ef-dab3-4f33-83fb-04d8c276209e tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-9097476", "id": 2004360271, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:23.688389 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3037e9ef-dab3-4f33-83fb-04d8c276209e tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042767 Jul 26 04:26:23.698360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:23 2022] POST /compute/v2.1/flavors => generated 411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:23.705895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3958e56b-af12-43c0-a03f-2b20686e72f5 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Calling method '.version_select at 0x7f38b7075dc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.714836 n-d-848886-16 devstack@n-api.service[119487]: WARNING oslo_db.sqlalchemy.utils [None req-3958e56b-af12-43c0-a03f-2b20686e72f5 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:26:23.728823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3958e56b-af12-43c0-a03f-2b20686e72f5 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs?user_id=722dbf54d2974136b63a4b7212dc4910" status: 200 len: 726 microversion: 2.10 time: 0.027628 Jul 26 04:26:23.730589 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 26/47] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Jul 26 04:26:23 2022] GET /compute/v2.1/os-keypairs?user_id=722dbf54d2974136b63a4b7212dc4910 => generated 726 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:23.737497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79a9ca42-9b53-474d-9c05-259f8b927e27 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.761972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79a9ca42-9b53-474d-9c05-259f8b927e27 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/2004360271" status: 200 len: 411 microversion: 2.1 time: 0.029932 Jul 26 04:26:23.762981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 27/48] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:23 2022] GET /compute/v2.1/flavors/2004360271 => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:23.776307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a437531-edfb-4544-88c9-18530a9b0c82 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Calling method '.version_select at 0x7f38b715cc10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:23.802421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a437531-edfb-4544-88c9-18530a9b0c82 tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1021777566" status: 204 len: 0 microversion: 2.10 time: 0.029162 Jul 26 04:26:23.804118 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 28/49] 10.222.0.43 () {60 vars in 1325 bytes} [Tue Jul 26 04:26:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1021777566 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:26:24.207818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:24.222822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfba8499-e1cf-42fe-a284-be3c784a1006 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 1.294442 Jul 26 04:26:24.224077 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 22/50] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:22 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:24.245654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-72d0a9e1-16e4-41d4-b325-158c32872ffe tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Calling method '.version_select at 0x7f38b68fe790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.284105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0372a75-7dc8-4b03-842b-03579b9b2c8e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.328521 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-72d0a9e1-16e4-41d4-b325-158c32872ffe tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958422217?user_id=722dbf54d2974136b63a4b7212dc4910" status: 204 len: 0 microversion: 2.10 time: 0.094275 Jul 26 04:26:24.330786 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 23/51] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:26:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958422217?user_id=722dbf54d2974136b63a4b7212dc4910 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:26:24.347498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.351291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:24.370645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:24.371437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:24.372468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:24.373091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:24.388409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0372a75-7dc8-4b03-842b-03579b9b2c8e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.582802 Jul 26 04:26:24.394464 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 29/52] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:23 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:24.410939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-801586a5-9502-4986-a305-7ebfa17fecfe tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] Calling method '.version_select at 0x7f38b70f8550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.456245 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-801586a5-9502-4986-a305-7ebfa17fecfe tempest-KeyPairsV210TestJSON-99504677 tempest-KeyPairsV210TestJSON-99504677-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768157117?user_id=722dbf54d2974136b63a4b7212dc4910" status: 204 len: 0 microversion: 2.10 time: 0.059306 Jul 26 04:26:24.460923 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 30/53] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:26:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768157117?user_id=722dbf54d2974136b63a4b7212dc4910 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:26:24.472938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d74a8802-3bd6-49d3-984f-abb5364a12d8 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.544339 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d74a8802-3bd6-49d3-984f-abb5364a12d8 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2004360271" status: 202 len: 0 microversion: 2.1 time: 0.083265 Jul 26 04:26:24.546458 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 31/54] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:24 2022] DELETE /compute/v2.1/flavors/2004360271 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:24.568528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f54ca27-3505-4925-a1d0-bab14226cea4 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.647353 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f54ca27-3505-4925-a1d0-bab14226cea4 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095788 Jul 26 04:26:24.648021 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 32/55] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:24.676567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59394243-7b47-4f59-abba-57f9d77f36a5 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1211942412", "id": 1645367077, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:24.731893 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59394243-7b47-4f59-abba-57f9d77f36a5 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.062924 Jul 26 04:26:24.734304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 33/56] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:24.754237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea5eb8e5-f81f-4f31-84c6-b6bda8531d5e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "1645367077"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:24.787068 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ea5eb8e5-f81f-4f31-84c6-b6bda8531d5e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] HTTP exception thrown: Flavor 1645367077 could not be found. Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea5eb8e5-f81f-4f31-84c6-b6bda8531d5e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Request method failure captured: Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 107 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zp1THSw2EJ2vU1btKn6kfw_3i1R-8ZGrTUB6g12KwViyiAkPRskrSqw_TlE531p83cl5671yNa0ihN0fc7I1Y88XL2_XwTXSkuOb9N0mkLnGzbNgwAob_ZsVT_06bCPbiVM9TT4RlD9x9bUjUP_IFoEcnPeDO2tl-bZp0v9aIWXg8 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 64e84555139042ea962950c6d984554e Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsAdminTestJSON-2115352506 Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:24.810319 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/64e84555139042ea962950c6d984554e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64e84555139042ea962950c6d984554e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64e84555139042ea962950c6d984554e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_64e84555139042ea962950c6d984554e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsAdminTestJSON-2115352506 Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 64e84555139042ea962950c6d984554e Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2115352506 Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsAdminTestJSON-2115352506-project Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f7e60747a78143ebad7111472f5ad8da Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsAdminTestJSON-2115352506-project Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "test", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "1645367077"}} Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:24.812164 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor 1645367077 could not be found. Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '1645367077'}}} Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1645367077 could not be found. Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:24.812967 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1645367077 could not be found. Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:24.814059 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:24.815184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:24.815184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:24.815184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:24.815184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1645367077 could not be found. Jul 26 04:26:24.815184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:24.819716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea5eb8e5-f81f-4f31-84c6-b6bda8531d5e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Returning 400 to user: Flavor 1645367077 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:24.822298 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea5eb8e5-f81f-4f31-84c6-b6bda8531d5e tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.078389 Jul 26 04:26:24.828441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 34/57] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:24 2022] POST /compute/v2.1/servers => generated 81 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 26 04:26:24.851991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0355f135-413b-4e24-aa75-e36ac3546d04 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.916143 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0355f135-413b-4e24-aa75-e36ac3546d04 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1645367077" status: 202 len: 0 microversion: 2.1 time: 0.084101 Jul 26 04:26:24.919961 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 35/58] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:24 2022] DELETE /compute/v2.1/flavors/1645367077 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:24.940175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b318fb3-505f-445f-bb3f-0fb7d2f8d0ce tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:24.999178 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b318fb3-505f-445f-bb3f-0fb7d2f8d0ce tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071938 Jul 26 04:26:25.023312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 36/59] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.033029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6381cb5-bb75-4cda-b741-0a9894f760a3 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1784758693", "id": 1022947610, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:25.087256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6381cb5-bb75-4cda-b741-0a9894f760a3 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.057916 Jul 26 04:26:25.095360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 37/60] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:25.103040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-efc3266a-fb03-492e-955b-d0b26eca317d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1627868519", "id": 328973324, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:25.159584 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-efc3266a-fb03-492e-955b-d0b26eca317d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.059922 Jul 26 04:26:25.170955 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 38/61] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:25 2022] POST /compute/v2.1/flavors => generated 411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:25.175594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60b53f96-9e4c-4587-a9bd-5876cc11e82d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.220196 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60b53f96-9e4c-4587-a9bd-5876cc11e82d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.047997 Jul 26 04:26:25.229015 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 39/62] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:25.239275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f7b6664-a43a-4dbf-b990-53d1b9385d24 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.271590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f7b6664-a43a-4dbf-b990-53d1b9385d24 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.040329 Jul 26 04:26:25.281037 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 40/63] 10.222.0.43 () {58 vars in 1177 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:25.287614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.289036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:25.304650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:25.306253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:25.307642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:25.309479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:25.365656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:25.377980 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-329d5b4d-5102-4e89-8ac1-2e116d06c05b tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1297 microversion: 2.1 time: 1.038328 Jul 26 04:26:25.378636 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 24/64] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:24 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1297 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.399733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0a1b9bd-b45f-4afc-8205-1a955d5cf3a6 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.444613 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0a1b9bd-b45f-4afc-8205-1a955d5cf3a6 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.063911 Jul 26 04:26:25.449618 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 25/65] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:25.469984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2730f797-8270-4476-8e0a-a0729b03da93 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.494135 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2730f797-8270-4476-8e0a-a0729b03da93 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.030486 Jul 26 04:26:25.495687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 26/66] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:25.513029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd66360d-fb66-47c0-9ba4-bf9c2e09b6c0 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.540109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd66360d-fb66-47c0-9ba4-bf9c2e09b6c0 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.034278 Jul 26 04:26:25.557714 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 27/67] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.563948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4118a8fa-0d3f-4eae-8d06-64ce06b40c3f tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.623355 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4118a8fa-0d3f-4eae-8d06-64ce06b40c3f tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.064171 Jul 26 04:26:25.624521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 28/68] 10.222.0.43 () {58 vars in 1175 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.657298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3741046-815c-4a4b-ba75-fabfc29e6ce0 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.713470 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3741046-815c-4a4b-ba75-fabfc29e6ce0 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.049000 Jul 26 04:26:25.714725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 29/69] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.735686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58d39279-39ba-46cd-ba7e-ce94383cb620 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.775950 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58d39279-39ba-46cd-ba7e-ce94383cb620 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.044430 Jul 26 04:26:25.791047 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 30/70] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.823557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b91cd2ec-9cc0-48ae-bb12-65ca7a705eae tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:25.824735 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:25.824735 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:25.868262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:25.879626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b91cd2ec-9cc0-48ae-bb12-65ca7a705eae tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/328973324" status: 202 len: 0 microversion: 2.1 time: 0.053837 Jul 26 04:26:25.884257 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 31/71] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:25 2022] DELETE /compute/v2.1/flavors/328973324 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:25.891854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:25.917600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0d110bf-3bb9-4908-8cd1-d09674ba8926 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.639951 Jul 26 04:26:25.923728 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 41/72] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:25.950428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5658c9f-2560-460e-a7a5-8f8c4f0a1997 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:26.058422 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5658c9f-2560-460e-a7a5-8f8c4f0a1997 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.129433 Jul 26 04:26:26.059056 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 42/73] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:26.082604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0b6969ff-9dee-40da-b194-af03d0c1caf5 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:26.085419 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:26.085419 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:26.141565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=81,nova_api:DELETE=11 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:26.158720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0b6969ff-9dee-40da-b194-af03d0c1caf5 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1022947610" status: 202 len: 0 microversion: 2.1 time: 0.076193 Jul 26 04:26:26.162764 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 43/74] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:26 2022] DELETE /compute/v2.1/flavors/1022947610 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:26.179753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72917899-1403-4d8b-8f5b-b3ea20a32a22 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:26.280633 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72917899-1403-4d8b-8f5b-b3ea20a32a22 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.112184 Jul 26 04:26:26.294239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 44/75] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:26.314026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-45b72df0-c968-4f9b-bc75-df7b1cbd84c6 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-814785797", "id": 1165894319, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:26.324762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2069517212", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "96b59dc4-002c-4352-aa03-a56e9ddf1f5b"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:26.340819 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:26.340819 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:26.453401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-45b72df0-c968-4f9b-bc75-df7b1cbd84c6 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.151881 Jul 26 04:26:26.462691 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 45/76] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:26.490315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:26.496625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:26.500889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:26.524505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:26.525817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:26.531790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:26.533549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:26.818634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:27.038309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:27.052735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4dee3e15-6926-4b6e-b125-cda5bec990a7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.588714 Jul 26 04:26:27.054084 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 46/77] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:26 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:27.088722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85bfac38-2631-4414-bcba-250b85786b8d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:27.136471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85bfac38-2631-4414-bcba-250b85786b8d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079624 Jul 26 04:26:27.138142 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 47/78] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:27.152793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:27.153770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:27.172625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:27.173406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:27.174382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:27.174986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:27.526607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:27.536905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de1523d2-b3d7-433d-834b-d5da1b2a0ea7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.397428 Jul 26 04:26:27.556640 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 48/79] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:27 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:27.962675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-845548783", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:33.614730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=28 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:34.278910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:26:34.289397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] validate_networks() for [('96b59dc4-002c-4352-aa03-a56e9ddf1f5b', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:26:34.491318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:26:34.491740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:26:34.492219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:26:34.492766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:26:34.493178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:26:34.502837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.503283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:34.504068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.504498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:34.522110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Getting quotas for project 3bfeea696f0e43bc80e13588702c2cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:34.526224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Getting quotas for user ed6d815a47d94a188808670c0eb29656 and project 3bfeea696f0e43bc80e13588702c2cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:34.538572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:26:34.540690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:26:34.586391 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c435c099-0cc7-4bb5-8ea1-a8920df7902e tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.028318 Jul 26 04:26:34.587245 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 49/80] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 7030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:26:34.591877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66d33e15-9027-4333-9510-62c9a7340e36 tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:34.628388 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66d33e15-9027-4333-9510-62c9a7340e36 tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040257 Jul 26 04:26:34.630720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 50/81] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:34.642284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:34.645125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:34.652694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.653153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:34.654117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.654587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:34.850786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:34.861678 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a82cc1c2-aee3-4ce6-92a3-90a8d581c97c tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.229809 Jul 26 04:26:34.862910 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 51/82] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:34 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:34.880307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:34.880981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:34.888569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.890520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:34.891649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:34.892235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.096020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:35.112099 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9461d3d-bdaa-4ace-bbb1-06e3f16e48d8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.247873 Jul 26 04:26:35.124421 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 52/83] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:34 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:35.251723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:26:35.252078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:26:35.252587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:26:35.253031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:26:35.253540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:26:35.267595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.268189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.269148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.269712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.285994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-67f5e72c-843f-4716-8edd-a8e906fd491c req-bf9225f8-5eb6-45ad-aebb-5440e5f26729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:35.303831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-67f5e72c-843f-4716-8edd-a8e906fd491c req-bf9225f8-5eb6-45ad-aebb-5440e5f26729 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.304439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-67f5e72c-843f-4716-8edd-a8e906fd491c req-bf9225f8-5eb6-45ad-aebb-5440e5f26729 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.310503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:35.319892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for user e06c8cb7d10e4818a7e40396b93e54ab and project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:35.334609 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-67f5e72c-843f-4716-8edd-a8e906fd491c req-bf9225f8-5eb6-45ad-aebb-5440e5f26729 service nova] Creating event network-changed:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h2-848886-16 Jul 26 04:26:35.334952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:26:35.335150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-67f5e72c-843f-4716-8edd-a8e906fd491c req-bf9225f8-5eb6-45ad-aebb-5440e5f26729 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:26:35.336281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.336717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.337490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.337923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.338010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:26:35.350774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.compute.rpcapi [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 04:26:35.351650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] Releasing lock "compute-rpcapi-router" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:26:35.371951 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1133f8f2-0eb9-456b-8d81-9b4c1d3ca824 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254202 Jul 26 04:26:35.372561 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 53/84] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:35.410433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-812ab461-b450-4217-9075-5bee2f5b894d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 9.524738 Jul 26 04:26:35.414615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 32/85] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 9529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:26:35.425898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.430238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:35.439120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.439577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.440352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.440797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.453626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1905690083", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:35.526245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:35.528492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:26:35.534029 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-142f9bea-0096-4b71-860b-b49ebd88db38 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1223 microversion: 2.1 time: 0.116757 Jul 26 04:26:35.534902 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 33/86] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:35.539461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce7a3426-c83d-402a-9870-4c6d3b24c1e2 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.540621 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:35.540621 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:35.570624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce7a3426-c83d-402a-9870-4c6d3b24c1e2 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1165894319" status: 202 len: 0 microversion: 2.1 time: 0.034287 Jul 26 04:26:35.571904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 34/87] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:35 2022] DELETE /compute/v2.1/flavors/1165894319 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:35.578386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.579215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:35.643915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:35.652632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:35.654209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:35.655436 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c4c49ed-9752-4ad5-91e6-6e7d473e9e30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1262 microversion: 2.25 time: 0.082986 Jul 26 04:26:35.656476 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 35/88] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:35.675426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6022725f-c03b-4368-bf83-8b5e79fc510d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.704711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6022725f-c03b-4368-bf83-8b5e79fc510d tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047132 Jul 26 04:26:35.705786 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 36/89] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:35.724425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46aef7f7-6e82-43d5-a171-471ce37ad78c tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2067736228", "id": 1191081548, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:35.727905 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:35.727905 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:35.760520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46aef7f7-6e82-43d5-a171-471ce37ad78c tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.039658 Jul 26 04:26:35.779590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 37/90] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:35.785137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a47c1f8a-c496-487b-a7aa-aca3375e8b3c tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.825859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a47c1f8a-c496-487b-a7aa-aca3375e8b3c tempest-FlavorsAdminTestJSON-2115352506 tempest-FlavorsAdminTestJSON-2115352506-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.044517 Jul 26 04:26:35.834489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:26:35.835896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:26:35.836968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:26:35.837528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:26:35.838116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:26:35.839517 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 38/91] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:35.845113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1c11ca5-cac8-48f1-9955-c223fccc8a79 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.845113 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:35.845113 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:35.852337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.853902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.855347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.855942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.868350 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1c11ca5-cac8-48f1-9955-c223fccc8a79 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1191081548" status: 202 len: 0 microversion: 2.1 time: 0.027651 Jul 26 04:26:35.869068 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 39/92] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:35 2022] DELETE /compute/v2.1/flavors/1191081548 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:35.881982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-267af8c3-cc1e-4180-84ba-1548f1beab28 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.883737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Getting quotas for project 76d8ba503d2e4944ab2f3d22e71c6b50. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:26:35.890490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Getting quotas for user fb9899adb0034b94889d1b40d6ceaea1 and project 76d8ba503d2e4944ab2f3d22e71c6b50. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:26:35.902092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-267af8c3-cc1e-4180-84ba-1548f1beab28 tempest-FlavorsAdminTestJSON-1016015666 tempest-FlavorsAdminTestJSON-1016015666-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028502 Jul 26 04:26:35.906520 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 40/93] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:35.916965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:26:35.938312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:35.938725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:26:35.938846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:35.947467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.948999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:35.950952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:35.952377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.009646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-819e7a26-1087-4b07-a198-952ca9fa49a4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635101 Jul 26 04:26:36.011266 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 54/94] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:26:36.029326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf5598e2-63dd-4cb4-bf23-066401acd2f5 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:36.032167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf5598e2-63dd-4cb4-bf23-066401acd2f5 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:36.167385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf5598e2-63dd-4cb4-bf23-066401acd2f5 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.184357 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf5598e2-63dd-4cb4-bf23-066401acd2f5 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1219 microversion: 2.1 time: 0.162798 Jul 26 04:26:36.198562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 55/95] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:36 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:36.204274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:36.204849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:36.211832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.212244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.213194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.213439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.227218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.269278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6932e098-9bdd-47a0-930e-a957781c6829 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.361504 Jul 26 04:26:36.276280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 41/96] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:35 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:36.393714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.401678 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11813db3-f2c2-473c-b073-1d06bc63a556 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.201913 Jul 26 04:26:36.402415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 56/97] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:36 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:36.555578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:36.556913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:36.564472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.565567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.566561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.567163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.634562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.644418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a07b9f30-9d24-461d-aada-06350610d661 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1223 microversion: 2.1 time: 0.092480 Jul 26 04:26:36.645617 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 42/98] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:36 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:36.678403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:36.679199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:36.685388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.686541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.687558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:36.688236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:36.755135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.763423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.765152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:36.766414 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72ea11bc-56c1-456e-8be3-ea6629be4422 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1266 microversion: 2.25 time: 0.092355 Jul 26 04:26:36.767042 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 57/99] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:36 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:37.205275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:37.205883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:37.211840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.212289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.213055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.213496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.274589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.282757 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e827fe0-20db-4ed3-afe9-d168ad2f2c01 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1223 microversion: 2.1 time: 0.082081 Jul 26 04:26:37.283325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 43/100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:37 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:37.298525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:37.299135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:37.305651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.306097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.306884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.307317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.389766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e69f9e21-ea79-4e8d-9530-74c823554069 req-09381c88-6f10-413a-8c83-e94c6835acd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b43c3e-c8af-411b-8088-d65083dffeb1", "tag": "5afabe86-466d-46dd-96eb-cc599982f606"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:37.410442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e69f9e21-ea79-4e8d-9530-74c823554069 req-09381c88-6f10-413a-8c83-e94c6835acd0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.411093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e69f9e21-ea79-4e8d-9530-74c823554069 req-09381c88-6f10-413a-8c83-e94c6835acd0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.437976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e69f9e21-ea79-4e8d-9530-74c823554069 req-09381c88-6f10-413a-8c83-e94c6835acd0 service nova] Creating event network-changed:5afabe86-466d-46dd-96eb-cc599982f606 for instance 55b43c3e-c8af-411b-8088-d65083dffeb1 on n-h1-848886-16 Jul 26 04:26:37.441263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e69f9e21-ea79-4e8d-9530-74c823554069 req-09381c88-6f10-413a-8c83-e94c6835acd0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:26:37.442460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.442907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.447353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.448006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.460174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.rpcapi [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 04:26:37.461297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] Releasing lock "compute-rpcapi-router" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:26:37.476213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.484693 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f81cac6-c2e7-4399-9989-456356bf7f98 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.190831 Jul 26 04:26:37.487027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 58/101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:37 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:37.496018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:37.496630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:37.509777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.515044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69917972-bbb3-4376-86e5-62d807ddfa0e None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128366 Jul 26 04:26:37.517291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 44/102] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:37.519717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.520642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.522353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.668926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:37.670924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:37.679598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.681021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.682126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.682833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.710000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.720024 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3037203-bc30-4545-a4de-220656bb1d94 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.231784 Jul 26 04:26:37.720236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:37.722446 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 59/103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:37 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:37.789478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:37.790219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:37.798294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.799403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.801032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:37.801032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:37.810178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.820824 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fcd4aab-c2c7-433d-a182-c82ba2597375 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1223 microversion: 2.1 time: 0.156069 Jul 26 04:26:37.828031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 45/104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:37 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:37.888297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.898790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.900919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:37.902268 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0e8bfcf-2d71-4f76-9745-3d22ccaa30fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1266 microversion: 2.25 time: 0.117227 Jul 26 04:26:37.902942 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 60/105] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:37 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:26:38.305621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:38.306595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:38.317033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.317489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.318310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.318795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.456951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:38.469330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0e86603-c7a4-452c-9223-b5ffa3c3db0c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1223 microversion: 2.1 time: 0.168035 Jul 26 04:26:38.470008 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 46/106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:38 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:38.507863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:38.508702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:38.522670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.524114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.527292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.527918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.678111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:38.686497 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e763d67-72c0-4540-b2c1-ade1e5db5697 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.183986 Jul 26 04:26:38.687065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 61/107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:38 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:38.741090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:38.741697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:38.747946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.748487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.749521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.750109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.842035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:38.843228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:38.851143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.851975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.854317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.857877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.923193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:38.932536 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39cb02f8-b1dc-4a2d-990a-8f798e8ccd60 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1271 microversion: 2.1 time: 0.094268 Jul 26 04:26:38.933723 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 62/108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:38 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:38.939282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:38.940092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:38.946505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.947129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:38.948265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:38.948870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.010460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.019861 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-446b2c61-6af0-4bcc-9f45-08bd68f1bbd5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.282734 Jul 26 04:26:39.021138 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 47/109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:38 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:39.037033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.040563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:39.045835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.047406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.048520 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a0aa078-b21d-4a6b-9a2d-059e533d8e27 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1314 microversion: 2.25 time: 0.113681 Jul 26 04:26:39.049674 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 63/110] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:38 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1314 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:39.490364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:39.490969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:39.498408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.498951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.499713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.500152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.562505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.570617 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93107af6-2960-4cae-a924-1730e8f1020e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1271 microversion: 2.1 time: 0.084033 Jul 26 04:26:39.571193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 48/111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:39 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:39.654649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-034b4269-6e75-472b-a71d-e758433957a7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-242661062", "id": 209297754, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:39.657839 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:39.657839 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:39.672227 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-034b4269-6e75-472b-a71d-e758433957a7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.181608 Jul 26 04:26:39.672738 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 64/112] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:39.684643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5ced2ec-2bf7-48fa-88dd-97e16e906b80 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:39.688014 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:39.688014 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:39.708700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:39.709314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:39.715403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.715848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.716605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.717039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.771089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5ced2ec-2bf7-48fa-88dd-97e16e906b80 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/209297754/action" status: 200 len: 96 microversion: 2.1 time: 0.090089 Jul 26 04:26:39.772059 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 49/113] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Jul 26 04:26:39 2022] POST /compute/v2.1/flavors/209297754/action => generated 96 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:39.781494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe43c191-2768-4eb7-9d4c-b5072596c0b3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:39.850837 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fe43c191-2768-4eb7-9d4c-b5072596c0b3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] HTTP exception thrown: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. Jul 26 04:26:39.854405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:39.861971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4259b842-0800-451d-ad68-ee4c71927341 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.157075 Jul 26 04:26:39.862553 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 65/114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:39 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe43c191-2768-4eb7-9d4c-b5072596c0b3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Request method failure captured: Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/flavors/209297754/action HTTP/1.1 Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 67 Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32z-Hlra8MvB-0ppTntIesVkHKr7jylMVRu8uqkrq1EKIwA5BEDL9zJa-7ICAjfomaLur83h_KfmtAKpxWbuG7OY7FoxeS-4z_z6hiATGqMFhgSebpGeFuOy42wn7paaoLPlaway8-kBWczDdWPZEyqnqbaedpzwDNFwNqFKHwvIz1I Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:26:39.878785 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a99cfcadddd04a6fab56be515faa6588 Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} Jul 26 04:26:39.880266 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: exception: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '209297754', 'body': {'addTenantAccess': {'tenant': '753ad18921a84617a9ed0755ea4b37c8'}}} Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:26:39.881128 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '26-753ad18921a84617a9ed0755ea4b37c8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:26:39.882448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:26:39.883930 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:26:39.885091 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '26-753ad18921a84617a9ed0755ea4b37c8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 4, 26, 39, 846114), 'updated_at': None, 'flavor_id': 26, 'project_id': '753ad18921a84617a9ed0755ea4b37c8'}] Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:39.886259 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:39.887347 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:39.888564 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:39.890548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. Jul 26 04:26:39.890548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:39.890548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe43c191-2768-4eb7-9d4c-b5072596c0b3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Returning 409 to user: Flavor access already exists for flavor 26 and project 753ad18921a84617a9ed0755ea4b37c8 combination. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:39.890548 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe43c191-2768-4eb7-9d4c-b5072596c0b3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/209297754/action" status: 409 len: 152 microversion: 2.1 time: 0.102509 Jul 26 04:26:39.890548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 50/115] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Jul 26 04:26:39 2022] POST /compute/v2.1/flavors/209297754/action => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 04:26:39.890900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98a11219-7e8c-491a-8842-c5cd91c6d1d4 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:39.891987 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:39.891987 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:39.954938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:39.955743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:39.961405 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98a11219-7e8c-491a-8842-c5cd91c6d1d4 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/209297754/action" status: 200 len: 21 microversion: 2.1 time: 0.076064 Jul 26 04:26:39.962181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 66/116] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Jul 26 04:26:39 2022] POST /compute/v2.1/flavors/209297754/action => generated 21 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:39.962392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.962899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.963758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:39.964253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:39.971662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24dcb80f-36dc-4ddf-9515-b4783a982ca6 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:39.972425 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:39.972425 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:39.989884 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24dcb80f-36dc-4ddf-9515-b4783a982ca6 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/209297754" status: 202 len: 0 microversion: 2.1 time: 0.021622 Jul 26 04:26:39.990684 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 67/117] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:39 2022] DELETE /compute/v2.1/flavors/209297754 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:39.998198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a50e8c7-799f-4b4d-899e-953556c745bb tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.018528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a50e8c7-799f-4b4d-899e-953556c745bb tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023699 Jul 26 04:26:40.019101 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 68/118] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:40.031282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.039660 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a8c7f1e-8891-4bdf-a4d7-5869dcc47aa5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1279 microversion: 2.1 time: 0.089552 Jul 26 04:26:40.039867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6701028b-20c1-4185-98b3-b86b30833379 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1356734888", "id": 1571267559, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.040220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 51/119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:39 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:40.042666 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.042666 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.044885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.046007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:40.051986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:40.052183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.052776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.054279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.054854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.067716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6701028b-20c1-4185-98b3-b86b30833379 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.032174 Jul 26 04:26:40.068486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 69/120] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:40.075954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.076643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:40.082776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.083228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.083984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.084416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.146291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.154549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.156442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.157549 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-118ad627-f481-456d-9c27-d58915a6c4ff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1314 microversion: 2.25 time: 0.086432 Jul 26 04:26:40.158115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 70/121] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:40.162467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4977ad37-04ea-44ba-a1b6-4839bd9a5db3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.163215 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.163215 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.171704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4977ad37-04ea-44ba-a1b6-4839bd9a5db3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4977ad37-04ea-44ba-a1b6-4839bd9a5db3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Request method failure captured: Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/flavors/1571267559/os-flavor-access HTTP/1.1 Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32z-Hlra8MvB-0ppTntIesVkHKr7jylMVRu8uqkrq1EKIwA5BEDL9zJa-7ICAjfomaLur83h_KfmtAKpxWbuG7OY7FoxeS-4z_z6hiATGqMFhgSebpGeFuOy42wn7paaoLPlaway8-kBWczDdWPZEyqnqbaedpzwDNFwNqFKHwvIz1I Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:40.174167 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a99cfcadddd04a6fab56be515faa6588 Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: exception: Access list not available for public flavors. Jul 26 04:26:40.175497 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1571267559'} Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 26 04:26:40.176396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.177868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4977ad37-04ea-44ba-a1b6-4839bd9a5db3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:40.177868 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4977ad37-04ea-44ba-a1b6-4839bd9a5db3 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1571267559/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017249 Jul 26 04:26:40.177868 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 71/122] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/flavors/1571267559/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:26:40.184629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eaaf160d-7176-4107-8968-899590d5e7a7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.185325 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.185325 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.190310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.197725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7107291c-e904-4474-9ebf-60113d1924a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.156320 Jul 26 04:26:40.198318 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 52/123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:40.202536 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eaaf160d-7176-4107-8968-899590d5e7a7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1571267559" status: 202 len: 0 microversion: 2.1 time: 0.021363 Jul 26 04:26:40.203089 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 72/124] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:40 2022] DELETE /compute/v2.1/flavors/1571267559 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:40.210639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a138a08-8958-468f-9147-37fa6ed24830 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.231752 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a138a08-8958-468f-9147-37fa6ed24830 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024599 Jul 26 04:26:40.232318 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 53/125] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:40.251989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ff89b3d-2db8-4e5f-b241-7a360af48de7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2011886220", "id": 98684204, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.254865 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.254865 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.268934 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ff89b3d-2db8-4e5f-b241-7a360af48de7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021443 Jul 26 04:26:40.269498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 73/126] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:40.382122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68cda7f4-7d68-44a7-9fcd-533944ee3228 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.384622 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.384622 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:40.385463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-68cda7f4-7d68-44a7-9fcd-533944ee3228 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '069819021b6945118a6ba53b55404917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ad18921a84617a9ed0755ea4b37c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68cda7f4-7d68-44a7-9fcd-533944ee3228 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Request method failure captured: Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/flavors/98684204/action HTTP/1.1 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 67 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32z-ZIV6RoLMqiCfRCYHCp4SDRJS6LEa-FZKJ9CFLXGqV5LAnZrhg13XuTREguumYjaElhX1wTI3LLTagXu8EmZHKRRQMP6qYDcEs2FIF8i4nXGMze6UZA66FQm-e1del4vtFPYTpmu9KJBzK7Bxn-UnRc0VZtOkOZuS2zfEIYq_Ww4 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 753ad18921a84617a9ed0755ea4b37c8 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:40.387061 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 753ad18921a84617a9ed0755ea4b37c8 Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FlavorsAccessNegativeTestJSON-1476231079-project Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 069819021b6945118a6ba53b55404917 Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079-project Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} Jul 26 04:26:40.388354 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '98684204', 'body': {'addTenantAccess': {'tenant': '753ad18921a84617a9ed0755ea4b37c8'}}} Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:40.389159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 04:26:40.390507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.391728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68cda7f4-7d68-44a7-9fcd-533944ee3228 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:40.391728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68cda7f4-7d68-44a7-9fcd-533944ee3228 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] 10.222.0.43 "POST /compute/v2.1/flavors/98684204/action" status: 403 len: 130 microversion: 2.1 time: 0.111097 Jul 26 04:26:40.391728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 54/127] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors/98684204/action => generated 130 bytes in 112 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:26:40.396842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1d67d24-293a-498d-89dd-8e489bfdc515 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.414734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1d67d24-293a-498d-89dd-8e489bfdc515 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/98684204" status: 202 len: 0 microversion: 2.1 time: 0.021547 Jul 26 04:26:40.415285 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 74/128] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:26:40 2022] DELETE /compute/v2.1/flavors/98684204 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:40.423668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d81871ff-4390-420e-8fef-2426836995cc tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.443165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d81871ff-4390-420e-8fef-2426836995cc tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023654 Jul 26 04:26:40.443664 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 55/129] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:40.462099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-527da535-5252-4c12-b8a2-8cfa396fa7ab tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-160519636", "id": 1050436695, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.479552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-527da535-5252-4c12-b8a2-8cfa396fa7ab tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021401 Jul 26 04:26:40.480132 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 75/130] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:40.492552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb738398-7974-498b-bbc1-ecba6f6bf682 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.560074 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb738398-7974-498b-bbc1-ecba6f6bf682 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1050436695/action" status: 200 len: 97 microversion: 2.1 time: 0.071092 Jul 26 04:26:40.560731 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 56/131] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors/1050436695/action => generated 97 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:40.571251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5068704e-5027-4060-b327-b80f4e28a327 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.573673 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.573673 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.574530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5068704e-5027-4060-b327-b80f4e28a327 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '069819021b6945118a6ba53b55404917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ad18921a84617a9ed0755ea4b37c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5068704e-5027-4060-b327-b80f4e28a327 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Request method failure captured: Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/flavors/1050436695/action HTTP/1.1 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 70 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32z-ZIV6RoLMqiCfRCYHCp4SDRJS6LEa-FZKJ9CFLXGqV5LAnZrhg13XuTREguumYjaElhX1wTI3LLTagXu8EmZHKRRQMP6qYDcEs2FIF8i4nXGMze6UZA66FQm-e1del4vtFPYTpmu9KJBzK7Bxn-UnRc0VZtOkOZuS2zfEIYq_Ww4 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 753ad18921a84617a9ed0755ea4b37c8 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:40.576121 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_753ad18921a84617a9ed0755ea4b37c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 753ad18921a84617a9ed0755ea4b37c8 Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079 Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsAccessNegativeTestJSON-1476231079-project Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 069819021b6945118a6ba53b55404917 Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1476231079-project Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: {"removeTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} Jul 26 04:26:40.577826 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1050436695', 'body': {'removeTenantAccess': {'tenant': '753ad18921a84617a9ed0755ea4b37c8'}}} Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can( Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:40.578761 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 04:26:40.579987 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.581531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5068704e-5027-4060-b327-b80f4e28a327 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:40.581531 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5068704e-5027-4060-b327-b80f4e28a327 tempest-FlavorsAccessNegativeTestJSON-1476231079 tempest-FlavorsAccessNegativeTestJSON-1476231079-project] 10.222.0.43 "POST /compute/v2.1/flavors/1050436695/action" status: 403 len: 133 microversion: 2.1 time: 0.010427 Jul 26 04:26:40.581531 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 76/132] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors/1050436695/action => generated 133 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:40.585660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4107082c-40a8-4285-8488-28a20dff6624 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "753ad18921a84617a9ed0755ea4b37c8"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.588163 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.588163 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:40.593495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.594267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:40.600486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.600934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.601696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.602127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.658013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4107082c-40a8-4285-8488-28a20dff6624 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1050436695/action" status: 200 len: 21 microversion: 2.1 time: 0.075912 Jul 26 04:26:40.658661 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 57/133] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors/1050436695/action => generated 21 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:40.667181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:40.667910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f156ee4e-4aec-4fd8-bcef-ff57758250f8 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.668734 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.668734 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:40.675288 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4d4acd0-5b0e-4e26-af05-9c351f761cc0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1271 microversion: 2.1 time: 0.086906 Jul 26 04:26:40.675839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 77/134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:40.677669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:40.688150 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f156ee4e-4aec-4fd8-bcef-ff57758250f8 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1050436695" status: 202 len: 0 microversion: 2.1 time: 0.023455 Jul 26 04:26:40.688711 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 58/135] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:40 2022] DELETE /compute/v2.1/flavors/1050436695 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:40.697528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ba2ad92-f743-45a5-a27f-3f1a1b22d883 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.716920 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ba2ad92-f743-45a5-a27f-3f1a1b22d883 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023564 Jul 26 04:26:40.717614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 78/136] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:40.736672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b767c32-99a1-4dd3-baf8-c5bd1f94cae9 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-987141051", "id": 600947943, "os-flavor-access:is_public": "False"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.739716 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.739716 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:40.755914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b767c32-99a1-4dd3-baf8-c5bd1f94cae9 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023711 Jul 26 04:26:40.756511 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 59/137] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:40.768395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af0f6be1-ac71-4157-87b0-1b04fd020052 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3f2f56aa3e264e70ba18b3737f21cfef"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:40.770911 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:40.770911 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:40.830573 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-af0f6be1-ac71-4157-87b0-1b04fd020052 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] HTTP exception thrown: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af0f6be1-ac71-4157-87b0-1b04fd020052 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Request method failure captured: Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/flavors/600947943/action HTTP/1.1 Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 70 Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32z-Hlra8MvB-0ppTntIesVkHKr7jylMVRu8uqkrq1EKIwA5BEDL9zJa-7ICAjfomaLur83h_KfmtAKpxWbuG7OY7FoxeS-4z_z6hiATGqMFhgSebpGeFuOy42wn7paaoLPlaway8-kBWczDdWPZEyqnqbaedpzwDNFwNqFKHwvIz1I Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:40.832710 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b291edfb4b4492db2fc1bb23869cb9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6b291edfb4b4492db2fc1bb23869cb9c Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519 Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a99cfcadddd04a6fab56be515faa6588 Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: {"removeTenantAccess": {"tenant": "3f2f56aa3e264e70ba18b3737f21cfef"}} Jul 26 04:26:40.834219 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '600947943', 'body': {'removeTenantAccess': {'tenant': '3f2f56aa3e264e70ba18b3737f21cfef'}}} Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 26 04:26:40.834905 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.836033 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af0f6be1-ac71-4157-87b0-1b04fd020052 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Returning 404 to user: Flavor access not found for 30 / 3f2f56aa3e264e70ba18b3737f21cfef combination. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af0f6be1-ac71-4157-87b0-1b04fd020052 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/600947943/action" status: 404 len: 124 microversion: 2.1 time: 0.069796 Jul 26 04:26:40.837299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 79/138] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/flavors/600947943/action => generated 124 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:40.842934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce3cf5ec-5d5a-45c7-970f-b356bcd7ec3c tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.860902 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce3cf5ec-5d5a-45c7-970f-b356bcd7ec3c tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/600947943" status: 202 len: 0 microversion: 2.1 time: 0.021658 Jul 26 04:26:40.861490 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 60/139] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:26:40 2022] DELETE /compute/v2.1/flavors/600947943 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:26:40.869385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f2cefc5-34f6-4eef-b890-bb300311dbe7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.882994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:40.883872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:40.890510 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f2cefc5-34f6-4eef-b890-bb300311dbe7 tempest-FlavorsAccessNegativeTestJSON-1206653519 tempest-FlavorsAccessNegativeTestJSON-1206653519-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024636 Jul 26 04:26:40.891021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.891141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 80/140] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:40.891760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:40.892825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:40.893388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.044924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.053103 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21dac2f3-b18e-41c7-81fa-9d0f5a8f55f7 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.174202 Jul 26 04:26:41.053724 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 61/141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:40 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:41.062568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:41.063366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:41.073678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.074362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.075206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.075636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.082479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-101fa9ef-59ed-490a-937c-752a6c89e114 req-0acf509c-4e4f-403f-adf6-dbe3b66f617d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b43c3e-c8af-411b-8088-d65083dffeb1", "name": "network-vif-plugged", "status": "completed", "tag": "5afabe86-466d-46dd-96eb-cc599982f606"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:41.092041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-101fa9ef-59ed-490a-937c-752a6c89e114 req-0acf509c-4e4f-403f-adf6-dbe3b66f617d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.093014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-101fa9ef-59ed-490a-937c-752a6c89e114 req-0acf509c-4e4f-403f-adf6-dbe3b66f617d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.103987 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-101fa9ef-59ed-490a-937c-752a6c89e114 req-0acf509c-4e4f-403f-adf6-dbe3b66f617d service nova] Creating event network-vif-plugged:5afabe86-466d-46dd-96eb-cc599982f606 for instance 55b43c3e-c8af-411b-8088-d65083dffeb1 on n-h1-848886-16 Jul 26 04:26:41.110396 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-101fa9ef-59ed-490a-937c-752a6c89e114 req-0acf509c-4e4f-403f-adf6-dbe3b66f617d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114297 Jul 26 04:26:41.110988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 81/142] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:41.155509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.163036 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7159c8bc-9cc8-42a7-b824-ae7e6f93bd05 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1279 microversion: 2.1 time: 0.105294 Jul 26 04:26:41.173139 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 62/143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:41 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:41.181275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:41.183000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:41.189993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.190487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.191287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.192690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.232096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:41.235483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:41.268431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.287932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.287932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.289575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.296639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.307189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.309759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.311619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dca7ced9-c1c5-44c4-8673-16354fa66e8f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1314 microversion: 2.25 time: 0.134091 Jul 26 04:26:41.312210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 82/144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:41 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:41.665226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.674969 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4ce3533-9ea1-49f2-8cb5-9dcb6542fb8f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.458948 Jul 26 04:26:41.690496 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 63/145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:41 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:41.696793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:41.697411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:41.705317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.705989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.707011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:41.707654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:41.797943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:41.805496 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-924a3096-0e1f-4058-afd6-1bfd7fd0c145 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1271 microversion: 2.1 time: 0.112514 Jul 26 04:26:41.806070 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 83/146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:41 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:42.074868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:42.075548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:42.083770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.084241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.085019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.085458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.184517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:42.185132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:42.196749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.197195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.197971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.198436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.415503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.427978 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91a00a5d-5cee-4c7b-b451-92ba858bbea4 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1277 microversion: 2.1 time: 0.246458 Jul 26 04:26:42.428855 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 84/147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:42 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:42.447532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:42.449314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:42.459117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.459598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.460433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.460947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.555266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.566207 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0305ee0-5ca0-4fda-9793-0d19ba91a8ca tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.495287 Jul 26 04:26:42.580847 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 64/148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:42 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:42.619473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.633632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.635819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.637209 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8897c12-4fb2-49bc-b600-15520efb735f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1320 microversion: 2.25 time: 0.207227 Jul 26 04:26:42.638349 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 85/149] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:42 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:42.695527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:42.696495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:42.704367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.705511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.706405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.706938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.831838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:42.834467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:42.847919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.848334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.849373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:42.850010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:42.960083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.970928 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ecdd8b6-678e-4fdf-801e-b07b5ba97f52 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1277 microversion: 2.1 time: 0.147319 Jul 26 04:26:42.973022 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 86/150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:42 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:42.978932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:42.994643 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-383e4b58-1d2e-4306-80e3-327705b9e7bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.302723 Jul 26 04:26:42.995359 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 65/151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:42 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:43.450511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:43.451393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:43.461148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.461604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.466948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.468007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.587655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:43.589075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:43.603924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.605019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.606379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.607230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.701772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:43.711747 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-792fe677-1a10-4298-a098-730dcc69e53f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1277 microversion: 2.1 time: 0.266081 Jul 26 04:26:43.712529 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 87/152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:43 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:43.736942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:43.741151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:43.758635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.759442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.765838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:43.766645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:43.990911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.012761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a47be9b-aac8-42b3-ba4d-ea655f7d7726 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1339 microversion: 2.1 time: 0.427851 Jul 26 04:26:44.014646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 66/153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:43 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1339 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:44.022449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:44.023527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:44.036985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.040047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.049198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.049928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.075199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.088828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.090452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.091647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b1d51b26-eb6d-422f-b69e-35e36decfb7e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.362422 Jul 26 04:26:44.092239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 88/154] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:43 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:44.096890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:44.097504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:44.125229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.127562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.128543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.130130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.273873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.303148 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6be214e7-14e9-4f2a-9502-c536eb9375a6 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1277 microversion: 2.1 time: 0.287080 Jul 26 04:26:44.303885 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 67/155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:44 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:44.510808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fe5ae5b0-cb65-4e34-9f1b-d272be7b99b5 req-c9e661af-0131-4337-a79e-0bd10e7774fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:44.532895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe5ae5b0-cb65-4e34-9f1b-d272be7b99b5 req-c9e661af-0131-4337-a79e-0bd10e7774fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.534144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe5ae5b0-cb65-4e34-9f1b-d272be7b99b5 req-c9e661af-0131-4337-a79e-0bd10e7774fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.551918 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fe5ae5b0-cb65-4e34-9f1b-d272be7b99b5 req-c9e661af-0131-4337-a79e-0bd10e7774fb service nova] Creating event network-changed:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h2-848886-16 Jul 26 04:26:44.562679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fe5ae5b0-cb65-4e34-9f1b-d272be7b99b5 req-c9e661af-0131-4337-a79e-0bd10e7774fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055402 Jul 26 04:26:44.563750 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 68/156] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:44.631820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:44.643941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0cff7f5a-6540-4803-8760-f88b464fff8c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.549989 Jul 26 04:26:44.647865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 89/157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:44 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:44.734854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:44.736334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:44.750539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.751422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:44.752458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:44.753172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.035019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.039530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:45.040452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:45.044637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e748dbe2-2aec-4f71-b079-596dc669024d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.315138 Jul 26 04:26:45.059727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 69/158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:44 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:45.059931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.059931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.059931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.059931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.125903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:45.126874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:45.151780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.152637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.154203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.156818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.328692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.352435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.355181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.357296 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57c69b98-e123-41e7-9d19-3791e1ed4c7b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.234468 Jul 26 04:26:45.358281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 70/159] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:45 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:26:45.359672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.365098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:45.366011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:45.371000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b837a7c-a4a4-4582-bbe9-8cc70f711fcc tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1489 microversion: 2.1 time: 0.335327 Jul 26 04:26:45.373131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.374303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.375372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.376709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.382602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 90/160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:45 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1489 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:45.399591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:45.401495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:45.417260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.417735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.421094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.422568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.605373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.619751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68663e7d-b328-48ec-bc61-d7d995dd62a7 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.258425 Jul 26 04:26:45.621473 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 71/161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:45 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:45.676640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:45.678028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:45.680193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:45.686775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.687533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.688706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.689359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.872594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:45.929489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:45.939787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:45.943409 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31e962d2-5e43-4190-9748-957610cb63a9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.279586 Jul 26 04:26:45.944539 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 72/162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:45 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:45.952911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-47972d35-23fb-4f19-bbc2-089c4ee8ddc6 req-33d57b2b-b01f-4927-8869-4f47f4d02c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "name": "network-vif-plugged", "status": "completed", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:45.966488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-47972d35-23fb-4f19-bbc2-089c4ee8ddc6 req-33d57b2b-b01f-4927-8869-4f47f4d02c9b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:45.967237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-47972d35-23fb-4f19-bbc2-089c4ee8ddc6 req-33d57b2b-b01f-4927-8869-4f47f4d02c9b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:45.983461 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-47972d35-23fb-4f19-bbc2-089c4ee8ddc6 req-33d57b2b-b01f-4927-8869-4f47f4d02c9b service nova] Creating event network-vif-plugged:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h2-848886-16 Jul 26 04:26:45.989155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-47972d35-23fb-4f19-bbc2-089c4ee8ddc6 req-33d57b2b-b01f-4927-8869-4f47f4d02c9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043153 Jul 26 04:26:45.991083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 73/163] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:46.073631 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-034d5390-fd0a-4b13-8db9-4d928b662b5a tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1642 microversion: 2.1 time: 0.677625 Jul 26 04:26:46.078312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 91/164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:45 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1642 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:46.091681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.093113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.100843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.101365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.112306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.114877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.115890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.115999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.116566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.116956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.118171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.118616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.165370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:26:46.182788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=14 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:46.343353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.353249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f057bf2-326d-43ce-916b-7df2af5e5d1d tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.273535 Jul 26 04:26:46.358763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 74/165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:46.371758 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-45048221-9378-4054-8b97-9efb23c0436e tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 204 len: 0 microversion: 2.1 time: 0.275321 Jul 26 04:26:46.376248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 92/166] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:26:46 2022] DELETE /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:26:46.382167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.382984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.391233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.391687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.392451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.392884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.413508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:46.499917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7d554117-ff86-450a-a348-84723f34b89a req-a1b4fd5c-9c41-436d-bd39-7252d6d901ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19344318-082c-4dd7-8de9-087e6094e9b2", "tag": "41e05caf-a07d-4969-bc4a-c0b841f1066d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.509333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7d554117-ff86-450a-a348-84723f34b89a req-a1b4fd5c-9c41-436d-bd39-7252d6d901ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.509846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7d554117-ff86-450a-a348-84723f34b89a req-a1b4fd5c-9c41-436d-bd39-7252d6d901ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.520762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7d554117-ff86-450a-a348-84723f34b89a req-a1b4fd5c-9c41-436d-bd39-7252d6d901ec service nova] Creating event network-changed:41e05caf-a07d-4969-bc4a-c0b841f1066d for instance 19344318-082c-4dd7-8de9-087e6094e9b2 on n-h2-848886-16 Jul 26 04:26:46.525930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7d554117-ff86-450a-a348-84723f34b89a req-a1b4fd5c-9c41-436d-bd39-7252d6d901ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165682 Jul 26 04:26:46.526619 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 75/167] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:46.532387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.533052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.539076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.539525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.540283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.540712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.543412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.551934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.553415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.554559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-daf0e582-153b-4398-9a29-e6455cea7c69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.176491 Jul 26 04:26:46.555107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 93/168] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:46.614404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75d6b4e2-b3e6-412f-ab7d-e387d843d902 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-787222843", "ram": 512, "vcpus": 1, "disk": 10, "id": 1723742223, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.617502 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.617502 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:46.633210 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75d6b4e2-b3e6-412f-ab7d-e387d843d902 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.076848 Jul 26 04:26:46.633809 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 94/169] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:26:46 2022] POST /compute/v2.1/flavors => generated 415 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:46.645982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.646629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.654045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.654778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.655651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.656097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.681108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.688953 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-530fb826-2c65-42a9-a7b1-73d8f3ef31a0 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1495 microversion: 2.1 time: 0.161229 Jul 26 04:26:46.689528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 76/170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1495 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:46.792346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-543af9e7-0710-4213-b427-4596e6375487 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.793143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.801591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-defc7fd1-5276-4386-9bd5-6fb9b4cb73d4 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.161274 Jul 26 04:26:46.801737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-543af9e7-0710-4213-b427-4596e6375487 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] HTTP exception thrown: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.802180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 95/171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-543af9e7-0710-4213-b427-4596e6375487 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Request method failure captured: Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320FM85H0mCN8MUNO9vmEIVR5sl2NlmtBC2MvxUuDlxv3lmHttC9T0Dw04n0bBtGcbH86fqVFpUKDu08AsYg7tGVPQY9aIHM7tHQc8A7b58CDAbn6i674XNfx27R-9JxBIjFeCaRnBBarvJqT-4zS5YKqybKYgyR_DP_1yRP2voCU_0 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:46.809068 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45ab9145b407473398560e8bedae37e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45ab9145b407473398560e8bedae37e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2d86adf498354023ba3038deaacab85f Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:46.810266 n-d-848886-16 devstack@n-api.service[119488]: exception: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'flavor_id': '1723742223', 'id': 'hw:cpu_thread_policy'} Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.811002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-543af9e7-0710-4213-b427-4596e6375487 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Returning 404 to user: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-543af9e7-0710-4213-b427-4596e6375487 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] 10.222.0.43 "GET /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.120032 Jul 26 04:26:46.812445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 77/172] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:46.819976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ba1570e-ba30-4817-8180-fca23094a84b tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.822748 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.822748 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:46.823580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ba1570e-ba30-4817-8180-fca23094a84b tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2d86adf498354023ba3038deaacab85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ab9145b407473398560e8bedae37e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ba1570e-ba30-4817-8180-fca23094a84b tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Request method failure captured: Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/flavors/1723742223/os-extra_specs HTTP/1.1 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 66 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320FM85H0mCN8MUNO9vmEIVR5sl2NlmtBC2MvxUuDlxv3lmHttC9T0Dw04n0bBtGcbH86fqVFpUKDu08AsYg7tGVPQY9aIHM7tHQc8A7b58CDAbn6i674XNfx27R-9JxBIjFeCaRnBBarvJqT-4zS5YKqybKYgyR_DP_1yRP2voCU_0 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:46.825444 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45ab9145b407473398560e8bedae37e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45ab9145b407473398560e8bedae37e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2d86adf498354023ba3038deaacab85f Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 26 04:26:46.827329 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1723742223', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:46.828099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 04:26:46.829185 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.830229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ba1570e-ba30-4817-8180-fca23094a84b tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.830229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ba1570e-ba30-4817-8180-fca23094a84b tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] 10.222.0.43 "POST /compute/v2.1/flavors/1723742223/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010640 Jul 26 04:26:46.830229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 96/173] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Jul 26 04:26:46 2022] POST /compute/v2.1/flavors/1723742223/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:46.836426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f00ce1ac-cc39-48a5-ab36-dbd71f8eff69 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.839896 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.839896 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:46.866919 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f00ce1ac-cc39-48a5-ab36-dbd71f8eff69 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1723742223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034155 Jul 26 04:26:46.867491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 78/174] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Jul 26 04:26:46 2022] POST /compute/v2.1/flavors/1723742223/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:26:46.877306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d99d6a81-f83b-400e-8739-fcf85fd93c0e tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.878007 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.878007 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:46.878851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d99d6a81-f83b-400e-8739-fcf85fd93c0e tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2d86adf498354023ba3038deaacab85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ab9145b407473398560e8bedae37e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d99d6a81-f83b-400e-8739-fcf85fd93c0e tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Request method failure captured: Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320FM85H0mCN8MUNO9vmEIVR5sl2NlmtBC2MvxUuDlxv3lmHttC9T0Dw04n0bBtGcbH86fqVFpUKDu08AsYg7tGVPQY9aIHM7tHQc8A7b58CDAbn6i674XNfx27R-9JxBIjFeCaRnBBarvJqT-4zS5YKqybKYgyR_DP_1yRP2voCU_0 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:46.880339 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45ab9145b407473398560e8bedae37e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45ab9145b407473398560e8bedae37e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2d86adf498354023ba3038deaacab85f Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:46.881693 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1723742223', 'id': 'hw:numa_nodes'} Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:46.882483 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.883793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d99d6a81-f83b-400e-8739-fcf85fd93c0e tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.884669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d99d6a81-f83b-400e-8739-fcf85fd93c0e tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] 10.222.0.43 "DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008417 Jul 26 04:26:46.884669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 97/175] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:26:46 2022] DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:46.890751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51f22a3c-a6f1-41c6-ada7-0a94ad038b40 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.913858 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51f22a3c-a6f1-41c6-ada7-0a94ad038b40 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1723742223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027278 Jul 26 04:26:46.914480 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 79/176] 10.222.0.43 () {60 vars in 1224 bytes} [Tue Jul 26 04:26:46 2022] POST /compute/v2.1/flavors/1723742223/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:26:46.924499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fcbcc9c1-dd0c-46bf-95b1-ffb61d47e4e6 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.926859 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.926859 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:46.927690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fcbcc9c1-dd0c-46bf-95b1-ffb61d47e4e6 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2d86adf498354023ba3038deaacab85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ab9145b407473398560e8bedae37e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fcbcc9c1-dd0c-46bf-95b1-ffb61d47e4e6 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Request method failure captured: Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 22 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320FM85H0mCN8MUNO9vmEIVR5sl2NlmtBC2MvxUuDlxv3lmHttC9T0Dw04n0bBtGcbH86fqVFpUKDu08AsYg7tGVPQY9aIHM7tHQc8A7b58CDAbn6i674XNfx27R-9JxBIjFeCaRnBBarvJqT-4zS5YKqybKYgyR_DP_1yRP2voCU_0 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:26:46.929227 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/45ab9145b407473398560e8bedae37e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/45ab9145b407473398560e8bedae37e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_45ab9145b407473398560e8bedae37e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 45ab9145b407473398560e8bedae37e6 Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2d86adf498354023ba3038deaacab85f Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: {"hw:numa_nodes": "1"} Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:46.930603 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1723742223', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:46.931491 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 04:26:46.932840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.934111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fcbcc9c1-dd0c-46bf-95b1-ffb61d47e4e6 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.934111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fcbcc9c1-dd0c-46bf-95b1-ffb61d47e4e6 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110 tempest-FlavorsExtraSpecsNegativeTestJSON-204518110-project] 10.222.0.43 "PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010568 Jul 26 04:26:46.934111 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 98/177] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Jul 26 04:26:46 2022] PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:46.939528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05a59aa7-78ad-4799-a4e1-f3dff68f6880 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.940281 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:46.940281 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:46.946899 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-05a59aa7-78ad-4799-a4e1-f3dff68f6880 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] HTTP exception thrown: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05a59aa7-78ad-4799-a4e1-f3dff68f6880 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Request method failure captured: Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320G6hLC9JvL64EciiIbj3LqsTNliDwJV5oGpJHuXuYHyotffvL0mWhvwzEd0DCuObKkmVH2J37hyTJxE1JD5rDDdLT8CooyZZhHAzEXkRqJ8E4ljgUEov76_e_cLyxaynaXjdPMZJbYF9HsLk8VFtvDevyjdtyQpSHHVTJr1Mwdy-o Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:26:46.948236 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 5164c81c3330448aa4fb2067ac7bb774 Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:46.949667 n-d-848886-16 devstack@n-api.service[119488]: exception: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'flavor_id': '1723742223', 'id': 'hw:cpu_thread_policy'} Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.950687 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05a59aa7-78ad-4799-a4e1-f3dff68f6880 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Returning 404 to user: Flavor 1723742223 has no extra specs with key hw:cpu_thread_policy. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05a59aa7-78ad-4799-a4e1-f3dff68f6880 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.013871 Jul 26 04:26:46.952645 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 80/178] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:26:46 2022] DELETE /compute/v2.1/flavors/1723742223/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:46.959354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3b114fd-ad4d-4946-9dc1-6192bf3c051c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.962518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c3b114fd-ad4d-4946-9dc1-6192bf3c051c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3b114fd-ad4d-4946-9dc1-6192bf3c051c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Request method failure captured: Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 27 Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320G6hLC9JvL64EciiIbj3LqsTNliDwJV5oGpJHuXuYHyotffvL0mWhvwzEd0DCuObKkmVH2J37hyTJxE1JD5rDDdLT8CooyZZhHAzEXkRqJ8E4ljgUEov76_e_cLyxaynaXjdPMZJbYF9HsLk8VFtvDevyjdtyQpSHHVTJr1Mwdy-o Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:46.963790 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 5164c81c3330448aa4fb2067ac7bb774 Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: {"hw:cpu_policy": "shared"} Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:46.965415 n-d-848886-16 devstack@n-api.service[119487]: exception: Request body and URI mismatch Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1723742223', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.966782 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.969001 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:46.969001 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:46.969001 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 26 04:26:46.969001 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.969304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:46.969401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3b114fd-ad4d-4946-9dc1-6192bf3c051c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.969582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:46.969702 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3b114fd-ad4d-4946-9dc1-6192bf3c051c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009499 Jul 26 04:26:46.969702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 99/179] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Jul 26 04:26:46 2022] PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes => generated 73 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:26:46.972592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.973044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.973819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:46.974310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:46.974402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51cd10fc-54e1-480f-bd81-2b13a9864554 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51cd10fc-54e1-480f-bd81-2b13a9864554 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Request method failure captured: Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 49 Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320G6hLC9JvL64EciiIbj3LqsTNliDwJV5oGpJHuXuYHyotffvL0mWhvwzEd0DCuObKkmVH2J37hyTJxE1JD5rDDdLT8CooyZZhHAzEXkRqJ8E4ljgUEov76_e_cLyxaynaXjdPMZJbYF9HsLk8VFtvDevyjdtyQpSHHVTJr1Mwdy-o Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:46.989999 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e84eaff3a454d5086f6e913357ab99f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e84eaff3a454d5086f6e913357ab99f Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 5164c81c3330448aa4fb2067ac7bb774 Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 26 04:26:46.991727 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'flavor_id': '1723742223', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance: Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 26 04:26:46.993253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.994725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51cd10fc-54e1-480f-bd81-2b13a9864554 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:46.996396 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51cd10fc-54e1-480f-bd81-2b13a9864554 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020591 Jul 26 04:26:46.997156 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 100/180] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Jul 26 04:26:46 2022] PUT /compute/v2.1/flavors/1723742223/os-extra_specs/hw:numa_nodes => generated 117 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:26:47.002186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52daeba3-c811-489d-88bb-cf86679c989c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:47.002931 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:47.002931 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:47.019594 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52daeba3-c811-489d-88bb-cf86679c989c tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1723742223" status: 202 len: 0 microversion: 2.1 time: 0.021436 Jul 26 04:26:47.023257 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 101/181] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:26:46 2022] DELETE /compute/v2.1/flavors/1723742223 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:47.027905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb422d02-046f-49fc-aa3b-c7dd09c2eb18 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:47.047768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb422d02-046f-49fc-aa3b-c7dd09c2eb18 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208 tempest-FlavorsExtraSpecsNegativeTestJSON-1377133208-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023458 Jul 26 04:26:47.048341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 102/182] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:26:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:47.108278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:47.116165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-213a7f4d-7ebf-40dc-b234-3410059eeb50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.155491 Jul 26 04:26:47.117709 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 81/183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:46 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:47.375695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:47.376983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:47.383964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.384417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:47.385271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.386192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:47.576885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:47.577484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:47.579517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:47.585228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.585944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:47.587000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.587431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:47.883915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:47.894424 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-64eb2205-f1d0-4d18-8850-389f037f191a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.524681 Jul 26 04:26:47.907492 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 103/184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:47 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:47.907492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:47.907492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:47.909447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.909987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:47.910834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:47.911282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.068569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.078693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.080845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.082325 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e6ae65a6-12d6-4297-acc5-74d33bfe81c6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.509331 Jul 26 04:26:48.083030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 82/185] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:47 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:26:48.088339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:48.088944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:48.095821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.096571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.097568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.098192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.436953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.445928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51580660-9adb-4b67-89e5-8ab07fc66ed0 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.361445 Jul 26 04:26:48.446548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 83/186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:48 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:48.452041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:48.453026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:48.461500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.462352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.463162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.463602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.485476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.496457 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95863599-c880-4309-9872-cd6566d067b5 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1495 microversion: 2.1 time: 0.600061 Jul 26 04:26:48.497044 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 104/187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:47 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1495 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:48.769906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:48.783314 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6d82e8e-75f3-482c-b6ee-c5a4109f6c9a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.335416 Jul 26 04:26:48.786044 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 84/188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:48 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:48.917731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:48.918445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:48.933915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.935500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:48.938660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:48.939619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.020435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8137ccf5-b5ad-46b7-9515-488cace3574c req-fcd407c8-066d-4c10-97a7-1ffe9b2f74bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b43c3e-c8af-411b-8088-d65083dffeb1", "name": "network-vif-deleted", "tag": "5afabe86-466d-46dd-96eb-cc599982f606"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:49.035100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8137ccf5-b5ad-46b7-9515-488cace3574c req-fcd407c8-066d-4c10-97a7-1ffe9b2f74bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.035507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8137ccf5-b5ad-46b7-9515-488cace3574c req-fcd407c8-066d-4c10-97a7-1ffe9b2f74bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.049810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8137ccf5-b5ad-46b7-9515-488cace3574c req-fcd407c8-066d-4c10-97a7-1ffe9b2f74bb service nova] Creating event network-vif-deleted:5afabe86-466d-46dd-96eb-cc599982f606 for instance 55b43c3e-c8af-411b-8088-d65083dffeb1 on n-h1-848886-16 Jul 26 04:26:49.059771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8137ccf5-b5ad-46b7-9515-488cace3574c req-fcd407c8-066d-4c10-97a7-1ffe9b2f74bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045642 Jul 26 04:26:49.066523 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 85/189] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:49.081122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7c875537-cca5-408a-a8c6-bb5dbbece0a8 req-d1be816b-90b6-4d34-b27e-cfee26c09603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290fa8d5-cc6c-4215-9cdd-ed3d815c30fc", "tag": "b7c34f7d-b562-41e8-bb05-2c2fffe0bde2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:49.092646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7c875537-cca5-408a-a8c6-bb5dbbece0a8 req-d1be816b-90b6-4d34-b27e-cfee26c09603 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.093509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7c875537-cca5-408a-a8c6-bb5dbbece0a8 req-d1be816b-90b6-4d34-b27e-cfee26c09603 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.114798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7c875537-cca5-408a-a8c6-bb5dbbece0a8 req-d1be816b-90b6-4d34-b27e-cfee26c09603 service nova] Creating event network-changed:b7c34f7d-b562-41e8-bb05-2c2fffe0bde2 for instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc on n-h2-848886-16 Jul 26 04:26:49.128735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7c875537-cca5-408a-a8c6-bb5dbbece0a8 req-d1be816b-90b6-4d34-b27e-cfee26c09603 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059721 Jul 26 04:26:49.129586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 86/190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:49.139222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:49.141323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:49.158194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.159025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.160131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.160774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.446397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.455634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.457967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.459361 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0547b019-501f-4cc2-8985-60d4fdab141c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.328539 Jul 26 04:26:49.460133 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 87/191] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:49 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:49.479134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:49.480134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:49.490357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.491337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.493047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.493718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.520087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.537468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-83c8cca3-26e9-4781-a631-b4c84c10d1d3 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.621663 Jul 26 04:26:49.538522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 105/192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:48 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:49.551728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:49.552495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:49.576357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.576882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.577618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.578107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.627016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.628281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.628962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lazy-loading 'fault' on Instance uuid 55b43c3e-c8af-411b-8088-d65083dffeb1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:26:49.698509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73e4f89266342e38205a01de85fa114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386785fcb6d14ee59bfd23b3ce537450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.709092 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2f138b0-20a1-4f6c-8fdc-713f63898618 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 200 len: 1329 microversion: 2.1 time: 0.169094 Jul 26 04:26:49.710300 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 106/193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:49 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:49.725986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.740167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6244fd38-5f55-49db-876c-156db378f401 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.276189 Jul 26 04:26:49.741067 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 88/194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:49 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:49.807830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:49.808700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:49.817536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.818076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.818943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:49.819446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:49.990178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:49.997868 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b790346f-df2d-4268-98a8-0481a7f0c5da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.195482 Jul 26 04:26:49.998611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 107/195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:49 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:50.481877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:50.484504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:50.491497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.491950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.492725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.493164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.564945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:50.566182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:50.572386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.573021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.573827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.574514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.633322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:50.642215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:50.644137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:50.645424 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d7f80220-5701-4e2c-8aee-1e36e87a639a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.167342 Jul 26 04:26:50.645977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 89/196] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:50 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:50.708615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:50.716293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6fb97ef7-d543-4467-aff6-8776a6604a92 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.156013 Jul 26 04:26:50.717206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 108/197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:50 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:50.732371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:50.733506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:50.740817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.741336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.742197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.742752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.757114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] HTTP exception thrown: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:50.761393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Request method failure captured: Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 HTTP/1.1 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfTesd-x3A-PyxE5d3FW54xoGq92GHOGkAkT03HwoJTd99DlrGXxkoyPZKrr0CL4bizMIcNqqFRuSvGlaw_ysbRXF7NOWsUuaKTL_-E1KbYMpaCMQvVKFb9fqYSWJRhQfltBQcg8Aq4jdr3bt8fMBN18u3WNPxDqbCvxWJzvmrkq8 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:50.761920 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f73e4f89266342e38205a01de85fa114 Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:50.763072 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '55b43c3e-c8af-411b-8088-d65083dffeb1'} Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:50.763741 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:50.764838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:50.766461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:50.766552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Returning 404 to user: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:50.766552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-645ff4b5-3dbd-436f-88c9-b28d25eb2d33 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 404 len: 111 microversion: 2.1 time: 0.034837 Jul 26 04:26:50.766552 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 90/198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:50 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:50.767126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:50.773209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.773379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c935288-8822-48f9-af41-711b78544c55 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:50.773824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.774721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.775266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.776188 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:50.776188 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:50.785724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c935288-8822-48f9-af41-711b78544c55 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:50.786430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c935288-8822-48f9-af41-711b78544c55 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:50.931242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:50.936381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:50.937408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c935288-8822-48f9-af41-711b78544c55 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.166335 Jul 26 04:26:50.938439 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 91/199] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:50.949465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f46b383-d40f-445f-b6f4-a2d08c7743e2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:50.952723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f009dada-0814-4280-bdc2-0d6506f9a9a9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.194262 Jul 26 04:26:50.953286 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:50.953286 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:50.953484 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 109/200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:50 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:50.988642 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f46b383-d40f-445f-b6f4-a2d08c7743e2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.043103 Jul 26 04:26:50.995178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 92/201] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:50 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:51.002870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0eec9d1-ba8a-4b98-90b9-684105d2e2c5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1715414579"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.005700 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.005700 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.006607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-c0eec9d1-ba8a-4b98-90b9-684105d2e2c5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid c9db9686-0c13-468a-ad9f-efaa2b7e55e3 for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:51.020091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.020977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:51.029453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.030592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.031569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.032160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.037053 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0eec9d1-ba8a-4b98-90b9-684105d2e2c5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038294 Jul 26 04:26:51.043124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 110/202] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.049611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0116dfe0-c476-4c4f-9009-e829f22dd29b tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.052514 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.052514 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.069035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0116dfe0-c476-4c4f-9009-e829f22dd29b tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.069485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0116dfe0-c476-4c4f-9009-e829f22dd29b tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.179389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:51.189957 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a27c5e4-6c17-402a-becf-eb1097bd2a42 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1312 microversion: 2.1 time: 0.174515 Jul 26 04:26:51.194204 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 93/203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:51.360486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27d5f4c7-5ad8-4f2a-853f-7a39d4c686d6 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1508553556", "id": 1034354553, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.363394 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.363394 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.380118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27d5f4c7-5ad8-4f2a-853f-7a39d4c686d6 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.138273 Jul 26 04:26:51.380971 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 94/204] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/flavors => generated 449 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:26:51.399281 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0116dfe0-c476-4c4f-9009-e829f22dd29b tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.353241 Jul 26 04:26:51.399869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 111/205] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.413263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-347a90f8-0d08-42d2-bf78-74005b4250b1 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.414087 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.414087 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.421871 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-347a90f8-0d08-42d2-bf78-74005b4250b1 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.012436 Jul 26 04:26:51.422439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 112/206] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.432871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccbe3a0c-0d6c-42e2-bd6b-675e2f5d1ef2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.435599 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.435599 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.444753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccbe3a0c-0d6c-42e2-bd6b-675e2f5d1ef2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.445142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccbe3a0c-0d6c-42e2-bd6b-675e2f5d1ef2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.492457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81f5c184-e444-4d92-b472-1e22dead3b4c tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.501190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81f5c184-e444-4d92-b472-1e22dead3b4c tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] 10.222.0.43 "GET /compute/v2.1/flavors/1034354553" status: 200 len: 449 microversion: 2.55 time: 0.111487 Jul 26 04:26:51.501736 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 95/207] 10.222.0.43 () {60 vars in 1199 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/flavors/1034354553 => generated 449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:51.514356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ddbda201-4777-4a0a-85bd-355a0f225f65 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] Action: 'update', calling method: .version_select at 0x7f38b8857c10>, body: {"flavor": {"description": "new"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.526553 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.526553 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.553183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ddbda201-4777-4a0a-85bd-355a0f225f65 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1034354553" status: 200 len: 450 microversion: 2.55 time: 0.042598 Jul 26 04:26:51.553829 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 96/208] 10.222.0.43 () {62 vars in 1219 bytes} [Tue Jul 26 04:26:51 2022] PUT /compute/v2.1/flavors/1034354553 => generated 450 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:26:51.558916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ccbe3a0c-0d6c-42e2-bd6b-675e2f5d1ef2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.129268 Jul 26 04:26:51.559726 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 113/209] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:51.566437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3d143fb-910f-4cfd-9d35-06a5e52abd38 tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.571478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e11fea6c-f8b5-4a25-9d75-a870a636c18e tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.572244 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.572244 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.587441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3d143fb-910f-4cfd-9d35-06a5e52abd38 tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.024942 Jul 26 04:26:51.587987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 97/210] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:26:51.594903 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e11fea6c-f8b5-4a25-9d75-a870a636c18e tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.027848 Jul 26 04:26:51.595550 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 114/211] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 26 04:26:51.605422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cc93c34-3cc6-4ae6-8383-6f25c7f2e4df tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-775999166"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.606954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5bb2a27-b8fd-44b0-a0ab-0831b67fdd9d tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.608717 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.608717 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.609592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-1cc93c34-3cc6-4ae6-8383-6f25c7f2e4df tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid a11390fd-0961-4c72-9137-492e65e8e941 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:51.628364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5bb2a27-b8fd-44b0-a0ab-0831b67fdd9d tempest-FlavorsV255TestJSON-247248738 tempest-FlavorsV255TestJSON-247248738-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.025122 Jul 26 04:26:51.629273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 115/212] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:26:51.630399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cc93c34-3cc6-4ae6-8383-6f25c7f2e4df tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.028502 Jul 26 04:26:51.631013 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 98/213] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.643413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1232e4b-eb9c-4ce1-a263-17ce16103071 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.646037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52825d1b-2fa2-4a9d-b70e-0a5204a07561 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.646313 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.646313 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:51.646846 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.646846 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.654724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1232e4b-eb9c-4ce1-a263-17ce16103071 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.655526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1232e4b-eb9c-4ce1-a263-17ce16103071 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.669200 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52825d1b-2fa2-4a9d-b70e-0a5204a07561 tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1034354553" status: 202 len: 0 microversion: 2.55 time: 0.027625 Jul 26 04:26:51.670046 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 99/214] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Jul 26 04:26:51 2022] DELETE /compute/v2.1/flavors/1034354553 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:26:51.675437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.676354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:51.683263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.683807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.684591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.685154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.806806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1232e4b-eb9c-4ce1-a263-17ce16103071 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.168143 Jul 26 04:26:51.807598 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 116/215] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.816122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59476054-db88-4836-bc27-43ff4608f5fa tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.840895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59476054-db88-4836-bc27-43ff4608f5fa tempest-FlavorsV255TestJSON-433878876 tempest-FlavorsV255TestJSON-433878876-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.028730 Jul 26 04:26:51.841643 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 117/216] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:51.848300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.849836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:51.852192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:51.859627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.860070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.861002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.861580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.864720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:51.866461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:51.867758 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca924222-5ee1-4bcf-8702-f405005f0cb8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.196537 Jul 26 04:26:51.868631 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 100/217] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:51.873187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dac8248d-1950-4d63-a859-5252a2a24516 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:51.875185 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.875185 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.883204 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dac8248d-1950-4d63-a859-5252a2a24516 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013437 Jul 26 04:26:51.884837 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 101/218] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.891190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b46c6664-b378-4739-a184-8a86bd03648b req-4a5c76f5-e3af-4849-a6a3-2375aa10a459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "name": "network-vif-plugged", "status": "completed", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.903724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b46c6664-b378-4739-a184-8a86bd03648b req-4a5c76f5-e3af-4849-a6a3-2375aa10a459 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.904280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b46c6664-b378-4739-a184-8a86bd03648b req-4a5c76f5-e3af-4849-a6a3-2375aa10a459 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:51.919445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b46c6664-b378-4739-a184-8a86bd03648b req-4a5c76f5-e3af-4849-a6a3-2375aa10a459 service nova] Creating event network-vif-plugged:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h2-848886-16 Jul 26 04:26:51.926445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b46c6664-b378-4739-a184-8a86bd03648b req-4a5c76f5-e3af-4849-a6a3-2375aa10a459 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040199 Jul 26 04:26:51.927268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 102/219] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:51.933557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c1d4a49-32e4-4111-8df6-424b13bc5194 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:51.937625 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:51.937625 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:51.946636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c1d4a49-32e4-4111-8df6-424b13bc5194 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:51.947089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c1d4a49-32e4-4111-8df6-424b13bc5194 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.095542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8c1d4a49-32e4-4111-8df6-424b13bc5194 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.166749 Jul 26 04:26:52.097214 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 103/220] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:52.106499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.107549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:52.116287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.116747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.117538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.117983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.350676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:52.363645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fad7d179-3333-440a-8346-cd4dc0386b16 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.265034 Jul 26 04:26:52.370323 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 104/221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:52 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:52.374417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-986903f1-2d98-4b4d-9f31-3abbdaa2b998 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.376223 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:52.376223 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:52.403309 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-986903f1-2d98-4b4d-9f31-3abbdaa2b998 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.037528 Jul 26 04:26:52.403885 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 105/222] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:52 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:52.413094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.414053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:52.420190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.420637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.421398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.421828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.456423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:52.464597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10e6b2a1-3126-4d8b-a147-f9bd43e5ce47 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.621054 Jul 26 04:26:52.465189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 118/223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:51 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:52.474785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91882c64-7fd2-44ca-a355-02aa0c59496d tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-914937908"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:52.478480 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:52.478480 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:52.479385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-91882c64-7fd2-44ca-a355-02aa0c59496d tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid bbb24555-a4d5-4dc2-a7ef-6bc1dec8b4df for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:52.504798 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91882c64-7fd2-44ca-a355-02aa0c59496d tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038153 Jul 26 04:26:52.505528 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 119/224] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:52.527902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7bfdcb31-151c-487f-b77a-fb90cf4803ef tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:52.532116 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:52.532116 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:52.541485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bfdcb31-151c-487f-b77a-fb90cf4803ef tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.542090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bfdcb31-151c-487f-b77a-fb90cf4803ef tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.577016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:52.586338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ea9315f-c79c-45b5-ab4f-b56dc1069c57 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1462 microversion: 2.1 time: 0.181412 Jul 26 04:26:52.603590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 106/225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:52 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1462 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:52.681524 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7bfdcb31-151c-487f-b77a-fb90cf4803ef tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.163854 Jul 26 04:26:52.682677 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 120/226] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:52.694643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1f51d71-b209-48ac-aeef-63ec4e8e14fc tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:52.697480 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:52.697480 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:52.706554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1f51d71-b209-48ac-aeef-63ec4e8e14fc tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.707014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1f51d71-b209-48ac-aeef-63ec4e8e14fc tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.854420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1f51d71-b209-48ac-aeef-63ec4e8e14fc tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.163433 Jul 26 04:26:52.855336 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 121/227] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:52.866805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df86b8a1-2074-4284-9547-28c520a43881 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.867568 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:52.867568 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:52.888639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df86b8a1-2074-4284-9547-28c520a43881 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.025504 Jul 26 04:26:52.889827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 122/228] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:52 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 26 04:26:52.894794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.895571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:52.903908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.905355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.906498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.907121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.929544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:52.930167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:52.937070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.937669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.938462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:52.938895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:52.972559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:53.068422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:53.077798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:53.079351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:53.080486 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-181584f5-4c65-4124-b2f0-b114523b2a6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.189545 Jul 26 04:26:53.081036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 123/229] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:52 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:53.085792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b815260-9492-4cc7-861c-7c9de1a8b857 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-298608665"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:53.088444 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.088444 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.089321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-9b815260-9492-4cc7-861c-7c9de1a8b857 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid 30675d87-b664-4df9-b94f-e37f1981f491 for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:53.117999 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b815260-9492-4cc7-861c-7c9de1a8b857 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035821 Jul 26 04:26:53.118667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 124/230] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.125250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b661d550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.128190 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.128190 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.129790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.130632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.131493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.131903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.161804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb975840-5fcd-416b-9d14-462d26494bc8 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.041994 Jul 26 04:26:53.162445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 125/231] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.167155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-825553b6-dcf1-4d7d-a32d-dbed607368c2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.168164 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.168164 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.194013 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-825553b6-dcf1-4d7d-a32d-dbed607368c2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.030513 Jul 26 04:26:53.197436 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 126/232] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:53 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:53.202140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b7075550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.204945 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.204945 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.207072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.207222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.208163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.208601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.238646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd203459-ecc9-49a4-98c3-96fc977e223d tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.042764 Jul 26 04:26:53.239289 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 127/233] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.245819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-604d8ba6-7f8f-464d-a7a8-4809665a72ce tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.246904 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.246904 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.253677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-604d8ba6-7f8f-464d-a7a8-4809665a72ce tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 26 04:26:53.254271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77e6e223-93e6-4932-9762-919c2979ec21 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1615 microversion: 2.1 time: 0.648158 Jul 26 04:26:53.255052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 107/234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:52 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1615 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:53.259415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b6377790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-604d8ba6-7f8f-464d-a7a8-4809665a72ce tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Request method failure captured: Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zi9jKCmj5T6qbcCdHj7WZwPVXiaTqG-KcbwfFVKMV0la7EMfr5muVCYHWA7ZgkjEYzrhkkJrCGA67fR5D4RACzv_xpgVvGPI8xnqYUTnXztfX5P9GK_txnbr2p9M6xnUPv6R50USCkhhAOMkbtivTJLLsgQyn0bdokE_meBHs3qHs Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:53.261593 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1ea148045dd4707be9199cd4d274037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fda7b09e51fd4d50868f26b2dbffb92d Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: exception: Aggregate 5 could not be found. Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '5'} Jul 26 04:26:53.263053 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.263822 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 26 04:26:53.265120 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.266044 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.266044 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.266229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-604d8ba6-7f8f-464d-a7a8-4809665a72ce tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:53.267761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.267913 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-604d8ba6-7f8f-464d-a7a8-4809665a72ce tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.022175 Jul 26 04:26:53.268057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.268200 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 128/235] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:26:53.268325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.268325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.272730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4730bb4d-e02f-4235-9562-8addc8a14806 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.273699 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.273699 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:53.292405 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4730bb4d-e02f-4235-9562-8addc8a14806 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4730bb4d-e02f-4235-9562-8addc8a14806 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Request method failure captured: Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zi9jKCmj5T6qbcCdHj7WZwPVXiaTqG-KcbwfFVKMV0la7EMfr5muVCYHWA7ZgkjEYzrhkkJrCGA67fR5D4RACzv_xpgVvGPI8xnqYUTnXztfX5P9GK_txnbr2p9M6xnUPv6R50USCkhhAOMkbtivTJLLsgQyn0bdokE_meBHs3qHs Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:53.294512 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1ea148045dd4707be9199cd4d274037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fda7b09e51fd4d50868f26b2dbffb92d Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: exception: Aggregate 5 could not be found. Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '5'} Jul 26 04:26:53.296636 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:53.297327 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:53.298573 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4730bb4d-e02f-4235-9562-8addc8a14806 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:53.299800 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4730bb4d-e02f-4235-9562-8addc8a14806 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.028040 Jul 26 04:26:53.300185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6f5fe65-32d3-4dcb-bf81-a6e9643d0107 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.041904 Jul 26 04:26:53.300258 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 129/236] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:53 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:26:53.301126 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 108/237] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.303353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:53.303948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:53.310322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.311465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.312519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.312963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.313813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-259117cb-92e6-4317-9ab4-12acf60b2e85 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-540831740", "name": "tempest-test_aggregate-1264134336"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:53.316721 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.316721 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.317680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-259117cb-92e6-4317-9ab4-12acf60b2e85 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid 6f16d5be-bbb9-43ae-87d3-556eb1147fb5 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:53.350452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-259117cb-92e6-4317-9ab4-12acf60b2e85 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.045536 Jul 26 04:26:53.356697 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 109/238] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Jul 26 04:26:53 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.363152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b6377a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.363152 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.363152 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.371325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.371842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.387423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.387878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.418427 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c82189d-aa3f-4ec6-a50e-5039fdd4575f tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h1-848886-16" status: 200 len: 335 microversion: 2.1 time: 0.065504 Jul 26 04:26:53.419218 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 110/239] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-hosts/n-h1-848886-16 => generated 335 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.425902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0c15ea7-250d-40f9-b966-b25ea311baa6 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-553453690"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:53.428621 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.428621 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.429689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-a0c15ea7-250d-40f9-b966-b25ea311baa6 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Generated uuid 64e0f7bf-78f5-4290-8cd7-d9286e4c0474 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:53.452289 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0c15ea7-250d-40f9-b966-b25ea311baa6 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.030941 Jul 26 04:26:53.452791 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 111/240] 10.222.0.43 () {62 vars in 1205 bytes} [Tue Jul 26 04:26:53 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:53.457445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a07f3ee8-8959-4e44-bc9f-62fc8402f469 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.458228 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.458228 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.484673 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a07f3ee8-8959-4e44-bc9f-62fc8402f469 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.030549 Jul 26 04:26:53.485512 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 112/241] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:53 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:53.508881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.509841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:53.519879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.521775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.522646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.523011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.604499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4c60ace439e84127980801b84a7ae45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b3d1d9a52c4ee8ba060d5c850a8805', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:53.605297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] flavor_id is None. Assuming migration. {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 04:26:53.605929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 04:26:53.671193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:53.679958 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3529cbad-b33b-4aff-a866-c306aaca3b8d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.193244 Jul 26 04:26:53.694863 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 113/242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:53.702564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Calling method '.version_select at 0x7f38b64d1e50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:53.703666 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:53.703666 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:53.713983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.715190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.738038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:53.739351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:53.936017 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b1b5490-4e16-4523-b20c-2f2cac8c4375 tempest-HostsAdminTestJSON-1687736725 tempest-HostsAdminTestJSON-1687736725-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h2-848886-16" status: 200 len: 867 microversion: 2.1 time: 0.239219 Jul 26 04:26:53.942647 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 114/243] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:26:53 2022] GET /compute/v2.1/os-hosts/n-h2-848886-16 => generated 867 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:53.942647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c2e33b9-4503-4601-a1dc-2579929586b3 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-457675542"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:54.031144 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.031144 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:54.035716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:54.069353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c2e33b9-4503-4601-a1dc-2579929586b3 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/7" status: 200 len: 298 microversion: 2.41 time: 0.131119 Jul 26 04:26:54.070173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 115/244] 10.222.0.43 () {62 vars in 1210 bytes} [Tue Jul 26 04:26:53 2022] PUT /compute/v2.1/os-aggregates/7 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:54.077886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.078582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:54.084863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.085275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.096599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.098290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.115748 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a0fab28a-be56-4b12-9e97-068582a8c2fa tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774/action" status: 202 len: 0 microversion: 2.1 time: 0.815867 Jul 26 04:26:54.117890 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 130/245] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:26:53 2022] POST /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:26:54.128413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08e3f7fc-7f3f-48f5-95ae-39e9b3199048 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.129295 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.129295 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.138145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-08e3f7fc-7f3f-48f5-95ae-39e9b3199048 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08e3f7fc-7f3f-48f5-95ae-39e9b3199048 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Request method failure captured: Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zi9jKCmj5T6qbcCdHj7WZwPVXiaTqG-KcbwfFVKMV0la7EMfr5muVCYHWA7ZgkjEYzrhkkJrCGA67fR5D4RACzv_xpgVvGPI8xnqYUTnXztfX5P9GK_txnbr2p9M6xnUPv6R50USCkhhAOMkbtivTJLLsgQyn0bdokE_meBHs3qHs Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:54.140614 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1ea148045dd4707be9199cd4d274037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fda7b09e51fd4d50868f26b2dbffb92d Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: exception: Aggregate 6 could not be found. Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '6'} Jul 26 04:26:54.141797 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.142581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 26 04:26:54.143568 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.144518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08e3f7fc-7f3f-48f5-95ae-39e9b3199048 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:54.144518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-08e3f7fc-7f3f-48f5-95ae-39e9b3199048 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.018745 Jul 26 04:26:54.144518 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 131/246] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:26:54.153825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eeea6261-7c93-4750-9fe3-733cbb0d68b6 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.167746 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eeea6261-7c93-4750-9fe3-733cbb0d68b6 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 298 microversion: 2.41 time: 0.019114 Jul 26 04:26:54.168813 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 132/247] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/os-aggregates/7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:54.177238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.177979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:54.185127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.185858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.186662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.187394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.308331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.320329 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-919c9bd2-78cf-424d-95f9-b73ef05b62b9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.246584 Jul 26 04:26:54.321125 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 116/248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:54.340832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.341672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:54.345449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:54.350742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.351210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.352111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.352624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.388374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.403622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.407456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.408635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f105cfa3-eec0-4ac9-a51e-62e115d356bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.236129 Jul 26 04:26:54.409195 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 133/249] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:54.415594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f769383-2c33-4b23-ba87-ab39ccc82bb5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.416632 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.416632 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.422037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:54.430191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8f769383-2c33-4b23-ba87-ab39ccc82bb5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f769383-2c33-4b23-ba87-ab39ccc82bb5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Request method failure captured: Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zi9jKCmj5T6qbcCdHj7WZwPVXiaTqG-KcbwfFVKMV0la7EMfr5muVCYHWA7ZgkjEYzrhkkJrCGA67fR5D4RACzv_xpgVvGPI8xnqYUTnXztfX5P9GK_txnbr2p9M6xnUPv6R50USCkhhAOMkbtivTJLLsgQyn0bdokE_meBHs3qHs Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:26:54.432183 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1ea148045dd4707be9199cd4d274037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1ea148045dd4707be9199cd4d274037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d1ea148045dd4707be9199cd4d274037 Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1768856336 Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fda7b09e51fd4d50868f26b2dbffb92d Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminTestJSON-1768856336-project-admin Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: exception: Aggregate 6 could not be found. Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '6'} Jul 26 04:26:54.433344 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:26:54.434030 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:54.435052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f769383-2c33-4b23-ba87-ab39ccc82bb5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f769383-2c33-4b23-ba87-ab39ccc82bb5 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.022987 Jul 26 04:26:54.436744 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 134/250] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:54 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:26:54.440040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e2bdaca-d4f2-415d-a8bd-16f0c06e6336 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:54.442939 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.442939 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.460760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e2bdaca-d4f2-415d-a8bd-16f0c06e6336 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.461633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e2bdaca-d4f2-415d-a8bd-16f0c06e6336 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.642313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.654343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-097ed403-8041-4830-83e4-759d6996fa39 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1471 microversion: 2.1 time: 0.318611 Jul 26 04:26:54.658093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 117/251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:54.664076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b523bf4f-cb7a-4b29-959f-40026943ad1e tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1196138730"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:54.666764 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.666764 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:54.667796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-b523bf4f-cb7a-4b29-959f-40026943ad1e tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid da5476d4-66dd-4146-91e9-a1f562f7c30b for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:54.677296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e2bdaca-d4f2-415d-a8bd-16f0c06e6336 tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 314 microversion: 2.41 time: 0.241097 Jul 26 04:26:54.678275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 135/252] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Jul 26 04:26:54 2022] POST /compute/v2.1/os-aggregates/7/action => generated 314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:54.690185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2204316f-f042-4a9e-bd7c-f258bac6a79d tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:54.693144 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.693144 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.701476 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b523bf4f-cb7a-4b29-959f-40026943ad1e tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041972 Jul 26 04:26:54.702706 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 118/253] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:54.710489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2204316f-f042-4a9e-bd7c-f258bac6a79d tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.711200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2204316f-f042-4a9e-bd7c-f258bac6a79d tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.718555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.721330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:54.738482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.741758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.742627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:54.744118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:54.875697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2204316f-f042-4a9e-bd7c-f258bac6a79d tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 298 microversion: 2.41 time: 0.187832 Jul 26 04:26:54.876869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 136/254] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Jul 26 04:26:54 2022] POST /compute/v2.1/os-aggregates/7/action => generated 298 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:26:54.887683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c207c383-deed-4f65-8784-aa153920d5c4 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.888717 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.888717 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.901340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c207c383-deed-4f65-8784-aa153920d5c4 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.021839 Jul 26 04:26:54.902232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 137/255] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:54.913557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c74013e-ac36-4d88-a93d-151ebd69f0cb tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:54.915726 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.915726 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:54.937550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:54.948834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50bfefcd-5430-4498-81f8-ce89e91316ad tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.240684 Jul 26 04:26:54.949549 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 119/256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:54.949907 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c74013e-ac36-4d88-a93d-151ebd69f0cb tempest-AggregatesAdminTestV241-780863801 tempest-AggregatesAdminTestV241-780863801-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.41 time: 0.045284 Jul 26 04:26:54.950710 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 138/257] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:26:54 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:54.955415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe7dbae5-c605-469b-bfa4-23781858ddac tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:54.958680 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:54.958680 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:54.989266 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe7dbae5-c605-469b-bfa4-23781858ddac tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.038820 Jul 26 04:26:54.990497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 120/258] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Jul 26 04:26:54 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:55.004700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb0d6ae2-e25f-4669-a025-d0472b3ca8c3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.005922 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.005922 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.016925 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb0d6ae2-e25f-4669-a025-d0472b3ca8c3 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.019715 Jul 26 04:26:55.018119 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 139/259] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:26:54 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:55.031770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91c2b629-e85e-44ff-8377-ea7b23a6d5bf tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.033450 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.033450 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:55.057743 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-91c2b629-e85e-44ff-8377-ea7b23a6d5bf tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.032156 Jul 26 04:26:55.058726 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 121/260] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:55 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:55.068694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41dbcde9-4954-462c-8b48-76cbf77d42b2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-139963982", "availability_zone": "tempest-test_az-2107835494"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:55.094094 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.094094 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.095185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-41dbcde9-4954-462c-8b48-76cbf77d42b2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid 532f8e9e-2467-4c37-8506-e6623b8829dd for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:55.147411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41dbcde9-4954-462c-8b48-76cbf77d42b2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.082596 Jul 26 04:26:55.148240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 140/261] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Jul 26 04:26:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:55.159946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e652cf65-f000-4583-8b86-f56adb7cd83f tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-139963982_new", "availability_zone": "tempest-test_az-2107835494_new"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:55.163872 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.163872 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:55.200877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e652cf65-f000-4583-8b86-f56adb7cd83f tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.202311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e652cf65-f000-4583-8b86-f56adb7cd83f tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.236399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e652cf65-f000-4583-8b86-f56adb7cd83f tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.080038 Jul 26 04:26:55.237025 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 122/262] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:26:55 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:55.251887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf170652-ca26-4701-b94c-3eccaf4c2426 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.252797 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.252797 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.264952 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf170652-ca26-4701-b94c-3eccaf4c2426 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.017132 Jul 26 04:26:55.265827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 141/263] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:55.278088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c52a637e-8902-4291-8eda-067a5d2829c2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.279285 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.279285 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:26:55.308390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c52a637e-8902-4291-8eda-067a5d2829c2 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.034817 Jul 26 04:26:55.312241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 123/264] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:26:55 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:55.321083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55b7a5f5-7083-4bbf-96cb-aa110f1e03d6 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-947149743"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:55.324844 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.324844 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.327118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-55b7a5f5-7083-4bbf-96cb-aa110f1e03d6 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Generated uuid 5926f513-bbfe-4bdb-a8c8-483ee0ac8670 for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:26:55.346805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.347581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:55.361826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.363739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.364614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.365056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.377266 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55b7a5f5-7083-4bbf-96cb-aa110f1e03d6 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061029 Jul 26 04:26:55.378249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 142/265] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:26:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:55.388205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-220e46e7-ea1f-4b12-8460-4893d5b97c07 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.389034 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.389034 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.403108 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-220e46e7-ea1f-4b12-8460-4893d5b97c07 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.018342 Jul 26 04:26:55.403834 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 143/266] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:26:55.423667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7718c254-95b8-4c4d-8374-9926e51e5323 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.424500 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:55.424500 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:55.477837 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7718c254-95b8-4c4d-8374-9926e51e5323 tempest-AggregatesAdminTestJSON-1768856336 tempest-AggregatesAdminTestJSON-1768856336-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.064525 Jul 26 04:26:55.479690 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 144/267] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:26:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:26:55.500128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.501489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:55.516573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.517391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.518770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.519435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.608730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:55.617939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-368bf6a0-0734-4994-93b3-3e5aa0fca3cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.277184 Jul 26 04:26:55.619187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 124/268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:55.625645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.626495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:55.633590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.634718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.635855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.637663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.657947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] HTTP exception thrown: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Request method failure captured: Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 HTTP/1.1 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfTesd-x3A-PyxE5d3FW54xoGq92GHOGkAkT03HwoJTd99DlrGXxkoyPZKrr0CL4bizMIcNqqFRuSvGlaw_ysbRXF7NOWsUuaKTL_-E1KbYMpaCMQvVKFb9fqYSWJRhQfltBQcg8Aq4jdr3bt8fMBN18u3WNPxDqbCvxWJzvmrkq8 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:55.659694 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f73e4f89266342e38205a01de85fa114 Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.661095 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '55b43c3e-c8af-411b-8088-d65083dffeb1'} Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:55.661823 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.662966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.665798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Returning 404 to user: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:55.666941 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32c46201-cfa4-4496-b296-da837f8e1cd1 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 404 len: 111 microversion: 2.1 time: 0.045952 Jul 26 04:26:55.671337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 125/269] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:26:55 2022] DELETE /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:55.682672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.683308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] [instance: 55b43c3e-c8af-411b-8088-d65083dffeb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:55.690799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.691763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.692800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.693467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.726487 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] HTTP exception thrown: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Request method failure captured: Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 HTTP/1.1 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfTesd-x3A-PyxE5d3FW54xoGq92GHOGkAkT03HwoJTd99DlrGXxkoyPZKrr0CL4bizMIcNqqFRuSvGlaw_ysbRXF7NOWsUuaKTL_-E1KbYMpaCMQvVKFb9fqYSWJRhQfltBQcg8Aq4jdr3bt8fMBN18u3WNPxDqbCvxWJzvmrkq8 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:26:55.730708 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_386785fcb6d14ee59bfd23b3ce537450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 386785fcb6d14ee59bfd23b3ce537450 Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203737409 Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f73e4f89266342e38205a01de85fa114 Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminTestJSON-203737409-project Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.731875 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '55b43c3e-c8af-411b-8088-d65083dffeb1'} Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:26:55.732528 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. Jul 26 04:26:55.735092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:26:55.736043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] Returning 404 to user: Instance 55b43c3e-c8af-411b-8088-d65083dffeb1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:26:55.736043 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-feb57579-b61b-4555-ac12-85449978ece9 tempest-AggregatesAdminTestJSON-203737409 tempest-AggregatesAdminTestJSON-203737409-project] 10.222.0.43 "GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1" status: 404 len: 111 microversion: 2.1 time: 0.063461 Jul 26 04:26:55.739414 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 126/270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/servers/55b43c3e-c8af-411b-8088-d65083dffeb1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:26:55.752972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:55.754486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:55.766530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.766978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:55.767764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:55.768203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.146720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:56.160494 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cf4f991-54e2-43be-b205-5e9b6430d7dc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1471 microversion: 2.1 time: 0.421654 Jul 26 04:26:56.161702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 127/271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:56.173179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19344318-082c-4dd7-8de9-087e6094e9b2", "name": "network-vif-plugged", "status": "completed", "tag": "41e05caf-a07d-4969-bc4a-c0b841f1066d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:56.197069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:56.198103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.209715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:56.221415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:56.229142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] Creating event network-vif-plugged:41e05caf-a07d-4969-bc4a-c0b841f1066d for instance 19344318-082c-4dd7-8de9-087e6094e9b2 on n-h2-848886-16 Jul 26 04:26:56.230093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:56.231635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d5a91af-d1d0-4144-b58f-b2a09ac4d0ae tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1362 microversion: 2.25 time: 0.748120 Jul 26 04:26:56.232860 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 145/272] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:55 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:56.241278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078231 Jul 26 04:26:56.242805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:56.243570 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 128/273] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:26:56.253808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:56.276354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:56.277048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.277997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:56.278684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.525452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:56.526939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-57b2d47d-a981-44b6-9ff4-a6787cb11771 req-eb0e24f2-5a86-4ce3-9626-fe023447168c service nova] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002107 Jul 26 04:26:56.534627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 129/274] 10.222.0.43 () {56 vars in 886 bytes} [Tue Jul 26 04:26:56 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 26 04:26:56.642135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:56.643264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:56.651595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:56.651781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:56.652923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.654123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:56.655102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:56.669323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8296847-9035-4e0c-81ae-ca81ffcb057b tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.434984 Jul 26 04:26:56.669901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 146/275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:56 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:57.182411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:57.183437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:57.208506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.210715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:57.212148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.214269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:57.329227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:57.340195 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95e377f1-3a5e-47ee-b7a9-08de236703e5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1319 microversion: 2.1 time: 0.700904 Jul 26 04:26:57.342840 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 130/276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:56 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:57.353985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:57.355073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:57.375266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.378104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:57.380594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.381323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:57.473305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:57.481780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cf21855-a68f-4e48-935d-9682bf72740d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1471 microversion: 2.1 time: 0.303516 Jul 26 04:26:57.483214 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 147/277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:57 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:57.583527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:57.594983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:57.596980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:57.598461 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34a4e677-32a9-4ea2-89de-67c5f12c65c1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1558 microversion: 2.25 time: 0.253526 Jul 26 04:26:57.615950 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 131/278] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:57 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:57.693714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:57.694483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:57.704875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.706231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:57.708800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:57.710395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.108726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:58.119390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a1e919e-63df-43bd-919f-5f3c455325cc tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.430488 Jul 26 04:26:58.133046 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 132/279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:57 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:58.298715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:58.300015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:58.307375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.308076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.308956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.309494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.365768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:58.367877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:58.377055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.378094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.379245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.379836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.566135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid d5663c86-0ddc-4546-a50d-1959846d25b6 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:26:58.646706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:58.659065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d18ee8d6-c2e4-4a94-a35a-fda691d76bf0 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1469 microversion: 2.1 time: 0.295588 Jul 26 04:26:58.660108 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 133/280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:58 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:26:58.665333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:58.665937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:58.683537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.685327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.686784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.688650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.698837 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea700785-5825-461b-b17a-1074f4b2fc71 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 2053 microversion: 2.25 time: 1.076731 Jul 26 04:26:58.699840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 148/281] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:57 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 2053 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:58.905387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:58.915454 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eed6c9c1-8a42-4c52-9f44-79ceb433b78e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1471 microversion: 2.1 time: 0.254290 Jul 26 04:26:58.930734 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 134/282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:58 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:58.937013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:58.937786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:58.946119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.946788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:58.947728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:58.948312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.161960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid d5663c86-0ddc-4546-a50d-1959846d25b6 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:26:59.188041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:59.189304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:59.197252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.201604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.202607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.203074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.253272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:26:59.332919 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0664d2cf-b34f-4317-9652-94832f58bfbf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 2053 microversion: 2.25 time: 0.398469 Jul 26 04:26:59.333961 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 135/283] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:26:58 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 2053 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:26:59.348844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:59.349772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:59.357268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.359436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.360745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.361509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.366358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:26:59.437955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ae91d25-2219-4cdf-8cc2-37fab68ad1f7 tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 204 len: 0 microversion: 2.1 time: 0.736477 Jul 26 04:26:59.439250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 149/284] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:26:58 2022] DELETE /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:26:59.457189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:59.461086 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:26:59.461086 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:26:59.462314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.462759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.463862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.464569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.496936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6cee28b-6234-4075-9559-0e39f9decb61 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.049301 Jul 26 04:26:59.505795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 150/285] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Jul 26 04:26:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:26:59.511137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:59.512172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:59.520825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.521511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.522540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.523177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.609118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:59.617077 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00396b87-8bee-476d-93eb-a935345ef045 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.272583 Jul 26 04:26:59.618010 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 136/286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:59 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:59.622907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": "auto"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:26:59.625768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:59.633143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.634237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.635530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.636222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.735251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'flavor' on Instance uuid d5663c86-0ddc-4546-a50d-1959846d25b6 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:26:59.749383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:26:59.765599 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7f308cf-67b8-4bbc-bd8a-962388bc5ac5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1475 microversion: 2.1 time: 0.256140 Jul 26 04:26:59.767139 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 151/287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:59 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:26:59.804504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119488) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:26:59.938350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:26:59.939545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:26:59.946494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.947291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:26:59.948286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:26:59.948846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:00.130912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:00.142131 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc5b4106-e835-48cb-8cd2-7927eb4c36f5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1471 microversion: 2.1 time: 0.208788 Jul 26 04:27:00.143008 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 152/288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:26:59 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:00.147557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-58d4c74b-fb05-4475-8c96-694635bb18aa req-d4be2af7-35a1-4c47-b987-8a111885e170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290fa8d5-cc6c-4215-9cdd-ed3d815c30fc", "name": "network-vif-plugged", "status": "completed", "tag": "b7c34f7d-b562-41e8-bb05-2c2fffe0bde2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:00.159119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-58d4c74b-fb05-4475-8c96-694635bb18aa req-d4be2af7-35a1-4c47-b987-8a111885e170 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:00.159877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-58d4c74b-fb05-4475-8c96-694635bb18aa req-d4be2af7-35a1-4c47-b987-8a111885e170 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:00.173504 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-58d4c74b-fb05-4475-8c96-694635bb18aa req-d4be2af7-35a1-4c47-b987-8a111885e170 service nova] Creating event network-vif-plugged:b7c34f7d-b562-41e8-bb05-2c2fffe0bde2 for instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc on n-h2-848886-16 Jul 26 04:27:00.178723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-58d4c74b-fb05-4475-8c96-694635bb18aa req-d4be2af7-35a1-4c47-b987-8a111885e170 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Jul 26 04:27:00.179809 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 153/289] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:00.640476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:00.642033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:00.649201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:00.649912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:00.651447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:00.652109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:00.841520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:00.850905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54061edd-da98-4dbe-93b7-f5d01a9d4161 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1319 microversion: 2.1 time: 0.215481 Jul 26 04:27:00.851468 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 154/290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:00 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:00.857007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:00.857781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:00.868933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:00.869381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:00.870225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:00.870775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:01.022867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:01.033359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb6d75f5-9e0b-4774-927c-68b911adf761 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1475 microversion: 2.1 time: 0.180520 Jul 26 04:27:01.034500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 155/291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:00 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1475 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:01.165905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:01.167053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:01.177930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:01.179517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:01.180335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:01.181176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:01.614478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:01.626750 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df51b339-7ce0-4ca6-a9d0-a1db94383011 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.464161 Jul 26 04:27:01.628604 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 156/292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:01 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:02.278842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b649a430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:02.280805 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:02.280805 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:02.295347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119487) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 04:27:02.296232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.299774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.351256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.352111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.368157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.368984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.372818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:02.378815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-463a7691-e96b-40a0-9ca6-dfe59d7a5c05 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.663485 Jul 26 04:27:02.379725 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 157/293] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:02.385788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:02.386939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:02.396230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.396755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.397652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.398355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.579020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:02.594012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ee7c6f0-fd2f-4cc5-b022-3daaab219745 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1468 microversion: 2.1 time: 0.209999 Jul 26 04:27:02.600799 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 158/294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:02 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:02.614886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:02.617668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:02.630717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.631723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.632358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.632868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.702562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.703198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.703755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lazy-loading 'fault' on Instance uuid 19344318-082c-4dd7-8de9-087e6094e9b2 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:02.760305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:02.772491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5a907f4-7cba-4136-9e19-2578bb72c8c6 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 200 len: 1309 microversion: 2.1 time: 0.170268 Jul 26 04:27:02.773841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 159/295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:02 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:02.779037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9be61dce-8e5c-4df3-af63-f7c255d84722 req-a7d8776b-96b5-4a85-84b4-4aaf7ee7fd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19344318-082c-4dd7-8de9-087e6094e9b2", "name": "network-vif-deleted", "tag": "41e05caf-a07d-4969-bc4a-c0b841f1066d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:02.790566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9be61dce-8e5c-4df3-af63-f7c255d84722 req-a7d8776b-96b5-4a85-84b4-4aaf7ee7fd64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.791200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9be61dce-8e5c-4df3-af63-f7c255d84722 req-a7d8776b-96b5-4a85-84b4-4aaf7ee7fd64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.805363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9be61dce-8e5c-4df3-af63-f7c255d84722 req-a7d8776b-96b5-4a85-84b4-4aaf7ee7fd64 service nova] Creating event network-vif-deleted:41e05caf-a07d-4969-bc4a-c0b841f1066d for instance 19344318-082c-4dd7-8de9-087e6094e9b2 on n-h2-848886-16 Jul 26 04:27:02.811972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9be61dce-8e5c-4df3-af63-f7c255d84722 req-a7d8776b-96b5-4a85-84b4-4aaf7ee7fd64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Jul 26 04:27:02.817572 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 160/296] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:02.822845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b638e670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:02.823934 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:02.823934 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:02.825710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.827085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.845193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.845639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.858363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:02.858996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:02.865587 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e0f42d67-ebed-464b-b537-55948e2ddb1d tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.046521 Jul 26 04:27:02.871100 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 161/297] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:27:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:03.110436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1362202739", "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:03.113222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:03.126940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.128320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.129786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.130533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.237559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lazy-loading 'flavor' on Instance uuid 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:03.272236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:03.297905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Going to try to live migrate instance to tempest-host-1362202739 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:27:03.305839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] HTTP exception thrown: Compute host tempest-host-1362202739 could not be found. Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Request method failure captured: Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc/action HTTP/1.1 Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 107 Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32z3KY_PWYyBzOC2gYFr5XElXIEA2VzYpPb0abj1on_lnuCLlvIPEo7aJqhbOQT4GBnvmq8_85jzfygIJWIqIZK8eERljcIgQELkeKd6LYbNixj_4uVxCfPCVeTV4tcF-AYKyoJFZy2xLJFnh4_Jcj7GwDDHp_kUoIOGdWAIWKU330s Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e2840fc0a97a46b1a3a231763bf5b60f Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:03.309845 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e2840fc0a97a46b1a3a231763bf5b60f Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-LiveMigrationNegativeTest-529126328-project-admin Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a5f6f4675ffe4b82b9a8765e643f2d23 Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-LiveMigrationNegativeTest-529126328-project-admin Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: {"os-migrateLive": {"host": "tempest-host-1362202739", "block_migration": true, "disk_over_commit": false}} Jul 26 04:27:03.311364 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: exception: Compute host tempest-host-1362202739 could not be found. Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '290fa8d5-cc6c-4215-9cdd-ed3d815c30fc', 'body': {'os-migrateLive': {'host': 'tempest-host-1362202739', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:03.312155 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1362202739 could not be found. Jul 26 04:27:03.313368 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1362202739 could not be found. Jul 26 04:27:03.314704 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1362202739 could not be found. Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:03.315785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Returning 400 to user: Compute host tempest-host-1362202739 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:03.317622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9352be72-9a13-4212-b758-e1aad99e5cef tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc/action" status: 400 len: 100 microversion: 2.1 time: 0.444000 Jul 26 04:27:03.318034 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 162/298] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jul 26 04:27:02 2022] POST /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc/action => generated 100 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:27:03.323027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:03.323726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:03.334452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.335009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.335910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.336420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.697063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:03.705666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f021ea0e-6440-4357-8ec1-35bab16e4628 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.386500 Jul 26 04:27:03.706579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 163/299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:03 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:03.935271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:03.938074 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:03.938074 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:03.939362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.939840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.940689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.941167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:03.956242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:03.974459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4da5c44-4f91-4f01-a02e-971631a4e96d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.266468 Jul 26 04:27:03.975032 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 164/300] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:27:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:03.980236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b64a3a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:03.981149 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:03.981149 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:03.983174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:03.983735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.000594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.001512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.014475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.014932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.029715 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-733fbdb2-1797-4d27-a857-5bb2e82e3d1a tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.045424 Jul 26 04:27:04.032848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 165/301] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:04.041180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.043993 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0eb557d1-ebd3-4964-ab35-454d4114140b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6/action" status: 202 len: 0 microversion: 2.25 time: 4.424964 Jul 26 04:27:04.044807 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 137/302] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:26:59 2022] POST /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6/action => generated 0 bytes in 4426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:04.053601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:04.069168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.069783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.070621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.071446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.303759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59c9bd0c-4cfd-49f3-831c-d27eaec8a00a tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Calling method '.version_select at 0x7f38b617e310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.304768 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.304768 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:04.305923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-59c9bd0c-4cfd-49f3-831c-d27eaec8a00a tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fdf0c2695fd84c58b697f069ef3b341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ac9401d87348d69823dfb130dfa50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59c9bd0c-4cfd-49f3-831c-d27eaec8a00a tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Request method failure captured: Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320VZyZ41Qug9fFE50AACtZ-xdmreSuFIPm549prpR02oAohCogzn66Z9wzcM_dXAlDNJglY6wHENOz58BlVTAuKxytg2HBAwsNeXRPQJGtDbsoZVHwIvr2yyoRzsq2KhcHm5oryWQbcb0mn7WQjzRS5ugFmXO0t7lU4Li3ufGKQzic Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:04.315561 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: fdf0c2695fd84c58b697f069ef3b341f Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:27:04.316729 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:04.317555 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 04:27:04.319840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.321723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59c9bd0c-4cfd-49f3-831c-d27eaec8a00a tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:04.321723 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59c9bd0c-4cfd-49f3-831c-d27eaec8a00a tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.270255 Jul 26 04:27:04.322349 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 138/303] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:04.331998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.332715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:04.341507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.342739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.343716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.344376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.369954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 HTTP/1.1 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:04.371682 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:04.373720 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '19344318-082c-4dd7-8de9-087e6094e9b2'} Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:04.374622 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:04.376454 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.377968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:04.378123 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1dcdf257-040a-4cb5-a269-2800cce52139 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 404 len: 111 microversion: 2.1 time: 0.049598 Jul 26 04:27:04.390264 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 139/304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:04.397502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63cc61fd-bd38-4730-9630-2195fd9d94c6 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-13604685"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:04.400473 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.400473 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:04.401976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-63cc61fd-bd38-4730-9630-2195fd9d94c6 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 624ceefe-d75c-4bb5-9728-0a7b91d12374 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:04.432869 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63cc61fd-bd38-4730-9630-2195fd9d94c6 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041252 Jul 26 04:27:04.436660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 140/305] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:04.446642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b617eb80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.449233 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.449233 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:04.451236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.453008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.491668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.495391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.508250 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f2ac0bfe-237f-4c85-b746-25252d34f5b4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.070279 Jul 26 04:27:04.523769 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 141/306] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:04.537387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.540315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:04.555724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.558326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.559742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.560471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.694583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.704432 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3520e8f4-55bf-4750-9b97-716e84fb662d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1468 microversion: 2.1 time: 0.670310 Jul 26 04:27:04.705000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 166/307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1468 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:04.739607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-088ec973-af6a-4d61-8fb8-f28018a9e369 tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Calling method '.version_select at 0x7f38b61c9af0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.740772 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.740772 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:04.742098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-088ec973-af6a-4d61-8fb8-f28018a9e369 tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fdf0c2695fd84c58b697f069ef3b341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ac9401d87348d69823dfb130dfa50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-088ec973-af6a-4d61-8fb8-f28018a9e369 tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Request method failure captured: Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320VZyZ41Qug9fFE50AACtZ-xdmreSuFIPm549prpR02oAohCogzn66Z9wzcM_dXAlDNJglY6wHENOz58BlVTAuKxytg2HBAwsNeXRPQJGtDbsoZVHwIvr2yyoRzsq2KhcHm5oryWQbcb0mn7WQjzRS5ugFmXO0t7lU4Li3ufGKQzic Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:04.744217 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fdf0c2695fd84c58b697f069ef3b341f Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:27:04.745581 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:04.746894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 04:27:04.748817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:04.751212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-088ec973-af6a-4d61-8fb8-f28018a9e369 tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:04.752242 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-088ec973-af6a-4d61-8fb8-f28018a9e369 tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.016376 Jul 26 04:27:04.757060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 167/308] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:04.761909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dba10bb4-6da5-452b-a915-aa868da20e05 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:04.764768 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.764768 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:04.777457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba10bb4-6da5-452b-a915-aa868da20e05 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.778256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba10bb4-6da5-452b-a915-aa868da20e05 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.902722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.912234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.913735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:04.914986 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-661e3254-d715-4cef-af91-001689b50dd6 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.388311 Jul 26 04:27:04.919007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 142/309] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:04.932279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93ea38cc-35d3-4d10-a20b-d89758be8f6b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b6177040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:04.933579 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:04.933579 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:04.934994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ea38cc-35d3-4d10-a20b-d89758be8f6b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:04.935653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ea38cc-35d3-4d10-a20b-d89758be8f6b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:04.955641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93ea38cc-35d3-4d10-a20b-d89758be8f6b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027260 Jul 26 04:27:04.956491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 143/310] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:04.962623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2006911658", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:04.991548 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dba10bb4-6da5-452b-a915-aa868da20e05 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.233383 Jul 26 04:27:04.992310 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 168/311] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:04.997355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.002003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:05.010515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.011517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.012437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.013019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.058651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:05.286671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:05.294713 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20d4e9a1-cec5-4fba-9cfd-24e23bcf7bff tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.301268 Jul 26 04:27:05.296371 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 169/312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:04 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:05.302418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b03bedb3-8b29-4d06-a455-75d61b83343c tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Calling method '.version_select at 0x7f38b61c9160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.303598 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:05.303598 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:05.304959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b03bedb3-8b29-4d06-a455-75d61b83343c tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fdf0c2695fd84c58b697f069ef3b341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ac9401d87348d69823dfb130dfa50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b03bedb3-8b29-4d06-a455-75d61b83343c tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Request method failure captured: Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320VZyZ41Qug9fFE50AACtZ-xdmreSuFIPm549prpR02oAohCogzn66Z9wzcM_dXAlDNJglY6wHENOz58BlVTAuKxytg2HBAwsNeXRPQJGtDbsoZVHwIvr2yyoRzsq2KhcHm5oryWQbcb0mn7WQjzRS5ugFmXO0t7lU4Li3ufGKQzic Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:05.306781 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fdf0c2695fd84c58b697f069ef3b341f Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:27:05.307929 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:05.308612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 04:27:05.309587 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.312104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b03bedb3-8b29-4d06-a455-75d61b83343c tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:05.313769 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b03bedb3-8b29-4d06-a455-75d61b83343c tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015662 Jul 26 04:27:05.320776 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 170/313] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Jul 26 04:27:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:05.327388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-30127119", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:05.395726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:05.460982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:05.461462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:05.462190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:05.462813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:05.463447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:05.475070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.475853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.477044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.477695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.502740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Getting quotas for project 3bfeea696f0e43bc80e13588702c2cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:05.508870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Getting quotas for user ed6d815a47d94a188808670c0eb29656 and project 3bfeea696f0e43bc80e13588702c2cb2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:05.525973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:05.533494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:05.594308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab358acb-339a-4cf3-8941-03807b68afce tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636507 Jul 26 04:27:05.595145 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 144/314] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:27:05.600234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b62d7ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.601256 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:05.601256 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:05.602725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.603411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.620005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.620619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.638291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.639307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.647332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db8c6b95-4b6f-408a-bca5-e231007f019e tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.050210 Jul 26 04:27:05.648611 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 145/315] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:05.653838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:05.657577 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:05.657577 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:05.666475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.667255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.694763 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-848886-16. Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 40 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:05.699751 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: {"add_host": {"host": "n-h1-848886-16"}} Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:05.701809 n-d-848886-16 devstack@n-api.service[119488]: exception: Aggregate 11 already has host n-h1-848886-16. Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-848886-16'}}} Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:27:05.702942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-848886-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:27:05.704191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:27:05.705419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:27:05.706778 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-848886-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 4, 27, 5, 684371), 'updated_at': None, 'host': 'n-h1-848886-16', 'aggregate_id': 11}] Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.707950 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-848886-16. Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.709317 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-848886-16. Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:05.712123 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:05.714433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-848886-16. Jul 26 04:27:05.714433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:05.715850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-848886-16. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:05.716473 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42bae39e-464b-433c-98c7-e964b2e67c91 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.066722 Jul 26 04:27:05.718322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 146/316] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:05 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 26 04:27:05.761908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:05.762732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:05.763212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:05.763618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:05.765113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:05.782054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.784170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.787317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.787317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.808776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Getting quotas for project 76d8ba503d2e4944ab2f3d22e71c6b50. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:05.815739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Getting quotas for user fb9899adb0034b94889d1b40d6ceaea1 and project 76d8ba503d2e4944ab2f3d22e71c6b50. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:05.827476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Calling method '.version_select at 0x7f38b893a4c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.829689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:05.829837 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:05.829837 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:05.832459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:05.834376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.834886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.856090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:05.860818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.861961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.881747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.883110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:05.896590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4de6f0d8-58ac-4bcd-b473-af12ea788016 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.176672 Jul 26 04:27:05.898560 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 147/317] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:05.919285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29ffdecf-5b2d-48bc-8801-5706fe856108 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.919984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29ffdecf-5b2d-48bc-8801-5706fe856108 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:05.929523 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a10444e-82ba-40e5-9378-e8fa178ad122 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606658 Jul 26 04:27:05.931575 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 171/318] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:27:05.941603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b62d20d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:05.942803 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:05.942803 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:05.944265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:05.945531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.005790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.009045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.022733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2a8e0a3-3f1c-43a6-8a8a-ed39b51094a4 tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.088317 Jul 26 04:27:06.023947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 172/319] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:06.035916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-12468051-16d9-480b-b8c3-7083624a7acc tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:06.043225 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:06.043225 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:06.067611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12468051-16d9-480b-b8c3-7083624a7acc tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.069676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12468051-16d9-480b-b8c3-7083624a7acc tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.177388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29ffdecf-5b2d-48bc-8801-5706fe856108 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.206418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29ffdecf-5b2d-48bc-8801-5706fe856108 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1220 microversion: 2.1 time: 0.295640 Jul 26 04:27:06.210537 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 148/320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:05 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1220 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:06.232079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-aa5af129-5d89-484f-a759-aa4dfe9aa125 req-00f60160-4ae6-425d-9d89-65caefb8b2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "name": "network-vif-unplugged", "status": "completed", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:06.258604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa5af129-5d89-484f-a759-aa4dfe9aa125 req-00f60160-4ae6-425d-9d89-65caefb8b2fe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.262467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa5af129-5d89-484f-a759-aa4dfe9aa125 req-00f60160-4ae6-425d-9d89-65caefb8b2fe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.283684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-aa5af129-5d89-484f-a759-aa4dfe9aa125 req-00f60160-4ae6-425d-9d89-65caefb8b2fe service nova] Creating event network-vif-unplugged:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h2-848886-16 Jul 26 04:27:06.317765 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-12468051-16d9-480b-b8c3-7083624a7acc tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 226 microversion: 2.1 time: 0.292383 Jul 26 04:27:06.319819 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 173/321] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 226 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:06.321106 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-aa5af129-5d89-484f-a759-aa4dfe9aa125 req-00f60160-4ae6-425d-9d89-65caefb8b2fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107408 Jul 26 04:27:06.324088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 149/322] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:06.340586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a581d028-b02e-4f3c-b021-c9a9e1c5978c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.342049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-823ac42a-3c97-431e-9fc9-222b6e24c25e tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Calling method '.version_select at 0x7f38b7117940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.346829 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:06.346829 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:06.348310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a581d028-b02e-4f3c-b021-c9a9e1c5978c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:06.351709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-823ac42a-3c97-431e-9fc9-222b6e24c25e tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fdf0c2695fd84c58b697f069ef3b341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ac9401d87348d69823dfb130dfa50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-823ac42a-3c97-431e-9fc9-222b6e24c25e tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Request method failure captured: Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320VZyZ41Qug9fFE50AACtZ-xdmreSuFIPm549prpR02oAohCogzn66Z9wzcM_dXAlDNJglY6wHENOz58BlVTAuKxytg2HBAwsNeXRPQJGtDbsoZVHwIvr2yyoRzsq2KhcHm5oryWQbcb0mn7WQjzRS5ugFmXO0t7lU4Li3ufGKQzic Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:06.359085 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: fdf0c2695fd84c58b697f069ef3b341f Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1'} Jul 26 04:27:06.360239 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:06.360940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 04:27:06.361924 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.363420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-823ac42a-3c97-431e-9fc9-222b6e24c25e tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:06.367130 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-823ac42a-3c97-431e-9fc9-222b6e24c25e tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.037282 Jul 26 04:27:06.369141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 174/323] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:06.380233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.405714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:06.442668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.444018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.449621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.450746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.619719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a581d028-b02e-4f3c-b021-c9a9e1c5978c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.641893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a581d028-b02e-4f3c-b021-c9a9e1c5978c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1217 microversion: 2.1 time: 0.316367 Jul 26 04:27:06.649311 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 150/324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:06.657929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b61d65e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.657929 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:06.657929 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:06.659721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.661017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.693387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.693864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.712425 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71cc1412-cae6-4c7a-a89f-7f1af0a65d9b tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.058473 Jul 26 04:27:06.713092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 151/325] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:06.723466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.724084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:06.741643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.742090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.745146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.745603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:06.841567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.855518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.864865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:06.869192 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f3bbf831-e241-45a4-ac68-88c8e537caab tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.492826 Jul 26 04:27:06.870536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 175/326] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:06.879373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-014ee87f-e96e-4cec-bbd0-f148932ec4fb tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.880473 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:06.880473 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:06.931541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-014ee87f-e96e-4cec-bbd0-f148932ec4fb tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.059488 Jul 26 04:27:06.932925 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 176/327] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:06 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:06.942639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb47e067-a2a7-432f-9e7a-d7f4b399a95f tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Calling method '.version_select at 0x7f38b61c9af0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.946586 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:06.946586 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:06.948822 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fb47e067-a2a7-432f-9e7a-d7f4b399a95f tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] HTTP exception thrown: Hypervisor with ID 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' could not be found. Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb47e067-a2a7-432f-9e7a-d7f4b399a95f tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Request method failure captured: Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/d186a12d-510f-4b22-abc5-45fd68dcd4d2/uptime HTTP/1.1 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320XM-s2M88rZgoBPq59hBkd2tCIqxm3ToIuaLVfO89dUkQ0UT2RKYVIxdl-5G9QasNp7yhUUdWZN0TJjF8oLOKgXNA1znFBvtQr8c7OFmB3JNOtuhgccMKOCxQIukj3m-FudP8jlvSmPQZ89nyU0ahs5LxNaZw90eQdSICe3cQzCiE Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: dc9e6c0c9b6a48fc867583fdb83e1e05 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:06.967142 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: dc9e6c0c9b6a48fc867583fdb83e1e05 Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: e168d1a0c7484afa938999945c5d857f Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: exception: Hypervisor with ID 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' could not be found. Jul 26 04:27:06.969757 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd186a12d-510f-4b22-abc5-45fd68dcd4d2'} Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 04:27:06.971113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' could not be found. Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:06.972829 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' could not be found. Jul 26 04:27:06.974474 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:06.976285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb47e067-a2a7-432f-9e7a-d7f4b399a95f tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Returning 404 to user: Hypervisor with ID 'd186a12d-510f-4b22-abc5-45fd68dcd4d2' could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:06.977324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb47e067-a2a7-432f-9e7a-d7f4b399a95f tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/d186a12d-510f-4b22-abc5-45fd68dcd4d2/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043075 Jul 26 04:27:06.978390 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 177/328] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/os-hypervisors/d186a12d-510f-4b22-abc5-45fd68dcd4d2/uptime => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:06.989155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Calling method '.version_select at 0x7f38b61d2550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:06.998628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:06.999365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.029277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.030595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.071798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.074387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.085456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:07.096138 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b98eaa7-7adf-4535-9c40-7a1e19765f79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.381712 Jul 26 04:27:07.103484 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 152/329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:07.124789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29882480-577a-4110-a2fb-93cffa907459 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-454439112"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:07.128361 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.128361 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.129877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-29882480-577a-4110-a2fb-93cffa907459 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 83146f8c-e218-41df-9852-a64257e7d666 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:07.166599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29882480-577a-4110-a2fb-93cffa907459 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061144 Jul 26 04:27:07.168459 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 153/330] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:07.174366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Calling method '.version_select at 0x7f38b61d6a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.177613 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.177613 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.179394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.181947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.198795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.199505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.220475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.221009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.230002 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26699683-f5a4-421d-aae9-56293596b9f3 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.060314 Jul 26 04:27:07.237759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 154/331] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:07.274315 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8859b8fe-6452-48a3-b700-d8a7dc68b30f tempest-HypervisorAdminTestJSON-1876782334 tempest-HypervisorAdminTestJSON-1876782334-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.294352 Jul 26 04:27:07.275410 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 178/332] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:27:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:07.285100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.285802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:07.305595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.307692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.313269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.313934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.505170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73b753ed-7ef6-43a6-97f0-984532c1e0dc tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:07.509441 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.509441 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.515644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73b753ed-7ef6-43a6-97f0-984532c1e0dc tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73b753ed-7ef6-43a6-97f0-984532c1e0dc tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 40 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:07.521010 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: {"add_host": {"host": "n-h1-848886-16"}} Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:07.523658 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-848886-16'}}} Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:07.524829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 04:27:07.525958 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.528552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73b753ed-7ef6-43a6-97f0-984532c1e0dc tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:07.528552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73b753ed-7ef6-43a6-97f0-984532c1e0dc tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.289236 Jul 26 04:27:07.530562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 155/333] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:07 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:07.543067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba1fb8b5-c8e3-49fc-90f8-7cf38f8054ac tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Calling method '.version_select at 0x7f38b6189ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.543877 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.543877 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.546991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba1fb8b5-c8e3-49fc-90f8-7cf38f8054ac tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fdf0c2695fd84c58b697f069ef3b341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ac9401d87348d69823dfb130dfa50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba1fb8b5-c8e3-49fc-90f8-7cf38f8054ac tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Request method failure captured: Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320VZyZ41Qug9fFE50AACtZ-xdmreSuFIPm549prpR02oAohCogzn66Z9wzcM_dXAlDNJglY6wHENOz58BlVTAuKxytg2HBAwsNeXRPQJGtDbsoZVHwIvr2yyoRzsq2KhcHm5oryWQbcb0mn7WQjzRS5ugFmXO0t7lU4Li3ufGKQzic Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:07.548826 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b1ac9401d87348d69823dfb130dfa50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b1ac9401d87348d69823dfb130dfa50a Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-993086129 Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: fdf0c2695fd84c58b697f069ef3b341f Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-993086129-project Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1'} Jul 26 04:27:07.550026 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:07.550787 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 04:27:07.551803 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.552832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba1fb8b5-c8e3-49fc-90f8-7cf38f8054ac tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:07.552832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba1fb8b5-c8e3-49fc-90f8-7cf38f8054ac tempest-HypervisorAdminNegativeTestJSON-993086129 tempest-HypervisorAdminNegativeTestJSON-993086129-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018971 Jul 26 04:27:07.556928 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 156/334] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:07.568243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29a26cd0-7fbe-4c64-b45b-eb8782a467af tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.569576 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.569576 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.596185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29a26cd0-7fbe-4c64-b45b-eb8782a467af tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.033507 Jul 26 04:27:07.597387 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 157/335] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:07.603444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3edb2592-1dda-4b48-bc00-9bfe293ac360 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Calling method '.version_select at 0x7f38b6177160>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.604499 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.604499 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.607634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3edb2592-1dda-4b48-bc00-9bfe293ac360 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] HTTP exception thrown: Hypervisor with ID '155834a3-845f-419b-9bd8-bbe329e19918' could not be found. Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3edb2592-1dda-4b48-bc00-9bfe293ac360 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Request method failure captured: Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hypervisors/155834a3-845f-419b-9bd8-bbe329e19918 HTTP/1.1 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320XM-s2M88rZgoBPq59hBkd2tCIqxm3ToIuaLVfO89dUkQ0UT2RKYVIxdl-5G9QasNp7yhUUdWZN0TJjF8oLOKgXNA1znFBvtQr8c7OFmB3JNOtuhgccMKOCxQIukj3m-FudP8jlvSmPQZ89nyU0ahs5LxNaZw90eQdSICe3cQzCiE Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: dc9e6c0c9b6a48fc867583fdb83e1e05 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:07.612309 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dc9e6c0c9b6a48fc867583fdb83e1e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: dc9e6c0c9b6a48fc867583fdb83e1e05 Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029 Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e168d1a0c7484afa938999945c5d857f Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: exception: Hypervisor with ID '155834a3-845f-419b-9bd8-bbe329e19918' could not be found. Jul 26 04:27:07.613922 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '155834a3-845f-419b-9bd8-bbe329e19918'} Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '155834a3-845f-419b-9bd8-bbe329e19918' Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 04:27:07.614782 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:27:07.616047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '155834a3-845f-419b-9bd8-bbe329e19918' could not be found. Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '155834a3-845f-419b-9bd8-bbe329e19918' could not be found. Jul 26 04:27:07.617195 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.621491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3edb2592-1dda-4b48-bc00-9bfe293ac360 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] Returning 404 to user: Hypervisor with ID '155834a3-845f-419b-9bd8-bbe329e19918' could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:07.627560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3edb2592-1dda-4b48-bc00-9bfe293ac360 tempest-HypervisorAdminNegativeTestJSON-1468422029 tempest-HypervisorAdminNegativeTestJSON-1468422029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/155834a3-845f-419b-9bd8-bbe329e19918" status: 404 len: 123 microversion: 2.1 time: 0.023114 Jul 26 04:27:07.631007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 158/336] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/os-hypervisors/155834a3-845f-419b-9bd8-bbe329e19918 => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:07.641409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b8d0fa3-41b2-4fca-8d1d-785afa5537fd tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-364797582"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:07.655014 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.655014 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:07.656118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-3b8d0fa3-41b2-4fca-8d1d-785afa5537fd tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 2251ced2-810e-4f0b-98f5-3b94b67a3604 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:07.712116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b8d0fa3-41b2-4fca-8d1d-785afa5537fd tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079708 Jul 26 04:27:07.713364 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 159/337] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:07.721124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.722556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:07.734120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.734923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.736202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.736830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.771069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:07.816015 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a75da8e-5580-4dee-b440-94e2348ad0a5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1272 microversion: 2.1 time: 0.536205 Jul 26 04:27:07.823223 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 179/338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1272 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:07.850673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-707748094"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:07.864150 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:07.864150 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:07.897494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.897965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.912675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:07.921583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-399af871-8d7d-4146-8c0a-6dd3efb1dc04 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1269 microversion: 2.1 time: 0.206913 Jul 26 04:27:07.925124 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 160/339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1269 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:07.930285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.930466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:07.930745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.933681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:07.953886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.956202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.956588 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-707748094 could not be found. Jul 26 04:27:07.958919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:07.961632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 57 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:07.969815 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: {"add_host": {"host": "tempest-nonexist_host-707748094"}} Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:07.972025 n-d-848886-16 devstack@n-api.service[119487]: exception: Compute host tempest-nonexist_host-707748094 could not be found. Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-707748094'}}} Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-707748094' is not mapped to any cell Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.972917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 26 04:27:07.976673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-707748094 could not be found. Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-707748094 could not be found. Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:07.978374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-707748094 could not be found. Jul 26 04:27:07.982258 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.003970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-707748094 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.010664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aabd70a5-e46e-4091-bfd3-5b77428c326a tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.177829 Jul 26 04:27:08.013484 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 180/340] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:07 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:08.028794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-804086df-df7b-43fd-a188-b1323f3658c6 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.030240 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.030240 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:08.069495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-804086df-df7b-43fd-a188-b1323f3658c6 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.051973 Jul 26 04:27:08.071418 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 181/341] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:08.092067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72221d1d-6cc6-426b-a720-e7e43e7c03ef tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72221d1d-6cc6-426b-a720-e7e43e7c03ef tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 283 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:08.105061 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:08.107228 n-d-848886-16 devstack@n-api.service[119487]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:27:08.108241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:27:08.109028 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:27:08.110346 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:27:08.111197 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:27:08.111197 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.111197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72221d1d-6cc6-426b-a720-e7e43e7c03ef tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.111197 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72221d1d-6cc6-426b-a720-e7e43e7c03ef tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029594 Jul 26 04:27:08.115571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 182/342] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:27:08.133782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3420dad-11ab-4683-a726-f1c0f28faadf tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3420dad-11ab-4683-a726-f1c0f28faadf tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 27 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:08.140813 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: {"aggregate": {"name": ""}} Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:08.142320 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.143172 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:27:08.144642 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.156807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3420dad-11ab-4683-a726-f1c0f28faadf tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.161145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3420dad-11ab-4683-a726-f1c0f28faadf tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.039715 Jul 26 04:27:08.167549 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 183/343] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:27:08.185443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.188004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:08.215406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:08.219642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:08.221654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:08.222050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:08.399948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:08.416287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:08.418301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:08.419775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2854b834-5142-4afb-88ba-499e813e53b5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.493273 Jul 26 04:27:08.421455 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 161/344] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:07 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:08.426432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af14dc20-ecfc-470b-8f83-58e3d24c476c tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-398372639"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.429386 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.429386 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.430551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af14dc20-ecfc-470b-8f83-58e3d24c476c tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af14dc20-ecfc-470b-8f83-58e3d24c476c tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 59 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:08.432397 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: {"aggregate": {"name": "tempest-test_aggregate-398372639"}} Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:08.433554 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-398372639'}}} Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:08.434306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:08.435322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 04:27:08.436570 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.438058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af14dc20-ecfc-470b-8f83-58e3d24c476c tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.439160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af14dc20-ecfc-470b-8f83-58e3d24c476c tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016471 Jul 26 04:27:08.440268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 162/345] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:08.445416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3f0de910-6d86-44b9-891a-3f2d99b3852c req-4b8ffdee-4db8-4a70-b570-104f2fcc2949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.457026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3f0de910-6d86-44b9-891a-3f2d99b3852c req-4b8ffdee-4db8-4a70-b570-104f2fcc2949 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:08.457817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3f0de910-6d86-44b9-891a-3f2d99b3852c req-4b8ffdee-4db8-4a70-b570-104f2fcc2949 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:08.470422 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3f0de910-6d86-44b9-891a-3f2d99b3852c req-4b8ffdee-4db8-4a70-b570-104f2fcc2949 service nova] Creating event network-changed:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h2-848886-16 Jul 26 04:27:08.476796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3f0de910-6d86-44b9-891a-3f2d99b3852c req-4b8ffdee-4db8-4a70-b570-104f2fcc2949 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Jul 26 04:27:08.477705 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 163/346] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:08.483411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25e67bbb-a852-4999-bf27-8e5715c10967 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-23496313"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.486946 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.486946 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.488331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-25e67bbb-a852-4999-bf27-8e5715c10967 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 5f202646-fa75-4616-9bc8-468617d1b2a6 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:08.513356 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25e67bbb-a852-4999-bf27-8e5715c10967 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.034095 Jul 26 04:27:08.516193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 164/347] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:08.533772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-23496313"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.544532 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.544532 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.546900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid cdc66b64-c48a-480a-b153-78ec3e1c7c3d for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:08.560179 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-23496313 already exists. Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 58 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:08.563819 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: {"aggregate": {"name": "tempest-test_aggregate-23496313"}} Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:08.565942 n-d-848886-16 devstack@n-api.service[119488]: exception: Aggregate tempest-test_aggregate-23496313 already exists. Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-23496313'}}} Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 26 04:27:08.567895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-23496313 already exists. Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:08.569742 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-23496313 already exists. Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-23496313 already exists. Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-23496313 already exists. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.571150 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-196d3363-fc39-45a9-9b0f-316f6d94fc1b tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 409 len: 109 microversion: 2.1 time: 0.042593 Jul 26 04:27:08.572210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 165/348] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 109 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:27:08.581248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5238408-2223-420c-8b53-165d1f16335d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.582646 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.582646 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.625866 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5238408-2223-420c-8b53-165d1f16335d tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.051279 Jul 26 04:27:08.626782 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 166/349] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 26 04:27:08.636124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8af2f11-62ae-4a42-aeaf-3f5a04baf518 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1020664643"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.639605 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.639605 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.641021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-b8af2f11-62ae-4a42-aeaf-3f5a04baf518 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 02243f07-4701-4a2f-8b68-cf94a77273f6 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:08.676362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8af2f11-62ae-4a42-aeaf-3f5a04baf518 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044402 Jul 26 04:27:08.677564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 167/350] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:08.690371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25d870d5-50c0-430e-98bd-71c414a813b3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.691179 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.691179 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.692131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-25d870d5-50c0-430e-98bd-71c414a813b3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25d870d5-50c0-430e-98bd-71c414a813b3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:08.694449 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 04:27:08.695831 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '15'} Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:08.696635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.697806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25d870d5-50c0-430e-98bd-71c414a813b3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.698900 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25d870d5-50c0-430e-98bd-71c414a813b3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.011073 Jul 26 04:27:08.710826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 168/351] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:08 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:08.721967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8eb54e3e-066e-4a67-940a-2ced15ce5dca tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.762420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8eb54e3e-066e-4a67-940a-2ced15ce5dca tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.050309 Jul 26 04:27:08.768277 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 169/352] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:08 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:08.775731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a32e493-d59b-403d-908a-059b730bc6fa tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.777020 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.777020 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.792116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4a32e493-d59b-403d-908a-059b730bc6fa tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a32e493-d59b-403d-908a-059b730bc6fa tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:08.794769 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: exception: Aggregate -1 could not be found. Jul 26 04:27:08.796300 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '-1'} Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:27:08.797017 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.798252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 04:27:08.799568 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:08.801034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a32e493-d59b-403d-908a-059b730bc6fa tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:08.802836 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a32e493-d59b-403d-908a-059b730bc6fa tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033186 Jul 26 04:27:08.807507 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 170/353] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:08 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:27:08.821063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97a62653-10e6-42db-acf5-6f964d6f410e tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1136074000"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:08.825061 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:08.825061 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:08.826497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-97a62653-10e6-42db-acf5-6f964d6f410e tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid f54c2cac-0eb1-43cc-92d6-fb09c68ca4e8 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:08.862926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97a62653-10e6-42db-acf5-6f964d6f410e tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053789 Jul 26 04:27:08.865084 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 171/354] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:08.872131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:08.873506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:08.883170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:08.884053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:08.885601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:08.892363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.045737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.049429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.057386 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-acc7543b-a68e-440e-8410-1e61e307dfdc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1278 microversion: 2.1 time: 0.190741 Jul 26 04:27:09.057577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b02140e6-a762-4e78-9b77-e6d4d1cae61c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.882603 Jul 26 04:27:09.057869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 172/355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:08 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:09.070210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 184/356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:08 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:09.075240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.076252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:09.078189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ef97474-119f-474e-9c30-de8b7326ebdd tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.079065 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.079065 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.079940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9ef97474-119f-474e-9c30-de8b7326ebdd tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ef97474-119f-474e-9c30-de8b7326ebdd tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:09.081663 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 04:27:09.082881 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '16'} Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:09.083556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.084817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ef97474-119f-474e-9c30-de8b7326ebdd tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:09.085739 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9ef97474-119f-474e-9c30-de8b7326ebdd tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.024238 Jul 26 04:27:09.085739 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 173/357] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:09 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:09.095329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc2c8a48-c55f-419c-94a7-44ff5774f3ce tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.096268 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.096268 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.103596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.108873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.109965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.110590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.135695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc2c8a48-c55f-419c-94a7-44ff5774f3ce tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.045059 Jul 26 04:27:09.137065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 174/358] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:09 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:09.151888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-931b8d42-3b43-4340-92c2-bfe45902443f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.154564 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.154564 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.165819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-931b8d42-3b43-4340-92c2-bfe45902443f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-931b8d42-3b43-4340-92c2-bfe45902443f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:09.167990 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: exception: Aggregate -1 could not be found. Jul 26 04:27:09.169305 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '-1'} Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.170865 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 04:27:09.172441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.173610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-931b8d42-3b43-4340-92c2-bfe45902443f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:09.174802 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-931b8d42-3b43-4340-92c2-bfe45902443f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032701 Jul 26 04:27:09.176103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 175/359] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:27:09 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:27:09.186986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-799608e4-39bf-4cb5-a18a-4b13a7c9f1a3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.188498 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.188498 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.189797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-799608e4-39bf-4cb5-a18a-4b13a7c9f1a3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-799608e4-39bf-4cb5-a18a-4b13a7c9f1a3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:09.192039 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 04:27:09.193700 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:09.194616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.195902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-799608e4-39bf-4cb5-a18a-4b13a7c9f1a3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:09.196818 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-799608e4-39bf-4cb5-a18a-4b13a7c9f1a3 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014696 Jul 26 04:27:09.197597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 176/360] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:27:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:09.208992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-724c2d3c-77bc-43ab-a27f-f30d6604af5f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-255039935"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.211061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:09.211647 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.211647 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.212545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-724c2d3c-77bc-43ab-a27f-f30d6604af5f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid 0547ffa4-084e-44b9-aeee-97b89e7a60c2 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:09.265571 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-724c2d3c-77bc-43ab-a27f-f30d6604af5f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059809 Jul 26 04:27:09.266214 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 177/361] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:09.282401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b48541be-ae73-4249-9070-ba617af37782 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.292481 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.292481 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.308002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48541be-ae73-4249-9070-ba617af37782 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.308566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48541be-ae73-4249-9070-ba617af37782 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.324300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.338691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fff11a4b-4e35-407c-8626-bbf04c75316d tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1275 microversion: 2.1 time: 0.275217 Jul 26 04:27:09.339980 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 185/362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:09 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:09.442881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.443701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:09.457766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.458124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.458928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.459366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.498991 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b48541be-ae73-4249-9070-ba617af37782 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.223895 Jul 26 04:27:09.500631 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 178/363] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:09.512750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a6ef5bf-c83b-4786-a55a-32de5f0c0b35 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.517036 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.517036 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.519383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a6ef5bf-c83b-4786-a55a-32de5f0c0b35 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '4ce474b1283f456e85b06af32aabbd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a0f806e33f41f8a09bdb1c258307a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a6ef5bf-c83b-4786-a55a-32de5f0c0b35 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Request method failure captured: Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 43 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320Uqi_Ai_j53xdQbcCMXNZzhoUQkNLG_sq2kAKgTwMki0Q412Wg2M9RiL_rmOkQPR_nqXfQKTrHnBrFWbTh1VQcDPJ4iYQYOlsVjfBKwJAPvWXYqR5aQqMjP8tnoLAwLioDowrHEwALizJrHQYLkfDE_3gzLHRfgnyh2aSlUDWogtc Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:09.526929 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_15a0f806e33f41f8a09bdb1c258307a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 15a0f806e33f41f8a09bdb1c258307a6 Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923 Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4ce474b1283f456e85b06af32aabbd1b Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1605109923-project Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: {"remove_host": {"host": "n-h1-848886-16"}} Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:09.528124 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-848886-16'}}} Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:09.528922 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 04:27:09.530608 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.536814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a6ef5bf-c83b-4786-a55a-32de5f0c0b35 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:09.538993 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a6ef5bf-c83b-4786-a55a-32de5f0c0b35 tempest-AggregatesAdminNegativeTestJSON-1605109923 tempest-AggregatesAdminNegativeTestJSON-1605109923-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.030647 Jul 26 04:27:09.541485 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 179/364] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:09.553159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6490425b-f1ed-419b-a018-fb2598c5a52f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.577691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6490425b-f1ed-419b-a018-fb2598c5a52f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.578724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6490425b-f1ed-419b-a018-fb2598c5a52f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.722336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6490425b-f1ed-419b-a018-fb2598c5a52f tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.176013 Jul 26 04:27:09.724482 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 180/365] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:09.747280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e490692e-2e14-4acf-a74e-3d5b88ab5c87 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.748964 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.748964 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.754928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:09.787545 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e490692e-2e14-4acf-a74e-3d5b88ab5c87 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.045973 Jul 26 04:27:09.788189 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 181/366] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:09 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:09.801821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-174e0eaa-0b0b-423f-a9bb-461768d07382 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2063429708"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.804907 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.804907 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.806540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.aggregate [None req-174e0eaa-0b0b-423f-a9bb-461768d07382 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Generated uuid f4a234f0-c15f-42f3-992c-4a1e4b22b948 for aggregate {{(pid=119488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:27:09.835840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-174e0eaa-0b0b-423f-a9bb-461768d07382 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041452 Jul 26 04:27:09.837186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 182/367] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:09.859992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:09.862788 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.862788 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:09.866569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.875521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.875727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.876800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.877145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:09.884473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79050d75-bb88-4cdc-a15c-b00a8eeecda9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.439320 Jul 26 04:27:09.885132 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 186/368] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:09 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:27:09.887698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:09.888495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:09.895808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:09.901858 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.compute.aggregates [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 04:27:09.902678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Request method failure captured: Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 42 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320WBbVvtWozr6D-6u9DiDkQMsj4-Wq5N1uWf8P9qlM60wCmu30o6ZdKalJo61b_D-KU3Hpr0UGw0r6doCoS9Fq5yRLTgY7nmmmyE9nqynDc74q34YzDfYXNo4em0sJ5Uk1LvR_WXDhkd4mt6maiW2PtgUR9S4ChAgXqPs6-lcSf-O0 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:27:09.905507 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f051b3931dcb4631aee94893a99ff30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f051b3931dcb4631aee94893a99ff30d Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488 Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 297dcb1774e14e4ab9bbe063ebc486e3 Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: {"remove_host": {"host": "nonexist_host"}} Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:09.906935 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 04:27:09.907659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 26 04:27:09.908727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.909912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:09.911109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:09.913023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9cb734d9-00cb-4d4d-beb0-0adfb5e56bb3 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.063192 Jul 26 04:27:09.917764 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 183/369] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:27:09 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:27:09.923229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b806545b-36d4-46c0-9afe-cc9e767eb4b4 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:09.924215 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:09.924215 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:09.950871 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b806545b-36d4-46c0-9afe-cc9e767eb4b4 tempest-AggregatesAdminNegativeTestJSON-2061522488 tempest-AggregatesAdminNegativeTestJSON-2061522488-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.032064 Jul 26 04:27:09.952154 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 187/370] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:27:09 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:10.086318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:10.087182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:10.088942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:10.089629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:10.098471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.098930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.100963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.101961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.139280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.142770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.148081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.149334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.709185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:10.720387 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8aa6a285-7373-4702-8f31-f8b6f2a89c1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.641912 Jul 26 04:27:10.721906 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 184/371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:10 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:10.730909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:10.732150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:10.740514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.741180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.743449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.743900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.859226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:10.875317 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01cf6246-92a0-4442-b558-a5c74b3e3750 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1275 microversion: 2.1 time: 0.152059 Jul 26 04:27:10.876631 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 185/372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:10 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:10.917345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:10.918362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:10.929198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.929613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:10.930575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:10.934590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:11.044961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:11.052696 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-131e550f-f6e5-4aa7-b333-8b071f89f7fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.971708 Jul 26 04:27:11.054893 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 188/373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:10 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:11.310401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:11.322730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:11.324236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:11.338711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e878a7e-0361-443c-9987-adc4d32c6899 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.417669 Jul 26 04:27:11.358217 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 186/374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:10 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:27:11.358691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-027e5091-2aa3-4c2a-8fde-1326d62bc6e5 req-529ec28d-416a-40f5-8400-4ff70efbb7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04dad4e5-f5f4-422e-bde6-83ece131df6c", "tag": "913b01ca-91f9-40b7-9225-76af37ca87c8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:11.379999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-027e5091-2aa3-4c2a-8fde-1326d62bc6e5 req-529ec28d-416a-40f5-8400-4ff70efbb7c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:11.383652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-027e5091-2aa3-4c2a-8fde-1326d62bc6e5 req-529ec28d-416a-40f5-8400-4ff70efbb7c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:11.405826 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-027e5091-2aa3-4c2a-8fde-1326d62bc6e5 req-529ec28d-416a-40f5-8400-4ff70efbb7c1 service nova] Creating event network-changed:913b01ca-91f9-40b7-9225-76af37ca87c8 for instance 04dad4e5-f5f4-422e-bde6-83ece131df6c on n-h1-848886-16 Jul 26 04:27:11.423982 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-027e5091-2aa3-4c2a-8fde-1326d62bc6e5 req-529ec28d-416a-40f5-8400-4ff70efbb7c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071368 Jul 26 04:27:11.424891 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 189/375] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:11.741557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:11.742185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:11.750479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:11.758806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:11.760018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:11.765340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:11.896222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:11.897847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:11.912484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:11.913609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:11.916529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:11.917191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:12.328839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:12.340558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84ca02de-c76b-4e12-83ce-b015621e82cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.599489 Jul 26 04:27:12.354335 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 187/376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:11 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:12.360557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:12.361465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:12.371189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:12.371962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:12.372939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:12.374711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:12.705753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:12.726636 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7566ff79-bde6-407b-975c-9b7f2a7993f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.370771 Jul 26 04:27:12.728496 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 188/377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:12 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:12.739388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:12.740127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:12.771723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:12.773499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:12.775150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:12.777351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:12.957473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:12.974565 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1bf6ec88-2425-41af-84e6-e078304cc513 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 1.082331 Jul 26 04:27:12.990757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 190/378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:11 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:13.096465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:13.108628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:13.111992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:13.114817 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d58aa1d6-594c-40e2-8a8a-7e3c5f2cd5cb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.385327 Jul 26 04:27:13.115798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 189/379] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:12 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:13.364129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:13.364978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:13.377716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:13.378289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:13.379164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:13.379718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:13.665893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9d846efa-4389-4f21-a297-88146ccfea58 req-209b463d-a468-476c-bbea-0bccac5e3fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "name": "network-vif-unplugged", "status": "completed", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:13.684926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9d846efa-4389-4f21-a297-88146ccfea58 req-209b463d-a468-476c-bbea-0bccac5e3fe7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:13.686719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9d846efa-4389-4f21-a297-88146ccfea58 req-209b463d-a468-476c-bbea-0bccac5e3fe7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:13.713395 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9d846efa-4389-4f21-a297-88146ccfea58 req-209b463d-a468-476c-bbea-0bccac5e3fe7 service nova] Creating event network-vif-unplugged:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h2-848886-16 Jul 26 04:27:13.725465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9d846efa-4389-4f21-a297-88146ccfea58 req-209b463d-a468-476c-bbea-0bccac5e3fe7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063831 Jul 26 04:27:13.726364 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 190/380] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:13.756344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:13.757287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:13.769151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:13.769598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:13.770415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:13.770854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:13.899060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:13.912627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0555235f-0b0a-47d4-bbf7-c136423ef260 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.552491 Jul 26 04:27:13.913661 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 191/381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:13 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:14.000071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:14.002251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:14.015660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.017849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:14.021588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.023784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:14.226023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:14.243431 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f65719a-7fa8-4353-b3d6-ab1b7f5f3bd3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.491382 Jul 26 04:27:14.245582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 191/382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:13 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:14.277864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:14.277864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:14.295881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.295881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:14.299617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.300164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:14.454634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:14.468002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d36f9ead-9e6f-488b-a05e-c756167c8bc8 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.474973 Jul 26 04:27:14.478946 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 192/383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:13 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:14.625124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:14.641771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:14.643802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:14.645020 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aaadb239-116c-45cd-99e3-e12456eab1e4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.391053 Jul 26 04:27:14.645575 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 192/384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:14 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:14.937728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:14.938773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:14.951627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.952091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:14.953481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:14.953932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.253811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25657d1b-c45e-4759-ab9f-bda644ea624b tempest-InstanceUsageAuditLogTestJSON-983635035 tempest-InstanceUsageAuditLogTestJSON-983635035-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:15.254944 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:15.254944 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:15.316229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-25657d1b-c45e-4759-ab9f-bda644ea624b tempest-InstanceUsageAuditLogTestJSON-983635035 tempest-InstanceUsageAuditLogTestJSON-983635035-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 04:27:14" status: 200 len: 318 microversion: 2.1 time: 0.732249 Jul 26 04:27:15.318493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 193/385] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 04:27:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2004%3A27%3A14 => generated 318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:15.323879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:15.323879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:15.364786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.365320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.367391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.367873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.429247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:15.439948 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cad13c3d-d841-48cf-9c87-f7739e284ab7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.507812 Jul 26 04:27:15.441468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 193/386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:14 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:15.459537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7badc13d-3e4a-48ef-a8d5-49c623ef0aac tempest-InstanceUsageAuditLogTestJSON-983635035 tempest-InstanceUsageAuditLogTestJSON-983635035-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:15.460942 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:15.460942 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:15.523497 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7badc13d-3e4a-48ef-a8d5-49c623ef0aac tempest-InstanceUsageAuditLogTestJSON-983635035 tempest-InstanceUsageAuditLogTestJSON-983635035-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.080815 Jul 26 04:27:15.542774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 194/387] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:27:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:15.548069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:15.559027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:15.575689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.581375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.582453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.583058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.751867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:15.760169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29f630f0-8900-4e20-8bad-0e87d04a49bd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.440606 Jul 26 04:27:15.780343 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 194/388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:15 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:15.785182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:15.785797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:15.801925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.802506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:15.803366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:15.803721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:16.068926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:16.082164 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f108bffd-ea38-49fc-a0fe-b07c49f35988 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.533560 Jul 26 04:27:16.083431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 195/389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:15 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:16.088319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e0c28584-308b-49ad-80e3-481a8e61f1b8 req-1de6a3c2-8275-452d-8699-f0c1c84c3e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c1bc30-8c55-465e-a34d-516344be45b1", "tag": "5a0bc459-204a-4215-a2a4-7ffe230cea0b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:16.136867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e0c28584-308b-49ad-80e3-481a8e61f1b8 req-1de6a3c2-8275-452d-8699-f0c1c84c3e82 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:16.137326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e0c28584-308b-49ad-80e3-481a8e61f1b8 req-1de6a3c2-8275-452d-8699-f0c1c84c3e82 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:16.164988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e0c28584-308b-49ad-80e3-481a8e61f1b8 req-1de6a3c2-8275-452d-8699-f0c1c84c3e82 service nova] Creating event network-changed:5a0bc459-204a-4215-a2a4-7ffe230cea0b for instance c2c1bc30-8c55-465e-a34d-516344be45b1 on n-h1-848886-16 Jul 26 04:27:16.173983 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e0c28584-308b-49ad-80e3-481a8e61f1b8 req-1de6a3c2-8275-452d-8699-f0c1c84c3e82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088925 Jul 26 04:27:16.182755 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 196/390] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:16.423893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:16.440536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:16.448081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:16.449558 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54d7a584-b6f3-4f94-a41e-d4408bc2391a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1568 microversion: 2.25 time: 0.668221 Jul 26 04:27:16.450609 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 195/391] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:15 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1568 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:16.474957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:16.476228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:16.502519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:16.502981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:16.503789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:16.504228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:16.801667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:16.802313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:16.814490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:16.814954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:16.815749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:16.816190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.022526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:17.047044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c1dff42-2292-413c-b833-45b75ab802d9 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.581310 Jul 26 04:27:17.049749 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 197/392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:16 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:17.104205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:17.104960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:17.115690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.116390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.117336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.119095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.128864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:17.137119 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95b89c85-01fa-4e57-9b34-fbfbb0bfb2a7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.339175 Jul 26 04:27:17.145536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 196/393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:16 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:17.475574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Calling method '.version_select at 0x7f38b60f39d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:17.479155 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:17.479155 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:17.480985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.487323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.501615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:17.512148 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a398021-2134-492d-a39d-dd570c30e493 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.412148 Jul 26 04:27:17.518416 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 198/394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:17 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:17.537086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:17.537979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:17.552139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.552581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.553398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.553817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.555927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.559780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.663941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.664837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.689443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.690543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.753142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.753611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.779002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b8ae098e-e46b-4190-9caf-cbdfe14676ab tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1998 microversion: 2.53 time: 0.622440 Jul 26 04:27:17.781267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 197/395] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Jul 26 04:27:17 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1998 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:17.806019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Calling method '.version_select at 0x7f38b61d2940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:17.812525 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:17.812525 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:17.818667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.819715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.844529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:17.849436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.850292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.905335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.908223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.941859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:17.944996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.945746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:17.989042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:17.989841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.003946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-28bf5538-037a-458d-ba60-8583a697a02f tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 688 microversion: 2.53 time: 0.210154 Jul 26 04:27:18.005274 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 198/396] 10.222.0.43 () {60 vars in 1222 bytes} [Tue Jul 26 04:27:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:18.356306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d5620b2-061c-4aa6-a0b6-f17396261ff7 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1534910716", "id": 1517584972, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:18.360529 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:18.360529 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:18.439826 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d5620b2-061c-4aa6-a0b6-f17396261ff7 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.423969 Jul 26 04:27:18.441134 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 199/397] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:18 2022] POST /compute/v2.1/flavors => generated 431 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:18.450709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Calling method '.version_select at 0x7f38b6142e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:18.460244 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:18.460244 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:18.461966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.462872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.528381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.530492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.555034 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d499e72-0c90-4b03-bac7-e9853cb05329 tempest-HypervisorAdminV253TestBase-128930743 tempest-HypervisorAdminV253TestBase-128930743-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/b5089ce7-4b5d-4307-a1f5-8828028484bc" status: 200 len: 794 microversion: 2.53 time: 0.112676 Jul 26 04:27:18.557315 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 200/398] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 26 04:27:18 2022] GET /compute/v2.1/os-hypervisors/b5089ce7-4b5d-4307-a1f5-8828028484bc => generated 794 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:18.568094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:18.569719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:18.581947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.587303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.588288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.588884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.606812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:18.617991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:18.629200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:18.636965 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-49b54252-b2af-4f01-89f1-0ab32ab9e698 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1558 microversion: 2.25 time: 1.117354 Jul 26 04:27:18.654247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 199/399] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:17 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1558 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:18.661534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:18.665130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:18.702392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.703068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:18.707665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:18.708149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.226332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:19.236281 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4f21877-72a5-4a08-bf10-7c5a67ec3cf5 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.677032 Jul 26 04:27:19.239045 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 201/400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:18 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:19.244737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c80e53f0-d98b-41a6-85ec-b7db42aa1405 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f699c896fb9341f1a13a4316e857a253"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:19.247473 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:19.247473 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:19.343780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:19.421643 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27e31dbe-e812-44d2-820e-cd94bf11ce24 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.752754 Jul 26 04:27:19.427282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 200/401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:18 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:19.455835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:19.458395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:19.472461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.498878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.501651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.502400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.698525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c80e53f0-d98b-41a6-85ec-b7db42aa1405 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1517584972/action" status: 200 len: 97 microversion: 2.1 time: 0.458208 Jul 26 04:27:19.700468 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 202/402] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Jul 26 04:27:19 2022] POST /compute/v2.1/flavors/1517584972/action => generated 97 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:19.707018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f127bb4f-5776-4a15-9a1b-ac859822bd2d tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '.version_select at 0x7f38b6131c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:19.711376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f127bb4f-5776-4a15-9a1b-ac859822bd2d tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.712229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f127bb4f-5776-4a15-9a1b-ac859822bd2d tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.731164 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f127bb4f-5776-4a15-9a1b-ac859822bd2d tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 868 microversion: 2.25 time: 0.028658 Jul 26 04:27:19.742770 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 203/403] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 26 04:27:19 2022] GET /compute/v2.1/os-migrations => generated 868 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:19.752385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d23b983d-2bf2-4cf5-8611-4d44fbbb916e req-e2f7ce32-2976-42f6-a73c-7e7f01d9b3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dad4e5-f5f4-422e-bde6-83ece131df6c", "name": "network-vif-plugged", "status": "completed", "tag": "913b01ca-91f9-40b7-9225-76af37ca87c8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:19.787167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d23b983d-2bf2-4cf5-8611-4d44fbbb916e req-e2f7ce32-2976-42f6-a73c-7e7f01d9b3a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.787948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d23b983d-2bf2-4cf5-8611-4d44fbbb916e req-e2f7ce32-2976-42f6-a73c-7e7f01d9b3a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.811126 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d23b983d-2bf2-4cf5-8611-4d44fbbb916e req-e2f7ce32-2976-42f6-a73c-7e7f01d9b3a4 service nova] Creating event network-vif-plugged:913b01ca-91f9-40b7-9225-76af37ca87c8 for instance 04dad4e5-f5f4-422e-bde6-83ece131df6c on n-h1-848886-16 Jul 26 04:27:19.816352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d23b983d-2bf2-4cf5-8611-4d44fbbb916e req-e2f7ce32-2976-42f6-a73c-7e7f01d9b3a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072217 Jul 26 04:27:19.817407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 204/404] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:19.885751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:19.892959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:19.898116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c78851c-7547-4939-b952-d5fbe0199747 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.467824 Jul 26 04:27:19.904972 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 201/405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:19 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:19.926934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:19.928905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:19.940650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.942143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:19.943226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:19.944974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:20.099490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-62601d41-2218-451c-aad6-b37397574729 tempest-FlavorsAccessTestJSON-1730507891 tempest-FlavorsAccessTestJSON-1730507891-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:20.125277 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-62601d41-2218-451c-aad6-b37397574729 tempest-FlavorsAccessTestJSON-1730507891 tempest-FlavorsAccessTestJSON-1730507891-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.306644 Jul 26 04:27:20.126570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 205/406] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:19 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:20.145385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-baafa38c-4fe5-4c3f-80e8-59b448bc8ee9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f699c896fb9341f1a13a4316e857a253"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:20.149529 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:20.149529 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:20.318516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:20.324948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid d5663c86-0ddc-4546-a50d-1959846d25b6 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:20.369355 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fd5e844-ca86-4d0c-89fd-13c916969171 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 2053 microversion: 2.25 time: 0.462992 Jul 26 04:27:20.380686 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 202/407] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:19 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 2053 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:20.400781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:20.402949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:20.425154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:20.428171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:20.430502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:20.431297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:20.633319 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-baafa38c-4fe5-4c3f-80e8-59b448bc8ee9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1517584972/action" status: 200 len: 21 microversion: 2.1 time: 0.491850 Jul 26 04:27:20.635919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 206/408] 10.222.0.43 () {60 vars in 1200 bytes} [Tue Jul 26 04:27:20 2022] POST /compute/v2.1/flavors/1517584972/action => generated 21 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:20.649862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:20.651149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:20.670772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:20.672886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:20.674081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:20.674628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:20.877549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:20.887305 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9bc6e74d-094a-400f-b3e3-b7389ac70a23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1320 microversion: 2.1 time: 0.493546 Jul 26 04:27:20.887910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 203/409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:20 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:20.895329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1285285700", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "96b59dc4-002c-4352-aa03-a56e9ddf1f5b"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:21.012657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:21.018515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:21.031338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] validate_networks() for [('96b59dc4-002c-4352-aa03-a56e9ddf1f5b', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:21.032862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-685be231-fd6e-4c4b-b4fb-e67dbaecad2a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.393163 Jul 26 04:27:21.033958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 207/410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:20 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:21.046177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52e9a558-c105-40fb-b336-1e375e2cc884 tempest-FlavorsAccessTestJSON-1730507891 tempest-FlavorsAccessTestJSON-1730507891-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.085830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52e9a558-c105-40fb-b336-1e375e2cc884 tempest-FlavorsAccessTestJSON-1730507891 tempest-FlavorsAccessTestJSON-1730507891-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043636 Jul 26 04:27:21.086734 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 208/411] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:21.105954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.106832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:21.119927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:21.121529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:21.122500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:21.123199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:21.493167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:21.505364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4171ac89-1ab9-4491-8011-d1b879d986c9 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.404152 Jul 26 04:27:21.507596 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 209/412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:21.517986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43408d22-7b1a-4604-97db-dd9730a17d89 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.521242 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:21.521242 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:21.597236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43408d22-7b1a-4604-97db-dd9730a17d89 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1517584972" status: 202 len: 0 microversion: 2.1 time: 0.087762 Jul 26 04:27:21.598363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 210/413] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:27:21 2022] DELETE /compute/v2.1/flavors/1517584972 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:27:21.611656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5df9dcba-1afe-495d-851a-527dc678d2a9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.646781 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5df9dcba-1afe-495d-851a-527dc678d2a9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042169 Jul 26 04:27:21.658433 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 211/414] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:21.669986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bbd5ccb1-2d9d-4a93-94c4-ca52805ab3a9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-479924282", "id": 1092083126, "os-flavor-access:is_public": "False"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:21.673854 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:21.673854 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:21.695113 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bbd5ccb1-2d9d-4a93-94c4-ca52805ab3a9 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.031184 Jul 26 04:27:21.704286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 212/415] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:21.713202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-181ccfed-d3ee-4d40-9252-f4266365549b tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.713970 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:21.713970 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:21.728406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-181ccfed-d3ee-4d40-9252-f4266365549b tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1092083126/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021131 Jul 26 04:27:21.729672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 213/416] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/flavors/1092083126/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:21.743881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7fa7c71d-5d4c-4798-8fe0-e49fe3eb0f99 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.773552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7fa7c71d-5d4c-4798-8fe0-e49fe3eb0f99 tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1092083126" status: 202 len: 0 microversion: 2.1 time: 0.037724 Jul 26 04:27:21.782296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 214/417] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:27:21 2022] DELETE /compute/v2.1/flavors/1092083126 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:27:21.792249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2162f8a-d219-43f8-93b7-1ba1412ae10c tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.824082 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2162f8a-d219-43f8-93b7-1ba1412ae10c tempest-FlavorsAccessTestJSON-1281546863 tempest-FlavorsAccessTestJSON-1281546863-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040273 Jul 26 04:27:21.825117 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 215/418] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:21.910750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:21.911549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:21.925411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:21.926806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:21.927608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:21.928184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.333464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:22.333952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:22.335237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:22.335659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:22.336075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:22.350586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.351038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.351854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.352299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.422993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:22.441038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for user e06c8cb7d10e4818a7e40396b93e54ab and project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:22.456442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:22.462014 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73ee9b36-1581-4a84-9bc2-0909c5c9fb1a tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1470 microversion: 2.1 time: 0.555254 Jul 26 04:27:22.462221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 216/419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:21 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1470 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:22.482289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:22.483663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:22.485653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:22.495124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:22.496079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.496747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.499134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.501454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.599443 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e377bfb4-5fa9-48b3-b0ce-bd1e6b260ea0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.710424 Jul 26 04:27:22.609116 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 204/420] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:27:22.615862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:22.626428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:22.634769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.635219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.636274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.636874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.822396 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2ef89561-3074-4ccc-a0c0-8c3d041042dd tempest-DeleteServersAdminTestJSON-1497417084 tempest-DeleteServersAdminTestJSON-1497417084-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c/action" status: 202 len: 0 microversion: 2.1 time: 0.211004 Jul 26 04:27:22.822634 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 205/421] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:27:22 2022] POST /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:27:22.834406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:22.835814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:22.846780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.847603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.848643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:22.849275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:22.962355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:22.973096 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fbaf869-1dec-4740-8b97-f07d1f927efa tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1476 microversion: 2.1 time: 0.500411 Jul 26 04:27:22.986191 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 217/422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:22 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:22.986191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:22.991522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:23.129007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:23.142450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:23.144852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:23.146282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d171a42-dbcc-4327-9f37-1df003994268 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1262 microversion: 2.25 time: 0.169946 Jul 26 04:27:23.149148 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 218/423] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:22 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:23.160212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:23.161058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:23.177836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.178561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.179636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.180320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.257341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.259336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.262569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lazy-loading 'fault' on Instance uuid 04dad4e5-f5f4-422e-bde6-83ece131df6c {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:23.429214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:23.442694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-56fc7caf-766f-460e-b162-8df7674dc147 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.616771 Jul 26 04:27:23.443520 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 206/424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:22 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:23.752687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2439df6f-6b2e-4756-9c93-e91218c7887e req-6b958ee3-8497-4dbc-bad7-bfae33e3fb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c1bc30-8c55-465e-a34d-516344be45b1", "name": "network-vif-plugged", "status": "completed", "tag": "5a0bc459-204a-4215-a2a4-7ffe230cea0b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:23.771887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2439df6f-6b2e-4756-9c93-e91218c7887e req-6b958ee3-8497-4dbc-bad7-bfae33e3fb86 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.773458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2439df6f-6b2e-4756-9c93-e91218c7887e req-6b958ee3-8497-4dbc-bad7-bfae33e3fb86 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.802428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2439df6f-6b2e-4756-9c93-e91218c7887e req-6b958ee3-8497-4dbc-bad7-bfae33e3fb86 service nova] Creating event network-vif-plugged:5a0bc459-204a-4215-a2a4-7ffe230cea0b for instance c2c1bc30-8c55-465e-a34d-516344be45b1 on n-h1-848886-16 Jul 26 04:27:23.813609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2439df6f-6b2e-4756-9c93-e91218c7887e req-6b958ee3-8497-4dbc-bad7-bfae33e3fb86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063650 Jul 26 04:27:23.815759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 207/425] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:23.846065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:23.856742 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e6f9ab21-5f7a-412a-a665-4f32f6b8d2cc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1453 microversion: 2.1 time: 0.706352 Jul 26 04:27:23.862088 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 219/426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:23 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1453 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:23.887541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:23.889411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:23.916762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.923828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.925654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:23.927891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:23.998892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:23.999676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:24.008860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:27:24.013203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.016135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.021084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.022041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.331678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09cc6868-6be8-4dd2-a1e6-4312f36a9dc7 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "DELETE /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 204 len: 0 microversion: 2.1 time: 0.448448 Jul 26 04:27:24.334438 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 208/427] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:27:23 2022] DELETE /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:24.356565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:24.359189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:24.377912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.378536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.379285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.379774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.505307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:24.543174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:24.544240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:24.546107 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93ac0c66-8fb7-4699-8297-55fffe22dad7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1314 microversion: 2.25 time: 0.207622 Jul 26 04:27:24.546752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 209/428] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:24 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:24.575177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:24.575520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:24.596348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.596812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.607287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.608048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.721503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:24.723058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:24.723907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lazy-loading 'fault' on Instance uuid 04dad4e5-f5f4-422e-bde6-83ece131df6c {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:25.114052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.126519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0e5f14a-4d41-4318-89fd-d55421205ddc tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1459 microversion: 2.1 time: 0.577113 Jul 26 04:27:25.127253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 210/429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:24 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1459 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:25.141437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:25.142986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:25.158723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:25.159426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:25.160835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:25.161637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:25.458388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.467247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cf00612-d37c-4232-9a7b-9ab3d73ffc8c tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.336777 Jul 26 04:27:25.467990 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 211/430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:25 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:25.605678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.631381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4ee1cde-fcb7-436e-8a99-1a681b45715d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1475 microversion: 2.1 time: 1.622233 Jul 26 04:27:25.632323 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 220/431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:23 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1475 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:25.653037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:25.653673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:25.669046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:25.669802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:25.671698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:25.674821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:25.839084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.849948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.854519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:25.855677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da6583e3-9fe8-4cbf-8e53-fa097cbf42ce tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1320 microversion: 2.25 time: 0.220375 Jul 26 04:27:25.875696 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 221/432] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:25 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:25.985839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Calling method '.version_select at 0x7f38b604bb80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:25.986808 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:25.986808 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:25.988250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:25.988868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.022067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.022551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.035822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.036700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.049852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b1bfeba-7070-416c-b8c2-20a39f3bdbe3 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.580735 Jul 26 04:27:26.051113 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 212/433] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:26.149424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:26.150046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:26.165880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.166417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.167267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.167727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.261948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.262544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.263191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lazy-loading 'fault' on Instance uuid 04dad4e5-f5f4-422e-bde6-83ece131df6c {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:26.344412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a9b-4c8d-4678-8801-8d420ee2d592 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Calling method '.version_select at 0x7f38b60da160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:26.346582 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:26.346582 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:26.348050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2bb8a9b-4c8d-4678-8801-8d420ee2d592 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0193b0fc82b74120ac9bd4316665fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20b06e65038416782213123a6c2f7bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a9b-4c8d-4678-8801-8d420ee2d592 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Request method failure captured: Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/n-h1-848886-16/search HTTP/1.1 Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320rOebpGJDBKoHmFNfFSysa2bSbamR8xmC2iBzHKv-p0wapALMHUjivxSOZ1SwpRAgge3n4hJHhlc1PFjYzTh0XwmVQJEfPwh2pVBs6dIVwpZKMvxxSzVjlW5X8Pboe_PJlJZ4QIft6IKSGi94e9rhoH8OdReyzRCqgsle9e10jCsE Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e20b06e65038416782213123a6c2f7bb Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:26.350098 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e20b06e65038416782213123a6c2f7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e20b06e65038416782213123a6c2f7bb Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-670728106-project Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 0193b0fc82b74120ac9bd4316665fde5 Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106-project Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 04:27:26.351309 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'n-h1-848886-16'} Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:26.351968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 04:27:26.353008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.354002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a9b-4c8d-4678-8801-8d420ee2d592 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:26.354002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2bb8a9b-4c8d-4678-8801-8d420ee2d592 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-848886-16/search" status: 403 len: 117 microversion: 2.1 time: 0.294336 Jul 26 04:27:26.358537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 222/434] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Jul 26 04:27:26 2022] GET /compute/v2.1/os-hypervisors/n-h1-848886-16/search => generated 117 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:26.371160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "name": "network-vif-unplugged", "status": "completed", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:26.405407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.406530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.425055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] Creating event network-vif-unplugged:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h1-848886-16 Jul 26 04:27:26.439200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] Instance cacf3c58-8195-4b00-abed-0463d23e7774 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:27:26.474645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-774270eb-1ebc-4b0c-bc36-35e2686c39a5 req-5df337d8-a125-4f6e-9c01-1aea54717b72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106200 Jul 26 04:27:26.475643 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 223/435] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:26.486311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Calling method '.version_select at 0x7f38b61c9f70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:26.487870 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:26.487870 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:26.492733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.504679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.531777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Request method failure captured: Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320sCX7nwEY_IytxjeyzZdAQP7EPq2PlZRl6Gf8IL0SqRGyZ-rY_fYIMhZkOFu9Exc-87fBv9aLrZy9-9-kqFpMyNA7H6nl7wjteCHBUeqT3A4qqAmW3y0SoWuoBArskkhZMKO0EUwMY6UrMAsdNVAEIAfnMC9irBdSoMPerHf65qME Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 11462ca4a0a84c3b90308e0a1d80f545 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:26.538231 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 11462ca4a0a84c3b90308e0a1d80f545 Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 66bc76d752ed4a6b8a99a223b6a1c3be Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 04:27:26.539460 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:26.540455 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:26.541800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:26.541800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:26.541800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:26.541800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 04:27:26.541800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:26.544089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:26.546089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39338772-c113-42b3-bec0-0882c6e681f1 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069143 Jul 26 04:27:26.552849 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 224/436] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 04:27:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:26.559523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:26.565360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:26.586486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.590070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.592880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:26.593595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:26.967040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:26.986499 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e7420854-678e-4dc9-bd72-a055cc21d870 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1459 microversion: 2.1 time: 0.841327 Jul 26 04:27:27.001041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 213/437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:26 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1459 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:27.007049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Calling method '.version_select at 0x7f38b5fb3a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:27.015821 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:27.015821 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:27.017465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.018736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.072420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.072875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.096422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.099031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.115100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba1fdc13-01f9-4ff5-b50b-4d45fc9967ce tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.112149 Jul 26 04:27:27.115422 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 214/438] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:27.129956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:27.132039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:27.144671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:27.157546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.159929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.162067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.162755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.427376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:27.438464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cda3cdc7-fc76-4d30-974e-c4833bee6d67 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1317 microversion: 2.1 time: 0.883864 Jul 26 04:27:27.440306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 225/439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:26 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:27.452809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:27.453403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:27.476910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.477368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.478187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.479048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.660382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:27.674771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:27.676697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:27.677364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1bd32ce4-6725-4459-8c4d-f5a8bab39920 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1320 microversion: 2.25 time: 0.234632 Jul 26 04:27:27.677913 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 226/440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:27 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:27.690612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1e47255-6cbe-4d89-8721-4ec2f57b14c8 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Calling method '.version_select at 0x7f38b6087700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:27.691830 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:27.691830 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:27.695915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d1e47255-6cbe-4d89-8721-4ec2f57b14c8 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0193b0fc82b74120ac9bd4316665fde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20b06e65038416782213123a6c2f7bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1e47255-6cbe-4d89-8721-4ec2f57b14c8 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Request method failure captured: Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320rOebpGJDBKoHmFNfFSysa2bSbamR8xmC2iBzHKv-p0wapALMHUjivxSOZ1SwpRAgge3n4hJHhlc1PFjYzTh0XwmVQJEfPwh2pVBs6dIVwpZKMvxxSzVjlW5X8Pboe_PJlJZ4QIft6IKSGi94e9rhoH8OdReyzRCqgsle9e10jCsE Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e20b06e65038416782213123a6c2f7bb Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:27.699304 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20b06e65038416782213123a6c2f7bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e20b06e65038416782213123a6c2f7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e20b06e65038416782213123a6c2f7bb Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106 Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-670728106-project Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 0193b0fc82b74120ac9bd4316665fde5 Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-670728106-project Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1'} Jul 26 04:27:27.701281 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:27.702184 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 04:27:27.703663 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.705815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1e47255-6cbe-4d89-8721-4ec2f57b14c8 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:27.710575 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1e47255-6cbe-4d89-8721-4ec2f57b14c8 tempest-HypervisorAdminNegativeUnderV252Test-670728106 tempest-HypervisorAdminNegativeUnderV252Test-670728106-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029551 Jul 26 04:27:27.711141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 227/441] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:27:27 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:27.720945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Calling method '.version_select at 0x7f38b6074310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:27.727975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:27.730539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:27.764787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] HTTP exception thrown: No hypervisor matching '34f8e8ae-3041-403b-b17a-0fe48c95554e' could be found. Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Request method failure captured: Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hypervisors/34f8e8ae-3041-403b-b17a-0fe48c95554e/servers HTTP/1.1 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320sCX7nwEY_IytxjeyzZdAQP7EPq2PlZRl6Gf8IL0SqRGyZ-rY_fYIMhZkOFu9Exc-87fBv9aLrZy9-9-kqFpMyNA7H6nl7wjteCHBUeqT3A4qqAmW3y0SoWuoBArskkhZMKO0EUwMY6UrMAsdNVAEIAfnMC9irBdSoMPerHf65qME Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 11462ca4a0a84c3b90308e0a1d80f545 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:27.770085 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11462ca4a0a84c3b90308e0a1d80f545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 11462ca4a0a84c3b90308e0a1d80f545 Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229 Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 66bc76d752ed4a6b8a99a223b6a1c3be Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: exception: No hypervisor matching '34f8e8ae-3041-403b-b17a-0fe48c95554e' could be found. Jul 26 04:27:27.771308 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '34f8e8ae-3041-403b-b17a-0fe48c95554e'} Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '34f8e8ae-3041-403b-b17a-0fe48c95554e' could be found. Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.771968 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '34f8e8ae-3041-403b-b17a-0fe48c95554e' could be found. Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] Returning 404 to user: No hypervisor matching '34f8e8ae-3041-403b-b17a-0fe48c95554e' could be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91507c0f-20c3-46fa-aaa3-65b46d8cd797 tempest-HypervisorAdminNegativeUnderV252Test-103255229 tempest-HypervisorAdminNegativeUnderV252Test-103255229-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/34f8e8ae-3041-403b-b17a-0fe48c95554e/servers" status: 404 len: 123 microversion: 2.1 time: 0.055405 Jul 26 04:27:27.778320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 228/442] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 04:27:27 2022] GET /compute/v2.1/os-hypervisors/34f8e8ae-3041-403b-b17a-0fe48c95554e/servers => generated 123 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:28.005205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:28.015362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:28.015979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:28.025291 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2a4396d-a480-479f-9e43-df18e5f6f802 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1475 microversion: 2.1 time: 0.907785 Jul 26 04:27:28.025873 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 215/443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:27 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1475 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:28.042668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.043301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.044965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.049200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.122206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-09781b02-76cf-4b2b-93d4-15d6f349ba1c req-1805ab90-58e0-4242-bdf2-1ce6f2368d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dad4e5-f5f4-422e-bde6-83ece131df6c", "name": "network-vif-deleted", "tag": "913b01ca-91f9-40b7-9225-76af37ca87c8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:28.169004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.169810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-09781b02-76cf-4b2b-93d4-15d6f349ba1c req-1805ab90-58e0-4242-bdf2-1ce6f2368d5f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.173209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.173870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-09781b02-76cf-4b2b-93d4-15d6f349ba1c req-1805ab90-58e0-4242-bdf2-1ce6f2368d5f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.176413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lazy-loading 'fault' on Instance uuid 04dad4e5-f5f4-422e-bde6-83ece131df6c {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:28.206957 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-09781b02-76cf-4b2b-93d4-15d6f349ba1c req-1805ab90-58e0-4242-bdf2-1ce6f2368d5f service nova] Creating event network-vif-deleted:913b01ca-91f9-40b7-9225-76af37ca87c8 for instance 04dad4e5-f5f4-422e-bde6-83ece131df6c on n-h1-848886-16 Jul 26 04:27:28.217300 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-09781b02-76cf-4b2b-93d4-15d6f349ba1c req-1805ab90-58e0-4242-bdf2-1ce6f2368d5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104353 Jul 26 04:27:28.218210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 216/444] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:28.431567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d815a47d94a188808670c0eb29656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfeea696f0e43bc80e13588702c2cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:28.449602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4211c49c-09e6-4c0e-80a3-79b99c51fb9f tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 200 len: 1417 microversion: 2.1 time: 0.435410 Jul 26 04:27:28.471366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:28.472309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:28.478003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 229/445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:28 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 1417 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:28.493034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.493851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.494906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.495495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.533690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:28.689639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:28.720256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.720687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.761251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] Creating event network-changed:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h1-848886-16 Jul 26 04:27:28.786960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] Instance cacf3c58-8195-4b00-abed-0463d23e7774 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:27:28.827544 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1c38a74f-adfa-49d5-b66f-49eb74c20840 req-92d84c49-20d6-445a-ba9e-780e31052870 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139925 Jul 26 04:27:28.832709 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 230/446] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:28.847588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:28.849425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:28.862190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.867247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.874620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:28.875117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:28.995904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:29.010997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-760b9a11-1bee-43ea-b3c7-7f88922c4519 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1467 microversion: 2.1 time: 0.544695 Jul 26 04:27:29.012516 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 217/447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:28 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1467 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:29.033934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:29.034833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:29.041237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.042026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.043044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.043676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.078005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lazy-loading 'flavor' on Instance uuid c2c1bc30-8c55-465e-a34d-516344be45b1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:29.227892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2bee593-ad7b-4045-9128-26cbeea8b8eb tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1/action" status: 202 len: 0 microversion: 2.1 time: 0.197468 Jul 26 04:27:29.235441 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 218/448] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:27:29 2022] POST /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:27:29.254564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:29.257102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:29.274733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.277576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.278703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.279567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.367134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:29.383750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:29.389092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:29.390865 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c48701d-61c7-4de4-9f8c-26813cfaf0ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1320 microversion: 2.25 time: 0.556378 Jul 26 04:27:29.393241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 231/449] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:28 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:29.406468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:29.407713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:29.416995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.417906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.418945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.420199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.504655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:29.518772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ebdfc92-4933-4d6d-af4d-cfb4a207e94b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1475 microversion: 2.1 time: 0.281543 Jul 26 04:27:29.520121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 219/450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:29 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:29.815541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5cc3680-b292-4fdd-bbf8-b945a703c0c8 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:29.829759 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5cc3680-b292-4fdd-bbf8-b945a703c0c8 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.308335 Jul 26 04:27:29.831236 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 220/451] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:27:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:29.915230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bce10f1-fa3c-4a08-86c4-6263a50c2352 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1776044087", "ram": 512, "vcpus": 1, "disk": 10, "id": 189772645, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:29.919278 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:29.919278 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:29.942093 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2bce10f1-fa3c-4a08-86c4-6263a50c2352 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.109542 Jul 26 04:27:29.942899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 221/452] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:29 2022] POST /compute/v2.1/flavors => generated 413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:29.947136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:29.950939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:29.958296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.958752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.959741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:29.959964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:29.976095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c HTTP/1.1 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:29.980160 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:29.981501 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '04dad4e5-f5f4-422e-bde6-83ece131df6c'} Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:29.982369 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:29.983539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:29.987158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:29.989320 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31c0caa7-2051-4f5b-b30c-29b542d38b08 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 404 len: 111 microversion: 2.1 time: 0.044599 Jul 26 04:27:29.990173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 222/453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:29 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:30.121224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc2e7602-82b1-47ac-adde-08d3ce02c84e tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-751943591", "id": 1027405834, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:30.126806 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:30.126806 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:30.145000 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc2e7602-82b1-47ac-adde-08d3ce02c84e tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.153210 Jul 26 04:27:30.146283 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 223/454] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:29 2022] POST /compute/v2.1/flavors => generated 424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:30.151083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d64e0622-38f7-46ce-93c1-f0d6d888081e tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:30.154044 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:30.154044 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:30.158241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:30.169407 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8628ab8a-2868-4a43-a4ef-ccd5edb30f54 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1475 microversion: 2.1 time: 0.774260 Jul 26 04:27:30.170731 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 232/455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:29 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1475 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:30.175316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.181572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.188207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.188838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.190002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.190829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.206323 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d64e0622-38f7-46ce-93c1-f0d6d888081e tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058363 Jul 26 04:27:30.207136 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 224/456] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Jul 26 04:27:30 2022] POST /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:30.207991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c HTTP/1.1 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:30.210235 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.211688 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '04dad4e5-f5f4-422e-bde6-83ece131df6c'} Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:30.212592 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.213891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.217970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:30.218417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54f20bc2-3581-4d67-af64-955d1d3bc8d4 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.219177 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa13a697-eb6f-4c97-b200-598b0aed4b23 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "DELETE /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 404 len: 111 microversion: 2.1 time: 0.047359 Jul 26 04:27:30.219869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 233/457] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:27:30 2022] DELETE /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:30.231883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54f20bc2-3581-4d67-af64-955d1d3bc8d4 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017852 Jul 26 04:27:30.233036 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 225/458] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:30.244675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.245741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 04dad4e5-f5f4-422e-bde6-83ece131df6c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.256361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.257281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.257615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.258049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.274475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c HTTP/1.1 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:30.276047 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.277926 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '04dad4e5-f5f4-422e-bde6-83ece131df6c'} Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:30.279986 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. Jul 26 04:27:30.281159 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.282318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 04dad4e5-f5f4-422e-bde6-83ece131df6c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:30.282318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-233534df-fecf-4578-b381-f9f4044d99fd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c" status: 404 len: 111 microversion: 2.1 time: 0.039300 Jul 26 04:27:30.282318 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 226/459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/servers/04dad4e5-f5f4-422e-bde6-83ece131df6c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:30.283984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5b0ff4fb-7a2d-4552-a77c-39cf32f0ab69 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1494507250", "id": 1004109337, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:30.287623 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:30.287623 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:30.307913 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5b0ff4fb-7a2d-4552-a77c-39cf32f0ab69 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.027415 Jul 26 04:27:30.316872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 227/460] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:30.322739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.323300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.330250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.330702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.331488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.331927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.347933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 HTTP/1.1 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:30.349605 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.351040 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '19344318-082c-4dd7-8de9-087e6094e9b2'} Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:30.351759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.353505 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.354609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:30.354609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47c14309-16ad-4081-ba4c-4cc0cc8fd4cd tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "DELETE /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 404 len: 111 microversion: 2.1 time: 0.033214 Jul 26 04:27:30.354609 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 228/461] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:27:30 2022] DELETE /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:30.356476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92de8717-c1bd-4719-a9fe-631ed5b7a455 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.394338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92de8717-c1bd-4719-a9fe-631ed5b7a455 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041503 Jul 26 04:27:30.395701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 229/462] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:30.426049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.427006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] [instance: 19344318-082c-4dd7-8de9-087e6094e9b2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.436260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0b4f8461-3a1a-41ad-a1de-221d9c9b8eed tempest-FlavorsExtraSpecsTestJSON-2088394244 tempest-FlavorsExtraSpecsTestJSON-2088394244-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.448872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.449333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.450536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.451013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.455103 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0b4f8461-3a1a-41ad-a1de-221d9c9b8eed tempest-FlavorsExtraSpecsTestJSON-2088394244 tempest-FlavorsExtraSpecsTestJSON-2088394244-project] 10.222.0.43 "GET /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.233989 Jul 26 04:27:30.456654 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 234/463] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:30.464109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4bb30599-3f46-4d7b-9a46-80a1b8de5144 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Action: 'create', calling method: .version_select at 0x7f38b6087790>, body: {"keypair": {"name": "tempest-keypair-2136406778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASH6gmCUT3uxOd31I5q/hXedUM2TmXmgqjRRbP07LTEIYYeezKi4AiNrUBYnbqCXdsDVk6a/cygbFA083O12uLlJP61cllv8GAWuLPANHMo3JNQH93G18Xe2WOo4kMWfA=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:30.472859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:30.480945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] HTTP exception thrown: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.485278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=13 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Request method failure captured: Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 HTTP/1.1 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zwoRQmoci1Qae77nFF2aNpykoc5KEPqJ0ZulZd3gSZnFMTtRFM6TIbBLvLh-YevU0cikSXnHJo1vgXZHECy6VQDGatF-yv3ORVLuLuK-hz9uuaS0-G_ujPW1Bg5v83moELqFJMFRyFPKNJWT36qMJhMXAp9Jlbp3WrTuwWK7-aYdQ Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:30.486682 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bfeea696f0e43bc80e13588702c2cb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bfeea696f0e43bc80e13588702c2cb2 Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2132467852 Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: ed6d815a47d94a188808670c0eb29656 Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersAdminTestJSON-2132467852-project Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.487977 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '19344318-082c-4dd7-8de9-087e6094e9b2'} Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:30.488659 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. Jul 26 04:27:30.490920 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:30.492408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] Returning 404 to user: Instance 19344318-082c-4dd7-8de9-087e6094e9b2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:30.492549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4bb30599-3f46-4d7b-9a46-80a1b8de5144 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:30.492694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1176ce2a-b08b-41d4-a53d-cc20251cb194 tempest-DeleteServersAdminTestJSON-2132467852 tempest-DeleteServersAdminTestJSON-2132467852-project] 10.222.0.43 "GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2" status: 404 len: 111 microversion: 2.1 time: 0.091222 Jul 26 04:27:30.496210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4bb30599-3f46-4d7b-9a46-80a1b8de5144 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for user 1d778337f6d54635ad8c536069f671f0 and project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:30.498854 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 230/464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/servers/19344318-082c-4dd7-8de9-087e6094e9b2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:30.510530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.511152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.533636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4bb30599-3f46-4d7b-9a46-80a1b8de5144 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074598 Jul 26 04:27:30.535904 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 235/465] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:27:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:30.541398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c2fd836-2ae6-4bd6-a364-003c07803585 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:30.545767 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:30.545767 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:30.548077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.548541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.549337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.549775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.609828 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c2fd836-2ae6-4bd6-a364-003c07803585 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072641 Jul 26 04:27:30.611113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 236/466] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Jul 26 04:27:30 2022] POST /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:30.617921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:30.618991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:30.629220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.630368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:30.631510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:30.632104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:31.048474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:31.081640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:31.090465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:31.097560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e1f50861-be50-4eda-91d5-c45a1d047220 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.595786 Jul 26 04:27:31.098167 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 231/467] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:31.108028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531eea1f-cc49-46dc-a2a9-a01ae6faaf88 tempest-FlavorsExtraSpecsTestJSON-2088394244 tempest-FlavorsExtraSpecsTestJSON-2088394244-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.147968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-531eea1f-cc49-46dc-a2a9-a01ae6faaf88 tempest-FlavorsExtraSpecsTestJSON-2088394244 tempest-FlavorsExtraSpecsTestJSON-2088394244-project] 10.222.0.43 "GET /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044436 Jul 26 04:27:31.157027 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 232/468] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.182912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee0c89da-1394-497f-a876-f5966e69736c tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:31.189015 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:31.189015 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:31.255560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee0c89da-1394-497f-a876-f5966e69736c tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094022 Jul 26 04:27:31.256175 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 233/469] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Jul 26 04:27:31 2022] POST /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.274811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.277863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:31.298204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:31.299604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:31.303035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:31.305277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:31.472735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:31.488901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3ebb3b4-bd2f-40ac-b77e-b9e03f1a6c65 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1475 microversion: 2.1 time: 0.875702 Jul 26 04:27:31.491964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 237/470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:30 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1475 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:31.511070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe24340d-59dd-490c-a0b2-6d9036f6cc15 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.533546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe24340d-59dd-490c-a0b2-6d9036f6cc15 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038677 Jul 26 04:27:31.540304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 238/471] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.548076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0317dc1-129a-4fe7-a64d-092256c152f6 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:31.552380 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:31.552380 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:31.596862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0317dc1-129a-4fe7-a64d-092256c152f6 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.054837 Jul 26 04:27:31.601720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 239/472] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:27:31 2022] PUT /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes => generated 22 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.608690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3aad2273-36a2-454f-89d3-4c274fa59bb6 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.619807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3aad2273-36a2-454f-89d3-4c274fa59bb6 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016691 Jul 26 04:27:31.620577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 240/473] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/flavors/189772645/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.634063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43504159-3bc3-4baa-a60c-352bef77a983 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.635044 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:31.635044 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:31.682227 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43504159-3bc3-4baa-a60c-352bef77a983 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.052844 Jul 26 04:27:31.687846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 241/474] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:27:31 2022] DELETE /compute/v2.1/flavors/189772645/os-extra_specs/hw:numa_nodes => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:31.695913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c29ed07f-706b-4434-a776-3dfb995bca4b tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.725245 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c29ed07f-706b-4434-a776-3dfb995bca4b tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/189772645/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.034652 Jul 26 04:27:31.730075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 242/475] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:27:31 2022] DELETE /compute/v2.1/flavors/189772645/os-extra_specs/hw:cpu_policy => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:27:31.743278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3362cef3-2d86-4174-846a-58c0071e6702 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.765218 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3362cef3-2d86-4174-846a-58c0071e6702 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/189772645/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021469 Jul 26 04:27:31.766484 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 243/476] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/flavors/189772645/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:27:31.777303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86829ee5-6441-4b14-92e9-672f05f513d2 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.779002 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:31.779002 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:31.810272 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86829ee5-6441-4b14-92e9-672f05f513d2 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/189772645" status: 202 len: 0 microversion: 2.1 time: 0.037221 Jul 26 04:27:31.811220 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 244/477] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:27:31 2022] DELETE /compute/v2.1/flavors/189772645 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:27:31.822127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b25effc-47a7-4c72-bbf7-95877a1658c4 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:31.858856 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b25effc-47a7-4c72-bbf7-95877a1658c4 tempest-FlavorsExtraSpecsTestJSON-1300842880 tempest-FlavorsExtraSpecsTestJSON-1300842880-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041343 Jul 26 04:27:31.860098 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 245/478] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:32.083331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:32.093507 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce997bc6-fe6b-4eea-86d0-e64da37cf855 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1458 microversion: 2.1 time: 0.828608 Jul 26 04:27:32.094088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 234/479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:31 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1458 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:32.114610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:32.115361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:32.125644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:32.132050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:32.136973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.137569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:32.141343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.144755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:32.158514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.159662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:32.160691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.161370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:32.402771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:32.457564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=20 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:32.596981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:32.612050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:32.618540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:32.620055 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62526bcc-6317-4ef7-bea2-43f5573deac4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.498724 Jul 26 04:27:32.624054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 235/480] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:32 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:32.631480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:32.633605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:32.650808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.651855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:32.652877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:32.658885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:33.277879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:33.293509 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-adb7b355-43e1-4f75-a9f9-148084284ee8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1473 microversion: 2.1 time: 0.668134 Jul 26 04:27:33.295538 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 236/481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:32 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1473 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:33.314070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-29730835-8dd7-4b43-86d7-73b9ee9a3c51 req-3629f2d7-3d0e-4246-878b-357bdd272754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:33.344531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29730835-8dd7-4b43-86d7-73b9ee9a3c51 req-3629f2d7-3d0e-4246-878b-357bdd272754 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:33.345634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29730835-8dd7-4b43-86d7-73b9ee9a3c51 req-3629f2d7-3d0e-4246-878b-357bdd272754 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:33.408649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-29730835-8dd7-4b43-86d7-73b9ee9a3c51 req-3629f2d7-3d0e-4246-878b-357bdd272754 service nova] Creating event network-changed:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h2-848886-16 Jul 26 04:27:33.420478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-29730835-8dd7-4b43-86d7-73b9ee9a3c51 req-3629f2d7-3d0e-4246-878b-357bdd272754 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121132 Jul 26 04:27:33.424739 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 237/482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:33.655571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:33.657424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:33.666744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:33.667585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:33.668888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:33.670730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:33.999272 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b2e6a6f-f71e-4dfa-a5cc-bef0022da09c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1611 microversion: 2.1 time: 1.889147 Jul 26 04:27:34.010741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 246/483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:32 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1611 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:34.041941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:34.046527 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:34.046527 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:34.047870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.048328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.049136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.049564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.134344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69694034-44a6-4c78-bf20-7cec78e775a1 tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.106519 Jul 26 04:27:34.148600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 247/484] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:27:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:34.155369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-16", "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:34.157697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:34.182439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.184103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.185105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.191166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.241964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:34.251141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Lazy-loading 'flavor' on Instance uuid c2c1bc30-8c55-465e-a34d-516344be45b1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:34.257270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:34.271591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:34.280204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:34.281975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c2c1bc30-8c55-465e-a34d-516344be45b1 while it is in vm_state suspended Jul 26 04:27:34.284751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d313e61f-528b-455b-bba7-4e9679ae942d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.641686 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Request method failure captured: Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1/action HTTP/1.1 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 98 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32z3KY_PWYyBzOC2gYFr5XElXIEA2VzYpPb0abj1on_lnuCLlvIPEo7aJqhbOQT4GBnvmq8_85jzfygIJWIqIZK8eERljcIgQELkeKd6LYbNixj_4uVxCfPCVeTV4tcF-AYKyoJFZy2xLJFnh4_Jcj7GwDDHp_kUoIOGdWAIWKU330s Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e2840fc0a97a46b1a3a231763bf5b60f Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:27:34.285698 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2840fc0a97a46b1a3a231763bf5b60f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e2840fc0a97a46b1a3a231763bf5b60f Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-529126328 Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-LiveMigrationNegativeTest-529126328-project-admin Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a5f6f4675ffe4b82b9a8765e643f2d23 Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-LiveMigrationNegativeTest-529126328-project-admin Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: {"os-migrateLive": {"host": "n-h2-848886-16", "block_migration": true, "disk_over_commit": false}} Jul 26 04:27:34.287115 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'os-migrateLive' instance c2c1bc30-8c55-465e-a34d-516344be45b1 while it is in vm_state suspended Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c2c1bc30-8c55-465e-a34d-516344be45b1', 'body': {'os-migrateLive': {'host': 'n-h2-848886-16', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 04:27:34.287909 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:34.289066 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c2c1bc30-8c55-465e-a34d-516344be45b1 while it is in vm_state suspended Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c2c1bc30-8c55-465e-a34d-516344be45b1 while it is in vm_state suspended Jul 26 04:27:34.290337 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:34.291341 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 238/485] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:33 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:34.293866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c2c1bc30-8c55-465e-a34d-516344be45b1 while it is in vm_state suspended {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:34.299159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81dbc638-2b94-43f9-b98e-422ac659a32c tempest-LiveMigrationNegativeTest-529126328 tempest-LiveMigrationNegativeTest-529126328-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1/action" status: 409 len: 155 microversion: 2.1 time: 0.148901 Jul 26 04:27:34.307346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 248/486] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:27:34 2022] POST /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1/action => generated 155 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:27:34.314800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:34.315932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:34.319202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:34.321175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:34.328940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.329422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.332946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.334058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.341391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.342504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.343285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.343728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.397059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:27:34.565055 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2029d38c-aada-46aa-8d65-3b87d6b22956 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 204 len: 0 microversion: 2.1 time: 0.256633 Jul 26 04:27:34.566039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 239/487] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:27:34 2022] DELETE /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:27:34.577248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:34.580945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:34.595675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.599532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.600603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:34.601270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:34.936238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:34.957295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e0b0d212-272b-4015-8258-0100ea4addbe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1470 microversion: 2.1 time: 0.643362 Jul 26 04:27:34.958454 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 249/488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:34 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1470 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:34.990111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:34.990492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:34.991351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:35.002420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80ec2050-717e-4c73-87d2-608731978c5e tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1464 microversion: 2.1 time: 0.431474 Jul 26 04:27:35.003030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 240/489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:34 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1464 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:35.010979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.010979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.010979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.016842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.227485 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-83e4cc4a-e3eb-4159-b340-e16769dc4e90 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774/action" status: 204 len: 0 microversion: 2.1 time: 0.249306 Jul 26 04:27:35.233332 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 250/490] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:27:34 2022] POST /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774/action => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:35.245935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:35.246595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:35.281325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.283779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.284777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.285351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.311520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:35.312173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:35.341382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.342743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.344947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:35.346098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:35.963429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:35.982516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:35.989287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:36.003645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:36.024534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1ffd02a-4735-4b8e-9fcc-8a7734180e94 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.687346 Jul 26 04:27:36.026931 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 251/491] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:35 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:27:36.032146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-70533e9a-fd97-4085-9dc6-f8804296d9dd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1470 microversion: 2.1 time: 0.793644 Jul 26 04:27:36.033496 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 241/492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:35 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1470 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:36.036262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:36.036875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:36.047203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:36.047855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:36.048773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:36.049384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:36.193725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-586491566", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "1004109337", "adminPass": "***", "networks": [{"uuid": "d6f6af0b-7c9d-4cd4-9267-6637611ab27e"}], "security_groups": [{"name": "tempest-securitygroup--1979498527"}], "key_name": "tempest-keypair-2136406778", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:36.693727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:36.708898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af44ba38-0cf4-41bb-bcb5-bfeaa7365959 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 200 len: 1464 microversion: 2.1 time: 0.678841 Jul 26 04:27:36.721867 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 252/493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:36 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 1464 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:37.079853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] validate_networks() for [('d6f6af0b-7c9d-4cd4-9267-6637611ab27e', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:37.413328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Action: 'update', calling method: .version_select at 0x7f38b60f3e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:37.632681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:37.633153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:37.633982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:37.634452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:37.805184 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5a1299d-66ce-4d01-9cd5-5cc73b8cf6bc tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122" status: 200 len: 240 microversion: 2.36 time: 1.092445 Jul 26 04:27:37.812885 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 253/494] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Jul 26 04:27:36 2022] PUT /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122 => generated 240 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:37.817980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:37.823212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:37.841147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:37.841799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:37.842782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:37.843368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.001411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:38.001988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:38.002521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:38.002936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:38.003337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:38.043285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.043931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.050622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.052446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.133201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:38.145127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for user 1d778337f6d54635ad8c536069f671f0 and project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:38.190912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:38.201507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:38.241621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:38.335422 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aca738d7-2b5b-45da-bd84-d5a29f6123da tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.145555 Jul 26 04:27:38.338389 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 242/495] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:27:38.351198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:38.353935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:38.403006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.404926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.407377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.409961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.646865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:38.660274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:38.663821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:38.665490 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0beed540-baea-4b39-9c33-22be18842c6b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.851267 Jul 26 04:27:38.667380 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 254/496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:37 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:38.687258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:38.689693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:38.698963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e03da3f6-352f-4a9a-b73f-c90f4886f8d4 req-071442e5-c77c-49e4-aa53-9792ab26ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c1bc30-8c55-465e-a34d-516344be45b1", "name": "network-vif-deleted", "tag": "5a0bc459-204a-4215-a2a4-7ffe230cea0b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:38.701847 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ac34de33-d2a2-46f0-8276-b00270f077ba tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1470 microversion: 2.1 time: 0.359304 Jul 26 04:27:38.703924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 243/497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:38 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:38.732289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:38.732947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: c2c1bc30-8c55-465e-a34d-516344be45b1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:38.746361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e03da3f6-352f-4a9a-b73f-c90f4886f8d4 req-071442e5-c77c-49e4-aa53-9792ab26ce83 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.748586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.749025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.749386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e03da3f6-352f-4a9a-b73f-c90f4886f8d4 req-071442e5-c77c-49e4-aa53-9792ab26ce83 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.751029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.751820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.769885 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e03da3f6-352f-4a9a-b73f-c90f4886f8d4 req-071442e5-c77c-49e4-aa53-9792ab26ce83 service nova] Creating event network-vif-deleted:5a0bc459-204a-4215-a2a4-7ffe230cea0b for instance c2c1bc30-8c55-465e-a34d-516344be45b1 on n-h1-848886-16 Jul 26 04:27:38.780321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e03da3f6-352f-4a9a-b73f-c90f4886f8d4 req-071442e5-c77c-49e4-aa53-9792ab26ce83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111329 Jul 26 04:27:38.780919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 255/498] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:38.786824 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] HTTP exception thrown: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Request method failure captured: Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 HTTP/1.1 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32z1_hNnxlojKq37I1H95H4B9dUYKnXq6Q3YQy5YaD0a2K-uFudwvGUo3nij1Au9M5QnlvKoiCVA3ATaufRn2T2tjkr5g7zfa2DSz0BQBXbAAok7UVHTQhRwNEeRshWbY27Vy7hLJQIwV_k3JJ5dxV4Lrt-0y2laytNf-Qjy-eXzuY8 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 76d8ba503d2e4944ab2f3d22e71c6b50 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:38.788700 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 76d8ba503d2e4944ab2f3d22e71c6b50 Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveMigrationNegativeTest-1251070373-project Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: fb9899adb0034b94889d1b40d6ceaea1 Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveMigrationNegativeTest-1251070373-project Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. Jul 26 04:27:38.790033 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c2c1bc30-8c55-465e-a34d-516344be45b1'} Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:38.790849 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. Jul 26 04:27:38.791993 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:38.793035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Calling method '.version_select at 0x7f38b60748b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:38.795793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Returning 404 to user: Instance c2c1bc30-8c55-465e-a34d-516344be45b1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:38.797352 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8c7c98b5-b3aa-4f1e-b539-6d06dc8891e1 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1" status: 404 len: 111 microversion: 2.1 time: 0.092157 Jul 26 04:27:38.798528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 244/499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:38 2022] GET /compute/v2.1/servers/c2c1bc30-8c55-465e-a34d-516344be45b1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:38.805576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "name": "network-vif-plugged", "status": "completed", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:38.820638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:38.821308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:38.839244 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] Creating event network-vif-plugged:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h1-848886-16 Jul 26 04:27:38.856416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] Instance cacf3c58-8195-4b00-abed-0463d23e7774 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:27:38.873006 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a16eaae0-e8d1-4c6a-b9f5-528465458fe0 req-0047776a-00c0-40be-b93a-1ecba6190ecf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072555 Jul 26 04:27:38.873845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 245/500] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:38.879628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d55a9754-f9af-4b1b-a353-c00ff482f21d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:38.880423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d55a9754-f9af-4b1b-a353-c00ff482f21d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:38.977220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d55a9754-f9af-4b1b-a353-c00ff482f21d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:38.989904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d55a9754-f9af-4b1b-a353-c00ff482f21d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1264 microversion: 2.1 time: 0.114736 Jul 26 04:27:38.991749 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 246/501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:38 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1264 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:39.006939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:39.007807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:39.021735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.024772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.028055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.030118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.084040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:27:39.172982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=2,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:39.183602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.188588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.190114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.190823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.218878 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-230f44b4-55f9-480c-9976-96bcc7c63a99 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122/detail" status: 200 len: 672 microversion: 2.36 time: 0.436763 Jul 26 04:27:39.229293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 256/502] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Jul 26 04:27:38 2022] GET /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122/detail => generated 672 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:39.271865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5ae0da0-75ac-49f3-b953-a555c0c65bf3 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 204 len: 0 microversion: 2.1 time: 0.276909 Jul 26 04:27:39.273567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 247/503] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:27:38 2022] DELETE /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:39.288308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:39.288308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:39.309594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.313574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.314978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.315577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.523312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:39.536601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6440f78f-2dfe-453a-a289-433866d5e712 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1474 microversion: 2.1 time: 0.258383 Jul 26 04:27:39.537093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 257/504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:39 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1474 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:39.694988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:39.698129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:39.708320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.709741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.711103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.711734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.902103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:39.914799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:39.916639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:39.920376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43928112-d0e7-4c3a-8014-31699d9b8322 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.230384 Jul 26 04:27:39.922129 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 258/505] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:39 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:39.927066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:39.928108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:39.935486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.936825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:39.938416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:39.939258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.082949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ac0bbc3-8479-4509-8677-e6cc56b44cf4 tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-352445175", "id": 597473154, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:40.087773 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:40.087773 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:40.137398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ac0bbc3-8479-4509-8677-e6cc56b44cf4 tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.466944 Jul 26 04:27:40.139391 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 248/506] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:27:39 2022] POST /compute/v2.1/flavors => generated 467 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:40.145000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:40.146748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:40.158861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.161672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.165230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.167761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.169600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:40.181254 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-694e08da-feff-4879-8093-125f19d39811 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1470 microversion: 2.1 time: 0.254989 Jul 26 04:27:40.182445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 259/507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:39 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:40.189023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14267217-0052-48f6-8a9f-5d9fa9ea0c6b tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:40.192071 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:40.192071 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:40.304024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:40.314653 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd3d3011-4dec-4d6e-9583-342e713fbfa3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1334 microversion: 2.1 time: 0.173866 Jul 26 04:27:40.321066 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 249/508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:40 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:40.328863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f8d550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:40.460986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14267217-0052-48f6-8a9f-5d9fa9ea0c6b tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/597473154/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.277085 Jul 26 04:27:40.462113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 260/509] 10.222.0.43 () {62 vars in 1262 bytes} [Tue Jul 26 04:27:40 2022] POST /compute/v2.1/flavors/597473154/os-extra_specs => generated 62 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:40.629028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.629503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.630366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.630807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.740867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.741552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.742424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.742869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.866898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Calling method '.version_select at 0x7f38b6163a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:40.867750 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:40.867750 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:40.869221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.870409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.892754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.893501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.907111 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b238012-7405-4e1c-bf89-72e6bed29476 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122?user_id=f5c0ad7cc7dd4be4a96808167e87e3e7" status: 200 len: 240 microversion: 2.36 time: 0.584139 Jul 26 04:27:40.915685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 250/510] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Jul 26 04:27:40 2022] PUT /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122?user_id=f5c0ad7cc7dd4be4a96808167e87e3e7 => generated 240 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:40.921706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f1e48f0-0910-432a-9c78-99fba310e3ed tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:40.922637 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:40.922637 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:40.923144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.923757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.931508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60a8775e-dd4e-4a4c-a3e5-e9dad5e9e59c tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.467966 Jul 26 04:27:40.932630 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 261/511] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:40.938420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:40.939242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:40.947284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.948287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.949769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:40.951458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:40.963876 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f1e48f0-0910-432a-9c78-99fba310e3ed tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/597473154" status: 202 len: 0 microversion: 2.86 time: 0.051132 Jul 26 04:27:40.964814 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 251/512] 10.222.0.43 () {60 vars in 1199 bytes} [Tue Jul 26 04:27:40 2022] DELETE /compute/v2.1/flavors/597473154 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:40.973877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-82ba4bd7-aaad-4bc7-971e-cffc86d1c924 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] Calling method '.version_select at 0x7f38b604bc10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:41.209701 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-82ba4bd7-aaad-4bc7-971e-cffc86d1c924 tempest-QuotasAdminTestV236-1876206727 tempest-QuotasAdminTestV236-1876206727-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122?user_id=f5c0ad7cc7dd4be4a96808167e87e3e7" status: 200 len: 282 microversion: 2.36 time: 0.243281 Jul 26 04:27:41.211281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 252/513] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Jul 26 04:27:40 2022] GET /compute/v2.1/os-quota-sets/ae042e6f6b3a4c69a74cd9d9a8738122?user_id=f5c0ad7cc7dd4be4a96808167e87e3e7 => generated 282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:41.215778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Calling method '.version_select at 0x7f38b5f57550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:41.224384 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:41.224384 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:41.226887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.227558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.276041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.286953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.339532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.340183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.361005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-547fdc60-92d4-431a-8481-f03cb9d913d0 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-848886-16/servers" status: 200 len: 355 microversion: 2.1 time: 0.148628 Jul 26 04:27:41.361582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 253/514] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Jul 26 04:27:41 2022] GET /compute/v2.1/os-hypervisors/n-h1-848886-16/servers => generated 355 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:41.370031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:41.370929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:41.387147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.388995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.390443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.392368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.534025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:41.543664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c6793c7-1e04-409d-8453-328c8d130964 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1474 microversion: 2.1 time: 0.609813 Jul 26 04:27:41.545752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 262/515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:40 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1474 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:41.566055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9f948d2-d3e5-4c4b-b57a-4f2be09c66ea tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:41.597734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9f948d2-d3e5-4c4b-b57a-4f2be09c66ea tempest-FlavorMetadataValidation-1578477852 tempest-FlavorMetadataValidation-1578477852-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.036583 Jul 26 04:27:41.599820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 263/516] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:27:41 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:41.605281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:41.606309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:41.613187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.613904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.630727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:41.633942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:41.949713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:41.987876 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4768709b-0217-44a6-9257-9f0496416b08 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1470 microversion: 2.1 time: 0.384257 Jul 26 04:27:41.990473 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 264/517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:41 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:42.000234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:42.002402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:42.017403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.018216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.019415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:42.019877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.020475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.046289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:42.051112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:42.056688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a99d622-5be5-406f-a0fa-8c872723df23 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.688304 Jul 26 04:27:42.073265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 254/518] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:41 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:42.075019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Calling method '.version_select at 0x7f38b5f579d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:42.078255 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:42.078255 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:42.079741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.081730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.127912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.128519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.161907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.164921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.184840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb164239-1800-4e2a-8d33-51e714781986 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.124800 Jul 26 04:27:42.186223 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 255/519] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:27:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:42.198632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Calling method '.version_select at 0x7f38b5f575e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:42.198632 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:42.198632 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:42.198632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.199198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:42.202318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.212446 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-339a9dd3-b845-4151-b05b-c9225cd92255 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1322 microversion: 2.1 time: 0.219440 Jul 26 04:27:42.229321 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 265/520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:41 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:42.232970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.233439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.249570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26c44428-f7b1-4136-8748-2756db5308d1 tempest-HypervisorAdminUnderV252Test-1729829767 tempest-HypervisorAdminUnderV252Test-1729829767-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-848886-16/search" status: 200 len: 105 microversion: 2.1 time: 0.057447 Jul 26 04:27:42.250612 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 256/521] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Jul 26 04:27:42 2022] GET /compute/v2.1/os-hypervisors/n-h1-848886-16/search => generated 105 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:27:42.568358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:42.569883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:42.585082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.585711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:42.587530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:42.588272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.015452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:43.017363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:43.024282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9899adb0034b94889d1b40d6ceaea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d8ba503d2e4944ab2f3d22e71c6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:43.034213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.038768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.040034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.041637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.060981 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4b61980-a77d-4156-a2b2-30342fc6ca55 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 200 len: 1474 microversion: 2.1 time: 0.497424 Jul 26 04:27:43.066953 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 266/522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:42 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 1474 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:43.089121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:43.090313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:43.143541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.144002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.144821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.145253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.606761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:43.626833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4bf59a2-40e8-4e4d-994d-b80dcd9b9f7a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1462 microversion: 2.1 time: 0.617439 Jul 26 04:27:43.631698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 257/523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:43 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1462 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:43.659511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:43.660471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:43.675376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.679593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:43.685718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:43.686293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.440602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:44.463079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-203597af-ce44-4701-b5d1-529f088ebc58 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.829688 Jul 26 04:27:44.465000 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 258/524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:43 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:44.477063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f9a1913f-0f08-44de-9458-a8bddadbebd7 req-f449611c-5fb2-46c0-a8ae-b02705130123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290fa8d5-cc6c-4215-9cdd-ed3d815c30fc", "name": "network-vif-deleted", "tag": "b7c34f7d-b562-41e8-bb05-2c2fffe0bde2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:44.491933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:44.499119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:44.512746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:44.518813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:44.528054 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46e56cf3-32e3-4113-984d-917d46149936 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 1.446698 Jul 26 04:27:44.528432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f9a1913f-0f08-44de-9458-a8bddadbebd7 req-f449611c-5fb2-46c0-a8ae-b02705130123 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.529719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f9a1913f-0f08-44de-9458-a8bddadbebd7 req-f449611c-5fb2-46c0-a8ae-b02705130123 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.530575 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 267/525] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:43 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:44.552520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:44.568158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:44.569626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f9a1913f-0f08-44de-9458-a8bddadbebd7 req-f449611c-5fb2-46c0-a8ae-b02705130123 service nova] Creating event network-vif-deleted:b7c34f7d-b562-41e8-bb05-2c2fffe0bde2 for instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc on n-h2-848886-16 Jul 26 04:27:44.584328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.585420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.589616 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f9a1913f-0f08-44de-9458-a8bddadbebd7 req-f449611c-5fb2-46c0-a8ae-b02705130123 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121500 Jul 26 04:27:44.590575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.591871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.593734 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 259/526] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:44.609192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:44.612687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] [instance: 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:44.647024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.665129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.667823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.670234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.722540 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] HTTP exception thrown: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Request method failure captured: Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc HTTP/1.1 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32z1_hNnxlojKq37I1H95H4B9dUYKnXq6Q3YQy5YaD0a2K-uFudwvGUo3nij1Au9M5QnlvKoiCVA3ATaufRn2T2tjkr5g7zfa2DSz0BQBXbAAok7UVHTQhRwNEeRshWbY27Vy7hLJQIwV_k3JJ5dxV4Lrt-0y2laytNf-Qjy-eXzuY8 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 76d8ba503d2e4944ab2f3d22e71c6b50 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:27:44.727213 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76d8ba503d2e4944ab2f3d22e71c6b50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 76d8ba503d2e4944ab2f3d22e71c6b50 Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1251070373 Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveMigrationNegativeTest-1251070373-project Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: fb9899adb0034b94889d1b40d6ceaea1 Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveMigrationNegativeTest-1251070373-project Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. Jul 26 04:27:44.728596 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '290fa8d5-cc6c-4215-9cdd-ed3d815c30fc'} Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:44.729417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. Jul 26 04:27:44.730712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:27:44.735004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] Returning 404 to user: Instance 290fa8d5-cc6c-4215-9cdd-ed3d815c30fc could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:44.736056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c4b289a-7bbd-4d63-86f7-9d9a8e6c1074 tempest-LiveMigrationNegativeTest-1251070373 tempest-LiveMigrationNegativeTest-1251070373-project] 10.222.0.43 "GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc" status: 404 len: 111 microversion: 2.1 time: 0.140300 Jul 26 04:27:44.737092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 260/527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:44 2022] GET /compute/v2.1/servers/290fa8d5-cc6c-4215-9cdd-ed3d815c30fc => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:44.742667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-002647a0-fb7e-4bab-8b31-fdc3a1b19fda req-a52a0a44-5ef4-4ddf-a427-185a23f96c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "name": "network-vif-plugged", "status": "completed", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:44.778265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-002647a0-fb7e-4bab-8b31-fdc3a1b19fda req-a52a0a44-5ef4-4ddf-a427-185a23f96c79 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:44.790456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-002647a0-fb7e-4bab-8b31-fdc3a1b19fda req-a52a0a44-5ef4-4ddf-a427-185a23f96c79 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:44.835866 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-002647a0-fb7e-4bab-8b31-fdc3a1b19fda req-a52a0a44-5ef4-4ddf-a427-185a23f96c79 service nova] Creating event network-vif-plugged:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h2-848886-16 Jul 26 04:27:44.854317 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-002647a0-fb7e-4bab-8b31-fdc3a1b19fda req-a52a0a44-5ef4-4ddf-a427-185a23f96c79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115716 Jul 26 04:27:44.855424 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 261/528] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:45.254652 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97b943db-6f9e-4900-9fa1-6cab56c917d0 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1615 microversion: 2.1 time: 0.709679 Jul 26 04:27:45.277053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 268/529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:44 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1615 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:45.297989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69a8bb88-9888-49df-9753-99f47e3ef3f6 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '.version_select at 0x7f38b5ee8c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:45.303023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69a8bb88-9888-49df-9753-99f47e3ef3f6 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:45.303764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69a8bb88-9888-49df-9753-99f47e3ef3f6 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:45.327300 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69a8bb88-9888-49df-9753-99f47e3ef3f6 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.043561 Jul 26 04:27:45.330358 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 262/530] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:27:45 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:45.488426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:45.489505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:45.506252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:45.506797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:45.509197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:45.510892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:45.561506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:45.562555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:45.585828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:45.588491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:45.591701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:45.592400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:45.848408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:45.865731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72a804e3-f167-4548-85a5-2eb70262ce95 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.381477 Jul 26 04:27:45.867136 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 269/531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:45 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:46.071134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-393023253", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:46.357332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:46.515315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:46.533577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:46.535665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:46.537113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c8d846f-73ed-474f-9574-cf8db63265b7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.982335 Jul 26 04:27:46.537670 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 263/532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:45 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:46.676286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bf8294fb-6b8c-4a95-b45f-183586bfb84f req-e1588f75-db7f-4eb7-93d0-b1dee02ead1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef59c1b4-b601-40f3-89d4-f23378e0c742", "tag": "a2048730-3a02-4a47-a623-6c1e42b46980"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:46.695043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bf8294fb-6b8c-4a95-b45f-183586bfb84f req-e1588f75-db7f-4eb7-93d0-b1dee02ead1e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:46.695484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bf8294fb-6b8c-4a95-b45f-183586bfb84f req-e1588f75-db7f-4eb7-93d0-b1dee02ead1e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:46.725066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bf8294fb-6b8c-4a95-b45f-183586bfb84f req-e1588f75-db7f-4eb7-93d0-b1dee02ead1e service nova] Creating event network-changed:a2048730-3a02-4a47-a623-6c1e42b46980 for instance ef59c1b4-b601-40f3-89d4-f23378e0c742 on n-h1-848886-16 Jul 26 04:27:46.734892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bf8294fb-6b8c-4a95-b45f-183586bfb84f req-e1588f75-db7f-4eb7-93d0-b1dee02ead1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070954 Jul 26 04:27:46.736065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 264/533] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:46.888717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:46.889752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:46.900511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:46.903025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:46.905000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:46.910440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:46.952871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:46.955247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:46.956256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:46.956922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:46.960009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:46.987672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:46.990656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:46.993859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:46.995670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:47.072720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:47.085640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:47.125457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:47.134820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:47.277548 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-928ae794-883d-44e7-a338-4a20e16289f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217115 Jul 26 04:27:47.289506 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 270/534] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:27:47.305482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-663f72b6-8a9c-45c5-977f-9d9c463a3e48 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:47.306736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-663f72b6-8a9c-45c5-977f-9d9c463a3e48 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:47.352324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:47.367556 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a32ce7b7-a988-4528-b811-86ef6850a336 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.482693 Jul 26 04:27:47.371510 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 265/535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:46 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:47.548390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-663f72b6-8a9c-45c5-977f-9d9c463a3e48 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:47.567535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:47.568800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:47.583499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:47.585002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:47.585821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:47.587462 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-663f72b6-8a9c-45c5-977f-9d9c463a3e48 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1212 microversion: 2.1 time: 0.296097 Jul 26 04:27:47.588142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:47.598086 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 271/536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:47 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1212 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:48.117811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:48.131582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:48.133092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:48.134275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e10d4c8b-9ebe-4214-877f-3650f393b912 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1362 microversion: 2.25 time: 0.573709 Jul 26 04:27:48.163051 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 266/537] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:47 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1362 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:48.397724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:48.398433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:48.416978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:48.417439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:48.418255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:48.418704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:48.624630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:48.625680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:48.645421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:48.645991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:48.664827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:48.666559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:48.684110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:48.724540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:48.741009 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-055a7e84-585e-48a1-843c-5e16b87a77c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.351074 Jul 26 04:27:48.742273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 272/538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:48 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:48.844145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:48.853299 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1af2553a-2347-4b18-9e75-570de319d0b7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1264 microversion: 2.1 time: 0.234274 Jul 26 04:27:48.857402 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 267/539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:48 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:49.158237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:49.159604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:49.181665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.184824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.187452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.188242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.552981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:49.564762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:49.566305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:49.567986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c15414e-7a6d-4a4b-8096-79d28b199291 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1558 microversion: 2.25 time: 0.414618 Jul 26 04:27:49.569221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 273/540] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:49 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1558 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:49.594058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:49.595396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:49.601915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.602400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.603432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.604034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.767557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:49.768242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:49.784080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.786190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.788056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:49.788983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:49.942826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:49.966173 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9eb7b0ff-6514-4b42-b3dd-ad7c49a6e079 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 2053 microversion: 2.25 time: 0.375645 Jul 26 04:27:49.983219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 268/541] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:49 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 2053 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:49.998646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:50.001893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:50.019276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.020260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.021206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.022541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.141624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:50.156924 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-964397d1-10f5-4a96-98bc-fc8a621bf17f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1270 microversion: 2.1 time: 0.170153 Jul 26 04:27:50.157626 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 269/542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:49 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:50.168806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:50.170003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:50.196450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.196923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.203907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.204365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.218543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:50.232627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-072e9945-6e87-43c1-867e-abf24aaab513 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.469861 Jul 26 04:27:50.233455 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 274/543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:49 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:50.718551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:50.775008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:50.782490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44efdfd3-6b79-4545-9723-01a2d1975bcd tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 2053 microversion: 2.25 time: 0.622389 Jul 26 04:27:50.783354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 270/544] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:50 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 2053 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:50.811168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:50.815615 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:50.815615 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:50.820434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.822084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.826056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.828094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.889362 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eba523bc-3d44-4f41-9ffc-69acff5c20a0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.082543 Jul 26 04:27:50.900938 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 275/545] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Jul 26 04:27:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:50.915500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:50.916293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:50.929178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:50.933901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.937100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:50.938880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:50.941047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.096625 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d0bb951-e94f-4397-97c0-fe4bb2536742 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e/action" status: 202 len: 0 microversion: 2.25 time: 0.184741 Jul 26 04:27:51.103151 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 271/546] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:27:50 2022] POST /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:51.109381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:51.110558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:51.124330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.125983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.127238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.129265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.182661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:51.183665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:51.196714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=24 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:51.205738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.206435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.209641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.211538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.764029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:51.807489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a648803-e0fd-411f-95b6-c818addb8cf0 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 2058 microversion: 2.25 time: 0.703671 Jul 26 04:27:51.808469 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 276/547] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:51 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 2058 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:27:51.820623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:51.821203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:51.840888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.841551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.843299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:51.844252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:51.984166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:51.998527 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a560c86-ace4-45ff-8409-dc9173e14ddb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 0.820859 Jul 26 04:27:52.014179 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 272/548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:51 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:27:52.018822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fbf07850-5b21-4b0c-adaf-1a4450f3add0 req-43239012-4fe2-46d2-a0d9-5221fa77bfce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:52.062613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fbf07850-5b21-4b0c-adaf-1a4450f3add0 req-43239012-4fe2-46d2-a0d9-5221fa77bfce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:52.070620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fbf07850-5b21-4b0c-adaf-1a4450f3add0 req-43239012-4fe2-46d2-a0d9-5221fa77bfce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:52.121761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fbf07850-5b21-4b0c-adaf-1a4450f3add0 req-43239012-4fe2-46d2-a0d9-5221fa77bfce service nova] Creating event network-changed:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h1-848886-16 Jul 26 04:27:52.130133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fbf07850-5b21-4b0c-adaf-1a4450f3add0 req-43239012-4fe2-46d2-a0d9-5221fa77bfce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126024 Jul 26 04:27:52.131447 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 273/549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:52.272735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:52.285660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb0c3094-8086-4828-9154-16ff89ba79f6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.476048 Jul 26 04:27:52.286571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 277/550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:51 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:52.808989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b1b679b-94d5-4159-be80-46c3ebe5ff85 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-966247605", "id": 229496727, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:52.813565 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:52.813565 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:27:52.830913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:52.837086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:52.844029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:52.845399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:52.849217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:52.851091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:52.851248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b1b679b-94d5-4159-be80-46c3ebe5ff85 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.655728 Jul 26 04:27:52.851925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 274/551] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:27:52 2022] POST /compute/v2.1/flavors => generated 464 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:53.143572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:53.189780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8af51064-0538-4398-a6e4-e1bceadac24e tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 2038 microversion: 2.25 time: 0.362606 Jul 26 04:27:53.192178 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 278/552] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:52 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 2038 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:53.210147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:53.212636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:53.240493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.243196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.246823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.250519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.317542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bfcfb3f6-8824-4a65-8890-7ddd16b4a1de tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:53.339117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bfcfb3f6-8824-4a65-8890-7ddd16b4a1de tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] 10.222.0.43 "GET /compute/v2.1/flavors/229496727" status: 200 len: 464 microversion: 2.61 time: 0.477250 Jul 26 04:27:53.345778 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 275/553] 10.222.0.43 () {60 vars in 1196 bytes} [Tue Jul 26 04:27:52 2022] GET /compute/v2.1/flavors/229496727 => generated 464 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:53.351623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": "auto"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:53.367759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:53.385649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.387572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.389820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.391598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.487246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'flavor' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:27:53.522512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119488) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:27:53.539420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:53.553629 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00dc724c-3468-4877-896a-880d61dc1ebf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 0.357198 Jul 26 04:27:53.572124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 279/554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:53 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:53.582113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:53.582831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:53.589895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.590461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.591583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:53.592382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:53.925373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:53.935787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91da6d33-175d-425b-8a23-e3c4d2475dad tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.362488 Jul 26 04:27:53.938918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 280/555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:53 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:53.948660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5dfecbe9-034b-4f0d-a8d8-56a3abdd1f66 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] Action: 'update', calling method: .version_select at 0x7f38b885bf70>, body: {"flavor": {"description": "new"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:53.989498 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:53.989498 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:54.070506 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5dfecbe9-034b-4f0d-a8d8-56a3abdd1f66 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/229496727" status: 200 len: 465 microversion: 2.61 time: 0.127999 Jul 26 04:27:54.079641 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 281/556] 10.222.0.43 () {62 vars in 1216 bytes} [Tue Jul 26 04:27:53 2022] PUT /compute/v2.1/flavors/229496727 => generated 465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:27:54.536074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1937547875", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:54.604540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:55.489241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:55.489808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:55.490114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:55.490767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:55.491179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:55.512457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:55.513433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:55.514271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:55.514903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:55.534728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Getting quotas for project bd55d6583e8d4b6fbad2a67de1a0556c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:55.539824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Getting quotas for user b5ce37fdfa974cda9782b7ee7fad0b2c and project bd55d6583e8d4b6fbad2a67de1a0556c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:55.553409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:55.556242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:27:55.559113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:27:55.642017 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-131a0705-bb62-4110-9ecd-78508179b8c7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560881 Jul 26 04:27:55.650509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 282/557] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:27:55.752412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19935e3c-d5b3-4c15-9bd0-06c6979e9246 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Calling method '.version_select at 0x7f38b5ff88b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:55.888774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19935e3c-d5b3-4c15-9bd0-06c6979e9246 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 371 microversion: 2.1 time: 0.236772 Jul 26 04:27:55.896060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 283/558] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:27:55 2022] GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:55.902793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fa34f6a4-99dc-46ef-8376-3a25a20c8860 req-26bd3e32-b92f-44d0-b7e2-2f4ad5de8f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef59c1b4-b601-40f3-89d4-f23378e0c742", "name": "network-vif-plugged", "status": "completed", "tag": "a2048730-3a02-4a47-a623-6c1e42b46980"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:55.915687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fa34f6a4-99dc-46ef-8376-3a25a20c8860 req-26bd3e32-b92f-44d0-b7e2-2f4ad5de8f9a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:55.916335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fa34f6a4-99dc-46ef-8376-3a25a20c8860 req-26bd3e32-b92f-44d0-b7e2-2f4ad5de8f9a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:55.935562 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fa34f6a4-99dc-46ef-8376-3a25a20c8860 req-26bd3e32-b92f-44d0-b7e2-2f4ad5de8f9a service nova] Creating event network-vif-plugged:a2048730-3a02-4a47-a623-6c1e42b46980 for instance ef59c1b4-b601-40f3-89d4-f23378e0c742 on n-h1-848886-16 Jul 26 04:27:55.944234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fa34f6a4-99dc-46ef-8376-3a25a20c8860 req-26bd3e32-b92f-44d0-b7e2-2f4ad5de8f9a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045414 Jul 26 04:27:55.945275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 284/559] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:55.951972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7263784d-846f-4f5d-b799-9aa404dd67c8 tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:55.997481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7263784d-846f-4f5d-b799-9aa404dd67c8 tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 7155 microversion: 2.61 time: 0.050683 Jul 26 04:27:55.998767 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 285/560] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:27:55 2022] GET /compute/v2.1/flavors/detail => generated 7155 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:56.016528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.020202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:56.033975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.035388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.036344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.037055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.229009 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30e89d66-df93-4d88-abd8-7e3c546bb589 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e/action" status: 202 len: 0 microversion: 2.25 time: 2.881382 Jul 26 04:27:56.232853 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 276/561] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:27:53 2022] POST /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e/action => generated 0 bytes in 2883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:56.236744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.237377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:56.255980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.256703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.257661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.262247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.363108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:56.371577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24b394ba-ef09-44d9-a983-66d45c09f9c9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 0.370899 Jul 26 04:27:56.377755 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 286/562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:55 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:56.382685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-acb9e358-62e6-4b17-97aa-20bf425537be tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.392712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-acb9e358-62e6-4b17-97aa-20bf425537be tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:56.486036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-acb9e358-62e6-4b17-97aa-20bf425537be tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:56.487361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:56.499152 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-acb9e358-62e6-4b17-97aa-20bf425537be tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1223 microversion: 2.1 time: 0.119996 Jul 26 04:27:56.500369 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54b21238-6c3a-4818-8a72-c52ab4627a97 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1390 microversion: 2.1 time: 0.268511 Jul 26 04:27:56.500705 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 287/563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:56 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:56.501997 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 277/564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:56 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1390 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:56.519202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f8a820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:56.656416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.657110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.659359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.660632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.717222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a0198a9-ddbf-4f7f-bbad-909d4d201d85 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Action: 'create', calling method: .version_select at 0x7f38b5f6baf0>, body: {"keypair": {"name": "tempest-keypair-2068114541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdJrrEdT4bTSQVmomuNTYciy+wVYfl4ziNJYnVQYIm3EtwLs19xSqS9QhvrW5+NHYnpV4k4stIWHBcvG+j9UGFYha1JRsB3Om+/YQkRAYtsPIFglwj7SwtlQsGYfK/RQg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:56.753920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-308e1ce4-516b-4099-ad62-65f0773b414e tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 328 microversion: 2.1 time: 0.250479 Jul 26 04:27:56.755024 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 278/565] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:27:56 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:56.762126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc3b34e8-9ea0-49b7-8db2-9ac3dd4f625b tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.790513 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc3b34e8-9ea0-49b7-8db2-9ac3dd4f625b tempest-FlavorsV261TestJSON-2057556298 tempest-FlavorsV261TestJSON-2057556298-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.61 time: 0.034202 Jul 26 04:27:56.791434 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 279/566] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Jul 26 04:27:56 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:56.796959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.797782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:56.806698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0a0198a9-ddbf-4f7f-bbad-909d4d201d85 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:56.810484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.810955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.813027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0a0198a9-ddbf-4f7f-bbad-909d4d201d85 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for user 152c5727614449b39b6cdb3d3d402c32 and project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:56.815135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:56.815612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:56.865915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a0198a9-ddbf-4f7f-bbad-909d4d201d85 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.363764 Jul 26 04:27:56.868946 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 288/567] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:27:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:56.874220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5cb28b0-6bf2-4cad-a8c3-b92b59486d08 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.878685 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:27:56.878685 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:27:56.914349 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5cb28b0-6bf2-4cad-a8c3-b92b59486d08 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/229496727" status: 202 len: 0 microversion: 2.61 time: 0.044102 Jul 26 04:27:56.914930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 289/568] 10.222.0.43 () {60 vars in 1199 bytes} [Tue Jul 26 04:27:56 2022] DELETE /compute/v2.1/flavors/229496727 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:27:56.923159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-711e425e-7a05-4066-bd0b-78b5c1601742 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:56.986350 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-711e425e-7a05-4066-bd0b-78b5c1601742 tempest-FlavorsV261TestJSON-13902061 tempest-FlavorsV261TestJSON-13902061-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.054361 Jul 26 04:27:56.987281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 290/569] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:27:56 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:57.082272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-154047098", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:57.238079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:27:57.480128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:57.502254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:57.505848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:57.510882 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b5061b1-1525-4b4b-bea9-12d2db5d90b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.717847 Jul 26 04:27:57.516392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 280/570] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:56 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:27:57.525733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:57.529572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:57.542094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:57.544626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:57.547865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:57.548331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.083209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:27:58.084319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:27:58.085614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:27:58.087121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:27:58.088703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:27:58.133435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.136684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.138630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.145244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.167544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=13 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:27:58.187057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:27:58.208338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for user 4f6f4ecba5d5432dac27a5b15f87e0d6 and project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:27:58.235860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.utils [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] cores quota exceeded for 5771eea6a42c481fb2148d9b9d81024b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119487) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 04:27:58.237695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Request method failure captured: Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 144 Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321H4LQWpYWTd4xS2fXAUFFGLN4tAtWTzjAbQlu-iO6Mpb_DzHv6tEGBMKqQ72dHQaYLSCeltkiB4JdqQG0zjFRzUIallerhRM81DYZA654pQVHFj5N1FSEnln1JAX-N39rK0_nHIVKfucvzMLj2ojVjNuhzISjgyt8eaJL-UYMS7Bg Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:27:58.243248 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4f6f4ecba5d5432dac27a5b15f87e0d6 Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-154047098", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} Jul 26 04:27:58.244600 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-154047098', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452'}}} Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 04:27:58.245284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:58.246476 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.250141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 04:27:58.252958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:27:58.254712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:27:58.255469 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50c5e012-dd68-45be-91ef-bb8ddc8b7527 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.266932 Jul 26 04:27:58.256072 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 291/571] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:27:56 2022] POST /compute/v2.1/servers => generated 111 bytes in 1268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:27:58.265700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:58.266577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:58.269318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:58.276146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.277108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.278055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.279454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.285654 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee201b67-41e1-473b-8e77-482433d9d35a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 0.766388 Jul 26 04:27:58.287365 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 281/572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:57 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:58.304384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:58.305132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:58.313302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.319198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.320665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.323963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.381714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:58.397557 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f6e7e3b-c37b-4caa-849d-cf0b8087794f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1281 microversion: 2.1 time: 0.140127 Jul 26 04:27:58.398258 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 292/573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:58 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:58.405245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b6131c10>, body: {"quota_set": {"cores": 20}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:58.692410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.692969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.695114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.695673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.796376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fc664d7-9be7-4921-a6c0-abd98ed1c4b0 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 329 microversion: 2.1 time: 0.396498 Jul 26 04:27:58.797862 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 293/574] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:27:58 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 329 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:58.805197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:58.806487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:58.817899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.818704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.819888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:58.820607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:58.929633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:27:58.940447 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6d317dd-2569-4407-aa75-53f95a14c358 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1590 microversion: 2.1 time: 0.651404 Jul 26 04:27:58.956753 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 282/575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:58 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1590 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:27:58.963717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e1bc733-9a91-4553-8c28-39132cfd6aa9 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Calling method '.version_select at 0x7f38b5ecadc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:59.123184 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e1bc733-9a91-4553-8c28-39132cfd6aa9 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 371 microversion: 2.1 time: 0.163750 Jul 26 04:27:59.124770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 283/576] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:27:58 2022] GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:59.133971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:59.134563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:59.148780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.154011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.155082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.155543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.342438 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a98163f-6f99-439a-852c-edce7026d0f3 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215886 Jul 26 04:27:59.357290 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 284/577] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:27:59 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:59.368128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f01310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:27:59.514741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.516436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.518531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.519272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.594342 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-884aa305-2ee5-44c4-815c-d01e48daad83 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 328 microversion: 2.1 time: 0.235275 Jul 26 04:27:59.598030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 285/578] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:27:59 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 328 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:27:59.604112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:27:59.605142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:27:59.615845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.616667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.618498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:27:59.620679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:27:59.662210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:00.001215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:00.015349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:00.021069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:00.023488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fbeb8372-9784-45fe-a1fb-dfb76fec45da tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 1.224235 Jul 26 04:28:00.029545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 294/579] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:27:58 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:00.043180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:00.044218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:00.072205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:00.072956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:00.076066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:00.076735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:01.066418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:01.073152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:01.077325 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8915b497-2102-4ec4-b19b-2bc193c2d77f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 1.046164 Jul 26 04:28:01.078832 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 295/580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:00 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:01.084329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1594103217", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:01.187793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:01.199750 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cfa1ceb-c5c7-47dc-82dd-fa00d1f43538 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 1.596712 Jul 26 04:28:01.208437 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 286/581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:27:59 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:01.213285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:01.247912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ab440e6c-7820-446e-b9f0-30454e8c1d82 req-bd331440-76a9-4488-aae9-40843478395a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "name": "network-vif-plugged", "status": "completed", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:01.287210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ab440e6c-7820-446e-b9f0-30454e8c1d82 req-bd331440-76a9-4488-aae9-40843478395a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:01.288158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ab440e6c-7820-446e-b9f0-30454e8c1d82 req-bd331440-76a9-4488-aae9-40843478395a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:01.316969 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ab440e6c-7820-446e-b9f0-30454e8c1d82 req-bd331440-76a9-4488-aae9-40843478395a service nova] Creating event network-vif-plugged:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h1-848886-16 Jul 26 04:28:01.337906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ab440e6c-7820-446e-b9f0-30454e8c1d82 req-bd331440-76a9-4488-aae9-40843478395a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118005 Jul 26 04:28:01.342079 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 287/582] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:01.356665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:01.357722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:01.385127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:01.385723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:01.387098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:01.388186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:01.769089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:01.779861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:01.780985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:01.786137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41695642-0aca-4ce6-9dc5-950fd2e768a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.438800 Jul 26 04:28:01.786866 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 288/583] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:01 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:02.103611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:02.103985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:02.111986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.112433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.113210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.113651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.186989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:02.188528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:02.189025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:02.190819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:02.191366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:02.200100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=50 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:02.204822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.205756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.207054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.208316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.239649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:02.244828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for user 4f6f4ecba5d5432dac27a5b15f87e0d6 and project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:02.257546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.utils [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] instances quota exceeded for 5771eea6a42c481fb2148d9b9d81024b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119487) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 04:28:02.257644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Request method failure captured: Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 145 Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321H4LQWpYWTd4xS2fXAUFFGLN4tAtWTzjAbQlu-iO6Mpb_DzHv6tEGBMKqQ72dHQaYLSCeltkiB4JdqQG0zjFRzUIallerhRM81DYZA654pQVHFj5N1FSEnln1JAX-N39rK0_nHIVKfucvzMLj2ojVjNuhzISjgyt8eaJL-UYMS7Bg Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:02.259591 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4f6f4ecba5d5432dac27a5b15f87e0d6 Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1594103217", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} Jul 26 04:28:02.261001 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1594103217', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452'}}} Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 04:28:02.261678 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:02.262798 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.267567 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca57f588-8f6b-4b32-8c3f-a2561ab73f93 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.181026 Jul 26 04:28:02.270948 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 296/584] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 1187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:02.274032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4e9993ce-717f-4ee2-8628-a4087b59c031 req-6f9374fe-ad79-4aeb-8dae-6520511c727e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "name": "network-vif-unplugged", "status": "completed", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:02.296950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e9993ce-717f-4ee2-8628-a4087b59c031 req-6f9374fe-ad79-4aeb-8dae-6520511c727e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.297891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e9993ce-717f-4ee2-8628-a4087b59c031 req-6f9374fe-ad79-4aeb-8dae-6520511c727e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.332366 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4e9993ce-717f-4ee2-8628-a4087b59c031 req-6f9374fe-ad79-4aeb-8dae-6520511c727e service nova] Creating event network-vif-unplugged:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h2-848886-16 Jul 26 04:28:02.344840 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4e9993ce-717f-4ee2-8628-a4087b59c031 req-6f9374fe-ad79-4aeb-8dae-6520511c727e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076131 Jul 26 04:28:02.345450 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 297/585] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:02.351460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:02.352848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:02.360973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.361425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.362260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:02.362702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:02.841760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:02.851843 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ad3a1ed-5e51-4920-b5e3-a7d6f0002c7c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.753062 Jul 26 04:28:02.863179 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 289/586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:02 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:02.872695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5efa1f0>, body: {"quota_set": {"instances": 10}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:03.015497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:03.046174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d2e4758-847b-49f7-9a9e-d16556656d5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1312 microversion: 2.1 time: 0.698100 Jul 26 04:28:03.047379 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 298/587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:02 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1312 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:03.055037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:03.056287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:03.067313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.068190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.072711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.073497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.321358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.321799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.322636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.323072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.533884 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62a9513e-9e34-4925-b947-762ec7748692 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 329 microversion: 2.1 time: 0.669408 Jul 26 04:28:03.534566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 290/588] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:28:02 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 329 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:03.545561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:03.547495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:03.564137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.565075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.566994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.567888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.671536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:03.688245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:03.690197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:03.691619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac840e72-769b-426c-a6e9-54ea519779df tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.642622 Jul 26 04:28:03.692647 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 299/589] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:03 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:03.706836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19c38c1e-f188-48a4-9025-140d4f251dad tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Calling method '.version_select at 0x7f38b5fedaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:03.752114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:03.761130 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5041b88-eeea-46ab-8739-d66eda746403 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 200 len: 1590 microversion: 2.1 time: 0.225080 Jul 26 04:28:03.763871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 291/590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:03 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 1590 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:03.874855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:03.876133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:03.897497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.901260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:03.914624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:03.917993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.130465 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19c38c1e-f188-48a4-9025-140d4f251dad tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 371 microversion: 2.1 time: 0.427116 Jul 26 04:28:04.146653 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 300/591] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:28:03 2022] GET /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:04.156734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cea30b10-fdf0-4349-a57b-e373a101b72c req-4d3a0022-e679-452b-b0ef-d577eafac94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb32bf2-6125-40c8-a091-faf2871f46e4", "tag": "b89db3b8-434c-4cd3-87e0-9370fd2b13cf"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:04.179869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cea30b10-fdf0-4349-a57b-e373a101b72c req-4d3a0022-e679-452b-b0ef-d577eafac94c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.180426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cea30b10-fdf0-4349-a57b-e373a101b72c req-4d3a0022-e679-452b-b0ef-d577eafac94c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.198472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:04.209290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cea30b10-fdf0-4349-a57b-e373a101b72c req-4d3a0022-e679-452b-b0ef-d577eafac94c service nova] Creating event network-changed:b89db3b8-434c-4cd3-87e0-9370fd2b13cf for instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 on n-h2-848886-16 Jul 26 04:28:04.212708 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d168cddd-2823-47de-929b-afed23bad12f tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.338458 Jul 26 04:28:04.215839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cea30b10-fdf0-4349-a57b-e373a101b72c req-4d3a0022-e679-452b-b0ef-d577eafac94c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067728 Jul 26 04:28:04.221514 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 301/592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:04.227280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 292/593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:03 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:04.230846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:04.235275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5eb1310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:04.240644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:04.252691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:04.257679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.258464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.259583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.260232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.611568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.612464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.613443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.614041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.720556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:04.722045 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3831c9d0-3796-4024-a408-382faee5f840 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 325 microversion: 2.1 time: 0.493376 Jul 26 04:28:04.722873 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 293/594] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:28:04 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:04.754536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef59c1b4-b601-40f3-89d4-f23378e0c742", "tag": "a2048730-3a02-4a47-a623-6c1e42b46980"}, {"name": "network-changed", "server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:04.779862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.780691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.795814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] Creating event network-changed:a2048730-3a02-4a47-a623-6c1e42b46980 for instance ef59c1b4-b601-40f3-89d4-f23378e0c742 on n-h1-848886-16 Jul 26 04:28:04.796634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] Creating event network-changed:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h2-848886-16 Jul 26 04:28:04.805452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3489c36a-80ee-4c2c-a9c8-f03d6642ed76 req-11abd7b3-68a0-430e-ba60-bb970987fb03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080931 Jul 26 04:28:04.807013 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 294/595] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:04.833964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:04.835020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:04.846590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.847562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:04.850214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:04.851046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:05.138410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:05.146802 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19b67e16-ea27-4b31-a5a3-a849b6ef6eef tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1461 microversion: 2.1 time: 0.923746 Jul 26 04:28:05.157244 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 302/596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:04 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1461 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:05.178476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-318940564", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:05.269451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:05.331536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:05.341263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:05.350146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:05.355439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0fded99-c9b7-42e9-9f97-8d45773d01bf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.531254 Jul 26 04:28:05.358206 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 295/597] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:04 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:05.369732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:05.379578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:05.414416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:05.414884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:05.415672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:05.416278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:05.618249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:05.628722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 04:28:05.648046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:05.650253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:05.652779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:05.653747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:05.654439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:05.889499 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4636716e-0d06-42a0-9e79-7527ff0fd75d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f/action" status: 202 len: 0 microversion: 2.1 time: 0.528852 Jul 26 04:28:05.891073 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 296/598] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:28:05 2022] POST /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:05.899259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:05.900161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:05.911877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:05.912749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:05.914413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:05.915313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.036477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:06.036909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:06.037659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:06.038140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:06.038682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:06.052243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.052696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.053502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.054134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.073194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:06.078043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Getting quotas for user 4f6f4ecba5d5432dac27a5b15f87e0d6 and project 5771eea6a42c481fb2148d9b9d81024b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:06.090408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.utils [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] ram quota exceeded for 5771eea6a42c481fb2148d9b9d81024b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119487) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 04:28:06.091783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Request method failure captured: Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 144 Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321H4LQWpYWTd4xS2fXAUFFGLN4tAtWTzjAbQlu-iO6Mpb_DzHv6tEGBMKqQ72dHQaYLSCeltkiB4JdqQG0zjFRzUIallerhRM81DYZA654pQVHFj5N1FSEnln1JAX-N39rK0_nHIVKfucvzMLj2ojVjNuhzISjgyt8eaJL-UYMS7Bg Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:06.094500 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4f6f4ecba5d5432dac27a5b15f87e0d6 Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-318940564", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} Jul 26 04:28:06.095844 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-318940564', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452'}}} Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 04:28:06.096637 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:06.097710 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.098961 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 04:28:06.100253 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:06.102860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:06.104168 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-27143fde-9cff-4d13-bd82-20ad2a658cda tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.945520 Jul 26 04:28:06.109918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 303/599] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 951 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:06.119302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-427779933", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "344cfeb5-a6b4-4376-acc0-c3b9d9d153f8"}], "security_groups": [{"name": "tempest-securitygroup--495150039"}], "key_name": "tempest-keypair-2068114541", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:06.235013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:06.251585 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d42da18-0756-4d43-863b-383f0e4ac074 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.359179 Jul 26 04:28:06.252954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 297/600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:05 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:06.287245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:06.289031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:06.302807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.303379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.304208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.304647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.410715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] validate_networks() for [('344cfeb5-a6b4-4376-acc0-c3b9d9d153f8', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:06.655068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:06.668248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-19b855a9-d203-4b91-a5a6-9bf0e210d0b3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1470 microversion: 2.1 time: 0.408941 Jul 26 04:28:06.670510 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 298/601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:06 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:06.889864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Calling method '.version_select at 0x7f38b5f5e5e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:06.896369 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:06.896369 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:06.897692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.898167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.900913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:06.901153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:06.954072 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9410c959-9491-4915-a5b3-57b8537df7d4 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.281875 Jul 26 04:28:06.954926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 299/602] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:28:06 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:06.960331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5e73ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:07.361408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.363926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.364803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.365243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.427495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:07.427966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:07.428361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:07.429506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:07.429907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:07.453231 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2c8f032-e5c3-47a1-b545-602e2b7405c8 tempest-QuotasAdminNegativeTest-569662889 tempest-QuotasAdminNegativeTest-569662889-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 200 len: 329 microversion: 2.1 time: 0.497016 Jul 26 04:28:07.453980 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 300/603] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:28:06 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 329 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:07.461833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.461833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.461833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.461833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.468730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:07.469583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:07.480136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.480899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.482144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.482823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.486602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:07.490877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for user 152c5727614449b39b6cdb3d3d402c32 and project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:07.504306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:07.506878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:07.568363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80748dbf-5492-4670-8630-7fcde1e24527 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.457003 Jul 26 04:28:07.569878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 304/604] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:07.710687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:07.729656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:07.748738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:07.752115 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b03ba7ca-61f5-442a-b204-639a7ff6f98f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.287425 Jul 26 04:28:07.753637 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 301/605] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:07 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:07.768126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:07.768817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:07.777792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.779557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:07.782657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:07.787913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:08.039736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.048192 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb6d1174-6583-4e62-8569-2f0e2a71f858 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.293703 Jul 26 04:28:08.048899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 302/606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:07 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:08.052011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42bd390c-ed1b-4dc0-8009-3e29c472006c tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Calling method '.version_select at 0x7f38b5fed940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.053595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9755e27-3cc6-4cd9-a65d-e00426f7ed08 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Action: 'update', calling method: .version_select at 0x7f38b5efa820>, body: {"quota_set": {"ram": 0}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.057238 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.057238 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:28:08.061182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c9755e27-3cc6-4cd9-a65d-e00426f7ed08 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '4f6f4ecba5d5432dac27a5b15f87e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771eea6a42c481fb2148d9b9d81024b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9755e27-3cc6-4cd9-a65d-e00426f7ed08 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Request method failure captured: Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b HTTP/1.1 Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 25 Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321H4LQWpYWTd4xS2fXAUFFGLN4tAtWTzjAbQlu-iO6Mpb_DzHv6tEGBMKqQ72dHQaYLSCeltkiB4JdqQG0zjFRzUIallerhRM81DYZA654pQVHFj5N1FSEnln1JAX-N39rK0_nHIVKfucvzMLj2ojVjNuhzISjgyt8eaJL-UYMS7Bg Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.063351 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5771eea6a42c481fb2148d9b9d81024b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5771eea6a42c481fb2148d9b9d81024b Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-583910067 Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4f6f4ecba5d5432dac27a5b15f87e0d6 Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-QuotasAdminNegativeTest-583910067-project Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: {"quota_set": {"ram": 0}} Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 04:28:08.064694 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '5771eea6a42c481fb2148d9b9d81024b', 'body': {'quota_set': {'ram': 0}}} Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.070264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.072057 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9755e27-3cc6-4cd9-a65d-e00426f7ed08 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9755e27-3cc6-4cd9-a65d-e00426f7ed08 tempest-QuotasAdminNegativeTest-583910067 tempest-QuotasAdminNegativeTest-583910067-project] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b" status: 403 len: 116 microversion: 2.1 time: 0.014894 Jul 26 04:28:08.074246 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 303/607] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-quota-sets/5771eea6a42c481fb2148d9b9d81024b => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.075384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42bd390c-ed1b-4dc0-8009-3e29c472006c tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.086529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae33246a-7d0c-4c45-b07b-be07d2ea8708 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.089301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae33246a-7d0c-4c45-b07b-be07d2ea8708 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42bd390c-ed1b-4dc0-8009-3e29c472006c tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:08.091843 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:28:08.093178 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.093955 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 04:28:08.095259 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.096719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42bd390c-ed1b-4dc0-8009-3e29c472006c tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.096719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42bd390c-ed1b-4dc0-8009-3e29c472006c tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.522099 Jul 26 04:28:08.096719 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 305/608] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:28:07 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 523 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.120293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.123280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:08.149503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:08.150053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:08.153618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:08.154077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:08.269794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae33246a-7d0c-4c45-b07b-be07d2ea8708 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.283113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae33246a-7d0c-4c45-b07b-be07d2ea8708 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1241 microversion: 2.1 time: 0.216456 Jul 26 04:28:08.284244 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 304/609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1241 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:08.289809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3f8cede-90dd-4042-969f-344fb383fab6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Calling method '.version_select at 0x7f38b5f5ee50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.291030 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.291030 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:08.292634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3f8cede-90dd-4042-969f-344fb383fab6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3f8cede-90dd-4042-969f-344fb383fab6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/n-d-848886-16/reboot HTTP/1.1 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.295605 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16'} Jul 26 04:28:08.297086 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.297874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 04:28:08.299503 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.300522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3f8cede-90dd-4042-969f-344fb383fab6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.300522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3f8cede-90dd-4042-969f-344fb383fab6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-848886-16/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011665 Jul 26 04:28:08.300522 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 305/610] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/n-d-848886-16/reboot => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.308393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f1e8651-f731-49d3-a1bf-90a333c6dfd5 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Calling method '.version_select at 0x7f38b5e73f70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.319239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7f1e8651-f731-49d3-a1bf-90a333c6dfd5 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f1e8651-f731-49d3-a1bf-90a333c6dfd5 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.321120 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'nonexistent_hostname'} Jul 26 04:28:08.322596 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:28:08.323439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 04:28:08.324597 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f1e8651-f731-49d3-a1bf-90a333c6dfd5 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.326058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f1e8651-f731-49d3-a1bf-90a333c6dfd5 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.018038 Jul 26 04:28:08.327643 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 306/611] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:28:08.333677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97ff24c8-f7b3-4873-a6a8-dc191a92525e tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Calling method '.version_select at 0x7f38b5e733a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.334562 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.334562 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:08.335642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97ff24c8-f7b3-4873-a6a8-dc191a92525e tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97ff24c8-f7b3-4873-a6a8-dc191a92525e tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/n-d-848886-16 HTTP/1.1 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.337360 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16'} Jul 26 04:28:08.338722 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.339479 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 04:28:08.341109 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.342143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97ff24c8-f7b3-4873-a6a8-dc191a92525e tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.342143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97ff24c8-f7b3-4873-a6a8-dc191a92525e tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-848886-16" status: 403 len: 109 microversion: 2.1 time: 0.010145 Jul 26 04:28:08.344316 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 307/612] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/n-d-848886-16 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.349010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acba13bb-10a0-4bee-8542-318f377166ea tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Calling method '.version_select at 0x7f38b5f5e550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.355465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-acba13bb-10a0-4bee-8542-318f377166ea tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acba13bb-10a0-4bee-8542-318f377166ea tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.358680 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'nonexistent_hostname'} Jul 26 04:28:08.359959 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.360744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.361804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.364464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acba13bb-10a0-4bee-8542-318f377166ea tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.364464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-acba13bb-10a0-4bee-8542-318f377166ea tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014702 Jul 26 04:28:08.365004 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 308/613] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:28:08.370713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa66fc87-5224-4dfe-809b-35a4d2076b2a tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Calling method '.version_select at 0x7f38b5f01040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.371704 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.371704 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:08.373489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa66fc87-5224-4dfe-809b-35a4d2076b2a tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa66fc87-5224-4dfe-809b-35a4d2076b2a tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/n-d-848886-16/shutdown HTTP/1.1 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.375264 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16'} Jul 26 04:28:08.376607 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.377349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 04:28:08.379050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.380480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa66fc87-5224-4dfe-809b-35a4d2076b2a tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.380480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa66fc87-5224-4dfe-809b-35a4d2076b2a tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-848886-16/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010581 Jul 26 04:28:08.380480 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 309/614] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/n-d-848886-16/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.389072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3aa94ed8-30f4-4a55-bb38-df16baab067e tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Calling method '.version_select at 0x7f38b5f011f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.401060 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3aa94ed8-30f4-4a55-bb38-df16baab067e tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3aa94ed8-30f4-4a55-bb38-df16baab067e tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.404606 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'nonexistent_hostname'} Jul 26 04:28:08.406207 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:28:08.407127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 04:28:08.408445 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3aa94ed8-30f4-4a55-bb38-df16baab067e tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.410353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3aa94ed8-30f4-4a55-bb38-df16baab067e tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023716 Jul 26 04:28:08.414590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 310/615] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:28:08.426099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de3af10b-dfed-49d2-8394-55f93c57034b tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Calling method '.version_select at 0x7f38b5efab80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.428107 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.428107 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:08.431758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de3af10b-dfed-49d2-8394-55f93c57034b tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de3af10b-dfed-49d2-8394-55f93c57034b tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/n-d-848886-16/startup HTTP/1.1 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.444517 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16'} Jul 26 04:28:08.445802 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.446584 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 04:28:08.447662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.453566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de3af10b-dfed-49d2-8394-55f93c57034b tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.456638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de3af10b-dfed-49d2-8394-55f93c57034b tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-848886-16/startup" status: 403 len: 110 microversion: 2.1 time: 0.039226 Jul 26 04:28:08.458509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 311/616] 10.222.0.43 () {58 vars in 1194 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/n-d-848886-16/startup => generated 110 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:08.468215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5341ebe3-fb90-4dd2-825a-a1b23b104c50 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Calling method '.version_select at 0x7f38b5f8a280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.511042 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5341ebe3-fb90-4dd2-825a-a1b23b104c50 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5341ebe3-fb90-4dd2-825a-a1b23b104c50 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.514132 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'nonexistent_hostname'} Jul 26 04:28:08.515691 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:28:08.516691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 04:28:08.518015 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.519373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.521070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5341ebe3-fb90-4dd2-825a-a1b23b104c50 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.523587 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5341ebe3-fb90-4dd2-825a-a1b23b104c50 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.059450 Jul 26 04:28:08.524383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 312/617] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:28:08.537372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08cc303c-7d0f-467f-b0f3-1f0dfca5c8e3 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f5e280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08cc303c-7d0f-467f-b0f3-1f0dfca5c8e3 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-hosts/n-d-848886-16 HTTP/1.1 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 51 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.552379 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: {"status": "enable", "maintenance_mode": "invalid"} Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.553946 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance: Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.555052 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.556886 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.558253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08cc303c-7d0f-467f-b0f3-1f0dfca5c8e3 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.559782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08cc303c-7d0f-467f-b0f3-1f0dfca5c8e3 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-848886-16" status: 400 len: 199 microversion: 2.1 time: 0.027261 Jul 26 04:28:08.562461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 313/618] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-hosts/n-d-848886-16 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:28:08.571866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c54820c1-3261-4b2b-8b2d-628007d1e6b9 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f57820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c54820c1-3261-4b2b-8b2d-628007d1e6b9 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-hosts/n-d-848886-16 HTTP/1.1 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 51 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.580277 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: {"status": "invalid", "maintenance_mode": "enable"} Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.581569 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance: Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.582416 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.583869 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.584932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c54820c1-3261-4b2b-8b2d-628007d1e6b9 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.585994 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c54820c1-3261-4b2b-8b2d-628007d1e6b9 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-848886-16" status: 400 len: 189 microversion: 2.1 time: 0.018172 Jul 26 04:28:08.589057 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 314/619] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-hosts/n-d-848886-16 => generated 189 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:28:08.598225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d5830a84-4c2b-4d49-8362-4022dfd675e6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Action: 'update', calling method: .version_select at 0x7f38b5f5ee50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.603432 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:08.603432 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:08.607668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d5830a84-4c2b-4d49-8362-4022dfd675e6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '739ebb45db0d4a65b1003f91ae424718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b375d58520441691b8568712131036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.612374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d5830a84-4c2b-4d49-8362-4022dfd675e6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Request method failure captured: Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-hosts/n-d-848886-16 HTTP/1.1 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 50 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321UizRv7FWMoxHCrLIi-9EDKRh0JhyuW3vU3ahA0El_wudK6WvSS-C-2bF_EIgccuFcn1p57Hj5Gspz-pyf5xYwwoIwUgj02Jc8ENks_m-Q6zCTgzXx5f3ogSijyHy5x_u-3s5bOTfrIVPCpV_-Eec7gDs28QmyBpjf9HmSaso_tec Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:08.618452 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3b375d58520441691b8568712131036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3b375d58520441691b8568712131036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3b375d58520441691b8568712131036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c3b375d58520441691b8568712131036 Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1888600651 Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 739ebb45db0d4a65b1003f91ae424718 Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1888600651-project Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 04:28:08.619962 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'n-d-848886-16', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.621067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 04:28:08.622887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.628830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36f3875f-685f-408d-b412-ac8c94cd0e3d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1470 microversion: 2.1 time: 0.533152 Jul 26 04:28:08.635445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 306/620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1470 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:08.635782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d5830a84-4c2b-4d49-8362-4022dfd675e6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.636825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d5830a84-4c2b-4d49-8362-4022dfd675e6 tempest-HostsAdminNegativeTestJSON-1888600651 tempest-HostsAdminNegativeTestJSON-1888600651-project] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-848886-16" status: 403 len: 111 microversion: 2.1 time: 0.042596 Jul 26 04:28:08.638737 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 315/621] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-hosts/n-d-848886-16 => generated 111 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:28:08.660555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47321c20-7413-4d06-97c1-212aea0f53af tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Action: 'update', calling method: .version_select at 0x7f38b609dd30>, body: {"status": null, "maintenance_mode": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47321c20-7413-4d06-97c1-212aea0f53af tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/os-hosts/n-d-848886-16 HTTP/1.1 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 42 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:28:08.664784 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: {"status": null, "maintenance_mode": null} Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 04:28:08.666490 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'n-d-848886-16', 'body': {'status': None, 'maintenance_mode': None}} Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance: Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi None Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.667533 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.671582 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.672974 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:28:08.672974 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:28:08.672974 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 04:28:08.672974 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.675444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47321c20-7413-4d06-97c1-212aea0f53af tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.676435 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-47321c20-7413-4d06-97c1-212aea0f53af tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-848886-16" status: 400 len: 127 microversion: 2.1 time: 0.019597 Jul 26 04:28:08.677557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 307/622] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-hosts/n-d-848886-16 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:28:08.687691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5ddeb80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:08.691499 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.hosts [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Enabling host nonexistent_hostname. Jul 26 04:28:08.711865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Request method failure captured: Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 50 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321V0q85MVVf5RJZdBYaBZUIUQbPexgEVChJIE9J04HVdF9p8xC9KPgLyN4S6lbv8R-9hefPzrD4aBPop7XxK7_unY8KipAucElwBfIhxvlh6bInw36dYd0XBpwXnUnDVOZL3_dwvNcUfWE2eQ9GZBh1k_JFVwJxeE1jM6Qvs2XQ_W0 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:08.714634 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d694669c4ff9408cace29c94b8592847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d694669c4ff9408cace29c94b8592847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d694669c4ff9408cace29c94b8592847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d694669c4ff9408cace29c94b8592847 Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-155629841 Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c39324f47c36441fb360a6da5b04ef64 Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-155629841-project-admin Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.716873 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 04:28:08.717934 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:08.719766 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:08.721196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:08.722336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c371a6b-042f-4b1b-95e7-ca9398d9a281 tempest-HostsAdminNegativeTestJSON-155629841 tempest-HostsAdminNegativeTestJSON-155629841-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037081 Jul 26 04:28:08.724837 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 316/623] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Jul 26 04:28:08 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:28:08.782483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:08.782483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:08.795968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:08.796409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:08.805055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:08.805794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.071046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:09.073288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:09.088427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.093539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.094823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.095473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.401725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:09.412252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:09.413754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:09.414960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d9e9dc9-fb5c-44db-8efe-6683604d0972 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.641902 Jul 26 04:28:09.415511 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 308/624] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:08 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:09.421945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:09.429950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:09.431841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f939f72c-e646-49d8-9dcf-5cf5733bf772 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.364553 Jul 26 04:28:09.432944 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 317/625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:09 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:09.434634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:09.455458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.456262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.457273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.457959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.608401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:09.629196 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aeaabe5c-dfe4-4068-9ed8-32a001828464 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1293 microversion: 2.1 time: 0.212416 Jul 26 04:28:09.630962 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 309/626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:09 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:09.659892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:09.661181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:09.674611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.676212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:09.679962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:09.680722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:10.059082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4d27be9f-22e0-4b2c-9945-5e3221fa791d req-2ac5df62-8b7b-44c9-93d6-f5c10acedb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "name": "network-vif-unplugged", "status": "completed", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:10.078587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4d27be9f-22e0-4b2c-9945-5e3221fa791d req-2ac5df62-8b7b-44c9-93d6-f5c10acedb79 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:10.079383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4d27be9f-22e0-4b2c-9945-5e3221fa791d req-2ac5df62-8b7b-44c9-93d6-f5c10acedb79 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:10.096588 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4d27be9f-22e0-4b2c-9945-5e3221fa791d req-2ac5df62-8b7b-44c9-93d6-f5c10acedb79 service nova] Creating event network-vif-unplugged:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h2-848886-16 Jul 26 04:28:10.102596 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4d27be9f-22e0-4b2c-9945-5e3221fa791d req-2ac5df62-8b7b-44c9-93d6-f5c10acedb79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050514 Jul 26 04:28:10.103940 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 310/627] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:10.233920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:10.242142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af049763-7df5-47d0-b4a8-eaf70da37cfd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1470 microversion: 2.1 time: 0.588829 Jul 26 04:28:10.245466 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 318/628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:09 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:10.447050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:10.447804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:10.456134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:10.457018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:10.464713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:10.465169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:10.465377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:10.466000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:10.466465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:10.466912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:10.467360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:10.467963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:11.228568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:11.233283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:11.244477 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b6073d2-2465-47cd-82c2-a33d042338ff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.791279 Jul 26 04:28:11.245186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 319/629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:10 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:11.256201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:11.260796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:11.276134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:11.287173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:11.288267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:11.288861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:11.572667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:11.588803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:11.597092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:11.598732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:11.602889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b262ef4-7b7f-46fa-b59f-61fb050ed548 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 1.162953 Jul 26 04:28:11.608164 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 311/630] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:10 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:11.621717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:11.622474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:11.628110 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d33b467-c9ee-4e83-8f7a-bd49bee7b422 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1299 microversion: 2.1 time: 0.362328 Jul 26 04:28:11.628782 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 320/631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:11 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1299 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:11.665150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:11.665615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:11.666440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:11.666893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.272782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:12.273976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:12.284598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.285093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.285817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.289659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:12.295221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.298680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0fb68c03-3895-4a57-bf69-1f64b6b37c40 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1470 microversion: 2.1 time: 0.687133 Jul 26 04:28:12.304932 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 312/632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:11 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1470 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:12.635183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:12.635923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:12.651018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.651747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.653574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.656646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.768692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:12.781287 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37351ac1-a519-405f-894e-edd98dc06bad tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.518954 Jul 26 04:28:12.783404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 321/633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:12 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:28:12.792659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:12.796966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:12.826806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.827844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:12.830053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:12.833087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:13.075598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:13.091534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:13.094793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:13.097125 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4599b7c8-848e-4b7c-9dea-00173511220a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1568 microversion: 2.25 time: 0.466377 Jul 26 04:28:13.112528 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 313/634] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:12 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1568 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:28:13.127836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b5ed2e01-4d25-4d0a-824f-708a8449a49a req-3146fd24-8dd1-4aa8-83e2-6ac01f8aa456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb32bf2-6125-40c8-a091-faf2871f46e4", "name": "network-vif-plugged", "status": "completed", "tag": "b89db3b8-434c-4cd3-87e0-9370fd2b13cf"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:13.158994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b5ed2e01-4d25-4d0a-824f-708a8449a49a req-3146fd24-8dd1-4aa8-83e2-6ac01f8aa456 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:13.160667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b5ed2e01-4d25-4d0a-824f-708a8449a49a req-3146fd24-8dd1-4aa8-83e2-6ac01f8aa456 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:13.188668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b5ed2e01-4d25-4d0a-824f-708a8449a49a req-3146fd24-8dd1-4aa8-83e2-6ac01f8aa456 service nova] Creating event network-vif-plugged:b89db3b8-434c-4cd3-87e0-9370fd2b13cf for instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 on n-h2-848886-16 Jul 26 04:28:13.204331 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b5ed2e01-4d25-4d0a-824f-708a8449a49a req-3146fd24-8dd1-4aa8-83e2-6ac01f8aa456 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086304 Jul 26 04:28:13.206963 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 314/635] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:13.327982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:13.328846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:13.354707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:13.356225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:13.358172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:13.360433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:13.646976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:13.664926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4656867-f228-4671-9248-19874ecd3d71 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.878734 Jul 26 04:28:13.679505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 322/636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:12 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:13.807329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:13.808345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:13.835938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:13.837025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:13.839728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:13.843290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.089445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:14.133701 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76fb2035-811e-4bc7-bae8-b3b4223870e3 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1323 microversion: 2.1 time: 0.329125 Jul 26 04:28:14.158468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 323/637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:13 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:14.180924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:14.182734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:14.194126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:14.205579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.205820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-069661bd-beea-47ac-8f82-80ffcb94ed56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.880125 Jul 26 04:28:14.206529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.208272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.208951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.213414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 315/638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:13 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:14.480575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:14.507006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:14.512990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:14.519118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5359aa0-edbc-499e-94ea-f611ed5b52b3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1543 microversion: 2.25 time: 0.356294 Jul 26 04:28:14.521242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 324/639] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:14 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1543 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:14.549982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58f60af1-4fe4-43ec-9ea4-c34ddd2615e3 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '.version_select at 0x7f38b5f76430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:14.554275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58f60af1-4fe4-43ec-9ea4-c34ddd2615e3 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.555818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58f60af1-4fe4-43ec-9ea4-c34ddd2615e3 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.568428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58f60af1-4fe4-43ec-9ea4-c34ddd2615e3 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.029347 Jul 26 04:28:14.580629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 316/640] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 26 04:28:14 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:14.592924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:14.596197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:14.603750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.604486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.605483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.606723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.868258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ccaf10e-68d5-415a-9804-6fef94d691f5 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:14.878617 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ccaf10e-68d5-415a-9804-6fef94d691f5 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.328605 Jul 26 04:28:14.879655 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 325/641] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:28:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:14.892666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:14.893262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:14.901671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.903246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:14.904962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:14.905404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.128844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:28:15.176161 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-82b432db-bba2-46c2-b60e-ebe0421da9fa tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 2038 microversion: 2.25 time: 0.591259 Jul 26 04:28:15.178629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 317/642] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:14 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 2038 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:15.246316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:15.260145 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-762e5a53-13f8-4f38-8c44-b87934f0b1bf tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.376128 Jul 26 04:28:15.262119 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 326/643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:14 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:15.275243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:15.276190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:15.284096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.284951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.286843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.287560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.511361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5ee7c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:15.553669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:15.565242 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0a31e01-0aae-4034-830f-b8c556f6ca9c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1473 microversion: 2.1 time: 0.301279 Jul 26 04:28:15.566940 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 327/644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:15 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:15.573112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f2065d2-eb41-46ec-b5aa-9a23f5dbdc4e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: .version_select at 0x7f38b5f57310>, body: {"keypair": {"name": "tempest-keypair-273969355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC/RuS4RpxcKCe6CjFpiWeEvxWUHxOUKYGTO4VEz5uoGYQaUfwV5d+fAgSZLjJ4kp1ln3fcxqudf3s62ibuszzZFXveD46Cim8GLR3Gz6asbmjIzk8GT6Gh5nXGQU9KEA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:15.612293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f2065d2-eb41-46ec-b5aa-9a23f5dbdc4e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:15.618841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f2065d2-eb41-46ec-b5aa-9a23f5dbdc4e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for user e06c8cb7d10e4818a7e40396b93e54ab and project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:15.634049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.634556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.635387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.635825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.656935 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f2065d2-eb41-46ec-b5aa-9a23f5dbdc4e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.088513 Jul 26 04:28:15.657548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 328/645] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:28:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:28:15.663423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:15.664399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:15.672230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.672871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.674384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.674991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.746047 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec1782df-a7f4-4820-8728-4a0b6f228f00 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24" status: 200 len: 148 microversion: 2.57 time: 0.564174 Jul 26 04:28:15.747249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 318/646] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Jul 26 04:28:15 2022] PUT /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24 => generated 148 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:15.755420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:15.758784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:15.773845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.774327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.775108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.775546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.832043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Request method failure captured: Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4/diagnostics HTTP/1.1 Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321H1eTNE8ay2lmmRonru4LlXz7hmQBmptT_xYK1OcUBHfA-Cd-0uhw6LCx5YD2BASH7ZYgmaJ0Qx6_GdVAoav8wScdC8AWDvPlQMZUacC86Q-Hd1tsS1HFUQgJ9EwCAIPMwRRHdA6hJ9L0YWcbbLYFvF2OUVwEQYlkLmoati3-2d6Y Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: bd55d6583e8d4b6fbad2a67de1a0556c Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:15.837519 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: bd55d6583e8d4b6fbad2a67de1a0556c Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiagnosticsNegativeTest-620599261-project Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b5ce37fdfa974cda9782b7ee7fad0b2c Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-620599261-project Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:28:15.839188 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '5fb32bf2-6125-40c8-a091-faf2871f46e4'} Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:28:15.839892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:15.841065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:15.842011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-683fbf50-6bd8-4839-a6b8-8d4a5d7955e0 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.090284 Jul 26 04:28:15.846103 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 319/647] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:28:15 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4/diagnostics => generated 117 bytes in 98 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:15.859184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Calling method '.version_select at 0x7f38b5ee7ca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:15.974041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.982999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:15.984622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:15.985166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.038616 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc013015-a975-48aa-871a-78675d94dceb tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24/detail" status: 200 len: 463 microversion: 2.57 time: 0.190923 Jul 26 04:28:16.040770 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 320/648] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Jul 26 04:28:15 2022] GET /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24/detail => generated 463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:16.064945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:16.065442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:16.100584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.103075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.104464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.107976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.150753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:16.164797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-190e1f56-340e-4133-abe1-b8be1fd75a54 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.505175 Jul 26 04:28:16.169839 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 329/649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:15 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:16.186884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:28:16.187197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c4642f29-8286-4e17-8f82-84d00a4728d5 req-5ea2450f-770c-46c8-9027-705409adbdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a9d026-f007-4d08-9d3d-f64b9a6e536b", "tag": "7de0d3c4-7692-4f24-ac6e-acfb2c47ed82"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:16.214115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c4642f29-8286-4e17-8f82-84d00a4728d5 req-5ea2450f-770c-46c8-9027-705409adbdf8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.214602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c4642f29-8286-4e17-8f82-84d00a4728d5 req-5ea2450f-770c-46c8-9027-705409adbdf8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.224551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:16.239074 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c4642f29-8286-4e17-8f82-84d00a4728d5 req-5ea2450f-770c-46c8-9027-705409adbdf8 service nova] Creating event network-changed:7de0d3c4-7692-4f24-ac6e-acfb2c47ed82 for instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b on n-h2-848886-16 Jul 26 04:28:16.258536 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c4642f29-8286-4e17-8f82-84d00a4728d5 req-5ea2450f-770c-46c8-9027-705409adbdf8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072078 Jul 26 04:28:16.263242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 330/650] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:16.288047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:16.289941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:16.305332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.307243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.309454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.311420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.378576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc96ab61-36df-4136-850f-2d319b91ac6c tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 204 len: 0 microversion: 2.1 time: 0.336053 Jul 26 04:28:16.379544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 321/651] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:28:16 2022] DELETE /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:28:16.385627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5f6bdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:16.458138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.458628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.459432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.459868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.499037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.499799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.500751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.501347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.571313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:16.585282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba38dd66-dbab-4ae6-b779-10fc0a356438 tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24?user_id=da744e9da4634129ba3f1e4469b5681d" status: 200 len: 148 microversion: 2.57 time: 0.204400 Jul 26 04:28:16.586779 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 322/652] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Jul 26 04:28:16 2022] PUT /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24?user_id=da744e9da4634129ba3f1e4469b5681d => generated 148 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:16.593270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-982828648", "imageRef": "e3608315-7d40-4d3b-984b-6ba4d4e64863", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:16.662693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:16.703910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:16.717310 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92fd71a4-0e93-4eda-9ffa-f34540e2d9ab tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.434137 Jul 26 04:28:16.735742 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 331/653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:16 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:16.743541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:16.744145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:16.750837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.751578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:16.752518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:16.753109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:17.029338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:17.045479 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce001cd5-528e-4868-b8a7-d96501c60a1b tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1479 microversion: 2.1 time: 0.306016 Jul 26 04:28:17.055249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 332/654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:16 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1479 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:17.065782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6859c877-f4e6-4cfe-aa9d-01e1b8fecc0c tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] Calling method '.version_select at 0x7f38b5ddeb80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:17.212646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:17.217560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6859c877-f4e6-4cfe-aa9d-01e1b8fecc0c tempest-QuotasAdminTestV257-1200269272 tempest-QuotasAdminTestV257-1200269272-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24?user_id=da744e9da4634129ba3f1e4469b5681d" status: 200 len: 190 microversion: 2.57 time: 0.160897 Jul 26 04:28:17.218185 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 333/655] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Jul 26 04:28:17 2022] GET /compute/v2.1/os-quota-sets/3bbc9f53c6f24ccea91435ce74fecb24?user_id=da744e9da4634129ba3f1e4469b5681d => generated 190 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:17.238216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:17.239068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:17.254638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:17.256200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:17.258944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:17.259649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:17.384764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:17.411705 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] Request method failure captured: Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 142 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321eLEzHIFSLEzyQDMFw-DhNYO6c8Sjds74zDr8QKy6CLnXk6SLTPJrZ5FDZEJMQx-iZ3MDT4PJxI1R9fKIwwLwYm5Fs_ZC5d6i_wGzmjlo-45o_RdQBamFnI7BKz6T-Aa6epPjHcjOPbVONhecrKqpppQ7LR6dyNq_uagSPaf-X-7k Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0560c4d58682494482684e2d46fc9635 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FlavorsV2NegativeTest-210418777 Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:17.413922 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0560c4d58682494482684e2d46fc9635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0560c4d58682494482684e2d46fc9635"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0560c4d58682494482684e2d46fc9635"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0560c4d58682494482684e2d46fc9635"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FlavorsV2NegativeTest-210418777 Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0560c4d58682494482684e2d46fc9635 Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-210418777 Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FlavorsV2NegativeTest-210418777-project Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d08d03041dd54f53a9a0bb2bae9f70b3 Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FlavorsV2NegativeTest-210418777-project Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-982828648", "imageRef": "e3608315-7d40-4d3b-984b-6ba4d4e64863", "flavorRef": "452"}} Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:28:17.415520 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor's memory is too small for requested image. Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-982828648', 'imageRef': 'e3608315-7d40-4d3b-984b-6ba4d4e64863', 'flavorRef': '452'}}} Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:17.416477 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:17.417873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 26 04:28:17.419674 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:17.421508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:17.422819 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bc2323b-23e8-4d4c-8d37-0e1baaf72040 tempest-FlavorsV2NegativeTest-210418777 tempest-FlavorsV2NegativeTest-210418777-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.834879 Jul 26 04:28:17.423588 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 323/656] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:16 2022] POST /compute/v2.1/servers => generated 93 bytes in 836 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:28:17.664278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:17.687089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-edde51fe-b85f-48f3-b965-43e40a286130 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.454125 Jul 26 04:28:17.688313 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 334/657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:17 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:17.747984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:17.748828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:17.767105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:17.768052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:17.769061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:17.771811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:18.069055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:18.070479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:18.083622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:18.084076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:18.084858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:18.088667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:18.571771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:18.581644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14dfbad7-c196-4346-bca8-04362b9dbe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.838887 Jul 26 04:28:18.585181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 324/658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:17 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:18.676568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:18.689389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14a5730a-2efb-4b4d-8783-b366cc543107 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1479 microversion: 2.1 time: 0.624906 Jul 26 04:28:18.692415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 335/659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:18 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1479 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:28:18.711516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:18.712724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:18.726724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:18.727175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:18.729616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:18.732593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:18.793057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-516378642", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "96b59dc4-002c-4352-aa03-a56e9ddf1f5b"}], "security_groups": [{"name": "tempest-securitygroup--423757614"}], "key_name": "tempest-keypair-273969355", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:19.005084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] validate_networks() for [('96b59dc4-002c-4352-aa03-a56e9ddf1f5b', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:19.295801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:19.306770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4982232f-0da9-449e-8b49-419373ac4e56 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.601724 Jul 26 04:28:19.311116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 325/660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:18 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:28:19.605039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:19.605281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:19.605466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:19.605957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:19.606102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:19.606384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:19.606792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:19.617108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.617554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.618934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.618934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.620525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.620985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.622567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.623170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.638207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:19.642295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for user e06c8cb7d10e4818a7e40396b93e54ab and project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:19.654652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:19.656530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:19.712658 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2f60651-0dad-4195-9f01-cfb407e9f55b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.925964 Jul 26 04:28:19.714348 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 336/661] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:28:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:28:19.720498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:19.721781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:19.732943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.733540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.734591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:19.735094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:19.918727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:19.927527 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-710f9638-36eb-416e-95df-73c54c0b6a22 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1479 microversion: 2.1 time: 0.211751 Jul 26 04:28:19.928502 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 337/662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:19 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1479 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:19.934473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:19.945043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:20.044562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:20.054708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:20.056356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:20.060212 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1131161e-2cac-49f6-b3bb-fa3ae4f78d97 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1284 microversion: 2.25 time: 0.129293 Jul 26 04:28:20.061187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 338/663] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:19 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:20.303530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a2ecc993-ccc2-4cac-aebd-b8a66017c942 req-3f993728-fab5-4e55-a5a4-63afcef794ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb32bf2-6125-40c8-a091-faf2871f46e4", "name": "network-vif-deleted", "tag": "b89db3b8-434c-4cd3-87e0-9370fd2b13cf"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:20.322747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:20.334203 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b96ec51-df4a-435d-aec4-265ded1a49a6 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.733057 Jul 26 04:28:20.337042 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 326/664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:19 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:28:20.338212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2ecc993-ccc2-4cac-aebd-b8a66017c942 req-3f993728-fab5-4e55-a5a4-63afcef794ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:20.340761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2ecc993-ccc2-4cac-aebd-b8a66017c942 req-3f993728-fab5-4e55-a5a4-63afcef794ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:20.344934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:20.345827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:20.370122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a2ecc993-ccc2-4cac-aebd-b8a66017c942 req-3f993728-fab5-4e55-a5a4-63afcef794ec service nova] Creating event network-vif-deleted:b89db3b8-434c-4cd3-87e0-9370fd2b13cf for instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 on n-h2-848886-16 Jul 26 04:28:20.380552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a2ecc993-ccc2-4cac-aebd-b8a66017c942 req-3f993728-fab5-4e55-a5a4-63afcef794ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080262 Jul 26 04:28:20.381581 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 339/665] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:28:20.386508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:20.387874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:20.392778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:20.393336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:20.636287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:20.650312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b8b10c92-b8d5-4b63-b3dd-b8a1273c0dcd tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.311896 Jul 26 04:28:20.651413 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 327/666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:20 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:20.951685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:20.952651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:20.967178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:20.967626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:20.970993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:20.971478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.073050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ce37fdfa974cda9782b7ee7fad0b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd55d6583e8d4b6fbad2a67de1a0556c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.091860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-53f2a0bc-32d6-4151-b3d5-ef9c4ee28bff tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 200 len: 1437 microversion: 2.1 time: 0.146002 Jul 26 04:28:21.093460 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 340/667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:20 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:21.102239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:21.103397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:21.135624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.138911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.139932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.142385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.257276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.279268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.283867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.289783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5daed086-9f3d-4392-9a08-d8c4b900abc2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1288 microversion: 2.25 time: 0.194549 Jul 26 04:28:21.292693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 341/668] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:21 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1288 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:21.362464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:21.364303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:21.383548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.385593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.386636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.390403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.433510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:21.486059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1422122579", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "d49ad6d2-e7e8-4c36-8548-0d97bda875ad"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:21.568043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] validate_networks() for [('d49ad6d2-e7e8-4c36-8548-0d97bda875ad', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:21.586117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.596751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67cb314d-fa38-420d-bc0a-9d4abe0dab78 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.240566 Jul 26 04:28:21.597340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 342/669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:21 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:21.675546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:21.676750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:21.690571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.693533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.695342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:21.696012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:21.953310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:21.967637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86a851d4-b809-482e-9b8e-5d3ce51ef787 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.297674 Jul 26 04:28:21.974670 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 343/670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:21 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:22.112619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:22.113238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] [instance: 5fb32bf2-6125-40c8-a091-faf2871f46e4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:22.127527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.128927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:22.129752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.130210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:22.188197 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] HTTP exception thrown: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Request method failure captured: Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 HTTP/1.1 Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321H1eTNE8ay2lmmRonru4LlXz7hmQBmptT_xYK1OcUBHfA-Cd-0uhw6LCx5YD2BASH7ZYgmaJ0Qx6_GdVAoav8wScdC8AWDvPlQMZUacC86Q-Hd1tsS1HFUQgJ9EwCAIPMwRRHdA6hJ9L0YWcbbLYFvF2OUVwEQYlkLmoati3-2d6Y Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: bd55d6583e8d4b6fbad2a67de1a0556c Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:22.192184 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bd55d6583e8d4b6fbad2a67de1a0556c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: bd55d6583e8d4b6fbad2a67de1a0556c Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-620599261 Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerDiagnosticsNegativeTest-620599261-project Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: b5ce37fdfa974cda9782b7ee7fad0b2c Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-620599261-project Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. Jul 26 04:28:22.193794 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '5fb32bf2-6125-40c8-a091-faf2871f46e4'} Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:22.194722 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. Jul 26 04:28:22.196457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:22.197875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] Returning 404 to user: Instance 5fb32bf2-6125-40c8-a091-faf2871f46e4 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:22.197875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dcbc3986-3c02-4361-954c-efb56ab24da7 tempest-ServerDiagnosticsNegativeTest-620599261 tempest-ServerDiagnosticsNegativeTest-620599261-project] 10.222.0.43 "GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4" status: 404 len: 111 microversion: 2.1 time: 0.084866 Jul 26 04:28:22.197875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 344/671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:22 2022] GET /compute/v2.1/servers/5fb32bf2-6125-40c8-a091-faf2871f46e4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:28:22.318126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:22.318767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:22.328005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.328463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:22.329255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.329696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:22.476778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:22.492121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:22.495550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:22.499224 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bda90bff-5a0f-43bb-b017-e5e0afc835be tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1354 microversion: 2.25 time: 0.185006 Jul 26 04:28:22.500192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 345/672] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:22 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:22.620587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:22.622103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:22.639224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.639224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:22.639964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:22.640896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.117450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:23.131688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2953938c-bc85-41f9-b3d9-118e2e606596 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.517465 Jul 26 04:28:23.133492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 346/673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:22 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:23.139409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:23.145177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:23.159559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.160281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.166314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.167115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.200735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:23.201300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:23.201962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:23.202465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:23.203023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:23.224786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.225244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.232262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.232952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.282421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:23.290984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for user 97734a3da7ef4a809b0edd23ac216dfb and project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:23.317457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:23.319770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:23.454516 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53c2fe19-4a05-4c20-b367-b59001b95715 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461695 Jul 26 04:28:23.455168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 328/674] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:28:23.474075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ade8a2fb-926a-4530-b9b9-71540121e1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:23.476220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ade8a2fb-926a-4530-b9b9-71540121e1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:23.589303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:23.601735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42cb1d78-c411-4c7f-9246-7f9e5354a4bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.465141 Jul 26 04:28:23.602111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 347/675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:23 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:23.607687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:23.608573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:23.619318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.622362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.648295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:23.649068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:23.723129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:23.733534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:23.735172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:23.736235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2a5da38-852a-45ea-b0a7-b043b072d7a4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1342 microversion: 2.25 time: 0.132316 Jul 26 04:28:23.736806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 348/676] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:23 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1342 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:24.070647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ade8a2fb-926a-4530-b9b9-71540121e1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:24.082835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ade8a2fb-926a-4530-b9b9-71540121e1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1211 microversion: 2.1 time: 0.620138 Jul 26 04:28:24.087629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 329/677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:23 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1211 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:24.153223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:24.153936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:24.164366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.167158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:24.168760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.171821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:24.509495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43a8aa22-d104-4220-bb48-de14c71039aa tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] Action: 'create', calling method: .version_select at 0x7f38b5de00d0>, body: {"security_group": {"name": "tempest-securitygroup-602113651", "description": "tempest-description-1884458562"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:24.612555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:24.639047 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-989db361-6e51-455e-aa29-0cab1c03422f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.489900 Jul 26 04:28:24.640863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 330/678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:24 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:28:24.666248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:24.669939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:24.701611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.702468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:24.704179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.704789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:24.935058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43a8aa22-d104-4220-bb48-de14c71039aa tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.819019 Jul 26 04:28:24.935656 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 349/679] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:28:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:24.941342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:24.941951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:24.976003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.977844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:24.978915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:24.981611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:25.106074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:25.121224 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26edeb75-44f8-49cb-b410-73b38ebe0ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.478939 Jul 26 04:28:25.125582 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 331/680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:24 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:25.132941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5122f95c-1eeb-4110-8963-8ce25f4c07f6 tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] Action: 'create', calling method: .version_select at 0x7f38b5eb9670>, body: {"security_group": {"name": "tempest-securitygroup-1709154678", "description": "tempest-description-1243339978"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:25.304460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:25.313137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:25.314712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:25.315836 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c17cd88-c1fd-430a-9b37-01d38a44ed6a tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.379260 Jul 26 04:28:25.335337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 350/681] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:24 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:25.350398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:25.351583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:25.376046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:25.380553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:25.386894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:25.393657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:25.580899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:25.599527 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6f864a29-f1db-4965-a40a-f57893f0ff92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1269 microversion: 2.1 time: 0.259706 Jul 26 04:28:25.603718 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 351/682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:25 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:25.663656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:25.664536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:25.679645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:25.680488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:25.682172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:25.682821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:25.867078 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5122f95c-1eeb-4110-8963-8ce25f4c07f6 tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.740040 Jul 26 04:28:25.867673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 332/683] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:28:25 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:26.177013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1edf1197-6cf3-4ab7-ab7a-66182df4230f tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] Action: 'create', calling method: .version_select at 0x7f38b5f76c10>, body: {"security_group": {"name": "tempest-securitygroup-332895020", "description": "tempest-description-1246025216"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:26.209102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:26.225850 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3755283-2963-4416-8cd4-9acb44e289f5 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.567259 Jul 26 04:28:26.227171 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 352/684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:25 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:26.240200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:26.241024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:26.248862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:26.249559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:26.250591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:26.251190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:26.525347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:26.534814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b96a9c7-8092-4e93-96af-c4e1976fbcda tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.304836 Jul 26 04:28:26.535401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 353/685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:26 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:26.544789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:26.545404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:26.573386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:26.574771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:26.576210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:26.576351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.211641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:27.227458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:27.229301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:27.235249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3a4afa6-cc4f-4cf3-a54d-9be738adbf0f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.698811 Jul 26 04:28:27.238383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 354/686] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:26 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:27.251947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:27.256353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:27.279086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:27.279674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.280690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:27.281491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.468408 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1edf1197-6cf3-4ab7-ab7a-66182df4230f tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.590653 Jul 26 04:28:27.470039 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 333/687] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:28:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:27.475612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ff45963a-e536-4495-aead-7450de95e7b8 req-f5e0e677-0e85-4bfe-a1fe-06769ddf2fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a9d026-f007-4d08-9d3d-f64b9a6e536b", "name": "network-vif-plugged", "status": "completed", "tag": "7de0d3c4-7692-4f24-ac6e-acfb2c47ed82"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:27.503324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff45963a-e536-4495-aead-7450de95e7b8 req-f5e0e677-0e85-4bfe-a1fe-06769ddf2fbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:27.503970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff45963a-e536-4495-aead-7450de95e7b8 req-f5e0e677-0e85-4bfe-a1fe-06769ddf2fbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.519164 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ff45963a-e536-4495-aead-7450de95e7b8 req-f5e0e677-0e85-4bfe-a1fe-06769ddf2fbc service nova] Creating event network-vif-plugged:7de0d3c4-7692-4f24-ac6e-acfb2c47ed82 for instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b on n-h2-848886-16 Jul 26 04:28:27.534752 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ff45963a-e536-4495-aead-7450de95e7b8 req-f5e0e677-0e85-4bfe-a1fe-06769ddf2fbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063153 Jul 26 04:28:27.539825 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 334/688] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:27.561630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:27.565544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:27.578844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:27.579502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.580752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:27.593706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:27.922984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:27.930561 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93f52ef3-97b2-4578-9f50-a7d02db554b8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.690761 Jul 26 04:28:27.935930 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 355/689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:27 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:27.940965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8836af4a-bd5b-4fb1-8092-e490f197e0ae tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] Action: 'create', calling method: .version_select at 0x7f38b5e73dc0>, body: {"security_group": {"name": "tempest-securitygroup-2143213444", "description": "tempest-description-1743909871"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:28.135205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:28.148770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6acc4ef9-563e-4a2a-a3a1-24b4c57f14c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1366 microversion: 2.1 time: 0.607575 Jul 26 04:28:28.151453 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 335/690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:27 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:28.161756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:28.166192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:28.185972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:28.186640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:28.189638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:28.190964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:28.502061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8836af4a-bd5b-4fb1-8092-e490f197e0ae tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.563967 Jul 26 04:28:28.503371 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 356/691] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:28:27 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:28.512656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6fff9f12-3541-4d61-924c-64a3566eb2fb req-0b75b83b-ec5d-4d83-95d2-9fe14255319e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:28.545823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6fff9f12-3541-4d61-924c-64a3566eb2fb req-0b75b83b-ec5d-4d83-95d2-9fe14255319e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:28.548002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6fff9f12-3541-4d61-924c-64a3566eb2fb req-0b75b83b-ec5d-4d83-95d2-9fe14255319e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:28.587490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6fff9f12-3541-4d61-924c-64a3566eb2fb req-0b75b83b-ec5d-4d83-95d2-9fe14255319e service nova] Creating event network-changed:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:28:28.594527 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6fff9f12-3541-4d61-924c-64a3566eb2fb req-0b75b83b-ec5d-4d83-95d2-9fe14255319e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088084 Jul 26 04:28:28.598600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 357/692] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:28.608256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:28.609206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:28.617881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:28.618685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:28.620674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:28.622345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:28.700237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:28.714909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe0a437c-ec5a-4042-bfe7-d0d1d546c7e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1475 microversion: 2.1 time: 0.561056 Jul 26 04:28:28.717040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 336/693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:28 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1475 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:28.730042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-faf001db-6d34-43bd-9ec4-4196bd6be6e5 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] Calling method '.version_select at 0x7f38b5f76c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:29.041958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:29.066554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:29.071092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:29.075173 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8865868f-17ec-4ffc-8579-ca1032604a0e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.475065 Jul 26 04:28:29.080812 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 358/694] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:28 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:29.096499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:29.108258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:29.118497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:29.119203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:29.120217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:29.120862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:29.436558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:29.479887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8b47d38-7031-4aeb-8ea1-525046eaa2a3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.393525 Jul 26 04:28:29.484706 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 359/695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:29 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:29.629574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:29.737067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-288409296", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:29.818984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:30.049062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=60 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:30.359002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:30.359414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:30.360254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:30.360523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:30.361119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:30.374608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.375322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:30.376324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.376983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:30.398783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Getting quotas for project 3bd21fb79414419e9fd04fda07d4f8ce. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:30.407663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Getting quotas for user 3c712491db8a455b8d9a627c58e8bc13 and project 3bd21fb79414419e9fd04fda07d4f8ce. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:30.420836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:30.423714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:30.500716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dee92774-445b-4ca0-97c8-3a2c1d1e2ed9 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010682 Jul 26 04:28:30.502601 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 360/696] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:30.517376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:30.518804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:30.533019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.534359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:30.535348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.535951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:30.910394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:30.922598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04c91d2e-30e1-444a-8175-25fd32f8fff4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1557 microversion: 2.1 time: 0.418565 Jul 26 04:28:30.923568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 361/697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:30 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1557 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:30.934655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:30.935435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:30.941988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.942545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:30.943544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:30.944065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.317914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:31.327709 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-156379ca-7085-4dc2-9448-b5eab2e5e161 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1474 microversion: 2.1 time: 0.400230 Jul 26 04:28:31.328294 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 362/698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:30 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:31.343705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:31.353461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:31.361813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:31.364773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.370492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:31.372370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.386327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:31.650050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:31.660554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:31.662684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:31.664033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32f05735-ff5f-4109-a8ee-b08f847fdd6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.330123 Jul 26 04:28:31.665429 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 363/699] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:31 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:31.671717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "name": "network-vif-unplugged", "status": "completed", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:31.682531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:31.683262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.705043 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] Creating event network-vif-unplugged:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h2-848886-16 Jul 26 04:28:31.711621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] Instance fb4f03d1-a8d0-425d-a569-519280cec48f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:28:31.729243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c3edeb77-cf71-45a1-bacb-115ae0fd8576 req-28de2f3a-4dc6-45f4-990d-cbd601719d30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062078 Jul 26 04:28:31.731493 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 364/700] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:31.741863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:31.742787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:31.752278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:31.752742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.755046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:31.758880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:31.974417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:31.992353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-427e5e91-f808-4423-9877-ac5d2fe90a65 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.258755 Jul 26 04:28:32.006977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 365/701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:31 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:32.012663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:32.013282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:32.022254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.022713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.023503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.023945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.478179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:32.486029 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0a3b337-141c-4d21-8b42-c5ca4995efca tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1281 microversion: 2.1 time: 0.477763 Jul 26 04:28:32.486650 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 366/702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:32 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1281 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:32.491586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3d16fc0d-222a-43c8-a70f-588645f85760 req-beb462c2-e618-4b70-b498-6518b1e0f619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:32.504737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3d16fc0d-222a-43c8-a70f-588645f85760 req-beb462c2-e618-4b70-b498-6518b1e0f619 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.505582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3d16fc0d-222a-43c8-a70f-588645f85760 req-beb462c2-e618-4b70-b498-6518b1e0f619 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.519834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3d16fc0d-222a-43c8-a70f-588645f85760 req-beb462c2-e618-4b70-b498-6518b1e0f619 service nova] Creating event network-changed:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h2-848886-16 Jul 26 04:28:32.526202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3d16fc0d-222a-43c8-a70f-588645f85760 req-beb462c2-e618-4b70-b498-6518b1e0f619 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038041 Jul 26 04:28:32.527954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 367/703] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:32.534767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:32.535594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:32.543887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.544888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.546566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.547460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.732639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-faf001db-6d34-43bd-9ec4-4196bd6be6e5 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13670 microversion: 2.1 time: 4.014231 Jul 26 04:28:32.733765 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 337/704] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Jul 26 04:28:28 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13670 bytes in 4016 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:32.739647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:32.740488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:32.741428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b6e9926-dba9-45d1-8a17-4b133fb331c4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211848 Jul 26 04:28:32.743095 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 368/705] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:28:32 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:32.748338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:32.749163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.749672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:32.749899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.750823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.751378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.767592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:32.769325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.769944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:32.770944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:32.771547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.052154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.065915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e9eee29-0622-46d3-9f62-45d7b8c567e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1474 microversion: 2.1 time: 0.330566 Jul 26 04:28:33.081165 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 338/706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:32 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:33.086730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7f46d8d-ea97-4d59-bbf9-99ba5c32d09a tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] Calling method '.version_select at 0x7f38b5ee7c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:33.126101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.135946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.138831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.139634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37386028-dc9d-4301-af0e-0ab9a2a08bf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.395373 Jul 26 04:28:33.140192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 369/707] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:32 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:33.164515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:33.166145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:33.184032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:33.184969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.186180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:33.187535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.256124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=20 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:33.533330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.555153 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17c1422a-02c7-41d1-9488-dc8736b86bcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.399152 Jul 26 04:28:33.555925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 370/708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:33 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:33.566461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:33.567290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:33.584527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:33.585150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.586196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:33.586856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.709799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:33.719855 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-adc5b8e8-1654-4129-b525-819dd539ee26 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1279 microversion: 2.1 time: 0.162504 Jul 26 04:28:33.723132 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 371/709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:33 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:33.731517 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7f46d8d-ea97-4d59-bbf9-99ba5c32d09a tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.648581 Jul 26 04:28:33.732415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 339/710] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Jul 26 04:28:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:33.751066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b029d81b-339e-462a-8f8b-a93fed3b53a6 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] Calling method '.version_select at 0x7f38b5d6d3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:33.763964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:33.776298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:33.776739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:33.790906 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] Creating event network-changed:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h2-848886-16 Jul 26 04:28:33.799214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] Instance fb4f03d1-a8d0-425d-a569-519280cec48f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:28:33.822823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-09e34b93-b4a4-40a9-bd4c-7c162028d01f req-33365151-f228-49e9-8191-2b0c6669941e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065722 Jul 26 04:28:33.824721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 340/711] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:28:34.047548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d8908ff-dc2e-4356-927f-dacdc48cef45 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Action: 'create', calling method: .version_select at 0x7f38b609d8b0>, body: {"pool": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:34.078882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=49 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:34.127057 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b029d81b-339e-462a-8f8b-a93fed3b53a6 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5254c7c5-9e73-4000-a3d8-dbac7bba428a" status: 202 len: 0 microversion: 2.1 time: 0.381495 Jul 26 04:28:34.128089 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 372/712] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:28:33 2022] DELETE /compute/v2.1/os-security-groups/5254c7c5-9e73-4000-a3d8-dbac7bba428a => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:34.138722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:34.139684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:34.150420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:34.151974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:34.153921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:34.154627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:34.475529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:34.486801 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42d290b8-1eb1-4681-b878-987cf131bc11 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1474 microversion: 2.1 time: 0.357577 Jul 26 04:28:34.502885 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 373/713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:34 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:34.508072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1530bcb-7303-41f6-a82e-590d361b2d08 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] Calling method '.version_select at 0x7f38b5dde310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:35.340915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1530bcb-7303-41f6-a82e-590d361b2d08 tempest-SecurityGroupsTestAdminJSON-1210649122 tempest-SecurityGroupsTestAdminJSON-1210649122-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1b16e6eb-486f-4c46-8640-cd3e27a2c842" status: 202 len: 0 microversion: 2.1 time: 0.836436 Jul 26 04:28:35.355134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 374/714] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:28:34 2022] DELETE /compute/v2.1/os-security-groups/1b16e6eb-486f-4c46-8640-cd3e27a2c842 => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:35.368275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:35.370089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:35.414983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:35.415779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:35.421758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:35.422367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:35.928859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:35.946215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:35.952914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:35.956072 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c77ed668-cb50-45a0-97c4-f8abc0490c89 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.597954 Jul 26 04:28:35.986297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 375/715] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:35 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:35.995271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:35.996677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:36.005713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:36.006611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:36.010095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:36.010927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:36.849096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:36.862013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee952d0a-52f2-44e0-ba0d-d3dc2510716c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.873853 Jul 26 04:28:36.862913 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 376/716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:35 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:36.884284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:36.885835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:36.893589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:36.894321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:36.896452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:36.897080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.238143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:37.258722 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-236a6be9-1e97-4511-96e7-184274f193a3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1321 microversion: 2.1 time: 0.381754 Jul 26 04:28:37.259616 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 377/717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:36 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:37.269138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cbc16b5e-eb3d-4cad-8e13-d175aae65a33 tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] Calling method '.version_select at 0x7f38b5d6d820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:37.596497 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cbc16b5e-eb3d-4cad-8e13-d175aae65a33 tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/482ec3cc-7287-4237-8435-d2e594deca2f" status: 202 len: 0 microversion: 2.1 time: 0.333244 Jul 26 04:28:37.601505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 378/718] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:28:37 2022] DELETE /compute/v2.1/os-security-groups/482ec3cc-7287-4237-8435-d2e594deca2f => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:37.610488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:37.612204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:37.625471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.629051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.630213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.632673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.836391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:37.845496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfef64f8-aa43-44c1-8e53-25ef9e96d7f1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1472 microversion: 2.1 time: 0.242513 Jul 26 04:28:37.846584 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 379/719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:37 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:37.851453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-62c025f1-f2fc-42c4-80f6-5b25003f1c15 req-a4c15b62-ae8c-44f2-9e4d-5d91d08cfbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1cf253-04a6-4d7a-b2b6-a86cae8c85b8", "tag": "52a71c28-6af4-4560-ab84-21186dd33b12"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:37.861836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-62c025f1-f2fc-42c4-80f6-5b25003f1c15 req-a4c15b62-ae8c-44f2-9e4d-5d91d08cfbb6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.862318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-62c025f1-f2fc-42c4-80f6-5b25003f1c15 req-a4c15b62-ae8c-44f2-9e4d-5d91d08cfbb6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.868177 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d8908ff-dc2e-4356-927f-dacdc48cef45 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.914297 Jul 26 04:28:37.869584 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 341/720] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:28:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:28:37.877237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ec0848b9-1061-4329-b201-736687fd23dd req-f527fa7f-b091-42c7-a5df-85faa5f481c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a9d026-f007-4d08-9d3d-f64b9a6e536b", "tag": "7de0d3c4-7692-4f24-ac6e-acfb2c47ed82"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:37.881344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-62c025f1-f2fc-42c4-80f6-5b25003f1c15 req-a4c15b62-ae8c-44f2-9e4d-5d91d08cfbb6 service nova] Creating event network-changed:52a71c28-6af4-4560-ab84-21186dd33b12 for instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 on n-h1-848886-16 Jul 26 04:28:37.887413 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-62c025f1-f2fc-42c4-80f6-5b25003f1c15 req-a4c15b62-ae8c-44f2-9e4d-5d91d08cfbb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038749 Jul 26 04:28:37.888009 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 380/721] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:37.895276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ec0848b9-1061-4329-b201-736687fd23dd req-f527fa7f-b091-42c7-a5df-85faa5f481c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.895796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ec0848b9-1061-4329-b201-736687fd23dd req-f527fa7f-b091-42c7-a5df-85faa5f481c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.899161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:37.899861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:37.907165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.907850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.908951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:37.909592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:37.912297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ec0848b9-1061-4329-b201-736687fd23dd req-f527fa7f-b091-42c7-a5df-85faa5f481c1 service nova] Creating event network-changed:7de0d3c4-7692-4f24-ac6e-acfb2c47ed82 for instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b on n-h2-848886-16 Jul 26 04:28:37.921872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ec0848b9-1061-4329-b201-736687fd23dd req-f527fa7f-b091-42c7-a5df-85faa5f481c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050538 Jul 26 04:28:37.923193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 342/722] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:37.931334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c90ddb9e-2fa5-47c7-8826-bce0b7d8404c tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] Calling method '.version_select at 0x7f38b609d670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:38.075573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:38.085158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:38.086953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:38.087758 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f58eccb-3b14-4ca1-b265-64848505030b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.196422 Jul 26 04:28:38.088324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 381/723] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:37 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:38.094076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:38.094598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:38.101238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.101693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.102707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.103150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.133692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:28:38.175429 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c90ddb9e-2fa5-47c7-8826-bce0b7d8404c tempest-SecurityGroupsTestAdminJSON-1633853314 tempest-SecurityGroupsTestAdminJSON-1633853314-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2ae6e3c6-4b02-4462-8712-a336537e5956" status: 202 len: 0 microversion: 2.1 time: 0.247923 Jul 26 04:28:38.176501 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 343/724] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:28:37 2022] DELETE /compute/v2.1/os-security-groups/2ae6e3c6-4b02-4462-8712-a336537e5956 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:38.188898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-341d1528-2ef8-4b52-b306-04aa34c56151 req-86fa6b69-279c-4294-b3af-e6575c8b90ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "name": "network-vif-plugged", "status": "completed", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:38.213295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-341d1528-2ef8-4b52-b306-04aa34c56151 req-86fa6b69-279c-4294-b3af-e6575c8b90ae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.214065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-341d1528-2ef8-4b52-b306-04aa34c56151 req-86fa6b69-279c-4294-b3af-e6575c8b90ae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.230018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-341d1528-2ef8-4b52-b306-04aa34c56151 req-86fa6b69-279c-4294-b3af-e6575c8b90ae service nova] Creating event network-vif-plugged:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:28:38.236586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-341d1528-2ef8-4b52-b306-04aa34c56151 req-86fa6b69-279c-4294-b3af-e6575c8b90ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058357 Jul 26 04:28:38.238117 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 344/725] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:38.244905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c60554e-f955-4c4d-91ec-259ff4de16a2 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b5eb9c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:38.281761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-877e87de-2d64-4daf-9642-cea2440e812d tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 204 len: 0 microversion: 2.1 time: 0.191769 Jul 26 04:28:38.282861 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 382/726] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:28:38 2022] DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:28:38.291191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:38.291923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:38.301381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.301986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.302847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.303617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.311770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:38.510716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c60554e-f955-4c4d-91ec-259ff4de16a2 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/1572a76e-6959-4ee6-8d1d-9f546b1db3c7" status: 200 len: 142 microversion: 2.1 time: 0.270069 Jul 26 04:28:38.514756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 345/727] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:28:38 2022] GET /compute/v2.1/os-floating-ips/1572a76e-6959-4ee6-8d1d-9f546b1db3c7 => generated 142 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:38.516421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:38.521221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:38.523881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:38.529553 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d673b687-3dcb-47b7-aaf9-eb4ce9c9f787 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.244807 Jul 26 04:28:38.530629 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 383/728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:38 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:38.532572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.533682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.534656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:38.535255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:38.539369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-728010666", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "1027405834", "adminPass": "***", "networks": [{"uuid": "d6f6af0b-7c9d-4cd4-9267-6637611ab27e"}], "security_groups": [{"name": "tempest-securitygroup--1979498527"}], "key_name": "tempest-keypair-2136406778", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:38.763999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] validate_networks() for [('d6f6af0b-7c9d-4cd4-9267-6637611ab27e', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:38.778660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:38.789877 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97c2524a-954b-40c0-bb7a-883f2c70a49e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1321 microversion: 2.1 time: 0.273870 Jul 26 04:28:38.802288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 346/729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:38 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:38.808468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e5ec617-216c-4592-8540-47a0b47627b9 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b5eb9c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:39.067091 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e5ec617-216c-4592-8540-47a0b47627b9 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.266000 Jul 26 04:28:39.067765 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 347/730] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:28:38 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:39.073134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:39.074335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:39.080596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.081045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.081807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.082267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.225759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:39.234265 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0eb040d-3fab-454c-a237-b2fcc09cae99 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1472 microversion: 2.1 time: 0.165338 Jul 26 04:28:39.235557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 348/731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:39 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:39.243872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4695977d-2610-48cb-9cc3-fdf71b791775 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b609dd30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:39.278818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:39.279311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:39.279768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:39.280183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:39.280599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:39.290386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.290838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.291654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.292088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.315716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:39.320233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Getting quotas for user 1d778337f6d54635ad8c536069f671f0 and project 6ddbcd869e65464a829b3527f13a2cbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:39.332430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:39.335068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:39.394960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6aa2d9b-d7f2-4ee1-b21d-50dfd377018a tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.862950 Jul 26 04:28:39.396089 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 384/732] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:39.401194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:39.402888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:39.410682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.411279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.412178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:39.412629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:39.722640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:39.741375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:39.744525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:39.746341 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0caa97cc-5229-48d2-a856-95bdee3d15c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.348563 Jul 26 04:28:39.776479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 385/733] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:39 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:39.799400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b9c29651-8b92-4425-923c-319d3aa2bad6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:39.800280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b9c29651-8b92-4425-923c-319d3aa2bad6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:39.977281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b9c29651-8b92-4425-923c-319d3aa2bad6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:39.988637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b9c29651-8b92-4425-923c-319d3aa2bad6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1264 microversion: 2.1 time: 0.208601 Jul 26 04:28:39.989292 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 386/734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:39 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:40.002844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:40.002844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:40.010641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.013747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.016267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.018076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.404609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:40.449506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfbda7ce-6582-4a29-a3e0-7e6ac8e96fcb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.459028 Jul 26 04:28:40.454244 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 387/735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:39 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:40.459480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:40.463072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:40.477955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.478432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.479249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.479686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.757180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:40.770796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64113338-05ba-4094-a180-287a79ac4b45 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1321 microversion: 2.1 time: 0.314813 Jul 26 04:28:40.771383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 388/736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:40 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:40.776011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:40.776609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:40.783779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.784230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.784987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.785423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.938012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:40.946910 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a1e2e0f-ca32-4bef-b42c-a9df472ddef1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1469 microversion: 2.1 time: 0.174538 Jul 26 04:28:40.947478 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 389/737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:40 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:40.954565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-78df8620-b353-431f-af67-e6773891c9c4 req-a018c507-14e7-436d-81c7-e3efcecdae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "name": "network-vif-plugged", "status": "completed", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:40.965561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-78df8620-b353-431f-af67-e6773891c9c4 req-a018c507-14e7-436d-81c7-e3efcecdae3b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:40.966864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-78df8620-b353-431f-af67-e6773891c9c4 req-a018c507-14e7-436d-81c7-e3efcecdae3b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:40.981186 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-78df8620-b353-431f-af67-e6773891c9c4 req-a018c507-14e7-436d-81c7-e3efcecdae3b service nova] Creating event network-vif-plugged:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h2-848886-16 Jul 26 04:28:40.986031 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-78df8620-b353-431f-af67-e6773891c9c4 req-a018c507-14e7-436d-81c7-e3efcecdae3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037306 Jul 26 04:28:40.986660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 390/738] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:40.991686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:40.992377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:40.999553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.000000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.000766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.001200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.191936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:41.219242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:41.221546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:41.222732 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e161832-8273-4059-bcad-f7a58b197c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1409 microversion: 2.25 time: 0.234852 Jul 26 04:28:41.223187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 391/739] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:40 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:41.228582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:41.229335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:41.239130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.240063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.246798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.247260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.369006 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4695977d-2610-48cb-9cc3-fdf71b791775 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/1572a76e-6959-4ee6-8d1d-9f546b1db3c7" status: 202 len: 0 microversion: 2.1 time: 2.132133 Jul 26 04:28:41.369637 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 349/740] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:28:39 2022] DELETE /compute/v2.1/os-floating-ips/1572a76e-6959-4ee6-8d1d-9f546b1db3c7 => generated 0 bytes in 2133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:41.377521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:41.378898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:41.394765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5581795-a204-4f81-8d3d-c00b7e48f106 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f/action" status: 204 len: 0 microversion: 2.1 time: 0.169453 Jul 26 04:28:41.398770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 392/741] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:28:41 2022] POST /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f/action => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:28:41.401580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.405211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.406496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.408227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.415174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20892e91-7f4b-455e-a9e3-9cbb2937dec6 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Action: 'create', calling method: .version_select at 0x7f38b5de0dc0>, body: {"pool": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:41.574108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:41.593774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-272356a6-9e39-48cb-8daf-307c2e11d905 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1316 microversion: 2.1 time: 0.222651 Jul 26 04:28:41.594292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 350/742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:41 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:41.614080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:41.614753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:41.629003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.629819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.631010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.631833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.638439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:41.901121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:41.910206 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e377e0b2-a06a-407c-b036-d3130e4646bc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1469 microversion: 2.1 time: 0.310868 Jul 26 04:28:41.914972 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 351/743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:41 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:41.933610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:41.934551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:41.951478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.952183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:41.953130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:41.953724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:42.442245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:42.452953 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b65d1fc9-7568-483d-adfb-151f5b3b8847 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1311 microversion: 2.1 time: 0.536584 Jul 26 04:28:42.454114 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 352/744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:41 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1311 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:42.473794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:42.474795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:42.482982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:42.483536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:42.484432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:42.484949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:42.745026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:42.754677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c6a41ee-f339-483f-a1dc-dd8a9cfac7ba tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1321 microversion: 2.1 time: 0.299215 Jul 26 04:28:42.755839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 353/745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:42 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:42.781821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:42.784571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:42.808952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:42.809418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:42.810303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:42.813940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:43.302369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:43.312616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:43.313313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:43.315375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9e64c67-f93d-4e07-bc83-58fba34cf7e5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1605 microversion: 2.25 time: 0.555691 Jul 26 04:28:43.324595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 354/746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:28:42 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1605 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:28:43.336585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:43.337166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:43.344228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:43.344603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:43.345433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:43.346288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:43.485096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:43.496644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ab6940d-07df-437a-a24a-d45f585aa88b tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1322 microversion: 2.1 time: 0.168412 Jul 26 04:28:43.499104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 355/747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:43 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:43.706144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-69501884", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:43.797455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:44.046904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:44.047705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:44.048387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:44.049002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:44.049622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:44.062210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.063015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.064202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.064660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.086907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:44.091827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for user b33bcb62a45c48aabc5f1c4e8e7fc0f0 and project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:44.108758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:44.111119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:44.165161 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-45a9dbdd-ed8c-43ff-9edd-380987e4964c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664585 Jul 26 04:28:44.166055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 356/748] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:44.190625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-66866edc-14cb-4fd7-9355-7d8e102074fc req-dffdd628-390f-46b0-833b-7804f4553687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef59c1b4-b601-40f3-89d4-f23378e0c742", "name": "network-vif-deleted", "tag": "a2048730-3a02-4a47-a623-6c1e42b46980"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:44.202863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-66866edc-14cb-4fd7-9355-7d8e102074fc req-dffdd628-390f-46b0-833b-7804f4553687 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.203451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-66866edc-14cb-4fd7-9355-7d8e102074fc req-dffdd628-390f-46b0-833b-7804f4553687 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.216662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-66866edc-14cb-4fd7-9355-7d8e102074fc req-dffdd628-390f-46b0-833b-7804f4553687 service nova] Creating event network-vif-deleted:a2048730-3a02-4a47-a623-6c1e42b46980 for instance ef59c1b4-b601-40f3-89d4-f23378e0c742 on n-h1-848886-16 Jul 26 04:28:44.224326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-66866edc-14cb-4fd7-9355-7d8e102074fc req-dffdd628-390f-46b0-833b-7804f4553687 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056650 Jul 26 04:28:44.225216 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 357/749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:44.232722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:44.233143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:44.242354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.243044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.243938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.244555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.437908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:44.449889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78ca562d-b224-4140-bf36-ec5c410ce5e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1461 microversion: 2.1 time: 0.222347 Jul 26 04:28:44.451276 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 358/750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:44 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1461 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:44.461031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1ec83dd8-ac8e-40d3-bc52-37174b56cc55 req-a5c0d2ed-6deb-4890-86a4-896f03ebc814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1cf253-04a6-4d7a-b2b6-a86cae8c85b8", "name": "network-vif-plugged", "status": "completed", "tag": "52a71c28-6af4-4560-ab84-21186dd33b12"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:44.471891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ec83dd8-ac8e-40d3-bc52-37174b56cc55 req-a5c0d2ed-6deb-4890-86a4-896f03ebc814 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.472551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ec83dd8-ac8e-40d3-bc52-37174b56cc55 req-a5c0d2ed-6deb-4890-86a4-896f03ebc814 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.499045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1ec83dd8-ac8e-40d3-bc52-37174b56cc55 req-a5c0d2ed-6deb-4890-86a4-896f03ebc814 service nova] Creating event network-vif-plugged:52a71c28-6af4-4560-ab84-21186dd33b12 for instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 on n-h1-848886-16 Jul 26 04:28:44.510396 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1ec83dd8-ac8e-40d3-bc52-37174b56cc55 req-a5c0d2ed-6deb-4890-86a4-896f03ebc814 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057857 Jul 26 04:28:44.512024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 359/751] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:44.535902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:44.536766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:44.550611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.551255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.552213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.552803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.664174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-807dcf1f-72ec-44e7-a865-c350e8331819 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.150308 Jul 26 04:28:44.664939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 360/752] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:28:44 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:28:44.674081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:44.674081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:44.681067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.682254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.695117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.696626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.743881 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20892e91-7f4b-455e-a9e3-9cbb2937dec6 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.343505 Jul 26 04:28:44.748156 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 393/753] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:28:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:44.760292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:44.762003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:44.794030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.794991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.796445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:44.799456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:44.924101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:44.936935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a95e2f3-7132-4085-a257-d71193be66bc tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1495 microversion: 2.1 time: 0.270793 Jul 26 04:28:44.951000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 361/754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:44 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1495 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:44.961223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1479230339", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:45.044598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:45.294662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:45.295274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:45.295789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:45.296362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:45.298400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:45.301750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:45.312364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.313033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.313831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd01dfcb-6485-4841-a2f5-3df51c520a85 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1321 microversion: 2.1 time: 0.563183 Jul 26 04:28:45.314106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.314580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.315687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 394/755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:44 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:45.333474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:45.335046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:45.346306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.347155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.348210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.348956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.358303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:45.362210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:45.363367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for user b33bcb62a45c48aabc5f1c4e8e7fc0f0 and project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:45.377388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:45.380642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:45.445759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee7acfbc-109f-4bfb-a761-8e5f5401a063 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492432 Jul 26 04:28:45.452791 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 362/756] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:45.452791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:45.453840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:45.459558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.460015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.460793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.461239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.611980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:45.619786 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-616f1608-d907-4a10-83e5-f7fce7a953be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.171805 Jul 26 04:28:45.634055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 363/757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:45 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:45.640024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eac20a3b-6629-4a42-bb86-d1aa145750b6 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b5ff8160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:45.666111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:45.675465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4086ca5-edad-4acb-9492-28ce9d00c243 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1461 microversion: 2.1 time: 0.357851 Jul 26 04:28:45.676420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 395/758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:45 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1461 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:45.835602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:45.836233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:45.845088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.845563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:45.846427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:45.847536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.249646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a4a6d00-b8d3-4762-89bb-00be45edc6ac tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1648 microversion: 2.1 time: 0.571924 Jul 26 04:28:46.250276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 396/759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:45 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1648 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:46.255288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:46.255898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:46.273544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.274385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.275419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.276062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.584671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eac20a3b-6629-4a42-bb86-d1aa145750b6 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0" status: 202 len: 0 microversion: 2.1 time: 0.949102 Jul 26 04:28:46.588176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 364/760] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:28:45 2022] DELETE /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:46.593771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55185b0c-1eef-4d23-bda5-5d5c7d8ef3bb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'create', calling method: .version_select at 0x7f38b5e7edc0>, body: {"keypair": {"name": "tempest-keypair-807465575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0J4ZaVxO2HbKHdeJJmHgnLvoxaFlRgBpotM5onZpkx1IJPPMLKwuIYrttRyjo7nqAigkqoQvGn9nSTqbfCkeuWNX4q4tSrNdotPwwuO9dOke84zbG+46/hXqSu4kB8Mw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:46.607965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-55185b0c-1eef-4d23-bda5-5d5c7d8ef3bb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:46.612375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-55185b0c-1eef-4d23-bda5-5d5c7d8ef3bb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:46.634488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55185b0c-1eef-4d23-bda5-5d5c7d8ef3bb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048126 Jul 26 04:28:46.635090 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 365/761] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:28:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:46.642143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:46.642722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:46.649005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.649532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.650413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.651022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.672394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:46.689181 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b1ecda2-fd4e-4d30-af3a-f329921e0e51 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1210 microversion: 2.1 time: 0.437545 Jul 26 04:28:46.689926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 397/762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:46 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1210 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:46.701383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:46.702570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:46.709435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.710185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.711077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:46.711755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:46.978697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff63c4a2-9ac5-4fdd-a160-84bc0566f101 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1648 microversion: 2.1 time: 0.340277 Jul 26 04:28:46.979270 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 366/763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:46 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1648 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:47.002861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ab2f802c-b17c-4c81-9a9d-b7579c7b2a4f req-28b38cb2-7483-498b-bd5e-80b57dbd4da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "name": "network-vif-plugged", "status": "completed", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:47.014035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab2f802c-b17c-4c81-9a9d-b7579c7b2a4f req-28b38cb2-7483-498b-bd5e-80b57dbd4da8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.014511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab2f802c-b17c-4c81-9a9d-b7579c7b2a4f req-28b38cb2-7483-498b-bd5e-80b57dbd4da8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.025791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ab2f802c-b17c-4c81-9a9d-b7579c7b2a4f req-28b38cb2-7483-498b-bd5e-80b57dbd4da8 service nova] Creating event network-vif-plugged:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h2-848886-16 Jul 26 04:28:47.032511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ab2f802c-b17c-4c81-9a9d-b7579c7b2a4f req-28b38cb2-7483-498b-bd5e-80b57dbd4da8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Jul 26 04:28:47.033157 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 367/764] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:47.039400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b5eb99d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:47.159473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 could not be found", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:28:47.160798 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] HTTP exception thrown: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.177150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Request method failure captured: Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 HTTP/1.1 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321xgJR2CRxETk4E8NUhEMxrL2ifUIvUDlR4_6fFxtPOW-sZhUUsBcBd4XoLoeqhpQDcjFoL8UfBS_5P7nwT63G2aG2cWGwPzHHA9D2fsXFpEOl73W8IpPrL5c4ohQGKUpleluIN4C9_SwvgYw_wklc1h9MkjZrpnqmrOLIOZIVR7V0 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d5ee6e228f3d4e07922cf27e4b10fdb6 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:28:47.186102 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d5ee6e228f3d4e07922cf27e4b10fdb6 Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsTestJSON-874169332-project Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 5050dc9a741041adaf8899817913badc Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsTestJSON-874169332-project Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: exception: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '39f45056-1c3e-4f1a-ac0e-2379c5fe46e0'} Jul 26 04:28:47.187648 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:28:47.188447 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 could not be found Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc9f9a6-f064-4a2f-8574-1d9cebc9e753'] Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0. Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.189720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:47.190997 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:47.192381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.192381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.192381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Returning 404 to user: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:47.192381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfac756d-694c-49b0-8bec-a959c0d05a4f tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0" status: 404 len: 111 microversion: 2.1 time: 0.155141 Jul 26 04:28:47.194996 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 368/765] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:28:47 2022] GET /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:47.197938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af2776f7-2c7d-4637-bd72-d5f56101ee09 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1471 microversion: 2.1 time: 0.500903 Jul 26 04:28:47.207356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:47.208115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:47.217726 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 398/766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:46 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:47.224049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.224507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.225990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:47.229606 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:47.229606 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:47.231035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.231506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.232423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.233041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.234031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.235246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.272725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32376c83-6341-49b9-b09b-a8efabd1f59a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053689 Jul 26 04:28:47.281821 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 399/767] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:28:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:47.281821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3f96ea07-15d6-4bd4-9640-6c44f769df5f req-fdd8562d-2943-428d-aec6-3211ac1f1065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ed302b-9ce6-4a6a-bb6c-d326bf843614", "tag": "4f19db3d-3527-4c9b-8728-a7bdf509825d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:47.291899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3f96ea07-15d6-4bd4-9640-6c44f769df5f req-fdd8562d-2943-428d-aec6-3211ac1f1065 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.293311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3f96ea07-15d6-4bd4-9640-6c44f769df5f req-fdd8562d-2943-428d-aec6-3211ac1f1065 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.314085 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3f96ea07-15d6-4bd4-9640-6c44f769df5f req-fdd8562d-2943-428d-aec6-3211ac1f1065 service nova] Creating event network-changed:4f19db3d-3527-4c9b-8728-a7bdf509825d for instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 on n-h2-848886-16 Jul 26 04:28:47.325315 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3f96ea07-15d6-4bd4-9640-6c44f769df5f req-fdd8562d-2943-428d-aec6-3211ac1f1065 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048673 Jul 26 04:28:47.326370 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 400/768] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:47.333426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Calling method '.version_select at 0x7f38b5ee8a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:47.472329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 could not be found", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:28:47.474490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] HTTP exception thrown: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Request method failure captured: Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 HTTP/1.1 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321xgJR2CRxETk4E8NUhEMxrL2ifUIvUDlR4_6fFxtPOW-sZhUUsBcBd4XoLoeqhpQDcjFoL8UfBS_5P7nwT63G2aG2cWGwPzHHA9D2fsXFpEOl73W8IpPrL5c4ohQGKUpleluIN4C9_SwvgYw_wklc1h9MkjZrpnqmrOLIOZIVR7V0 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d5ee6e228f3d4e07922cf27e4b10fdb6 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:28:47.479224 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5ee6e228f3d4e07922cf27e4b10fdb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d5ee6e228f3d4e07922cf27e4b10fdb6 Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsTestJSON-874169332 Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsTestJSON-874169332-project Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 5050dc9a741041adaf8899817913badc Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsTestJSON-874169332-project Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: exception: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '39f45056-1c3e-4f1a-ac0e-2379c5fe46e0'} Jul 26 04:28:47.481303 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:28:47.482517 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 could not be found Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baedf0d6-98a9-40bd-985e-05a81f2df310'] Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0. Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.484069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:47.485401 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:47.486905 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 Jul 26 04:28:47.486905 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.488103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] Returning 404 to user: Floating IP not found for ID 39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:47.488975 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30f220c7-a9fc-410f-b2eb-5a5807d356c7 tempest-FloatingIPsTestJSON-874169332 tempest-FloatingIPsTestJSON-874169332-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0" status: 404 len: 111 microversion: 2.1 time: 0.160910 Jul 26 04:28:47.495030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 401/769] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:28:47 2022] DELETE /compute/v2.1/os-floating-ips/39f45056-1c3e-4f1a-ac0e-2379c5fe46e0 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:47.555257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:47.577095 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b0b946c-91d3-4676-bb85-370ee925d919 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.379633 Jul 26 04:28:47.593358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 369/770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:47 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:47.602353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:47.608564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:47.618900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.622014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.623396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.624137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.668389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lazy-loading 'flavor' on Instance uuid bdd6f2ab-34eb-477c-919c-3013ef2ac190 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:28:47.695405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:28:47.738329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:47.739356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] [instance: c2868164-de8c-4700-a822-73048a0829a5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:47.768245 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] HTTP exception thrown: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Request method failure captured: Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/c2868164-de8c-4700-a822-73048a0829a5/action HTTP/1.1 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 15 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321sfxf_LopM17ZJHcbGPtOMpxgNT2NVb8RB4fjPkjxzkf4DBXlhqisWJA84N2OGpz2hGSvxyxso3JiTyRT_x8MAM9F5etdyNZLIDDSyxCCCCN_AIGGHlWnnOJ5Q0xhrlL90bOqGeRamAgznJpRlVRQ9N1NMtv3LxnBvqn4Z5Ahbp-g Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:28:47.774726 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 27729fd6e46a4032b085dc0342dbdb55 Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: {"migrate": {}} Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:28:47.776415 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c2868164-de8c-4700-a822-73048a0829a5', 'body': {'migrate': {}}} Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:28:47.777720 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. Jul 26 04:28:47.779002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:28:47.782635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Returning 404 to user: Instance c2868164-de8c-4700-a822-73048a0829a5 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:28:47.784211 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47f1d6dc-9c5b-412e-88e5-c326b8df70fd tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c2868164-de8c-4700-a822-73048a0829a5/action" status: 404 len: 111 microversion: 2.1 time: 0.286959 Jul 26 04:28:47.785327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 402/771] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:28:47 2022] POST /compute/v2.1/servers/c2868164-de8c-4700-a822-73048a0829a5/action => generated 111 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:28:47.790089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:47.791654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:47.824378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.825223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:47.827499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:47.828408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:48.001572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:48.012999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b45ebec7-d517-4222-a5f7-9ce695482303 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1272 microversion: 2.1 time: 0.224171 Jul 26 04:28:48.014904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 403/772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:47 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:48.021467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2012668246", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:48.113647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:49.354838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:49.355541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:49.355945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:49.356560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:49.357148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:49.377994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:49.378485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:49.379294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:49.379946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:49.425094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Getting quotas for project 3bd21fb79414419e9fd04fda07d4f8ce. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:49.439840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Getting quotas for user 3c712491db8a455b8d9a627c58e8bc13 and project 3bd21fb79414419e9fd04fda07d4f8ce. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:49.467806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:49.470262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:49.502626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:49.537498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d02a5d9e-f4e2-4d78-8c27-156a40b7e2c5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521254 Jul 26 04:28:49.538527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 404/773] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:49.545175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:49.546328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:49.557477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:49.559129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:49.560634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:49.561340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.028616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:50.036732 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13fb51b7-967f-44e9-a15c-7424167024be tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.496792 Jul 26 04:28:50.037388 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 405/774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:49 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:50.042104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:50.042683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:50.049195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.049748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.050660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.051212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.056490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:50.400355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:50.408544 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b80bd584-f4be-4385-a910-8933e665b487 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.370001 Jul 26 04:28:50.409262 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 406/775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:50 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:50.413790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f60c08e2-8e1f-4533-8abe-c4b52027f474 req-c376b40d-474b-432d-bc0a-810d395a7292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6129d35-4751-405e-b635-7b779fe46f3e", "tag": "6989b633-c962-4bf2-ba18-1d258858cdf8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:50.426314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f60c08e2-8e1f-4533-8abe-c4b52027f474 req-c376b40d-474b-432d-bc0a-810d395a7292 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.426840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f60c08e2-8e1f-4533-8abe-c4b52027f474 req-c376b40d-474b-432d-bc0a-810d395a7292 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.441859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f60c08e2-8e1f-4533-8abe-c4b52027f474 req-c376b40d-474b-432d-bc0a-810d395a7292 service nova] Creating event network-changed:6989b633-c962-4bf2-ba18-1d258858cdf8 for instance b6129d35-4751-405e-b635-7b779fe46f3e on n-h1-848886-16 Jul 26 04:28:50.447367 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f60c08e2-8e1f-4533-8abe-c4b52027f474 req-c376b40d-474b-432d-bc0a-810d395a7292 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036878 Jul 26 04:28:50.447967 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 407/776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:50.454360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0ff42456-63ec-4c87-83b9-3bde2cf805a8 req-eb8bd247-c17a-4b49-bc81-c2b06328b085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:50.464046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ff42456-63ec-4c87-83b9-3bde2cf805a8 req-eb8bd247-c17a-4b49-bc81-c2b06328b085 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.464572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ff42456-63ec-4c87-83b9-3bde2cf805a8 req-eb8bd247-c17a-4b49-bc81-c2b06328b085 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.475392 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0ff42456-63ec-4c87-83b9-3bde2cf805a8 req-eb8bd247-c17a-4b49-bc81-c2b06328b085 service nova] Creating event network-changed:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:28:50.480914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0ff42456-63ec-4c87-83b9-3bde2cf805a8 req-eb8bd247-c17a-4b49-bc81-c2b06328b085 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031312 Jul 26 04:28:50.481446 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 408/777] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:50.486434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:50.487129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:50.493219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.493675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.494475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:50.494923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:50.627365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:50.635141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8725abff-4e25-453d-999d-10faaf91bba3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1226 microversion: 2.1 time: 0.152556 Jul 26 04:28:50.648676 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 409/778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:50 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:50.992986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e26193b-9c7d-449c-9ad5-ae19d70301a1 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '.version_select at 0x7f38b5f66ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.003556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e26193b-9c7d-449c-9ad5-ae19d70301a1 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.004810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e26193b-9c7d-449c-9ad5-ae19d70301a1 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.021799 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e26193b-9c7d-449c-9ad5-ae19d70301a1 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1925 microversion: 2.1 time: 0.035492 Jul 26 04:28:51.023825 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 410/779] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:28:50 2022] GET /compute/v2.1/os-migrations => generated 1925 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:51.049968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3df528af-d588-41c0-8213-99944155f7ac tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.059106 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3df528af-d588-41c0-8213-99944155f7ac tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019668 Jul 26 04:28:51.067531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 411/780] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:28:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:51.073212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.074893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:51.082274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.082873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.083848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.084632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.415233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:51.423117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5813ce2-6216-4440-b638-7af2ede48797 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.354112 Jul 26 04:28:51.424077 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 412/781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:51 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:51.428349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24991ec3-9890-4ba6-aeac-b9ec96e6a2bc tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-72863270", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:51.431151 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:28:51.431151 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:28:51.447183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24991ec3-9890-4ba6-aeac-b9ec96e6a2bc tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.022125 Jul 26 04:28:51.447950 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 413/782] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 26 04:28:51 2022] POST /compute/v2.1/flavors => generated 497 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:51.453054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.453664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:51.459695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.460142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.460920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.461353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.836690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:51.851819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37b53737-fd0d-43a8-b0ee-91a9150ce0d9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.400455 Jul 26 04:28:51.854776 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 414/783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:51 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:51.862187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9def22b7-e256-4c58-a6ba-494d801861f8 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.882534 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9def22b7-e256-4c58-a6ba-494d801861f8 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024913 Jul 26 04:28:51.885374 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 415/784] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Jul 26 04:28:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:28:51.892488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:51.893501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:51.906785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.908234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:51.909266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:51.909892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:52.307246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:52.325710 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93c2cc4d-b6b8-4336-80a8-9949c60f7d87 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1274 microversion: 2.1 time: 0.434040 Jul 26 04:28:52.349848 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 416/785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:51 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1274 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:52.356415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1590527595", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "9dad9420-0839-431b-b22f-e57d83afc363"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:52.469774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:28:53.125914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:28:53.126389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:28:53.127021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:28:53.127437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:28:53.127847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:28:53.143726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.144178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.144974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.145410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.166677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90c374e1-4592-434e-bc52-f25b63149a2a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190/action" status: 202 len: 0 microversion: 2.1 time: 5.571607 Jul 26 04:28:53.167966 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 370/786] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:28:47 2022] POST /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190/action => generated 0 bytes in 5574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:28:53.173299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:53.174059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:53.191907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.195670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.197464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.199561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.200671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:28:53.208135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:28:53.233210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:28:53.236019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:28:53.360411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-605f36fd-96d1-4e17-b5fb-a35cc1f47e47 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008846 Jul 26 04:28:53.367127 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 417/787] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:28:53.377146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:53.380264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:53.398358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.400621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.403607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.406688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.804701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:53.814813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c068c76c-e41e-4473-8e9d-1cbed004d825 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.446476 Jul 26 04:28:53.817627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 418/788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:53 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:53.822264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:53.822871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:53.842504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.843037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:53.843877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:53.844322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.034803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:54.045880 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2fb34516-1033-4f53-b778-65cafe91f679 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.876529 Jul 26 04:28:54.048622 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 371/789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:53 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:54.055359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:54.056602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:54.065588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.066181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.067068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.067577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.094120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:54.149428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:54.166711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-946dfa96-a5f7-4a3d-9a63-c9e44805634a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.345537 Jul 26 04:28:54.169922 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 419/790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:53 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:54.181313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:54.185801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:54.194245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.195177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.196318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.196985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.229360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:54.245841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c81b2348-2b3d-40fb-ae53-d3e0e11915be tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1280 microversion: 2.1 time: 0.194213 Jul 26 04:28:54.265797 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 372/791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:54 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:54.272194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-47ac7ba0-24f6-40bb-94d7-7c80cbcfda61 req-9cb35e23-824a-486b-a9df-11688753e640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8295eba4-7896-4474-90a9-91a6db08cfdb", "tag": "b9ff22bc-41b3-458b-af9b-b765dbedc3bf"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:54.291827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47ac7ba0-24f6-40bb-94d7-7c80cbcfda61 req-9cb35e23-824a-486b-a9df-11688753e640 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.293106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47ac7ba0-24f6-40bb-94d7-7c80cbcfda61 req-9cb35e23-824a-486b-a9df-11688753e640 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.319267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-47ac7ba0-24f6-40bb-94d7-7c80cbcfda61 req-9cb35e23-824a-486b-a9df-11688753e640 service nova] Creating event network-changed:b9ff22bc-41b3-458b-af9b-b765dbedc3bf for instance 8295eba4-7896-4474-90a9-91a6db08cfdb on n-h1-848886-16 Jul 26 04:28:54.335188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-47ac7ba0-24f6-40bb-94d7-7c80cbcfda61 req-9cb35e23-824a-486b-a9df-11688753e640 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081298 Jul 26 04:28:54.338050 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 373/792] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:54.350874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fd988664-5bca-4a86-aed8-3b444fde7bda req-58ab155c-504c-4d9b-9016-ee3fab18d8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed302b-9ce6-4a6a-bb6c-d326bf843614", "name": "network-vif-plugged", "status": "completed", "tag": "4f19db3d-3527-4c9b-8728-a7bdf509825d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:54.373249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fd988664-5bca-4a86-aed8-3b444fde7bda req-58ab155c-504c-4d9b-9016-ee3fab18d8f8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.373993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:54.376215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fd988664-5bca-4a86-aed8-3b444fde7bda req-58ab155c-504c-4d9b-9016-ee3fab18d8f8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.388825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87566568-8d80-48b5-8791-54d5465d4c8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1283 microversion: 2.1 time: 0.213259 Jul 26 04:28:54.401276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 420/793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:54 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1283 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:54.408721 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fd988664-5bca-4a86-aed8-3b444fde7bda req-58ab155c-504c-4d9b-9016-ee3fab18d8f8 service nova] Creating event network-vif-plugged:4f19db3d-3527-4c9b-8728-a7bdf509825d for instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 on n-h2-848886-16 Jul 26 04:28:54.415995 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fd988664-5bca-4a86-aed8-3b444fde7bda req-58ab155c-504c-4d9b-9016-ee3fab18d8f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074056 Jul 26 04:28:54.420565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 374/794] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:54.839073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:54.839881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:54.848385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.848839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:54.849844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:54.851811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.017061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:55.027792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3761f839-0294-44b2-b6af-2603b05098b8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.193717 Jul 26 04:28:55.036830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 421/795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:54 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:55.072143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:55.073396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:55.080132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.080664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.081543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.082048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.190395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:55.191004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:55.198043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.198812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.199564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.200009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.348418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:55.358490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:55.366606 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f581e432-ea01-4376-b21b-96f3f4cb6c98 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.180706 Jul 26 04:28:55.367178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 422/796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:55 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:55.372665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:55.373283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:55.380052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.380904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.383160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.383768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.561191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:55.579160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb661675-eb2f-4068-809f-011a31025062 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1390 microversion: 2.1 time: 0.511391 Jul 26 04:28:55.582415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 375/797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:55 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1390 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:55.589783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:55.591995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:55.619808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.622246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.624678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:55.625472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:55.686695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:55.696335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e15f268f-4767-47ea-951b-7cc1c4606add tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.328121 Jul 26 04:28:55.697726 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 423/798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:55 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:55.758270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:55.772105 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-496d24ec-d082-42b6-a983-8da7eb2bc1cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1331 microversion: 2.1 time: 0.190854 Jul 26 04:28:55.773203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 376/799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:55 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1331 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:56.049333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:56.049977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:56.056403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.057087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.058650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.059260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.389107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:56.389720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:56.404345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.404789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.405565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.409621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.619728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:56.625153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:56.646219 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa4d9640-4fcf-4c31-93ef-0938e1948eb3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.600512 Jul 26 04:28:56.647376 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 424/800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:56 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:56.654343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5846288f-c6ab-4f89-9c5c-70c1bfc00450 req-1fe8402a-f4fd-4615-a5bd-0922bcdcf8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6129d35-4751-405e-b635-7b779fe46f3e", "name": "network-vif-plugged", "status": "completed", "tag": "6989b633-c962-4bf2-ba18-1d258858cdf8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:56.684803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5846288f-c6ab-4f89-9c5c-70c1bfc00450 req-1fe8402a-f4fd-4615-a5bd-0922bcdcf8b7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.696527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5846288f-c6ab-4f89-9c5c-70c1bfc00450 req-1fe8402a-f4fd-4615-a5bd-0922bcdcf8b7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.737749 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5846288f-c6ab-4f89-9c5c-70c1bfc00450 req-1fe8402a-f4fd-4615-a5bd-0922bcdcf8b7 service nova] Creating event network-vif-plugged:6989b633-c962-4bf2-ba18-1d258858cdf8 for instance b6129d35-4751-405e-b635-7b779fe46f3e on n-h1-848886-16 Jul 26 04:28:56.747173 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5846288f-c6ab-4f89-9c5c-70c1bfc00450 req-1fe8402a-f4fd-4615-a5bd-0922bcdcf8b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098024 Jul 26 04:28:56.749668 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 425/801] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:56.762840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:56.766561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:56.782458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.786416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:56.796053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:56.797671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.135300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:57.146075 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a99e9ee-f427-42a2-b707-a8ea2297872e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.761480 Jul 26 04:28:57.160368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 377/802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:56 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:57.160678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:57.161492 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-008e72f7-ded8-4a16-8656-6e54827642c7 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1589 microversion: 2.1 time: 0.405901 Jul 26 04:28:57.163882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:57.164499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:57.166323 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 426/803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:56 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1589 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:57.184515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.187389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.188670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.189356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.190198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:57.190989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:57.203578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.204309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.205243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.206979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.316513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:57.328892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87dcb1f4-8b03-478b-a880-d7e4dcf9c078 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1337 microversion: 2.1 time: 0.148546 Jul 26 04:28:57.347796 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 427/804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:57 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1337 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:57.359026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:57.359725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:57.367840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.368939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.369763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.370270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.497434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f943bf03-a8e9-41d4-b466-48aec229e652 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142756 Jul 26 04:28:57.502400 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 428/805] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:28:57 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:57.692087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:57.693069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:57.702126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.703507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.704409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:57.704967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:57.723163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:28:58.186646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:58.208810 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b4b7a09-6f25-4619-ba8a-0b1d8f05a74b tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 1.061041 Jul 26 04:28:58.210758 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 378/806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:57 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:58.217876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-53978a03-1c82-4419-b0d5-95a7f5e7943c req-d80ed92f-38cf-489c-9d14-4afb4c0b8e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135f27a2-b149-426b-9875-603c970af376", "tag": "3e1b5ee7-0853-4362-bfe8-73601387e2f1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:58.232636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-53978a03-1c82-4419-b0d5-95a7f5e7943c req-d80ed92f-38cf-489c-9d14-4afb4c0b8e72 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.233400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-53978a03-1c82-4419-b0d5-95a7f5e7943c req-d80ed92f-38cf-489c-9d14-4afb4c0b8e72 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.266054 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-53978a03-1c82-4419-b0d5-95a7f5e7943c req-d80ed92f-38cf-489c-9d14-4afb4c0b8e72 service nova] Creating event network-changed:3e1b5ee7-0853-4362-bfe8-73601387e2f1 for instance 135f27a2-b149-426b-9875-603c970af376 on n-h2-848886-16 Jul 26 04:28:58.273924 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-53978a03-1c82-4419-b0d5-95a7f5e7943c req-d80ed92f-38cf-489c-9d14-4afb4c0b8e72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061433 Jul 26 04:28:58.275205 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 379/807] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:58.284933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:58.286524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:58.294688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.295367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.296311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.296936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.462216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:58.473490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-144a4f98-a85e-4171-8541-1759738cb194 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1314 microversion: 2.1 time: 0.786899 Jul 26 04:28:58.474936 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 429/808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:57 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:58.481869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:58.488147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:58.496888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.497661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.498688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.499359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.920607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:58.930015 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09c7df4e-dcaa-4fc4-a84b-22ad3ebcf937 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.453829 Jul 26 04:28:58.930888 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 430/809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:58 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:58.947691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-da3787e8-09c2-47b8-a9fa-58028a6c20c8 req-5f6c3e83-232a-4a07-9214-9a46e2bdb920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8295eba4-7896-4474-90a9-91a6db08cfdb", "name": "network-vif-plugged", "status": "completed", "tag": "b9ff22bc-41b3-458b-af9b-b765dbedc3bf"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:58.958649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-da3787e8-09c2-47b8-a9fa-58028a6c20c8 req-5f6c3e83-232a-4a07-9214-9a46e2bdb920 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:58.959095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-da3787e8-09c2-47b8-a9fa-58028a6c20c8 req-5f6c3e83-232a-4a07-9214-9a46e2bdb920 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:58.971874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-da3787e8-09c2-47b8-a9fa-58028a6c20c8 req-5f6c3e83-232a-4a07-9214-9a46e2bdb920 service nova] Creating event network-vif-plugged:b9ff22bc-41b3-458b-af9b-b765dbedc3bf for instance 8295eba4-7896-4474-90a9-91a6db08cfdb on n-h1-848886-16 Jul 26 04:28:58.978887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-da3787e8-09c2-47b8-a9fa-58028a6c20c8 req-5f6c3e83-232a-4a07-9214-9a46e2bdb920 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035721 Jul 26 04:28:58.979560 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 431/810] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:28:59.138611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:59.146899 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa480c7f-3d13-463a-99af-342ca3f46aa5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.868078 Jul 26 04:28:59.148159 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 380/811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:58 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:59.248573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:59.251376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:59.259291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.259748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.260790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.262017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.497549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:59.498580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:59.513215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.514029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.515116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.515850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.673238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:28:59.690260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9cb4d1a2-9110-4939-9f7d-b04d04d31cf1 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.457235 Jul 26 04:28:59.691495 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 432/812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:59 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:28:59.869044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3135dbb2-c736-4289-9be0-6a35c0f8f8a6 req-edfaf650-ca2b-4fda-8e83-7262ccb22f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:28:59.880535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3135dbb2-c736-4289-9be0-6a35c0f8f8a6 req-edfaf650-ca2b-4fda-8e83-7262ccb22f6a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.881283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3135dbb2-c736-4289-9be0-6a35c0f8f8a6 req-edfaf650-ca2b-4fda-8e83-7262ccb22f6a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.896085 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3135dbb2-c736-4289-9be0-6a35c0f8f8a6 req-edfaf650-ca2b-4fda-8e83-7262ccb22f6a service nova] Creating event network-changed:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:28:59.902661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3135dbb2-c736-4289-9be0-6a35c0f8f8a6 req-edfaf650-ca2b-4fda-8e83-7262ccb22f6a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Jul 26 04:28:59.903939 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 433/813] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:28:59.952476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:28:59.953244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:28:59.962881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.963343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:28:59.964722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:28:59.965171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.235922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:00.245613 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f3e951c-4ebe-4f40-9b94-0b245d21fc6b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.297127 Jul 26 04:29:00.247568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 434/814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:59 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:00.254463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:00.255439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:00.274871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.275356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.276245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.279745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.507072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:00.517324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:00.522677 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-698d352b-5515-4630-bfa6-167580c24364 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1589 microversion: 2.1 time: 0.273817 Jul 26 04:29:00.523642 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 435/815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:00 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1589 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:00.532089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18102235-498b-4bc9-b4f7-fa3b7528b241 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1463 microversion: 2.1 time: 1.040745 Jul 26 04:29:00.532798 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 381/816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:28:59 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1463 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:00.535612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:00.537958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:00.547616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.548418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.550090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.550894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.556405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dfbc4d40-1297-48e0-9bb6-323ae52431c9 req-0249f307-723f-4ce0-bb2e-64cbdf9d44d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "name": "network-vif-unplugged", "status": "completed", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:00.570119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfbc4d40-1297-48e0-9bb6-323ae52431c9 req-0249f307-723f-4ce0-bb2e-64cbdf9d44d0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.570879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfbc4d40-1297-48e0-9bb6-323ae52431c9 req-0249f307-723f-4ce0-bb2e-64cbdf9d44d0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.585256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dfbc4d40-1297-48e0-9bb6-323ae52431c9 req-0249f307-723f-4ce0-bb2e-64cbdf9d44d0 service nova] Creating event network-vif-unplugged:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h2-848886-16 Jul 26 04:29:00.591231 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dfbc4d40-1297-48e0-9bb6-323ae52431c9 req-0249f307-723f-4ce0-bb2e-64cbdf9d44d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057086 Jul 26 04:29:00.592515 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 382/817] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:00.599159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:00.600803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:00.608891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.609774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.611153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.611894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.859690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:00.871769 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e47cc53b-8407-44f4-89ee-213eca13722a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.343248 Jul 26 04:29:00.872362 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 436/818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:00 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:00.891726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:00.892491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:00.905429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.908480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:00.912209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:00.912782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.137760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:01.150426 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e4c9718-30c4-4c97-9c2e-70190ce761e9 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1312 microversion: 2.1 time: 0.553382 Jul 26 04:29:01.151188 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 383/819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:00 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:01.170070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:01.177873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2cd5b0e-f959-4f4e-b1f3-35cdaa5f70ac tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.304366 Jul 26 04:29:01.178801 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 437/820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:00 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:01.272371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:01.273327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:01.281575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:01.282266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.283183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:01.283856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.519241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:01.533591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c1e5ec4-ebd3-47da-8d83-be75a0c403fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.269215 Jul 26 04:29:01.535468 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 384/821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:01 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:01.892997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:01.893630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:01.900102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:01.900793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.901807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:01.902544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.924665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8436aacf-e6c3-493a-8fd4-3097c8e32a5e req-575a5ecd-8b25-4ea1-ac37-b8461021d052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ed302b-9ce6-4a6a-bb6c-d326bf843614", "tag": "4f19db3d-3527-4c9b-8728-a7bdf509825d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:01.938374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8436aacf-e6c3-493a-8fd4-3097c8e32a5e req-575a5ecd-8b25-4ea1-ac37-b8461021d052 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:01.938810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8436aacf-e6c3-493a-8fd4-3097c8e32a5e req-575a5ecd-8b25-4ea1-ac37-b8461021d052 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:01.954780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8436aacf-e6c3-493a-8fd4-3097c8e32a5e req-575a5ecd-8b25-4ea1-ac37-b8461021d052 service nova] Creating event network-changed:4f19db3d-3527-4c9b-8728-a7bdf509825d for instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 on n-h2-848886-16 Jul 26 04:29:01.960734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8436aacf-e6c3-493a-8fd4-3097c8e32a5e req-575a5ecd-8b25-4ea1-ac37-b8461021d052 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Jul 26 04:29:01.961338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 385/822] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:02.140679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:02.150443 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-60279482-800a-4b84-b15a-ee614469f8a5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.260682 Jul 26 04:29:02.153812 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 438/823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:01 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:02.174532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:02.175712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:02.183017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.183850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.184623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.185060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.198055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:02.199097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:02.205143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.205595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.206399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.206838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.344802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:02.352373 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-781d6f19-6f1e-4a29-9207-6a783499dfb2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.158124 Jul 26 04:29:02.352866 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 439/824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:02 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:02.413928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:02.421616 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a482912d-1f6d-4b16-ab7a-1d4c6b422f12 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1461 microversion: 2.1 time: 0.252239 Jul 26 04:29:02.422392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 386/825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:02 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1461 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:02.552335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1032595320", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8295eba4-7896-4474-90a9-91a6db08cfdb"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:02.557011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:02.558209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:02.564738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.564738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.565428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.566094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.622626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:02.720784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:02.731115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5e49e75-c671-4fac-9986-21bb4860cd58 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.178997 Jul 26 04:29:02.743436 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 387/826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:02 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:02.751693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4b1f9853-dd12-48bb-9c29-dfae56d93c76 req-73f45398-11c6-4029-9df4-9bb4f095d095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:02.771501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b1f9853-dd12-48bb-9c29-dfae56d93c76 req-73f45398-11c6-4029-9df4-9bb4f095d095 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:02.772152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b1f9853-dd12-48bb-9c29-dfae56d93c76 req-73f45398-11c6-4029-9df4-9bb4f095d095 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:02.785455 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4b1f9853-dd12-48bb-9c29-dfae56d93c76 req-73f45398-11c6-4029-9df4-9bb4f095d095 service nova] Creating event network-changed:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h2-848886-16 Jul 26 04:29:02.791388 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4b1f9853-dd12-48bb-9c29-dfae56d93c76 req-73f45398-11c6-4029-9df4-9bb4f095d095 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046147 Jul 26 04:29:02.792889 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 388/827] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:03.099922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:03.100441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:03.101071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:03.101486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:03.102308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:03.110208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=27 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:03.113153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.113619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.114459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.114901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.123654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=11 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:03.135492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:03.140166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Getting quotas for user b33bcb62a45c48aabc5f1c4e8e7fc0f0 and project b2ecbd875cdc46a384524202af6c60e1. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:03.153057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:03.155702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:03.176613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:03.188789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:03.192114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:03.201675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.202972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.204120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.204888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.232605 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c6e291e-e7ab-4646-9aa0-bd91921deb13 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688167 Jul 26 04:29:03.240053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 440/828] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:29:03.261100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0eb2f521-408c-4d32-8fc6-9bb110806222 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:03.261966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0eb2f521-408c-4d32-8fc6-9bb110806222 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:03.329878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0eb2f521-408c-4d32-8fc6-9bb110806222 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:03.337735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0eb2f521-408c-4d32-8fc6-9bb110806222 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1214 microversion: 2.1 time: 0.096562 Jul 26 04:29:03.339586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 441/829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:03 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:03.375947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:03.376908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:03.384580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.385937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.386975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.388272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.430227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:03.443842 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a6eb435-3040-4f50-b9aa-78d658b3f33b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.272533 Jul 26 04:29:03.445374 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 389/830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:03 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:03.753414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:03.754061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:03.763786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.764253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.765058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:03.766089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:03.773939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:03.786409 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-463cbb4d-ba81-4cee-96a2-53eef495e852 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.413389 Jul 26 04:29:03.789362 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 442/831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:03 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:03.951430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:03.959598 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac3ec9fa-7104-4171-a216-099203885998 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.210663 Jul 26 04:29:03.961553 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 390/832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:03 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:04.361065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:04.362301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:04.369300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.370320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.371103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.371712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.468308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:04.469410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:04.479350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.485216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.486096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.486585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.534716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:04.550554 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0adc02f9-7fce-45ba-8c42-0324871db68d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1266 microversion: 2.1 time: 0.193367 Jul 26 04:29:04.565771 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 443/833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:04 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:04.811003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:04.811772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:04.825546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.826061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.826937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.828497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.941648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:04.956764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43f96645-db7b-46b3-9191-4245268d8143 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.492813 Jul 26 04:29:04.958440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 391/834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:04 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:04.983025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:04.984113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:04.991720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.993425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:04.995443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:04.996121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:05.156810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:05.170742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d614d082-e175-4249-b189-da083039a16c tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.364830 Jul 26 04:29:05.172051 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 444/835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:04 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:05.385419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:05.404982 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1f592b35-e247-4ef0-84f1-f778ef04f1cb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.426651 Jul 26 04:29:05.409361 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 392/836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:04 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:05.573891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:05.574389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:05.589779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:05.590659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:05.592008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:05.592953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:05.719853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:05.734239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-315a7762-6934-401f-abe5-668a5b52ea09 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1272 microversion: 2.1 time: 0.164009 Jul 26 04:29:05.736425 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 445/837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:05 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:05.976903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:05.977624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:05.985517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:05.986261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:05.987518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:05.988165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:05.993161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:06.189239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1cdbeec1-38af-44b8-9037-146f3394b12d req-de8423f3-4020-4634-858b-250059133aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135f27a2-b149-426b-9875-603c970af376", "name": "network-vif-plugged", "status": "completed", "tag": "3e1b5ee7-0853-4362-bfe8-73601387e2f1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:06.205535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1cdbeec1-38af-44b8-9037-146f3394b12d req-de8423f3-4020-4634-858b-250059133aa7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.206330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1cdbeec1-38af-44b8-9037-146f3394b12d req-de8423f3-4020-4634-858b-250059133aa7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.220732 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1cdbeec1-38af-44b8-9037-146f3394b12d req-de8423f3-4020-4634-858b-250059133aa7 service nova] Creating event network-vif-plugged:3e1b5ee7-0853-4362-bfe8-73601387e2f1 for instance 135f27a2-b149-426b-9875-603c970af376 on n-h2-848886-16 Jul 26 04:29:06.229271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1cdbeec1-38af-44b8-9037-146f3394b12d req-de8423f3-4020-4634-858b-250059133aa7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048579 Jul 26 04:29:06.231547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 446/838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:06.241239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:06.243583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:06.270786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.271661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.272891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.274265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.280857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:06.292785 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-272e2fae-d7bc-4df2-8492-46a8b8f594ea tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.319634 Jul 26 04:29:06.293977 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 393/839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:05 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:06.426508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:06.427342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:06.435095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.436291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.437557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.438625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.567599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:06.583310 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b66b0b3a-e436-4c98-a1c5-2de6f2257ba5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.348763 Jul 26 04:29:06.587173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 447/840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:06 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:06.698313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:06.707581 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a272b7ba-b20f-4009-a7c0-c429a162af84 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.284852 Jul 26 04:29:06.723934 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 394/841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:06 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:06.758397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:06.759017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:06.778538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.784479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:06.786078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:06.786643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.059461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:07.072492 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fffa6d11-6c8d-4ec5-a6e9-20a925691321 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.318791 Jul 26 04:29:07.073764 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 448/842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:06 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:07.315963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:07.317160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:07.330356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.331048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.331990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.332757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.608257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:07.609466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:07.620839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.621670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.622863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.623492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.709155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:07.717761 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9334023-138b-4e2e-a15f-43b4577db0b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.405574 Jul 26 04:29:07.719318 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 395/843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:07 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:07.741242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:07.762305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:07.777799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.779190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:07.780949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:07.782317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.187896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:08.203901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:08.204431 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b85a16b4-9d65-4286-baa8-0c0e7b3667da tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.474221 Jul 26 04:29:08.206964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 396/844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:07 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:08.215571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:08.218365 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e233e1cc-ce45-44d9-8ff5-ccb39dc4d6b8 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1322 microversion: 2.1 time: 0.614937 Jul 26 04:29:08.219995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 449/845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:07 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:08.234240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-86b463f8-5dae-457a-bbfb-4f49289ada23 req-83245e77-56fe-435b-abc8-74f91a03056d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadde0fb-19ef-4eca-8151-f7bc15d74b61", "tag": "4759b812-ba82-4555-a673-7db41a172cfc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:08.236149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-86b463f8-5dae-457a-bbfb-4f49289ada23 req-83245e77-56fe-435b-abc8-74f91a03056d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:08.236775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-86b463f8-5dae-457a-bbfb-4f49289ada23 req-83245e77-56fe-435b-abc8-74f91a03056d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.247216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:08.248349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:08.254194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-86b463f8-5dae-457a-bbfb-4f49289ada23 req-83245e77-56fe-435b-abc8-74f91a03056d service nova] Creating event network-changed:4759b812-ba82-4555-a673-7db41a172cfc for instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 on n-h1-848886-16 Jul 26 04:29:08.262543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:08.263259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.264297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:08.265028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.273557 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-86b463f8-5dae-457a-bbfb-4f49289ada23 req-83245e77-56fe-435b-abc8-74f91a03056d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065230 Jul 26 04:29:08.278514 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 397/846] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:08.496441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] Calling method '.version_select at 0x7f38b5de5af0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:08.499773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:08.508327 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34f29172-8cc2-422d-91f1-56dbf430d2e0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.271850 Jul 26 04:29:08.508897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 450/847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:08 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:08.555380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0abaceee-c14d-4be7-b07d-e03900c86bb3 could not be found", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:29:08.556198 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] HTTP exception thrown: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] Request method failure captured: Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-floating-ips/0abaceee-c14d-4be7-b07d-e03900c86bb3 HTTP/1.1 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322Uoi4Im-ZQEl1rEjziDQZ3EZVW1zpVaimyb3Fn7l4sooELeoaMu4Pifb4gGzR7vCv5jNQMWgnOgk5BSzWS9PNqPaWVCSGzqgU0XB5_nzsqrc_bJXKIohIk7LT3ZAUMi8euDLSJ9272E1kDHqTWgjR6n1kSvOI9xQh0EWTSuuMdN-w Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: ab746bffba5c47c08208895e795c9114 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-635453750 Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:29:08.559488 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab746bffba5c47c08208895e795c9114"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab746bffba5c47c08208895e795c9114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab746bffba5c47c08208895e795c9114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab746bffba5c47c08208895e795c9114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-635453750 Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: ab746bffba5c47c08208895e795c9114 Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-635453750 Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-635453750-project Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 0adb85782ae04b80b4111ef35ba565a8 Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-635453750-project Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: exception: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3 Jul 26 04:29:08.561056 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0abaceee-c14d-4be7-b07d-e03900c86bb3'} Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:29:08.562013 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0abaceee-c14d-4be7-b07d-e03900c86bb3 could not be found Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dfe399a-d1de-4711-bb96-6589f0e17ba1'] Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3. Jul 26 04:29:08.564020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3 Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:08.566026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:29:08.567664 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:29:08.567664 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3 Jul 26 04:29:08.567664 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:08.567664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] Returning 404 to user: Floating IP not found for ID 0abaceee-c14d-4be7-b07d-e03900c86bb3 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:08.567664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-495d508a-df3f-4440-8e64-dd96d72ddbdb tempest-FloatingIPDetailsNegativeTestJSON-635453750 tempest-FloatingIPDetailsNegativeTestJSON-635453750-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/0abaceee-c14d-4be7-b07d-e03900c86bb3" status: 404 len: 111 microversion: 2.1 time: 0.238455 Jul 26 04:29:08.571112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 398/848] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:29:08 2022] GET /compute/v2.1/os-floating-ips/0abaceee-c14d-4be7-b07d-e03900c86bb3 => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:29:08.740197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:08.740730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:08.751799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:08.752272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.753060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:08.753618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:08.987422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:08.996423 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32c55ce9-10a1-42d9-9b56-cb9baa670930 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.260066 Jul 26 04:29:09.010054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 451/849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:08 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:09.232438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:09.233603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:09.241262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.241891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.245773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.246607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.252465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:09.253205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:09.260591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.261092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.262210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.262332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.434904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:09.446297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7a274b7-841c-4cf2-8fd9-692602dec599 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.218710 Jul 26 04:29:09.450972 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 399/850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:09 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:09.529671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:09.531149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:09.538294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.538860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.539864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.541212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.556300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:09.567838 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14df1f1e-3aed-4b7a-b31b-a9fb0013504d tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1471 microversion: 2.1 time: 0.321172 Jul 26 04:29:09.570594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 452/851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:09 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:09.592417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:09.592957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:09.599234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.599683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.600462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.600901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.660055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lazy-loading 'flavor' on Instance uuid 135f27a2-b149-426b-9875-603c970af376 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:29:09.720677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:09.728308 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-395854a7-bad3-40c7-ada9-c24e7f55c913 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.203135 Jul 26 04:29:09.742422 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 400/852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:09 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:09.768982 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8469349c-dc9f-41d7-a5a4-1ebbc7973709 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376/action" status: 202 len: 0 microversion: 2.1 time: 0.180423 Jul 26 04:29:09.769636 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 453/853] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:09 2022] POST /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:29:09.779793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:09.780840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:09.789203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.789905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:09.791058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:09.791785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.020419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:10.021503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:10.040826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.043238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.047076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.051012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.313356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:10.321175 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61dd5d58-fca7-4084-85b2-023a0c6d17d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.306264 Jul 26 04:29:10.334852 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 454/854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:10 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:10.341649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-891c5a52-1c28-49b3-836c-718ab4f0afa5 req-eb105e3c-2c5f-48e3-83cf-7460b6003abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-plugged", "status": "completed", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:10.356455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-891c5a52-1c28-49b3-836c-718ab4f0afa5 req-eb105e3c-2c5f-48e3-83cf-7460b6003abf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.357195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-891c5a52-1c28-49b3-836c-718ab4f0afa5 req-eb105e3c-2c5f-48e3-83cf-7460b6003abf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.374203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-891c5a52-1c28-49b3-836c-718ab4f0afa5 req-eb105e3c-2c5f-48e3-83cf-7460b6003abf service nova] Creating event network-vif-plugged:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:29:10.379670 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-891c5a52-1c28-49b3-836c-718ab4f0afa5 req-eb105e3c-2c5f-48e3-83cf-7460b6003abf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043235 Jul 26 04:29:10.380470 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 455/855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:10.430010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-887f0ffa-3b98-4e5d-8197-5b4c74093ac9 req-a61e2fcf-d608-41d0-9f69-70f55ff39390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "name": "network-vif-unplugged", "status": "completed", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:10.466420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-887f0ffa-3b98-4e5d-8197-5b4c74093ac9 req-a61e2fcf-d608-41d0-9f69-70f55ff39390 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.471496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-887f0ffa-3b98-4e5d-8197-5b4c74093ac9 req-a61e2fcf-d608-41d0-9f69-70f55ff39390 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.491629 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c750a308-8a0d-4377-bc29-3400ddd275e2 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1632 microversion: 2.1 time: 0.713703 Jul 26 04:29:10.493868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-887f0ffa-3b98-4e5d-8197-5b4c74093ac9 req-a61e2fcf-d608-41d0-9f69-70f55ff39390 service nova] Creating event network-vif-unplugged:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h2-848886-16 Jul 26 04:29:10.501654 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-887f0ffa-3b98-4e5d-8197-5b4c74093ac9 req-a61e2fcf-d608-41d0-9f69-70f55ff39390 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076047 Jul 26 04:29:10.502999 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 456/856] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:10.508132 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 401/857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:09 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1632 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:10.511928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:10.512844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:10.521707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.522222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.522964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.523444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.750834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:10.751593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:10.771209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.771671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.772472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:10.772925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:10.882971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:10.909722 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d7c6459-8619-429c-8480-79f96204c8f2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.404405 Jul 26 04:29:10.910348 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 457/858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:10 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:11.037511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:11.049521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65185a7b-2905-4cad-9558-8666bbb0d0f4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.303735 Jul 26 04:29:11.059610 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 402/859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:10 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:11.347658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:11.348648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.355668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.356457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.357467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.358215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.516054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:11.516819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.525933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.527915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.528786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.529322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.662206 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c93b3f3f-4139-4a93-bf3a-63cd07d5ce1d tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1615 microversion: 2.1 time: 0.149844 Jul 26 04:29:11.673396 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 403/860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:11 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1615 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:11.684133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:11.684706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.690910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.691369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.692148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.692578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.703138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:11.711688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae9c19fa-d13e-488a-846d-58e0b154877f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.367811 Jul 26 04:29:11.712845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 458/861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:11 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:11.731915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] HTTP exception thrown: Cannot 'migrate' instance 135f27a2-b149-426b-9875-603c970af376 while it is in vm_state suspended Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Request method failure captured: Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376/action HTTP/1.1 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 15 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321sfxf_LopM17ZJHcbGPtOMpxgNT2NVb8RB4fjPkjxzkf4DBXlhqisWJA84N2OGpz2hGSvxyxso3JiTyRT_x8MAM9F5etdyNZLIDDSyxCCCCN_AIGGHlWnnOJ5Q0xhrlL90bOqGeRamAgznJpRlVRQ9N1NMtv3LxnBvqn4Z5Ahbp-g Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:29:11.733555 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 27729fd6e46a4032b085dc0342dbdb55 Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: {"migrate": {}} Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:29:11.735019 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'migrate' instance 135f27a2-b149-426b-9875-603c970af376 while it is in vm_state suspended Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '135f27a2-b149-426b-9875-603c970af376', 'body': {'migrate': {}}} Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 135f27a2-b149-426b-9875-603c970af376 in vm_state suspended. Cannot resize while the instance is in this state. Jul 26 04:29:11.735823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 135f27a2-b149-426b-9875-603c970af376 while it is in vm_state suspended Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.737020 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 135f27a2-b149-426b-9875-603c970af376 while it is in vm_state suspended Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Returning 409 to user: Cannot 'migrate' instance 135f27a2-b149-426b-9875-603c970af376 while it is in vm_state suspended {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33238025-8d4d-4093-a33e-a25c31a0d1de tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376/action" status: 409 len: 148 microversion: 2.1 time: 0.055624 Jul 26 04:29:11.738304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 404/862] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:11 2022] POST /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376/action => generated 148 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 04:29:11.746008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab5c96dd-698f-412a-bcc8-29e277d20298 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab5c96dd-698f-412a-bcc8-29e277d20298 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Request method failure captured: Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action HTTP/1.1 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 39 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321sfxf_LopM17ZJHcbGPtOMpxgNT2NVb8RB4fjPkjxzkf4DBXlhqisWJA84N2OGpz2hGSvxyxso3JiTyRT_x8MAM9F5etdyNZLIDDSyxCCCCN_AIGGHlWnnOJ5Q0xhrlL90bOqGeRamAgznJpRlVRQ9N1NMtv3LxnBvqn4Z5Ahbp-g Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:29:11.749872 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 27729fd6e46a4032b085dc0342dbdb55 Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: {"os-resetState": {"state": "invalid"}} Jul 26 04:29:11.751189 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'be1cf253-04a6-4d7a-b2b6-a86cae8c85b8', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.751918 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:29:11.753245 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 04:29:11.754417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.754417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab5c96dd-698f-412a-bcc8-29e277d20298 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:11.754417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab5c96dd-698f-412a-bcc8-29e277d20298 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action" status: 400 len: 144 microversion: 2.1 time: 0.009663 Jul 26 04:29:11.754417 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 459/863] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:11 2022] POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:29:11.761957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-212815e1-44ea-4490-95de-22a08e65ff6c tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-212815e1-44ea-4490-95de-22a08e65ff6c tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Request method failure captured: Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action HTTP/1.1 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 31 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321sfxf_LopM17ZJHcbGPtOMpxgNT2NVb8RB4fjPkjxzkf4DBXlhqisWJA84N2OGpz2hGSvxyxso3JiTyRT_x8MAM9F5etdyNZLIDDSyxCCCCN_AIGGHlWnnOJ5Q0xhrlL90bOqGeRamAgznJpRlVRQ9N1NMtv3LxnBvqn4Z5Ahbp-g Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:29:11.765598 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 27729fd6e46a4032b085dc0342dbdb55 Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: {"os-resetState": {"state": 1}} Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:29:11.766911 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'be1cf253-04a6-4d7a-b2b6-a86cae8c85b8', 'body': {'os-resetState': {'state': 1}}} Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 1 Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:11.767692 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 04:29:11.768960 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.770097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-212815e1-44ea-4490-95de-22a08e65ff6c tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:11.770097 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-212815e1-44ea-4490-95de-22a08e65ff6c tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action" status: 400 len: 120 microversion: 2.1 time: 0.009763 Jul 26 04:29:11.770097 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 405/864] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:11 2022] POST /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:29:11.778795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:11.781150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Failed to fetch instance by id 999 {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:29:11.781761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Request method failure captured: Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 37 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321sfxf_LopM17ZJHcbGPtOMpxgNT2NVb8RB4fjPkjxzkf4DBXlhqisWJA84N2OGpz2hGSvxyxso3JiTyRT_x8MAM9F5etdyNZLIDDSyxCCCCN_AIGGHlWnnOJ5Q0xhrlL90bOqGeRamAgznJpRlVRQ9N1NMtv3LxnBvqn4Z5Ahbp-g Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:29:11.793021 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_21e94e1b77fb4eb6aac6688e3b92e313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 21e94e1b77fb4eb6aac6688e3b92e313 Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1945735735 Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 27729fd6e46a4032b085dc0342dbdb55 Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1945735735-project-admin Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: {"os-resetState": {"state": "error"}} Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:29:11.794464 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 999 could not be found. Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:29:11.795254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:11.796507 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb089252-606b-497d-8f3b-29909e9fb498 tempest-ServersAdminNegativeTestJSON-1945735735 tempest-ServersAdminNegativeTestJSON-1945735735-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020735 Jul 26 04:29:11.798402 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 460/865] 10.222.0.43 () {60 vars in 1179 bytes} [Tue Jul 26 04:29:11 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:29:11.804736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:11.805236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.808891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:11.814294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.814791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.815552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.815996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.842238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:29:11.935011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-850315b7-13bf-4d16-928b-9da1dedea2c2 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "DELETE /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 204 len: 0 microversion: 2.1 time: 0.133863 Jul 26 04:29:11.939386 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 406/866] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:29:11 2022] DELETE /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:29:11.942382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:11.942998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.946064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:11.947060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:11.955377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.956102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.957059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.957859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.959209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.959919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:11.961083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:11.961714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:12.134603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:12.143544 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-908e4abe-6d81-46ff-95ac-b633996012d3 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1468 microversion: 2.1 time: 0.202214 Jul 26 04:29:12.144228 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 407/867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:11 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1468 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:12.149111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:12.149926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:12.158349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:12.159610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:12.160521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:12.161070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:12.336660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:12.359142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84808e3e-3d1e-4dfb-a743-3ec374a496b1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.213622 Jul 26 04:29:12.359919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 408/868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:12 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:12.525538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:12.536630 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8679fc09-5058-4a3e-b6d4-c2d17e98fc2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1379 microversion: 2.1 time: 0.605496 Jul 26 04:29:12.537311 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 461/869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:11 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1379 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:12.736041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:12.736041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:12.748772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:12.751419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:12.754656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:12.756852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.172301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:13.174352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:13.185082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:13.189922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.190617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.191577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.192191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.197466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:13.211312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c9a504d-e688-44da-adcb-9f87076f0b83 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1505 microversion: 2.1 time: 0.481365 Jul 26 04:29:13.212558 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 409/870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:12 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:13.334597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:13.384826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:13.385741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:13.397519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.398076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.399453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.399888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.448814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:13.456911 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27681b78-419d-4417-ae99-0204ac0287fa tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1468 microversion: 2.1 time: 0.293895 Jul 26 04:29:13.472371 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 462/871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:13 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:13.561715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:13.563087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:13.571269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.572035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.573147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.574389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.599540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:13.610204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7fbc0f1-13e9-45e9-8eff-1f46aa9372c1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.230886 Jul 26 04:29:13.611570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 410/872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:13 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:13.748771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:13.757053 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0373bbb1-c24f-4bcf-9a49-195cc3822013 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1529 microversion: 2.1 time: 0.199947 Jul 26 04:29:13.757534 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 463/873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:13 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1529 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:13.777558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:13.778189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:13.785195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.785655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.786458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:13.786903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:13.791107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:13.968290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:13.985887 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4692c2b1-cdbc-4392-ba3a-a1f28febf825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1529 microversion: 2.1 time: 0.212396 Jul 26 04:29:13.986510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 411/874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:13 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1529 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:14.006960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eebaf0ec-a4a2-4f35-9f61-37945a657400 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.007867 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:29:14.007867 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:29:14.028928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eebaf0ec-a4a2-4f35-9f61-37945a657400 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/9dad9420-0839-431b-b22f-e57d83afc363" status: 202 len: 0 microversion: 2.1 time: 0.025546 Jul 26 04:29:14.030077 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 464/875] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:29:14 2022] DELETE /compute/v2.1/flavors/9dad9420-0839-431b-b22f-e57d83afc363 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:29:14.038402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75262fac-4878-489c-b8ff-1cfe32b3d7a9 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.061719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75262fac-4878-489c-b8ff-1cfe32b3d7a9 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.027161 Jul 26 04:29:14.062629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 412/876] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:14.081158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:14.083680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.091652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.092401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.093371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.094137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.129869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:14.137982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Old instance type tempest-test_resize_flavor_-72863270, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 04:29:14.158812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:14.159465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:14.160151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:14.160840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:14.161495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:14.199073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bfc0854a-2814-46cd-9fbd-55c56316808c req-5c320bc7-60c8-4ff8-aa5e-64a2025c937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadde0fb-19ef-4eca-8151-f7bc15d74b61", "name": "network-vif-plugged", "status": "completed", "tag": "4759b812-ba82-4555-a673-7db41a172cfc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:14.226854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bfc0854a-2814-46cd-9fbd-55c56316808c req-5c320bc7-60c8-4ff8-aa5e-64a2025c937a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.227672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bfc0854a-2814-46cd-9fbd-55c56316808c req-5c320bc7-60c8-4ff8-aa5e-64a2025c937a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.255488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bfc0854a-2814-46cd-9fbd-55c56316808c req-5c320bc7-60c8-4ff8-aa5e-64a2025c937a service nova] Creating event network-vif-plugged:4759b812-ba82-4555-a673-7db41a172cfc for instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 on n-h1-848886-16 Jul 26 04:29:14.261987 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bfc0854a-2814-46cd-9fbd-55c56316808c req-5c320bc7-60c8-4ff8-aa5e-64a2025c937a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067966 Jul 26 04:29:14.262856 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 413/877] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:14.268412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.269780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.283394 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd93bc81-5432-495c-ac26-7c3b660fb825 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a/action" status: 202 len: 0 microversion: 2.1 time: 0.206140 Jul 26 04:29:14.286339 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 465/878] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:14 2022] POST /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:29:14.288230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.289199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.290277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.290921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.297066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.301316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.319073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.319705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.321769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.322428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.567706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:14.581443 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86f1ea72-b11f-476a-b55c-a5e3567d8af1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1538 microversion: 2.1 time: 0.290923 Jul 26 04:29:14.582351 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 466/879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1538 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:14.601846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.602779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.609901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.610619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.610777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:14.611828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.612435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.618864 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f68c5323-669e-42ab-a836-0a6086d09634 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1495 microversion: 2.1 time: 0.354488 Jul 26 04:29:14.633722 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 414/880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:14.639315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.639921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.652639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.653094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.653921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.654371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.813115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:14.815782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:14.827902 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18a8bb25-9b7e-452f-b3b9-029adcdf087a tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 200 len: 1468 microversion: 2.1 time: 0.231841 Jul 26 04:29:14.854031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 467/881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:14.860708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89d70eb2-46b6-480c-b774-90454d5b2856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '.version_select at 0x7f38b5fa95e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.868035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89d70eb2-46b6-480c-b774-90454d5b2856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.868826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89d70eb2-46b6-480c-b774-90454d5b2856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.882482 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89d70eb2-46b6-480c-b774-90454d5b2856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.027022 Jul 26 04:29:14.893284 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 468/882] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:14.905709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:14.906857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:14.913493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.913966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.915242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:14.916558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:14.923807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:14.931256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5aeb8e9-5117-4ed0-912d-2ab2d771fda5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.302477 Jul 26 04:29:14.946452 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 415/883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:15.093069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2eee5280-4f91-440d-b8db-538ab3aa23ee req-a7c5144e-7fd4-4e80-9b7e-4006df3f7d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135f27a2-b149-426b-9875-603c970af376", "name": "network-vif-deleted", "tag": "3e1b5ee7-0853-4362-bfe8-73601387e2f1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:15.109068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2eee5280-4f91-440d-b8db-538ab3aa23ee req-a7c5144e-7fd4-4e80-9b7e-4006df3f7d24 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.109770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2eee5280-4f91-440d-b8db-538ab3aa23ee req-a7c5144e-7fd4-4e80-9b7e-4006df3f7d24 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.111003 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6d86a92-3e37-43b5-8010-5786cb1dd428 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1648 microversion: 2.1 time: 0.211568 Jul 26 04:29:15.119519 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 469/884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:14 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1648 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:15.357202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1013691275", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "d49ad6d2-e7e8-4c36-8548-0d97bda875ad"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:15.412554 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2eee5280-4f91-440d-b8db-538ab3aa23ee req-a7c5144e-7fd4-4e80-9b7e-4006df3f7d24 service nova] Creating event network-vif-deleted:3e1b5ee7-0853-4362-bfe8-73601387e2f1 for instance 135f27a2-b149-426b-9875-603c970af376 on n-h2-848886-16 Jul 26 04:29:15.418391 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2eee5280-4f91-440d-b8db-538ab3aa23ee req-a7c5144e-7fd4-4e80-9b7e-4006df3f7d24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330007 Jul 26 04:29:15.418987 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 416/885] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:15.433034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] validate_networks() for [('d49ad6d2-e7e8-4c36-8548-0d97bda875ad', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:15.605389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:15.606400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:15.613210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.613853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.614889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.615329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.804792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:15.813938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-684e1915-a0b5-4ba4-aa4e-8b4f081435f9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1538 microversion: 2.1 time: 0.212712 Jul 26 04:29:15.814440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 417/886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:15 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1538 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:15.849598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:15.850488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: 135f27a2-b149-426b-9875-603c970af376] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:15.857681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.858130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.858928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.859357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.874704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] HTTP exception thrown: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. Jul 26 04:29:15.875363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:15.876010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Request method failure captured: Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 HTTP/1.1 Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321r1sA2Ae7otRXbHsub_3om3PyBI4R0EHa59Idce9-qWV3CCQdPB_uLk37CtG41iQscmX0HnlcwVmgIg22CVCY9PKxxilttXnkbsdLXHHTQoZAQ6hE7uEfRJgdIg9fd7X4IDL53170fLL7XNFcUge_Y_qLvQFf9vtF21iDceakx3jU Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3bd21fb79414419e9fd04fda07d4f8ce Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:29:15.876348 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3bd21fb79414419e9fd04fda07d4f8ce Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminNegativeTestJSON-621587565-project Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3c712491db8a455b8d9a627c58e8bc13 Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-621587565-project Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. Jul 26 04:29:15.877628 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '135f27a2-b149-426b-9875-603c970af376'} Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:15.878410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. Jul 26 04:29:15.879551 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:29:15.880594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:15.880672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Returning 404 to user: Instance 135f27a2-b149-426b-9875-603c970af376 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:15.880746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:15.880746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:15.880890 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fccfc21c-3c14-4e52-993f-a3614eadfebb tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376" status: 404 len: 111 microversion: 2.1 time: 0.032164 Jul 26 04:29:15.880890 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 418/887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:15 2022] GET /compute/v2.1/servers/135f27a2-b149-426b-9875-603c970af376 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:29:15.887924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.888087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:15.888367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.888583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:15.889154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.889762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.894910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.895561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.896504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.897172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.910673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:15.915440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for user 97734a3da7ef4a809b0edd23ac216dfb and project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:15.927259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:29:15.927697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:15.930001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:15.975848 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c19533ce-8065-4100-a162-1e2443ec9689 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623147 Jul 26 04:29:15.976489 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 470/888] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:29:15.983055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:15.983749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:15.990627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.991380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:15.992314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:15.992911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:16.032604 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4b908a37-d44d-4259-a291-1c300a6fa81f tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 204 len: 0 microversion: 2.1 time: 0.149519 Jul 26 04:29:16.035060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 419/889] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:29:15 2022] DELETE /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:29:16.046187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bac26ecd-0f3a-455c-9dc7-f80888dad258 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:16.046187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bac26ecd-0f3a-455c-9dc7-f80888dad258 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:16.123166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bac26ecd-0f3a-455c-9dc7-f80888dad258 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:16.131290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bac26ecd-0f3a-455c-9dc7-f80888dad258 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1211 microversion: 2.1 time: 0.091805 Jul 26 04:29:16.134170 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 420/890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:16 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:16.151620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:16.153115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:16.160561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:16.161043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:16.161780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:16.162247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:16.173992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:16.181927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51b95d1f-f8fc-403e-bbed-2a35bd0a2c16 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1314 microversion: 2.1 time: 0.204364 Jul 26 04:29:16.182545 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 471/891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:15 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:16.309363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:16.317983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b88e68e-da16-49ee-aff5-f14de6d91bb5 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1477 microversion: 2.1 time: 0.172173 Jul 26 04:29:16.319274 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 421/892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:16 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:16.834939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:16.835549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:16.842304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:16.842933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:16.843701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:16.844136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:16.891665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3debafc-c9a1-492d-a5ed-da741eec4c70 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5da9670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:16.941836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3debafc-c9a1-492d-a5ed-da741eec4c70 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e" status: 200 len: 662 microversion: 2.1 time: 0.054016 Jul 26 04:29:16.942843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 422/893] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:16 2022] GET /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:16.955889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27d8865d-ab0d-4dbd-869f-d5fdf5bbdb6d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5dd8ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:16.989979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:17.001177 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dacefd2a-88e2-4098-a556-2a20943793d3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1538 microversion: 2.1 time: 0.169839 Jul 26 04:29:17.015917 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 472/894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:16 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1538 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:17.016111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-27d8865d-ab0d-4dbd-869f-d5fdf5bbdb6d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e" status: 200 len: 662 microversion: 2.1 time: 0.052519 Jul 26 04:29:17.016111 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 423/895] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:16 2022] GET /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:17.156252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:17.156860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:17.162942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.163390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.164152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.164586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.203111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:17.203718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:17.212258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.213468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.214483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.215069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.236949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:17.245175 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-175cf022-3164-4322-b579-44fffbebd7c4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1269 microversion: 2.1 time: 0.092876 Jul 26 04:29:17.245741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 473/896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:17 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:17.341809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:17.342592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:17.348582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.349041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.349817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.350297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.442780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:17.451813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2ddd1f9-af2d-4df6-8d34-aa303e6b72ab tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1463 microversion: 2.1 time: 0.252518 Jul 26 04:29:17.466361 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 424/897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:17 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:17.496084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:17.504340 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99b903bb-4e6b-4019-ba49-dd71a93925da tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1477 microversion: 2.1 time: 0.167225 Jul 26 04:29:17.505463 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 474/898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:17 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:17.685872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:17.691184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'deleted': False, 'project_id': '042b25c464984d47ac3570749cf406b3'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:17.697251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.698396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.699455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.700201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.817470 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-567af824-56fb-4ebf-b6c8-a57001850a49 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.346771 Jul 26 04:29:17.830180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 425/899] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:29:17 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:29:17.840286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:17.848567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'deleted': False} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:17.856776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.857232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.858816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:17.859327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:17.993441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:29:18.027237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.028847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:18.036866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.037618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.038674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.039441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.145094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.145810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.374959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:18.382615 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-367323d6-fe08-4a4e-ac10-bed5feb2608d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1538 microversion: 2.1 time: 0.362144 Jul 26 04:29:18.394544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 426/900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1538 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:18.402331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.403204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:18.410086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.411114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.412155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.412816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.604968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3836032b-0358-4dfb-8ed0-7209ff1fcbe5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 23239 microversion: 2.1 time: 0.767890 Jul 26 04:29:18.605624 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 475/901] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Jul 26 04:29:17 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 23239 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:29:18.610502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e600c5cb-0239-4b39-88ff-6826b325cce4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5fa9ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.657951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e600c5cb-0239-4b39-88ff-6826b325cce4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e" status: 200 len: 662 microversion: 2.1 time: 0.051280 Jul 26 04:29:18.658554 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 476/902] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e => generated 662 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:18.662946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.663710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:18.670908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.671228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.672018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.672436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.783156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:18.792994 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30091722-5067-4b72-a48f-137a3469bd4b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.396858 Jul 26 04:29:18.794074 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 427/903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:18.823033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.827474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c712491db8a455b8d9a627c58e8bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd21fb79414419e9fd04fda07d4f8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:18.831094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'deleted': False, 'project_id': '042b25c464984d47ac3570749cf406b3'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:18.836455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.838583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.839611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.839812 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7a31fc6e-b9dd-4751-a194-081e9d51fc20 tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 200 len: 1477 microversion: 2.1 time: 0.179576 Jul 26 04:29:18.840274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.840606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 477/904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:18.845886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90a49f78-8276-4fa0-87e6-ede0c9869257 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5fa95e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.891424 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20eaa710-b41a-47f1-86de-b3c735b5fa86 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?tenant_id=b2ecbd875cdc46a384524202af6c60e1" status: 200 len: 15 microversion: 2.1 time: 0.073833 Jul 26 04:29:18.892766 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 428/905] 10.222.0.43 () {58 vars in 1231 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/servers/detail?tenant_id=b2ecbd875cdc46a384524202af6c60e1 => generated 15 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:29:18.902588 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90a49f78-8276-4fa0-87e6-ede0c9869257 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e" status: 200 len: 662 microversion: 2.1 time: 0.059925 Jul 26 04:29:18.903166 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 478/906] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:18.917530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:18.924981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'tenant_id': 'b2ecbd875cdc46a384524202af6c60e1', 'deleted': False} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:18.929879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.930411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.931206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:18.931684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:18.991926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:29:19.031065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a5a31086-28cb-4e85-a287-dc1f0f47367f req-3147bd69-df76-473b-824c-41b789c5b2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1cf253-04a6-4d7a-b2b6-a86cae8c85b8", "name": "network-vif-deleted", "tag": "52a71c28-6af4-4560-ab84-21186dd33b12"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:19.048085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a5a31086-28cb-4e85-a287-dc1f0f47367f req-3147bd69-df76-473b-824c-41b789c5b2a5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.049035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a5a31086-28cb-4e85-a287-dc1f0f47367f req-3147bd69-df76-473b-824c-41b789c5b2a5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.064968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a5a31086-28cb-4e85-a287-dc1f0f47367f req-3147bd69-df76-473b-824c-41b789c5b2a5 service nova] Creating event network-vif-deleted:52a71c28-6af4-4560-ab84-21186dd33b12 for instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 on n-h1-848886-16 Jul 26 04:29:19.072710 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a5a31086-28cb-4e85-a287-dc1f0f47367f req-3147bd69-df76-473b-824c-41b789c5b2a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051139 Jul 26 04:29:19.073519 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 479/907] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:19.139351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.139963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.391853 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3b40d55-7204-4c6e-9afa-e4591d1c30f2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b2ecbd875cdc46a384524202af6c60e1" status: 200 len: 4829 microversion: 2.1 time: 0.479124 Jul 26 04:29:19.392535 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 429/908] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Jul 26 04:29:18 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b2ecbd875cdc46a384524202af6c60e1 => generated 4829 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:19.409345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.410285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.417594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.418303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.419162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.419311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.419694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.428733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'tenant_id': '042b25c464984d47ac3570749cf406b3', 'deleted': False} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:19.438193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.438854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.439830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.441129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.487257 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-faa31d0b-c472-4329-a371-b516df5d96a2 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=042b25c464984d47ac3570749cf406b3" status: 200 len: 15 microversion: 2.1 time: 0.071653 Jul 26 04:29:19.487897 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 430/909] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=042b25c464984d47ac3570749cf406b3 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:29:19.508950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34c5a29a-bb68-4861-8a18-321532d19dac tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.519006 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34c5a29a-bb68-4861-8a18-321532d19dac tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009399 Jul 26 04:29:19.520676 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 431/910] 10.222.0.43 () {58 vars in 1189 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:29:19.543384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:19.546397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.554548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.555100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.556226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.556842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.604608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:19.616481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0d79d78-32f4-475e-b281-45155a5ad933 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.211762 Jul 26 04:29:19.617792 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 480/911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:19.660611 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a0f313b-e107-4269-abb3-58092cf4d854 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.123481 Jul 26 04:29:19.661336 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 432/912] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:19 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:29:19.669703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.674773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:19.675821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:19.680056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:19.686203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.686646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.687522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.687951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.780633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:29:19.813636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.814396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.820429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.820980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.821802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.823141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.828276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:19.842280 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96a2a833-4edc-43da-b7d9-3e7a52fde81b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.176727 Jul 26 04:29:19.843437 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 481/913] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:19.854240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:19.856448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.862893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.863339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.864103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.864535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.940184 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71887e00-2a37-4a83-8788-d3ba116e0988 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.089570 Jul 26 04:29:19.943830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 482/914] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:19 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:29:19.945340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.945933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] [instance: be1cf253-04a6-4d7a-b2b6-a86cae8c85b8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.952771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.953241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.953980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.954444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.959672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:19.968166 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc01cee6-1df9-4466-8759-8c76f4295fab tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.158552 Jul 26 04:29:19.968556 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] HTTP exception thrown: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. Jul 26 04:29:19.969030 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 433/915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Request method failure captured: Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 HTTP/1.1 Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321r1sA2Ae7otRXbHsub_3om3PyBI4R0EHa59Idce9-qWV3CCQdPB_uLk37CtG41iQscmX0HnlcwVmgIg22CVCY9PKxxilttXnkbsdLXHHTQoZAQ6hE7uEfRJgdIg9fd7X4IDL53170fLL7XNFcUge_Y_qLvQFf9vtF21iDceakx3jU Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3bd21fb79414419e9fd04fda07d4f8ce Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:29:19.970337 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3bd21fb79414419e9fd04fda07d4f8ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3bd21fb79414419e9fd04fda07d4f8ce Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-621587565 Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminNegativeTestJSON-621587565-project Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3c712491db8a455b8d9a627c58e8bc13 Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-621587565-project Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. Jul 26 04:29:19.971615 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'be1cf253-04a6-4d7a-b2b6-a86cae8c85b8'} Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:29:19.972330 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. Jul 26 04:29:19.973485 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:29:19.974581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] Returning 404 to user: Instance be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:29:19.974581 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e1d7654-5b9e-49a5-b40a-d38c9ef1275e tempest-ServersAdminNegativeTestJSON-621587565 tempest-ServersAdminNegativeTestJSON-621587565-project] 10.222.0.43 "GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8" status: 404 len: 111 microversion: 2.1 time: 0.029982 Jul 26 04:29:19.974722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:19.974722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:19.975787 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 483/916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/be1cf253-04a6-4d7a-b2b6-a86cae8c85b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:29:19.980552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.981002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:19.981833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:19.982235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.119993 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cffab6b1-61e5-401a-ade7-79a8e5b83ff8 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1614 microversion: 2.1 time: 0.149109 Jul 26 04:29:20.120402 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 434/917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:19 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:20.140968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.141898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:20.148199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.148647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.149405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.149837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.302301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-103038a0-9883-4911-8f32-845e085d43ee tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1614 microversion: 2.1 time: 0.164970 Jul 26 04:29:20.303031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 484/918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1614 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:20.319162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-425a28f0-14df-4120-ae13-c3202c729c5c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f0b9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.322398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.328910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'host': 'n-h1-848886-16', 'deleted': False} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:20.333936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.334419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.335330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.335771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.364779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-425a28f0-14df-4120-ae13-c3202c729c5c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57" status: 200 len: 662 microversion: 2.1 time: 0.049449 Jul 26 04:29:20.365663 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 435/919] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57 => generated 662 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:20.380353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d7c7883-ff04-47e4-a95e-ae97d0ba8038 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5de5b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.429235 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d7c7883-ff04-47e4-a95e-ae97d0ba8038 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57" status: 200 len: 662 microversion: 2.1 time: 0.053006 Jul 26 04:29:20.429806 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 436/920] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57 => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:20.435575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:29:20.510410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7033fd49-12fa-47e4-96db-1d7cdce77e0b tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=n-h1-848886-16&all_tenants=1" status: 200 len: 2633 microversion: 2.1 time: 0.191653 Jul 26 04:29:20.511001 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 485/921] 10.222.0.43 () {58 vars in 1192 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/servers?host=n-h1-848886-16&all_tenants=1 => generated 2633 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:20.523703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.530419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:29:20.535284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.535657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.536438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.536876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.559699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-871056276", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:20.620157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:20.623259 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a05896f-8739-4121-9639-78b2d46f65a5 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.103122 Jul 26 04:29:20.624680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 437/922] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:29:20.637688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:20.640032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:20.646709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.647154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.647912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.648456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.747449 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4e4cf12-c1d8-4e14-9647-80da97afe475 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.114402 Jul 26 04:29:20.751185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 438/923] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:20 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:29:20.753296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:20.753559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:20.760496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.760837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.761515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.761947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.856336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:20.856827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:20.857210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:20.857611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:20.858264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:20.868088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.868598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.869931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.870399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.879565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:20.895362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Getting quotas for project 8a6fbc239a6f4a4b80e5ba267fdb3e61. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:20.901677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Getting quotas for user 14044a2c939440da9b93daeb4e21242b and project 8a6fbc239a6f4a4b80e5ba267fdb3e61. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:20.910658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:20.915041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:20.918033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:20.921324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-57777aa5-4f65-45bb-85bd-93e7386d7031 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.171920 Jul 26 04:29:20.922187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 439/924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:20.931341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:20.934651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:20.941188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.941805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.942696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:20.943200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:20.964765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77168b1f-090f-46ba-a23b-4154b0828cbd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.410167 Jul 26 04:29:20.970741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 486/925] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:29:21.003729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:21.005001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:21.014805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.015255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.016630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.017181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.060605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:21.061027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:21.062282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:21.062946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:21.063520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:21.138679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:21.145432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.146040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.147936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.148628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.180904 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60420d90-d207-4a52-9cae-4aadfe416254 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 1065 microversion: 2.1 time: 0.253456 Jul 26 04:29:21.182029 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 440/926] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:20 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 1065 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 04:29:21.196787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0e711c15-2569-40bc-973b-db9b027d188c req-5314d705-5770-40a3-9852-45c97a877e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:21.215640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0e711c15-2569-40bc-973b-db9b027d188c req-5314d705-5770-40a3-9852-45c97a877e33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.216083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0e711c15-2569-40bc-973b-db9b027d188c req-5314d705-5770-40a3-9852-45c97a877e33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.230205 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0e711c15-2569-40bc-973b-db9b027d188c req-5314d705-5770-40a3-9852-45c97a877e33 service nova] Creating event network-changed:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h2-848886-16 Jul 26 04:29:21.260900 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0e711c15-2569-40bc-973b-db9b027d188c req-5314d705-5770-40a3-9852-45c97a877e33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074019 Jul 26 04:29:21.262092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 441/927] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:21.267235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:21.269775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1521666490", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:21.278038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9594a766-9351-43d7-8feb-de2381fc4e9d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.283768 Jul 26 04:29:21.282638 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 487/928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:20 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:21.290059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:21.292244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:21.302282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.302797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.303803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.304531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.342751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:21.462476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:21.471910 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6f7f5b74-3345-4a86-846b-e985524b170c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.187849 Jul 26 04:29:21.472849 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 488/929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:21 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:21.651265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:21.651735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:21.652502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:21.652909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:21.653595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:21.664124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.664810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.665726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.666395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.684175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Getting quotas for project 8a6fbc239a6f4a4b80e5ba267fdb3e61. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:21.689224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Getting quotas for user 14044a2c939440da9b93daeb4e21242b and project 8a6fbc239a6f4a4b80e5ba267fdb3e61. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:21.701583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:21.704655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:21.717064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:21.753623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85a9ef27-abe5-40f0-92d6-5b91c5a47a5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489740 Jul 26 04:29:21.755508 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 442/930] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:29:21.765125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86a83bc8-3749-4792-aa1c-e2f2920151b6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:21.766037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86a83bc8-3749-4792-aa1c-e2f2920151b6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:21.826902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86a83bc8-3749-4792-aa1c-e2f2920151b6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:21.832741 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86a83bc8-3749-4792-aa1c-e2f2920151b6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1218 microversion: 2.1 time: 0.068853 Jul 26 04:29:21.842240 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 489/931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:21 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:21.942626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:21.943238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:21.951143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.951602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:21.952454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:21.953068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.117685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:22.126342 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4497b736-581a-455d-811a-8f2680e391a8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.187566 Jul 26 04:29:22.126926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 443/932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:21 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:22.299971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:22.300579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:22.306868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.307317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.308094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.308530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.470344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:22.477780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce6c0f19-49fb-4422-9e88-bbf92fa817fa tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.181733 Jul 26 04:29:22.479030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 490/933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:22 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:22.494146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:22.494993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:22.501091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.501514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.502416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.502826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.807752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:22.821097 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aaaefe56-f7bc-42b9-8e2c-e4c23ed0e645 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.330663 Jul 26 04:29:22.823586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 444/934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:22 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:22.854751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:22.856137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:22.863785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.864623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.866041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:22.866734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:22.941324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:22.949335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0876627a-9822-4d00-becc-becb0a921200 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1270 microversion: 2.1 time: 0.099531 Jul 26 04:29:22.949907 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 491/935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:22 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:23.147950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:23.148558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:23.155701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.156217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.157301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.157815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.358059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:23.369599 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c66f924e-9e36-4910-a0ff-21878083bd4e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.222629 Jul 26 04:29:23.385019 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 445/936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:23 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:23.501080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:23.502914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:23.518514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.521817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.522925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.523608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.855884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:23.858209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:23.882198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.886880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.889504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.890896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.918663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:23.929945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f0a0fdc-d9da-452a-9647-4d6d3b2df4f9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.434030 Jul 26 04:29:23.930567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 492/937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:23 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:23.974489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:23.975484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:23.990257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.991202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:23.993675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:23.995920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:24.133326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:24.141948 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdc58880-7341-472e-979d-773767c19015 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1276 microversion: 2.1 time: 0.174919 Jul 26 04:29:24.156974 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 493/938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:23 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:24.356247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:24.373525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed6778c3-f064-4e26-b3fe-38e5a63f9d6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.526538 Jul 26 04:29:24.374439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 446/939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:23 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:24.395718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:24.396599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:24.404712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:24.409359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:24.411645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:24.412269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:24.954341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:24.955612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:24.965125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:24.965582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:24.966588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:24.967239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:25.136019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:25.148052 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e38fa33d-e235-4612-bfe7-b09736d71373 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.756019 Jul 26 04:29:25.158740 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 494/940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:24 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:25.177215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:25.178209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:25.185226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:25.186065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:25.187006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:25.187658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:25.398648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:25.412170 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-25c535e1-4b24-4b10-b4d4-3c8887dd3041 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.464295 Jul 26 04:29:25.413729 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 447/941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:24 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:25.424813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:25.426278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:25.435121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:25.435569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:25.436340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:25.436840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:25.583868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:25.595798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec29f968-28fc-4ffa-b450-37d91bcb93b4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.422234 Jul 26 04:29:25.596646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 495/942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:25 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:25.626850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:25.637807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-150d5058-3ee2-45e9-9b10-84e9eb76fd27 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.222066 Jul 26 04:29:25.638421 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 448/943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:25 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:26.180539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:26.181155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:26.190894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.193136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.194421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.195678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.314857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-af28a18d-2d4d-4ac2-8ef5-28ef9b5fc1d0 req-88e1252c-d001-401b-916c-c1ceae94a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "name": "network-vif-plugged", "status": "completed", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:26.339413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-af28a18d-2d4d-4ac2-8ef5-28ef9b5fc1d0 req-88e1252c-d001-401b-916c-c1ceae94a2e9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.341218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-af28a18d-2d4d-4ac2-8ef5-28ef9b5fc1d0 req-88e1252c-d001-401b-916c-c1ceae94a2e9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.359638 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-af28a18d-2d4d-4ac2-8ef5-28ef9b5fc1d0 req-88e1252c-d001-401b-916c-c1ceae94a2e9 service nova] Creating event network-vif-plugged:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h2-848886-16 Jul 26 04:29:26.374492 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-af28a18d-2d4d-4ac2-8ef5-28ef9b5fc1d0 req-88e1252c-d001-401b-916c-c1ceae94a2e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064975 Jul 26 04:29:26.377986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 449/944] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:26.421891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c87f951a-4af5-4217-8682-805891ae051d req-619e7e63-f933-4131-b1e1-007895fa93d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e46c6d2-15c9-4d22-88ab-46713a88a208", "tag": "d6fc979e-4b1a-4de9-b284-53e7a6b1dd03"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:26.443481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c87f951a-4af5-4217-8682-805891ae051d req-619e7e63-f933-4131-b1e1-007895fa93d9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.447709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c87f951a-4af5-4217-8682-805891ae051d req-619e7e63-f933-4131-b1e1-007895fa93d9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.486365 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c87f951a-4af5-4217-8682-805891ae051d req-619e7e63-f933-4131-b1e1-007895fa93d9 service nova] Creating event network-changed:d6fc979e-4b1a-4de9-b284-53e7a6b1dd03 for instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 on n-h2-848886-16 Jul 26 04:29:26.491183 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c87f951a-4af5-4217-8682-805891ae051d req-619e7e63-f933-4131-b1e1-007895fa93d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075140 Jul 26 04:29:26.492246 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 450/945] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:26.502837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:26.503693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:26.517497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.522370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.523363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.523922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.553949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:26.772859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:26.781961 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e7c3016-0fac-47de-935c-ac9c9bec8ef8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.606643 Jul 26 04:29:26.786963 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 496/946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:26 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:26.787549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:26.795408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:26.803069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.803510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.807941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.808379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.871233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:26.881695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-660fa9e0-2d56-4088-9f7f-d2f0fcdf88a6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.387232 Jul 26 04:29:26.882783 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 451/947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:26 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:26.888150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:26.889020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:26.897236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.897732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:26.898540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:26.898975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:27.051877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:27.063236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13cef3de-dfa6-468f-bc44-546748ff52a7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.178862 Jul 26 04:29:27.064402 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 452/948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:26 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:27.136482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:27.152540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fca1161a-6107-46cf-ae7c-04fb87c8d5cf req-5efd80bb-6b20-4591-bf3f-10c8b5eb7ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:27.161288 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b55acdf-d732-4a40-8a53-ace298bd67ed tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.377116 Jul 26 04:29:27.165509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 497/949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:26 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:27.184567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fca1161a-6107-46cf-ae7c-04fb87c8d5cf req-5efd80bb-6b20-4591-bf3f-10c8b5eb7ab2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:27.185416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fca1161a-6107-46cf-ae7c-04fb87c8d5cf req-5efd80bb-6b20-4591-bf3f-10c8b5eb7ab2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:27.207800 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fca1161a-6107-46cf-ae7c-04fb87c8d5cf req-5efd80bb-6b20-4591-bf3f-10c8b5eb7ab2 service nova] Creating event network-changed:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:29:27.219214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fca1161a-6107-46cf-ae7c-04fb87c8d5cf req-5efd80bb-6b20-4591-bf3f-10c8b5eb7ab2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072053 Jul 26 04:29:27.220124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 453/950] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:27.803813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:27.804428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:27.811384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:27.812345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:27.812652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:27.813099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:27.904809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:27.905536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:27.914844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:27.915762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:27.916769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:27.917413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:28.061452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:28.077694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2210f92-8eef-4f65-9ece-91d0506a7cbb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.277470 Jul 26 04:29:28.078700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 498/951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:27 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:28.090653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:28.092116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:28.102041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:28.102959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:28.104674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:28.107695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:28.173646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:28.185749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da78bd00-b29f-4e75-9642-8b189fec714c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.286245 Jul 26 04:29:28.199557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 454/952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:27 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:28.210678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:28.211893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:28.219800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:28.220728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:28.221752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:28.222513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:28.368250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:28.379415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8cfd87c-f112-4cf2-b6d0-10d97ebf79ca tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1469 microversion: 2.1 time: 0.297845 Jul 26 04:29:28.382196 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 499/953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:28 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:28.472411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:28.481568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24f57b1f-4dbc-402b-8ee9-9bbff1098b55 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.280234 Jul 26 04:29:28.483549 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 455/954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:28 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:29.099939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:29.100745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:29.108258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.108828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.109679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.115279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.215971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:29.216662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:29.226309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.227019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.228075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.229791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.304401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:29.312916 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa6916bd-7e7c-4889-8db6-1e4337989eec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.216845 Jul 26 04:29:29.314065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 500/955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:29 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:29.402382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:29.403246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:29.411849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.412537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.413525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.414180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.466237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:29.476754 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-afaac176-e12f-4d7c-895e-c08e17ca5d33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.266331 Jul 26 04:29:29.478514 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 456/956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:29 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:29.589583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:29.597759 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4863a8c2-65bf-4d21-a8a7-2deafe3722e5 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.200594 Jul 26 04:29:29.612279 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 501/957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:29 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:29.617515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:29.618376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:29.625680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.626485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.627399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:29.627847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:29.662619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1771441909", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "79148372-8626-42a1-9ce2-ec3332744087"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:29.717109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] validate_networks() for [('79148372-8626-42a1-9ce2-ec3332744087', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:29.764350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:29.772123 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f306e508-4e15-40d1-9439-885e5259e218 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.158490 Jul 26 04:29:29.772697 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 502/958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:29 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:30.338645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:30.339122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:30.339499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:30.339586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:30.339685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:30.339925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:30.340335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:30.346319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.346949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.347739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.348349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.350548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.351000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.351807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.352242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.370874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:30.375496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for user baadf645f9914104a5e50c7bced4ffea and project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:30.388049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:30.390350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:30.440553 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7e32716-2a22-44e3-8c1c-7ef24984175a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960761 Jul 26 04:29:30.441366 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 457/959] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:29:30.457271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4bc3dc73-af7a-43a8-ac9c-174253f1a4d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:30.458132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4bc3dc73-af7a-43a8-ac9c-174253f1a4d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:30.532083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4bc3dc73-af7a-43a8-ac9c-174253f1a4d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:30.538301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:30.542396 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4bc3dc73-af7a-43a8-ac9c-174253f1a4d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1218 microversion: 2.1 time: 0.091494 Jul 26 04:29:30.547078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f31fec49-8670-44b3-a362-6f64a63200ed tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.212586 Jul 26 04:29:30.558305 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 503/960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:30 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:30.558305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:30.558305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:30.558604 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 458/961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:30 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:30.559912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.563222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.563222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.563222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.582817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:30.620722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:30.621574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:30.629581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.630146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.631143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.632230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.719535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:30.736252 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc823a6d-5d6b-4000-a530-631c5c16c896 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1311 microversion: 2.1 time: 0.180273 Jul 26 04:29:30.737371 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 504/962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:30 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:30.795565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:30.796490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:30.803892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.804527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.805496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:30.805770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:30.806862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:30.829402 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-360530c4-6606-4247-a562-c6617bec19ee tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.213409 Jul 26 04:29:30.830083 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 459/963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:30 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:30.879857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:30.977042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:30.985505 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4102ed2b-fd39-4c2c-a76a-2e58cff8918f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.195445 Jul 26 04:29:30.998518 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 505/964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:30 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:31.565034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:31.566396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:31.571084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:31.572670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:31.575814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.576273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.577909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.578443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.581600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.583128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.584337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.585032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.672552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:31.680660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e18561e1-aeb6-4e6a-8615-0e208d97adb3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1214 microversion: 2.1 time: 0.119461 Jul 26 04:29:31.692168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 460/965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:31 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:31.748080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:31.759002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:31.761111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:31.764140 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8296c9f-d15e-46d5-8be2-bc8ca1242aa9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.196877 Jul 26 04:29:31.768219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.768837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.769787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.770406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.781231 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 506/966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:31 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:31.869801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:31.872461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:31.877941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:31.889345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.889803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.890623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:31.891069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:31.970549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:31.979066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5db041a0-5225-4343-9c2b-22f2bafe0601 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1494 microversion: 2.1 time: 0.223951 Jul 26 04:29:31.979765 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 461/967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:31 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:32.007044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.007926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.014621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.015406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.016412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.017059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.079350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:32.088336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e8f1f8c0-b2f1-4b49-a4f2-8e152b38c22e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.228998 Jul 26 04:29:32.102344 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 507/968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:31 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:32.102344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.102344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.110286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.110738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.111517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.111955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.195835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b2892bf-f197-4cdf-bd0a-dc6d063286f4 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1647 microversion: 2.1 time: 0.198822 Jul 26 04:29:32.196425 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 462/969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:31 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1647 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:32.220910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.221655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.229202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.229731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.230560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.231184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.289615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:32.298449 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df38ab29-f09f-491e-be85-bf87c57764fc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.200576 Jul 26 04:29:32.298843 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 508/970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:32.375061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f56d7de-7a6f-4c96-b2d0-5b5d75a14882 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1647 microversion: 2.1 time: 0.157980 Jul 26 04:29:32.375633 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 463/971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1647 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:32.395705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.398436 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:29:32.398436 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:29:32.399639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.401450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.402548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.403008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.430852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-133c730a-da93-4eec-b5fd-365e42508650 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039032 Jul 26 04:29:32.432605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 509/972] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:32.444027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:32.444559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.451056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.451480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.452292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.452884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.523507 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cc628fa-f687-4aea-a1c7-d88fad59cdf0 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1/action" status: 202 len: 0 microversion: 2.1 time: 0.082999 Jul 26 04:29:32.524279 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 464/973] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:32 2022] POST /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:29:32.533553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.534191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.541172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.541932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.542755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.543192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.686681 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bbaf4fa9-fc66-4166-ac0f-b413c6acc155 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1652 microversion: 2.1 time: 0.157221 Jul 26 04:29:32.688403 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 510/974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:32.709949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.711334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.718227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.718679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.719479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.719942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.788036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:32.788650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:32.795043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.795676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.796965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:32.797298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:32.797898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:32.806765 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0011de7c-c6ba-4c50-89d9-68b4619fd231 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1214 microversion: 2.1 time: 0.101382 Jul 26 04:29:32.807871 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 465/975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:32.942172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:32.950235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f991639-0131-4785-81ac-b59b0f2eec32 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.165945 Jul 26 04:29:32.950996 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 511/976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:32 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:33.110611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:33.111214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:33.117253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.117701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.118492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.119726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.249236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:33.256952 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f009c486-4202-4418-a7be-43ed95693937 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.150285 Jul 26 04:29:33.257508 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 466/977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:33 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:33.320326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:33.321211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:33.329759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.330237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.331037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.331472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.468809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:33.476330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0d55575-3383-40fd-af14-af4e4e5ea93b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.160146 Jul 26 04:29:33.476887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 512/978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:33 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:33.710052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:33.710694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:33.718251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.718705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.719471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.719909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.828571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:33.829175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:33.836076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.836523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.843586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.844223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.847406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e095792b-aa7b-4712-9524-c8484d83d121 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1652 microversion: 2.1 time: 0.141040 Jul 26 04:29:33.847985 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 467/979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:33 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1652 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:33.923710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:33.932380 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-202796e8-b449-47fd-8b81-e093520dcb1a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1214 microversion: 2.1 time: 0.107572 Jul 26 04:29:33.932956 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 513/980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:33 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:33.970706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:33.971325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:33.977442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.978541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:33.979562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:33.979999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.113079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:34.120759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-04189ba5-fed2-41c5-b9d2-314705336dc9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.153872 Jul 26 04:29:34.121530 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 468/981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:33 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:34.201605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-936e7519-39c3-47ba-9706-186c8d51c6fe req-8aec7055-3c72-43d6-9c8e-2a133e0865da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8295eba4-7896-4474-90a9-91a6db08cfdb", "name": "network-vif-plugged", "status": "completed", "tag": "b9ff22bc-41b3-458b-af9b-b765dbedc3bf"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:34.211078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-936e7519-39c3-47ba-9706-186c8d51c6fe req-8aec7055-3c72-43d6-9c8e-2a133e0865da service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.211561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-936e7519-39c3-47ba-9706-186c8d51c6fe req-8aec7055-3c72-43d6-9c8e-2a133e0865da service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.224294 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-936e7519-39c3-47ba-9706-186c8d51c6fe req-8aec7055-3c72-43d6-9c8e-2a133e0865da service nova] Creating event network-vif-plugged:b9ff22bc-41b3-458b-af9b-b765dbedc3bf for instance 8295eba4-7896-4474-90a9-91a6db08cfdb on n-h1-848886-16 Jul 26 04:29:34.229404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-936e7519-39c3-47ba-9706-186c8d51c6fe req-8aec7055-3c72-43d6-9c8e-2a133e0865da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Jul 26 04:29:34.230221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 514/982] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:34.278850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:34.279869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:34.286598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.287602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.288567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.289020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.312686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:34.501144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:34.502105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:34.512954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.513515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.515701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.517253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.626278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:34.636529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bef5798b-9550-4f53-a96b-046b127d8111 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.361986 Jul 26 04:29:34.644729 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 469/983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:34 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:34.713411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:34.720661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c011efef-1b47-4890-ab5d-ae09c5b4f435 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.225712 Jul 26 04:29:34.721351 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 515/984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:34 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:34.868990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:34.869925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:34.876809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.877483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.878565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.879160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.952889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:34.954038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:34.961126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.961588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:34.962919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:34.963665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.047706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:35.059093 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b0ca1ee-f458-4551-b323-9c812f4b1b33 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1278 microversion: 2.1 time: 0.109596 Jul 26 04:29:35.060124 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 516/985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:34 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:35.142946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:35.143564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:35.151369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.151833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.152877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.153319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.171401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4b9ad7de-5242-4ef8-a030-01d273b063e1 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1632 microversion: 2.1 time: 0.306139 Jul 26 04:29:35.186206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 470/986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:34 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1632 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:35.195474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:35.199051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:35.205331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.206040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.206835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.207269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.236241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lazy-loading 'flavor' on Instance uuid ead7e696-c94a-4516-8282-5dc1cbd829d1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:29:35.264290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:29:35.318265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:35.327847 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c090881c-fd0f-437d-8e37-866e0baf744b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.188771 Jul 26 04:29:35.334206 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 517/987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:35 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:35.658526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:35.659326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:35.665491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.666144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.667041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.667468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.863237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:35.871272 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cdcfa1d1-3f32-4330-96ad-9e4e0139fa75 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1475 microversion: 2.1 time: 0.216597 Jul 26 04:29:35.872094 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 518/988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:35 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1475 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:35.892816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:35.893812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:35.900955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.901398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:35.902959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:35.903403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.101358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:36.112764 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1061e228-1c06-4307-85d4-66c074e96da1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.224979 Jul 26 04:29:36.114280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 519/989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:35 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:36.121456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:36.123265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:36.130530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.131399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.132541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.133194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.315132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:36.325131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13ec3729-9016-4059-9833-2f95ad66aaa2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.208977 Jul 26 04:29:36.326928 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 520/990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:36 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:36.332128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ca28a3de-065e-4f65-9fde-5aa7cbc6cf31 req-42680202-cbf5-4368-a6ae-a07b5b9e7412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e46c6d2-15c9-4d22-88ab-46713a88a208", "name": "network-vif-plugged", "status": "completed", "tag": "d6fc979e-4b1a-4de9-b284-53e7a6b1dd03"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:36.342896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca28a3de-065e-4f65-9fde-5aa7cbc6cf31 req-42680202-cbf5-4368-a6ae-a07b5b9e7412 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.344325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca28a3de-065e-4f65-9fde-5aa7cbc6cf31 req-42680202-cbf5-4368-a6ae-a07b5b9e7412 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.357057 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ca28a3de-065e-4f65-9fde-5aa7cbc6cf31 req-42680202-cbf5-4368-a6ae-a07b5b9e7412 service nova] Creating event network-vif-plugged:d6fc979e-4b1a-4de9-b284-53e7a6b1dd03 for instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 on n-h2-848886-16 Jul 26 04:29:36.363430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ca28a3de-065e-4f65-9fde-5aa7cbc6cf31 req-42680202-cbf5-4368-a6ae-a07b5b9e7412 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Jul 26 04:29:36.364610 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 521/991] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:36.370789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:36.371584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:36.377452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:36.379447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.380103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.381234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.381780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.528521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:36.537988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8fb369d-ad3e-4d37-ab7c-1b0e3fd02bc4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.172139 Jul 26 04:29:36.538727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 522/992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:36 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:36.893278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:36.893977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:36.900153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.900805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.901574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:36.902301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:36.906385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:37.067176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.077128 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d2d3b0e-6bed-4cb1-b915-c0ce43d37ba7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1461 microversion: 2.1 time: 0.187737 Jul 26 04:29:37.091555 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 523/993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:36 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1461 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:37.100588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0772e220-e57f-4e56-b067-83c82c4c8c74 req-4af7ef03-2763-43d9-a389-19ae55c8f0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a92aba-ac5b-4fe0-9ea4-2dcb683568ad", "tag": "40bcbc35-dea5-405e-adce-ebaf7713e0db"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:37.113984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5474441-6c15-4418-8bfb-b992af885d1e tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1/action" status: 202 len: 0 microversion: 2.1 time: 1.922720 Jul 26 04:29:37.114624 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 471/994] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:35 2022] POST /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1/action => generated 0 bytes in 1924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:29:37.119783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0772e220-e57f-4e56-b067-83c82c4c8c74 req-4af7ef03-2763-43d9-a389-19ae55c8f0c7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.120503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.121102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0772e220-e57f-4e56-b067-83c82c4c8c74 req-4af7ef03-2763-43d9-a389-19ae55c8f0c7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.122093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.136460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.137748 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0772e220-e57f-4e56-b067-83c82c4c8c74 req-4af7ef03-2763-43d9-a389-19ae55c8f0c7 service nova] Creating event network-changed:40bcbc35-dea5-405e-adce-ebaf7713e0db for instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad on n-h2-848886-16 Jul 26 04:29:37.138712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.139537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.139981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.148995 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0772e220-e57f-4e56-b067-83c82c4c8c74 req-4af7ef03-2763-43d9-a389-19ae55c8f0c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055996 Jul 26 04:29:37.150217 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 524/995] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:37.155862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.156876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.163559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.164376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.166078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.166760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.308589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.309418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.317111 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce7d18b3-e426-4257-b06a-7653eaa0cd6f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.165526 Jul 26 04:29:37.317290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c31503a5-e49a-4490-b7c3-f79526d52ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1461 microversion: 2.1 time: 0.201594 Jul 26 04:29:37.317747 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 472/996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1461 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:37.317878 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 525/997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:37.328010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.329384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.335620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.336072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.336832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.338053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.338705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:37.341518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.347741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.348227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.349030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.349473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.427430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:37.427880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:37.428356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:37.428765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:37.429205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:37.473296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.481459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf5554f0-71a5-4bf5-ad66-b4227a5f4a04 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1318 microversion: 2.1 time: 0.157758 Jul 26 04:29:37.482298 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 473/998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:37.488419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.489042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.496152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.499132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.499632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.500484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.500924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.505740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.506428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.507206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.507876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.548663 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c45dcc9-0f9b-4211-a586-9a325443372e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 1065 microversion: 2.1 time: 0.214695 Jul 26 04:29:37.549632 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 526/999] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:37 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 1065 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 04:29:37.561098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.561757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.568490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.569266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.570324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.570867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.651137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.659420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48821780-bc3a-4c4c-974a-48e7f8887560 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.175949 Jul 26 04:29:37.659988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 474/1000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:37.664883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:37.665516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:37.671835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.672294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.673065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:37.673502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:37.714431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.722191 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f690a879-1501-42a6-8ad2-de221589cccf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.164975 Jul 26 04:29:37.722836 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 527/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:37.809876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:37.818336 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14a50c75-46b7-4eb3-85b6-33369380d28a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.156984 Jul 26 04:29:37.818831 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 475/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:37 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:38.338342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:38.339053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:38.346332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.347156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.347936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.348368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.404776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c623da43-3ffa-4920-a23e-f7b6dd2ab4bf req-b8a435b4-d041-4af7-aeec-0ba633fa3ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-plugged", "status": "completed", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:38.418657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c623da43-3ffa-4920-a23e-f7b6dd2ab4bf req-b8a435b4-d041-4af7-aeec-0ba633fa3ae7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.419284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c623da43-3ffa-4920-a23e-f7b6dd2ab4bf req-b8a435b4-d041-4af7-aeec-0ba633fa3ae7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.439495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c623da43-3ffa-4920-a23e-f7b6dd2ab4bf req-b8a435b4-d041-4af7-aeec-0ba633fa3ae7 service nova] Creating event network-vif-plugged:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:29:38.445231 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c623da43-3ffa-4920-a23e-f7b6dd2ab4bf req-b8a435b4-d041-4af7-aeec-0ba633fa3ae7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049262 Jul 26 04:29:38.446348 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 476/1003] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:38.507275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:38.508376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:38.521625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:38.531555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.531555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.532620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.533107 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4a45701-da7f-4ca6-948c-f5f8dec9c43e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.197570 Jul 26 04:29:38.533424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.533719 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 528/1004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:38 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:38.679786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:38.680384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:38.686475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.686917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.687674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.688103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.835715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:38.846132 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0f6c3b6-7494-4e70-aa9a-f1ca1c5b8e11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.170057 Jul 26 04:29:38.847281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 529/1005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:38 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:38.853391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:38.854184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:38.861112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.861591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.862440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.862857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.879000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:38.888332 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a6b52d2-b39e-4b9d-9189-778e3eb441aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1467 microversion: 2.1 time: 0.386543 Jul 26 04:29:38.888916 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 477/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:38 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1467 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:38.893494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:38.894120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:38.901061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.901715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:38.902915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:38.903506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.097954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:39.114298 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef81ed74-0f51-4dc9-9736-a36dcdfdaf80 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.224280 Jul 26 04:29:39.115521 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 478/1007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:38 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:39.123086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:39.123812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:39.138311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.138857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.139743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.140242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.319153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:39.324486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:39.327728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92e973d2-1c2e-44c0-a13f-152856ce74f0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.479408 Jul 26 04:29:39.332160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9285213c-e44b-4e11-b719-fde2ce39572d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1317 microversion: 2.1 time: 0.215214 Jul 26 04:29:39.333155 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 479/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:39 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:39.347341 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 530/1009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:38 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:39.557481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:39.558179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:39.565098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.565553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.566406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.566848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.695784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7ceeed16-eaf8-468d-a236-63404a5c2130 req-d9babe4e-4e9b-4468-9fc9-31428c8f2f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "name": "network-vif-unplugged", "status": "completed", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:39.705862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7ceeed16-eaf8-468d-a236-63404a5c2130 req-d9babe4e-4e9b-4468-9fc9-31428c8f2f61 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.706376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7ceeed16-eaf8-468d-a236-63404a5c2130 req-d9babe4e-4e9b-4468-9fc9-31428c8f2f61 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.717590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7ceeed16-eaf8-468d-a236-63404a5c2130 req-d9babe4e-4e9b-4468-9fc9-31428c8f2f61 service nova] Creating event network-vif-unplugged:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h2-848886-16 Jul 26 04:29:39.722485 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7ceeed16-eaf8-468d-a236-63404a5c2130 req-d9babe4e-4e9b-4468-9fc9-31428c8f2f61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030396 Jul 26 04:29:39.723063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 531/1010] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:39.807854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:39.815666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92701c9d-0eab-4814-a5c4-ab36803dfe5f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.262874 Jul 26 04:29:39.816246 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 480/1011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:39 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:39.868930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:39.869702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:39.876088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.876754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:39.877741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:39.878387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.032352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:40.041314 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-768553f0-ea2d-4b6a-b212-929eeb836b09 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.177207 Jul 26 04:29:40.041981 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 532/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:39 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:40.136529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:40.137467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:40.143618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.144079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.144869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.145520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.282323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:40.291533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e0e2abab-a348-444f-9267-039488796c61 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.159621 Jul 26 04:29:40.292113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 481/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:40 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:40.353274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:40.353905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:40.360333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.360779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.361550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.361988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.362797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:40.363387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:40.367743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=14 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:40.367743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:40.371424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.371952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.372800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.373311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.530440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:40.537069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=18 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:40.538139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e589554-1b36-4bb3-9989-4d912e734c5d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1317 microversion: 2.1 time: 0.189065 Jul 26 04:29:40.538671 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 533/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:40 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:40.553700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:40.561838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fdcfbab-38eb-4f4b-853c-7c5940313b4a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.204009 Jul 26 04:29:40.562476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 482/1015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:40 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:40.837071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:40.837944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:40.844550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.845004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.845771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:40.846234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:40.975665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:40.983826 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58319ca6-fefe-41ad-a7a4-a326b2e5f749 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.150597 Jul 26 04:29:40.984385 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 534/1016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:40 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:41.064239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:41.064846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:41.073145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.073596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.074398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.074835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.205031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:41.213646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-688d6f44-034c-454b-b1d3-f7edc0def5e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.153249 Jul 26 04:29:41.214228 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 483/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:41 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:41.312603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:41.313213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:41.319254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.319704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.320468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.320907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.449233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:41.456676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad426c04-a23c-446e-bbf7-f28b9b416531 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.147950 Jul 26 04:29:41.457249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 535/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:41 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:41.560026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:41.560654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:41.566702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.567276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.567903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.568341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.583591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:41.584192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:41.590288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.590742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.591497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.591929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.702666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:41.705953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:41.710659 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9f012c6-4996-4f1a-9406-c332ddc889d9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1317 microversion: 2.1 time: 0.155365 Jul 26 04:29:41.711228 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 484/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:41 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:41.726979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:41.734571 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-66e51549-f3c5-4979-b7c2-4829a3bc237b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.154683 Jul 26 04:29:41.735143 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 536/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:41 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:41.751880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7697ffce-6ee9-41aa-ab6e-d67119cf86da req-8a79c9d5-2656-45b2-98dd-205236473c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:41.763049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7697ffce-6ee9-41aa-ab6e-d67119cf86da req-8a79c9d5-2656-45b2-98dd-205236473c75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:41.763496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7697ffce-6ee9-41aa-ab6e-d67119cf86da req-8a79c9d5-2656-45b2-98dd-205236473c75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:41.775837 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7697ffce-6ee9-41aa-ab6e-d67119cf86da req-8a79c9d5-2656-45b2-98dd-205236473c75 service nova] Creating event network-changed:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h2-848886-16 Jul 26 04:29:41.780918 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7697ffce-6ee9-41aa-ab6e-d67119cf86da req-8a79c9d5-2656-45b2-98dd-205236473c75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Jul 26 04:29:41.781500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 485/1021] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:42.004861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:42.005470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:42.012376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.012834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.013604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.014047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.147091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:42.155391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-207554ed-fc9c-4a8f-9a5e-dcb102cbdb62 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.154168 Jul 26 04:29:42.155802 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 537/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:41 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:42.236158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:42.236782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:42.242991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.243456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.244276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.244714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.372037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:42.379495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31655c5d-e75f-4756-96e4-6cbd2967ea95 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.148509 Jul 26 04:29:42.380077 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 486/1023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:42 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:42.477377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:42.478661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:42.480594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:42.486126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.486641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.487347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.487778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.623270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:42.630725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfd9d27c-fad7-45de-9a54-bfa0a789058b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.157167 Jul 26 04:29:42.631274 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 538/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:42 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:42.731739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:42.732355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:42.738696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.739093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.739864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.740333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.757065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:42.757672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:42.764334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.764784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.765557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:42.765992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:42.770258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:42.876855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:42.885375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ac0f2bc-5365-4844-b135-0f380cde2682 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1317 microversion: 2.1 time: 0.157748 Jul 26 04:29:42.896757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 487/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:42 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:42.899327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:42.907729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa5b4760-441f-4b9a-be95-38ace5e06ee0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.155260 Jul 26 04:29:42.908282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 539/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:42 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:43.176614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:43.177218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:43.183984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.184431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.185197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.185628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.400636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:43.401407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:43.408411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.409434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.412434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.412946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.416835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:43.435579 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5de13b16-d518-4e99-b896-55c9b82278d2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.262616 Jul 26 04:29:43.436867 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 488/1027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:43 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:43.559462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:43.567004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b1c128e-28c9-4d2b-9ad0-25b5e1396f68 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.171040 Jul 26 04:29:43.567569 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 540/1028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:43 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:43.653383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:43.653996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:43.660253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.660706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.661507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.661953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.851643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:43.860047 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f02719c2-5230-4636-b74c-f927f132fd93 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.211591 Jul 26 04:29:43.860631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 489/1029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:43 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:43.905361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:43.905973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:43.912154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.912603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.913369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.913803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.928927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:43.930057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:43.936562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.937014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:43.938059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:43.938662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.058846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:44.066900 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9ad68503-0b50-4251-bbdd-bced4591d879 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1467 microversion: 2.1 time: 0.165666 Jul 26 04:29:44.067462 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 541/1030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:43 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1467 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:44.086370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:44.089213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1706664134"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:44.091668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:44.095608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5dc7c866-2b7b-483a-a219-bd2657fc2861 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.170173 Jul 26 04:29:44.096089 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 490/1031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:43 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:44.104891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.105516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.106192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.106662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.321936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44050913-ec93-4ee0-8304-aa2eb7e0873f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "POST /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650/action" status: 202 len: 0 microversion: 2.1 time: 0.237448 Jul 26 04:29:44.322508 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 542/1032] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:44 2022] POST /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 04:29:44.332787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f17d9294-3cfa-4ee6-b350-3f91c4bb4b71 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c05e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:44.384160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f17d9294-3cfa-4ee6-b350-3f91c4bb4b71 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.054681 Jul 26 04:29:44.385094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 491/1033] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:44 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:44.458461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:44.459158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:44.465983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.466460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.467260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.467696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.587755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:44.588437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:44.595478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.596010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.596833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.597279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.602825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:44.610416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-971d4f30-db63-4c1f-95e5-dc8ecb403870 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.156188 Jul 26 04:29:44.610977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 543/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:44 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:44.728456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:44.737296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c5647f9-b912-4b92-8365-11845dd700d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.153472 Jul 26 04:29:44.737947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 492/1035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:44 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:44.880900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:44.881513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:44.888608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.889058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:44.889817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:44.890297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.023895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:45.032475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a904495c-212e-4b29-9e44-ffa5a79344db tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.155558 Jul 26 04:29:45.033037 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 544/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:44 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:45.116594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:45.117101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:45.123098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.123542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.124292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.124723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.257555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:45.266081 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-397b8fd8-cecf-4053-be26-90a223ee36e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.153339 Jul 26 04:29:45.266694 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 493/1037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:45 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:45.399109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e81a00d-6945-4ade-bfdb-62d4e3c65e25 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a47e50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:45.443687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e81a00d-6945-4ade-bfdb-62d4e3c65e25 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.048332 Jul 26 04:29:45.444253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 545/1038] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:45 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:45.633238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:45.635034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:45.642570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.643019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.643794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.644229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.757834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:45.759392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:45.767352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.767814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.768931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:45.768931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:45.804341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:45.812076 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d02ff28a-6244-43cb-9aa7-dc70c3a427c3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.183757 Jul 26 04:29:45.812651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 494/1039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:45 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:45.904662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:45.912321 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce5fe567-f91a-48a4-9ec4-20b22aae3243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.158223 Jul 26 04:29:45.913087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 546/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:45 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:46.053762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:46.054330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:46.062000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.062497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.063260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.063700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.280673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:46.292992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:46.293843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:46.294099 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c68a6a6e-fb62-48ef-8817-8c641d00d473 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.244689 Jul 26 04:29:46.308023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.308023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.309215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.309759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.317530 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 495/1041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:46 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:46.420289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c6cd212e-dbb8-4cc1-8304-71e3edfb56a4 req-d1770d95-9afb-4d5e-905b-cfa6a783f410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a92aba-ac5b-4fe0-9ea4-2dcb683568ad", "name": "network-vif-plugged", "status": "completed", "tag": "40bcbc35-dea5-405e-adce-ebaf7713e0db"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:46.433977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c6cd212e-dbb8-4cc1-8304-71e3edfb56a4 req-d1770d95-9afb-4d5e-905b-cfa6a783f410 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.434128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c6cd212e-dbb8-4cc1-8304-71e3edfb56a4 req-d1770d95-9afb-4d5e-905b-cfa6a783f410 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.449178 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c6cd212e-dbb8-4cc1-8304-71e3edfb56a4 req-d1770d95-9afb-4d5e-905b-cfa6a783f410 service nova] Creating event network-vif-plugged:40bcbc35-dea5-405e-adce-ebaf7713e0db for instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad on n-h2-848886-16 Jul 26 04:29:46.454699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c6cd212e-dbb8-4cc1-8304-71e3edfb56a4 req-d1770d95-9afb-4d5e-905b-cfa6a783f410 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039346 Jul 26 04:29:46.455430 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 496/1042] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:29:46.461082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-80f324ac-4dfd-4ff6-b25e-696372b96c65 req-2b395950-642f-48b8-9b26-bdd52bc57e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "name": "network-vif-unplugged", "status": "completed", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:46.473041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-80f324ac-4dfd-4ff6-b25e-696372b96c65 req-2b395950-642f-48b8-9b26-bdd52bc57e78 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.473489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-80f324ac-4dfd-4ff6-b25e-696372b96c65 req-2b395950-642f-48b8-9b26-bdd52bc57e78 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.481358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:46.488160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-80f324ac-4dfd-4ff6-b25e-696372b96c65 req-2b395950-642f-48b8-9b26-bdd52bc57e78 service nova] Creating event network-vif-unplugged:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h2-848886-16 Jul 26 04:29:46.490776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43d7311e-6c7d-4e41-8bc3-90a3f7ee9bc5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.206217 Jul 26 04:29:46.499758 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 547/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:46 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:46.504983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ecc9e7a7-55ba-4619-bff9-2e8c5bdc8771 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a47040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:46.507352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-80f324ac-4dfd-4ff6-b25e-696372b96c65 req-2b395950-642f-48b8-9b26-bdd52bc57e78 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050347 Jul 26 04:29:46.508136 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 497/1044] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:46.559892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ecc9e7a7-55ba-4619-bff9-2e8c5bdc8771 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.058824 Jul 26 04:29:46.560497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 548/1045] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:46 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:46.835140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:46.835903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:46.842964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.843366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.844182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.844771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.937120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:46.937739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:46.944983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.945446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:46.946355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:46.947007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:47.082070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:47.090385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ebde88c0-7942-44c7-8543-56b88046f050 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.260868 Jul 26 04:29:47.090967 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 498/1046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:46 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:47.108045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:47.115548 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c55d67a-793c-46bd-8834-bf1880d5ad50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.182477 Jul 26 04:29:47.116114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 549/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:46 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:47.315839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:47.316448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:47.323018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:47.323473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:47.324234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:47.324674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:47.498354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:47.507344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-424fee26-08e1-4860-af96-3b17744923b6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.193794 Jul 26 04:29:47.507344 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 499/1048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:47 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:47.513453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:47.514272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:47.520884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:47.521449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:47.522085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:47.522570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:47.576684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-370426cb-7041-4a4a-8ff6-876dfc06770d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c11af0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:47.625130 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-370426cb-7041-4a4a-8ff6-876dfc06770d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.054036 Jul 26 04:29:47.625877 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 500/1049] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:47 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:47.664900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:47.672755 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f69e337-8ae8-43d0-99af-f55efe6dc463 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.163804 Jul 26 04:29:47.673736 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 550/1050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:47 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:48.112294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:48.112989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:48.123213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.123530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.124292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.124744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.136502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:48.137326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:48.144514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.145612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.146370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.146716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.311220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:48.319836 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-231a08c4-8f1d-4e67-b9a1-a9747b7c9b00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1318 microversion: 2.1 time: 0.187343 Jul 26 04:29:48.320619 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 551/1051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:48 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:48.327482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:48.338222 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90114d52-7f54-44a2-add7-1b93214a9b82 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1504 microversion: 2.1 time: 0.229884 Jul 26 04:29:48.339073 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 501/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:48 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:48.528201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:48.528888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:48.535134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.535570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.536331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.536770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.640996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-208e9540-ef35-4f22-8f3f-df47b22add3e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5fdd0d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:48.668551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:48.676550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eff1abfe-1083-44ed-96aa-8780e3187677 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.152519 Jul 26 04:29:48.677105 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 552/1053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:48 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:48.684811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-208e9540-ef35-4f22-8f3f-df47b22add3e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.048505 Jul 26 04:29:48.685375 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 502/1054] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:48 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:48.694188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:48.694873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:48.701528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.701980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.702792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:48.703234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:48.841957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:48.849522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65665b22-6cd9-4a19-9495-809f9aa99ec2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.159110 Jul 26 04:29:48.850083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 553/1055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:48 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:49.342186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.342727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.349471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.349927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.350726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.351168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.360139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.360750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.367263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.367714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.368497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.369588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.496758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:49.506272 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9eeb498c-7c03-466b-90e3-71b734bdb3b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1507 microversion: 2.1 time: 0.169100 Jul 26 04:29:49.507006 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 503/1056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:49.511994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:49.520555 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a765f7e-08fe-47bb-9b27-6002cfcc079d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1479 microversion: 2.1 time: 0.164169 Jul 26 04:29:49.521641 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 554/1057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1479 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:49.527189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.527924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.534085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.534604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.535384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.535829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.543496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c75d33c9-bf6f-4b6f-a116-4be9202eb20c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '.version_select at 0x7f38b59af040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.547381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c75d33c9-bf6f-4b6f-a116-4be9202eb20c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.547840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c75d33c9-bf6f-4b6f-a116-4be9202eb20c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.560594 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c75d33c9-bf6f-4b6f-a116-4be9202eb20c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2759 microversion: 2.1 time: 0.023043 Jul 26 04:29:49.560922 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 555/1058] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/os-migrations => generated 2759 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:49.578660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.579332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.585614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.586064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.586862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.587303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.674516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:49.682639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-612ca02c-cb71-4fb2-8c7c-a9aa3d77195d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1507 microversion: 2.1 time: 0.159653 Jul 26 04:29:49.683239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 504/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:49.698391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.699055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.705029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.705470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.706258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.706691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.720615 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb8dc32a-a402-47c5-bec9-998992a79d99 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1632 microversion: 2.1 time: 0.146428 Jul 26 04:29:49.721284 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 556/1060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1632 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:49.725804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-def8b37f-151b-436e-b5b9-9720a52be780 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f5e790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.774021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-def8b37f-151b-436e-b5b9-9720a52be780 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.051637 Jul 26 04:29:49.774615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 557/1061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:49.784259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:49.788452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.796072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.796523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.797285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.797724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.801956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:49.846797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:49.855883 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e7886c8-64bd-4f17-a721-01a0ac061f88 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.161386 Jul 26 04:29:49.856586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 505/1062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:49.861199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30e52892-b9ee-4c86-929e-4ea085099ae3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: .version_select at 0x7f38b609d700>, body: {"keypair": {"name": "tempest-keypair-208329623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOmglwUzUyt2skLjWR07ggkxtAz5LlZ90EsqLI5geETwZkBgeCW8U8PmJgk58G2nuXI95gMTYrh1jETmbeF9jmhRAUzNSboqbl5PPeTOZYjzzeY4Bof/7WzdJ6wA8Ge1w=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:49.877554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-30e52892-b9ee-4c86-929e-4ea085099ae3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for project f4bb20f8c8174308901ace320bb16903. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:49.879659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:49.880086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:49.880565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:49.880980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:49.881341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-30e52892-b9ee-4c86-929e-4ea085099ae3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for user 97734a3da7ef4a809b0edd23ac216dfb and project f4bb20f8c8174308901ace320bb16903. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:49.881440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:49.904960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30e52892-b9ee-4c86-929e-4ea085099ae3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047203 Jul 26 04:29:49.911551 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 506/1063] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:29:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:49.911551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:49.911551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.919510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.920109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.920815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.921255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.941822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:49.945375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:49.951872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.952412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.953274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:49.953924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:49.981922 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d935a43-79b6-4eab-b36d-5eeb54db057c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "POST /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad/action" status: 202 len: 1109 microversion: 2.1 time: 0.205589 Jul 26 04:29:49.986199 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 558/1064] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:49 2022] POST /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad/action => generated 1109 bytes in 208 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 04:29:50.001309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:50.002578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:50.012290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:50.012991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:50.015116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:50.015616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:50.083558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:50.093723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53d6c5f0-39c9-4f9e-be64-19cb3a674fb6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1543 microversion: 2.1 time: 0.186839 Jul 26 04:29:50.094525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 507/1065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1543 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:50.218399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:50.227897 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4485999-0813-4541-adfd-314a374d1807 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.231120 Jul 26 04:29:50.229278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 559/1066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:49 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:50.329214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c41adb1d-9ecc-4353-b098-4fad9d1da1c3 req-ea416d4f-fe59-41bc-af46-5faa9bff719a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-plugged", "status": "completed", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:50.340896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c41adb1d-9ecc-4353-b098-4fad9d1da1c3 req-ea416d4f-fe59-41bc-af46-5faa9bff719a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:50.341624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c41adb1d-9ecc-4353-b098-4fad9d1da1c3 req-ea416d4f-fe59-41bc-af46-5faa9bff719a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:50.356395 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c41adb1d-9ecc-4353-b098-4fad9d1da1c3 req-ea416d4f-fe59-41bc-af46-5faa9bff719a service nova] Creating event network-vif-plugged:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:29:50.363545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c41adb1d-9ecc-4353-b098-4fad9d1da1c3 req-ea416d4f-fe59-41bc-af46-5faa9bff719a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038389 Jul 26 04:29:50.364447 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 508/1067] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:50.788795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a0ab3bc-e628-41d6-b386-ac417330492c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b617e430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:50.834167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a0ab3bc-e628-41d6-b386-ac417330492c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.049106 Jul 26 04:29:50.834895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 560/1068] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:50 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:50.877487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:50.878222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:50.885103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:50.885683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:50.886480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:50.886927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.114903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:51.115607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:51.122555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:51.123079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.123931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:51.124457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.219189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:51.228461 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31d7ef02-6cee-4078-b19f-2939d343fedf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.354974 Jul 26 04:29:51.234769 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 509/1069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:50 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:51.249759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:51.250404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:51.256995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:51.257454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.258273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:51.258696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.283465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:51.291750 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43286036-f3bc-42f7-a1ae-8a7d9aa39bc3 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1542 microversion: 2.1 time: 0.180731 Jul 26 04:29:51.292858 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 561/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:51 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:51.522954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:51.531656 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc8d2aa4-8aad-4652-ba52-402b593b611b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.286016 Jul 26 04:29:51.532230 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 510/1071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:51 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:51.646442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:51.656735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:51.657173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:51.670733 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] Creating event network-vif-unplugged:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h2-848886-16 Jul 26 04:29:51.676018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:29:51.686544 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5c68dfd0-6417-4f39-bd8f-8cbf616d8cd2 req-b4b1027f-a4a3-4dd5-852f-ace9fdf3c0eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043827 Jul 26 04:29:51.687171 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 562/1072] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:51.849521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd79fa6f-2e00-4d1e-bf60-a7a7129340ce tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c12430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:51.898862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd79fa6f-2e00-4d1e-bf60-a7a7129340ce tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.053504 Jul 26 04:29:51.899707 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 511/1073] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:51 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:52.147008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-927057612", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "d49ad6d2-e7e8-4c36-8548-0d97bda875ad"}], "security_groups": [{"name": "tempest-securitygroup--1883645116"}], "key_name": "tempest-keypair-208329623", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:52.249383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:52.249959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:52.256396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.256790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.257566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.258002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.269696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] validate_networks() for [('d49ad6d2-e7e8-4c36-8548-0d97bda875ad', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:29:52.504698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:52.513090 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9092aec4-3428-4b0e-a65a-98440ae42454 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.267406 Jul 26 04:29:52.513887 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 512/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:52 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:52.519077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:52.519856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:52.526673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.528058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.529129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.529743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.671775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:29:52.672193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:29:52.672656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:29:52.673061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:29:52.673466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:29:52.682363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.682886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.683682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.684113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.701145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:52.705073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for user 97734a3da7ef4a809b0edd23ac216dfb and project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:52.717218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:29:52.719593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:29:52.743017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:52.754849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32e0de4c-fcae-4352-8961-1143aaa7fe61 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1542 microversion: 2.1 time: 0.239768 Jul 26 04:29:52.755682 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 513/1075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:52 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1542 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:52.761142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:52.761739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:52.767675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.768074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.768833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:52.769264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:52.772217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a924ae18-58ed-4a24-b6ac-3bbc7e0eebde tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630750 Jul 26 04:29:52.773064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 563/1076] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:29:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:29:52.786439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67cb68fd-601b-499d-8873-7feb2063b3b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:52.787051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67cb68fd-601b-499d-8873-7feb2063b3b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:52.795057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:52.863749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67cb68fd-601b-499d-8873-7feb2063b3b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:52.874268 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67cb68fd-601b-499d-8873-7feb2063b3b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1233 microversion: 2.1 time: 0.091255 Jul 26 04:29:52.874849 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 564/1077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:52 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:52.914910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45c4c8a8-4e54-4d2f-bc29-c5472a528f85 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f5ef70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:52.948155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:52.956428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-840668ae-2af6-4b6c-a73e-92d5af28d0d2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.199530 Jul 26 04:29:52.956891 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 514/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:52 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:52.969984 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45c4c8a8-4e54-4d2f-bc29-c5472a528f85 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.058938 Jul 26 04:29:52.970479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 565/1079] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:52 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:53.536301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:53.536906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:53.544448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.544890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.545640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.546072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.673989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:53.681694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3818254-de59-40b6-aef3-0c336f5ce7d6 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.149231 Jul 26 04:29:53.682275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 515/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:53 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:53.716836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:53.726454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.726906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.739195 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] Creating event network-changed:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h2-848886-16 Jul 26 04:29:53.744830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:29:53.755307 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4b38bcad-abcd-40a3-afae-d4e718db8800 req-c3777409-6b58-4f08-bf64-9c5ad727cdab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043395 Jul 26 04:29:53.755901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 566/1081] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:29:53.778147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:53.778783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:53.784809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.785261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.786023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.786488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.899327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:53.900824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:53.907464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.907917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.908694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:53.909132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:53.973272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:53.980974 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80ef4f02-b253-4832-b813-b1d1ca28ed03 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1237 microversion: 2.1 time: 0.085836 Jul 26 04:29:53.981667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 567/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:53 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:53.995575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:53.996336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:53.997357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:54.002677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:54.003133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:54.003916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:54.004389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:54.005691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-234f0ab3-21d1-4dad-bc45-22cf706c26be tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1474 microversion: 2.1 time: 0.232689 Jul 26 04:29:54.006302 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 516/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:53 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1474 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:54.023826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e583037-41c9-4d51-8294-1cfd57d5b3c8 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5baf310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:54.070849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e583037-41c9-4d51-8294-1cfd57d5b3c8 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.051439 Jul 26 04:29:54.071428 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 517/1084] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:54 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:54.144290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:54.153131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30dd7aef-6fae-4e54-8a54-9768f79f057e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.161888 Jul 26 04:29:54.153710 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 568/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:53 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:54.704197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:54.704835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:54.711441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:54.711908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:54.713516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:54.713962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:54.841816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:54.849381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1df4e769-fe21-47d8-9db7-4ed3128f01cf tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.149982 Jul 26 04:29:54.849949 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 518/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:54 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:55.001751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:55.002352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:55.009748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.010343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.011108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.011569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.028510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:55.029121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:55.035199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.035653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.036418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.036859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.072182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:55.079760 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8de46196-f6c9-46db-bd08-a078acf6ae4c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1237 microversion: 2.1 time: 0.081856 Jul 26 04:29:55.080543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 569/1087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:54 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:55.089048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25c486bd-a455-4447-9917-e9206eda7ea2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59cc310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:55.136411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25c486bd-a455-4447-9917-e9206eda7ea2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.054053 Jul 26 04:29:55.136983 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 570/1088] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:55 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:55.170797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:55.173970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:55.174615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:55.178578 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc0eb266-95ec-41e6-8e9c-07e4aa479510 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1474 microversion: 2.1 time: 0.154499 Jul 26 04:29:55.179153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 519/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:55 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:55.180604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.181823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.182591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.183025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.315085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:55.322673 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e284fb2-9b20-486d-a711-82a6b0064cce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.152441 Jul 26 04:29:55.323232 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 571/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:55 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:55.870592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:55.871410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:55.878348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.878798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:55.879561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:55.879997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.014468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:56.021858 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71906e04-4482-46c3-bb0e-341123e6fb4e tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.155125 Jul 26 04:29:56.022444 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 520/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:55 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:56.100385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:56.100988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:56.107545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.107985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.108741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.109173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.152355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-62c9ec27-915b-4744-8beb-781a13ab9ac3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b61d2c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:56.173193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:56.181668 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01eb50c6-bbef-4481-a744-e8d29fa74921 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1237 microversion: 2.1 time: 0.084709 Jul 26 04:29:56.189184 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 572/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:56 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:56.199332 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-62c9ec27-915b-4744-8beb-781a13ab9ac3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.051893 Jul 26 04:29:56.199902 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 521/1093] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:56 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:56.203026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:56.203632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:56.210068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.210568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.211335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.211771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.343419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:56.344065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:56.350402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.351005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.351790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:56.352232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:56.352576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:56.361640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f16b5ee3-23dd-4e97-8f2a-3bdc9bdbf803 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1474 microversion: 2.1 time: 0.162331 Jul 26 04:29:56.362698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 573/1094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:56 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:56.482377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:56.489777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df2734a7-0b70-4dff-ad40-688e9f8a5b11 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.150249 Jul 26 04:29:56.490372 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 522/1095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:56 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:57.045164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.045681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.052704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.053158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.053964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.054395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.197994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:57.204575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.205798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.209814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33f4910e-0711-40e3-9235-2afe17efb1c3 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.169410 Jul 26 04:29:57.220705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.223917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.224733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.225179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.227087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 574/1096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:57.235592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76ce75ae-8717-46f9-8c5d-e0ce9d378428 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f5ee50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.284304 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76ce75ae-8717-46f9-8c5d-e0ce9d378428 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.053840 Jul 26 04:29:57.286205 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 575/1097] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:57.339692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:57.349498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5b89bf0-4f4f-40bd-8ae5-f851dfe6f1a7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1229 microversion: 2.1 time: 0.149389 Jul 26 04:29:57.350896 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 523/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1229 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:57.385498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.386249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.393647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.394292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.395225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.395804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.512247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.512862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.518994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.519450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.520222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.520666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.529941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:57.537371 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-951238d2-e12f-4418-9019-77fe172184b0 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1471 microversion: 2.1 time: 0.156436 Jul 26 04:29:57.537941 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 576/1099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:57.557534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:29:57.558059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.564339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.564783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.565541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.565978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.605114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.605572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.606414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.606857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.629345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:29:57.633477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:29:57.655375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:57.663165 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3b905b22-84c8-4f69-97ee-5299d7046b6b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.155346 Jul 26 04:29:57.663735 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 524/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:29:57.698705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:57.790983 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3eb09352-df22-4496-87f9-27cbd2b9a9c4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a/action" status: 202 len: 0 microversion: 2.1 time: 0.236626 Jul 26 04:29:57.791908 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 577/1101] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:29:57 2022] POST /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:29:57.801174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:57.802226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:57.810422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.811364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:57.812706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:57.813383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.248540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:58.249269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:58.277518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.278584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.286717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.287233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.510067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:58.518573 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52327441-b333-4ad4-aced-e130c48ad940 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.722114 Jul 26 04:29:58.519872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:58.523194 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 525/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:57 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:58.532286 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c54ea91-e13d-46a2-82e9-7fe8ccb2ce6a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.290605 Jul 26 04:29:58.538431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4341fef4-dd63-4950-a9e9-3c39fe6d3763 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c12310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:58.551134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 578/1103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:58 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:58.559576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:58.560363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:58.578559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.579015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.579936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.580380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.604973 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4341fef4-dd63-4950-a9e9-3c39fe6d3763 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.075329 Jul 26 04:29:58.612538 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 526/1104] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:58 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:58.676818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:58.688049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:58.689123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:58.690142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f79056c-06b6-4a23-8dbd-85a8e6b1b19c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1291 microversion: 2.1 time: 0.137695 Jul 26 04:29:58.698199 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 579/1105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:58 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1291 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:58.722286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.722890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:58.723936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:58.724479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.099290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:59.119610 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6eb6c461-13b2-4cbc-86c2-1053389d4e6e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.435523 Jul 26 04:29:59.120296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 527/1106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:58 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:59.547623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:59.548215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:59.557703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:59.559131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.559895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.560490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.560865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.561893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:59.577911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.581820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.583076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.583799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.853360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:29:59.864470 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6eab2f55-5587-4de5-ad5c-f46d6ff5ff2c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.320505 Jul 26 04:29:59.865375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 580/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:59 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:59.884675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8277333-34fc-4204-bcfb-f8b64dd5a191 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a8fca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:59.888983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:29:59.936457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8277333-34fc-4204-bcfb-f8b64dd5a191 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.056302 Jul 26 04:29:59.937712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 581/1108] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:29:59 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:29:59.943030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:29:59.943955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:29:59.952329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.953144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:29:59.954262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:29:59.955061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.190033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:00.197327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:00.215220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3adb7a05-d7df-4ff8-a89f-f4a2c2d2d956 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.662134 Jul 26 04:30:00.216546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 528/1109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:59 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:00.231904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:00.233009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:00.246460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.247279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.248308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.248933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.294700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:00.307042 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5326be6a-c806-44e4-b11e-0d5430e6667b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.367733 Jul 26 04:30:00.311065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 582/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:29:59 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:00.531825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-plugged", "status": "completed", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:00.553741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.555027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.584969 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] Creating event network-vif-plugged:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h2-848886-16 Jul 26 04:30:00.598394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:30:00.623565 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9ac624ab-b540-414f-a215-fc5d0e77a675 req-7faac1c8-da01-4df1-af28-e13a1b656fbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098133 Jul 26 04:30:00.624172 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 583/1111] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:00.629581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4be5850c-2517-4441-8699-0418e1e88544 req-2d3fc146-5596-486e-a1c9-3ec045008bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:00.640575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4be5850c-2517-4441-8699-0418e1e88544 req-2d3fc146-5596-486e-a1c9-3ec045008bd8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.641025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4be5850c-2517-4441-8699-0418e1e88544 req-2d3fc146-5596-486e-a1c9-3ec045008bd8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.653772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4be5850c-2517-4441-8699-0418e1e88544 req-2d3fc146-5596-486e-a1c9-3ec045008bd8 service nova] Creating event network-changed:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:30:00.658775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4be5850c-2517-4441-8699-0418e1e88544 req-2d3fc146-5596-486e-a1c9-3ec045008bd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032905 Jul 26 04:30:00.663095 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 584/1112] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:00.838271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:00.858373 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e1028e0-0c6e-438f-b0df-9a1fdfa333d7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.640445 Jul 26 04:30:00.859184 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 529/1113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:00 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:00.887479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:00.888564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:00.908720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.909206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.910013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:00.911696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:00.952179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db482369-6900-4c88-8a9f-3319c786514f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5bbd940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:01.018306 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db482369-6900-4c88-8a9f-3319c786514f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.070510 Jul 26 04:30:01.028370 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 530/1114] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:00 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:01.073036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:01.080875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18776ee9-b1f1-4ec3-b6fa-c1452483ce87 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.199264 Jul 26 04:30:01.094414 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 585/1115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:00 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:01.239735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:01.240494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:01.257081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.257844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:01.258678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.260852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:01.331861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:01.332946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:01.340312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.340914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:01.341801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.342417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:01.440947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:01.451192 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d4305dd-eebb-4908-a4e3-faa4ac138745 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.215849 Jul 26 04:30:01.452035 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 531/1116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:01 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:01.500490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:01.511109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7fd336a-319e-489e-b525-6f84565a5b68 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.183351 Jul 26 04:30:01.518597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 586/1117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:01 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:01.880495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:01.881409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:01.891480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.893233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:01.894451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:01.894973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.035248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d6b7c27-412a-4382-bbd9-dc1c5dd87544 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59b8b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:02.106575 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d6b7c27-412a-4382-bbd9-dc1c5dd87544 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.073271 Jul 26 04:30:02.118861 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 587/1118] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:02 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:02.119394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:02.119513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:02.119513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:02.121800 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-301847f3-b9bf-43dc-a460-856d724a73e0 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.244749 Jul 26 04:30:02.127842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 532/1119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:01 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:02.131590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.132143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.133023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.133561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.422453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:02.435468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d35488f9-53b0-45c2-9be6-029287fcd148 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.325645 Jul 26 04:30:02.436443 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 588/1120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:02 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:02.473047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:02.473763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:02.480641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.481221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.482260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.482771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.534825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:02.535838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:02.548338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.549167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.550261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:02.550853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:02.657871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:02.668104 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-899ed7aa-0d5c-4b3c-af1c-d2b5deb72b43 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.198951 Jul 26 04:30:02.668653 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 533/1121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:02 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:02.726170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:02.741027 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b556ae5-d3e9-457d-a7d2-c0be2a9bdf8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.212953 Jul 26 04:30:02.742492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 589/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:02 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:03.135285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d636f55a-d605-439c-8d57-98ada7bedd2a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5baf280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:03.147422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:03.148714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:03.160528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:03.167904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.168375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.169945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.175862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.221704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d636f55a-d605-439c-8d57-98ada7bedd2a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.092152 Jul 26 04:30:03.223099 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 534/1123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:03 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:03.344218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:03.352998 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f070db1-8440-440b-a89c-0591cd7b4f6c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.208917 Jul 26 04:30:03.353689 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 590/1124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:03 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:03.458391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:03.459711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:03.469738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.470219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.471216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.471656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.627362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:03.636055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1351442f-cb8f-4da4-90a7-6f5a792e9a8b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.182333 Jul 26 04:30:03.636752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 535/1125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:03 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:03.689440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:03.690055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:03.696840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.697360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.698077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.698542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.761323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:03.762198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:03.764338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:03.790063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.790984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.793130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:03.796240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:03.924950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:03.936317 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-868c2319-8897-4bbb-87f5-13d378fb0116 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.249883 Jul 26 04:30:03.946861 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 591/1126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:03 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:04.014568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:04.026402 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-958d7ccc-18af-4d70-adc4-bbc6ff66c49f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.269284 Jul 26 04:30:04.028471 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 536/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:03 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:04.237299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78476da4-33b3-497f-b25f-ea3d3a320c85 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a47940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:04.287278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78476da4-33b3-497f-b25f-ea3d3a320c85 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.053746 Jul 26 04:30:04.288170 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 592/1128] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:04 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:04.378857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:04.384668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:04.394758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.396515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:04.398951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.400945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:04.570298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:04.593335 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-70bad514-fc00-47b0-bcfc-361eccb6b946 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.221017 Jul 26 04:30:04.593915 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 537/1129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:04 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:04.658555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:04.659338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:04.667366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.668239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:04.669191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.669779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:04.876549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:04.889483 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0139f904-fcf3-432c-9510-6a1e72ccb711 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.234610 Jul 26 04:30:04.900407 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 593/1130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:04 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:04.961825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:04.963650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:04.972301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.972891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:04.973740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:04.974285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.049457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:05.050654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:05.058990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.059891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.061151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.061807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.253484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:05.260691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6aae00e1-afd5-4469-b228-d19cfe0cde4a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.303577 Jul 26 04:30:05.290381 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 538/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:04 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:05.305164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c668b389-5c2f-4d53-84c2-d1cd47b39e09 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5bbb430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:05.338133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:05.347457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae4c26fb-f4c7-42a0-ab37-c65ed3c86f7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.302370 Jul 26 04:30:05.348769 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 594/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:05 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:05.375666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c668b389-5c2f-4d53-84c2-d1cd47b39e09 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.076067 Jul 26 04:30:05.376541 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 539/1133] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:05 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:05.616235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:05.617201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:05.625112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.625658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.626555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.627191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.814582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:05.824217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f470f3aa-d1a1-4a0f-b975-c2c498b40339 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.212020 Jul 26 04:30:05.839578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 595/1134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:05 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:05.913805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:05.914391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:05.922054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.922856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:05.923847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:05.924487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.085663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:06.094973 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1efa486-0040-4490-842c-19a3497e0492 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.184919 Jul 26 04:30:06.099922 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 540/1135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:05 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:06.301217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:06.302904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:06.311598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.312146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.313159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.313711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.394436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:06.396489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:06.411686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.412134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.412900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.413331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.520552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:06.525628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:06.531302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d355a507-327f-4e14-90a0-87f335d43b21 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.233906 Jul 26 04:30:06.532418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 596/1136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:06 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:06.537162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cd65911-ff89-4c98-89c2-43b6473d59ff tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59cc9d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:06.609073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cd65911-ff89-4c98-89c2-43b6473d59ff tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.075141 Jul 26 04:30:06.609659 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 597/1137] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:06 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:06.647684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:06.657164 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec0f5966-dfb7-464c-b084-be8b3a7f5629 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.287481 Jul 26 04:30:06.658372 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 541/1138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:06 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:06.829262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d20e276-64be-4236-bf37-44011b92ca24"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:06.831976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:06.844883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:06.845859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:06.857655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.864685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.868329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.869251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.870649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.888853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:06.889746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:06.892450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.100279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:07.109374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-491755e4-33a0-4f57-a69d-c07fe43bd43b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.268227 Jul 26 04:30:07.110810 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 542/1139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:06 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:07.122557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:07.124193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:07.132435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.133300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.134396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.135056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.280778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:07.290188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-256f779b-5950-42ef-bb87-7e3eb79a36e5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1470 microversion: 2.1 time: 0.171017 Jul 26 04:30:07.290764 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 543/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:07 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:07.554429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:07.555063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:07.565199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.565656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.568689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.569628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.617109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:07.713107 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccdd2e91-cbc0-47e9-a9ee-6aa02aca9bf1 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "POST /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887832 Jul 26 04:30:07.744763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 598/1141] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:30:06 2022] POST /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:07.768813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2b9301a-43f1-420f-ae5d-ee4b25b9dbad tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59491f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:07.848738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2b9301a-43f1-420f-ae5d-ee4b25b9dbad tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.102568 Jul 26 04:30:07.857095 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 599/1142] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:07 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:07.859868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:07.861667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:07.869836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.870395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.871714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:07.872251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:07.896750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:07.906527 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-671d7f87-b763-410a-88e0-6ed5398d6ef2 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.355918 Jul 26 04:30:07.922281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 544/1143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:07 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:08.114087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:08.137314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:08.137969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:08.143818 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e237d86-fff4-4d51-9739-086e0e7ddfe7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.290358 Jul 26 04:30:08.162186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 600/1144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:07 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:08.162559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.162559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.162559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.162559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.314720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:08.315350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:08.343899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.345985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.347923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.350091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.409855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:08.420029 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc503c6e-021a-4fc8-a668-96e26f02d81e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.289806 Jul 26 04:30:08.423168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 545/1145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:08 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:08.489052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:08.510390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.510796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.537030 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] Creating event network-vif-unplugged:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:30:08.545773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:30:08.561461 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7470afe3-5e04-4287-a44c-8e5122185d23 req-343b7a4a-1281-4a89-a699-354dd4b7686e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076166 Jul 26 04:30:08.562795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 546/1146] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:08.608372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:08.619473 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b45e2e5-de8c-4c15-a349-6a282a30cacc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1536 microversion: 2.1 time: 0.310507 Jul 26 04:30:08.621545 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 601/1147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:08 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1536 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:08.867995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97b7c1ea-42a4-41ba-94ac-425aeb2421f4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5bbb040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:08.930511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:08.931051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:08.943324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.943786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.945024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:08.946494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:08.982650 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97b7c1ea-42a4-41ba-94ac-425aeb2421f4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.119279 Jul 26 04:30:08.986033 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 547/1148] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:08 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:09.119072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:09.129040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d220289-5a68-4175-8916-6d9991d6d3ff tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1470 microversion: 2.1 time: 0.203407 Jul 26 04:30:09.130210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 602/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:08 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:09.178023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:09.179360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:09.217715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.218499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.219509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.220294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.445891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:09.446857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:09.465643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:09.466727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.467360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.468734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.469543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.476107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f02e8dce-254d-4d34-a0ba-355cc9b2bed0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.304442 Jul 26 04:30:09.492669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 548/1150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:09 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:09.644970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:09.646172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:09.668092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.675979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.679456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:09.684477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:09.742744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:09.752225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccc49be4-c22b-4894-a058-5effb26dabbc tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.310220 Jul 26 04:30:09.771110 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 603/1151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:09 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:09.949367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:09.952955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:09.960813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a74eab9-acf6-4afe-b0b0-29761c177953 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1536 microversion: 2.1 time: 0.320255 Jul 26 04:30:09.973203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 549/1152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:09 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1536 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:09.998109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c0bda05-c525-4f78-83a8-c76e750759cd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58edee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:10.047647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c0bda05-c525-4f78-83a8-c76e750759cd tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1453 microversion: 2.1 time: 0.053677 Jul 26 04:30:10.048264 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 604/1153] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:09 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:10.152399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:10.153007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:10.160746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.161202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.161979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.162443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.422595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:10.430784 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ff2f04a-3e24-4293-a54a-8ee5cc4215c0 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1476 microversion: 2.1 time: 0.283237 Jul 26 04:30:10.431763 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 550/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:10 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:10.499222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:10.499997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:10.507643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.514900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.516149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.516819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.666674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:10.676285 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f23e005-09bd-467e-a57b-df71b58433b3 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.180827 Jul 26 04:30:10.678490 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 605/1155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:10 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:10.750669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:10.762081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.763781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.783301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] Creating event network-changed:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:30:10.788525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:10.789999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:10.796900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.797642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:30:10.797793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.798728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.799285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:10.812093 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-43f09c48-afac-4c07-9dd3-4d974c9e881a req-499d652f-792d-4bb0-bfbb-51da5740e53d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065362 Jul 26 04:30:10.813431 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 551/1156] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:10.984259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:10.988056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:10.989040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:10.997936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c811f184-18a8-4792-8dc3-e4fe249b21ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.213128 Jul 26 04:30:10.998549 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 606/1157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:10 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:10.999300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:10.999880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.000760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.001332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.062795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84f94ef7-de10-4006-a5ff-1172e7f5d048 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5949e50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:11.131441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84f94ef7-de10-4006-a5ff-1172e7f5d048 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1462 microversion: 2.1 time: 0.072439 Jul 26 04:30:11.140623 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 607/1158] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:11 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:11.145570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67a33fef-4bae-40b2-90ac-41dac5967f7b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59499d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:11.214388 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67a33fef-4bae-40b2-90ac-41dac5967f7b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 200 len: 1462 microversion: 2.1 time: 0.067747 Jul 26 04:30:11.218636 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 608/1159] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:11 2022] GET /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:11.224534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:11.225153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:11.231320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:11.232496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.232959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.234682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.235116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.240603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-03a1ced8-1bf2-49fb-8060-da4d184df90f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1536 microversion: 2.1 time: 0.259764 Jul 26 04:30:11.250866 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 552/1160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:10 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1536 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:11.376482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f296a718-e376-4275-a0db-d1db429db3bb req-3af80899-8999-4008-a910-966155bbd474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "name": "network-vif-plugged", "status": "completed", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:11.399970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f296a718-e376-4275-a0db-d1db429db3bb req-3af80899-8999-4008-a910-966155bbd474 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.400739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f296a718-e376-4275-a0db-d1db429db3bb req-3af80899-8999-4008-a910-966155bbd474 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.422290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f296a718-e376-4275-a0db-d1db429db3bb req-3af80899-8999-4008-a910-966155bbd474 service nova] Creating event network-vif-plugged:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:30:11.431305 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f296a718-e376-4275-a0db-d1db429db3bb req-3af80899-8999-4008-a910-966155bbd474 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057541 Jul 26 04:30:11.443393 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 553/1161] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:11.455880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:11.456589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:11.469317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.473328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.474439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.474900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.821604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:11.831078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6937aa0-9a46-4e22-aa3e-536a9875d45e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1480 microversion: 2.1 time: 0.610155 Jul 26 04:30:11.831265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:11.832071 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 609/1162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:11 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1480 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:11.838324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:11.838879 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e44d43ec-6a91-4795-8ee3-f8786dcc3f71 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1476 microversion: 2.1 time: 0.388596 Jul 26 04:30:11.839047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:11.840687 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 554/1163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:11 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:11.850536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.851117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:11.852546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:11.853096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.008804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:12.018389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43cb95ea-871d-4606-845a-880aade27392 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.185190 Jul 26 04:30:12.019773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:12.020695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:12.021545 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 610/1164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:11 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:12.028783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.029315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.030344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.030855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.169262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:12.190410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f33d961f-6f1b-438e-917f-63615a888992 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.174430 Jul 26 04:30:12.190991 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 555/1165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:12 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:12.268453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:12.283401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:12.290353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.290802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.291571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.292330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.443289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:12.456533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d021bbc7-373b-4e39-a87a-34ce0e7d82c7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1536 microversion: 2.1 time: 0.193938 Jul 26 04:30:12.457433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 611/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:12 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1536 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:12.851427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:12.852639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:12.859793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.860251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.861008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.861447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.861691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:12.862637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:12.874221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.874619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:12.875405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:12.875844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.016780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:13.026297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20464d6e-a387-4385-8b5f-819cac4c14e9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1467 microversion: 2.1 time: 0.178595 Jul 26 04:30:13.030203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 556/1167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:12 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:13.041722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:13.043159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:13.059019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.059840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.060990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.061682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.113091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:13.123441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02d0a77a-1a38-40ad-837c-f27a2052f8eb tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1476 microversion: 2.1 time: 0.266241 Jul 26 04:30:13.124654 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 612/1168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:12 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:13.129974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1831088309"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:13.132516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:13.139899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.140598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.141562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.142190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.388231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:13.401314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9b9cd38-be4c-4bbf-bc33-c5b290a6a4a4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1359 microversion: 2.1 time: 0.362507 Jul 26 04:30:13.404522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 557/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:13 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1359 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:13.413214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:13.414094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:13.422862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.423859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.424920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.425568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.479302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b6eaede-6200-4f29-90a5-9ba6124d59f6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "POST /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208/action" status: 202 len: 0 microversion: 2.1 time: 0.350055 Jul 26 04:30:13.481826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 613/1170] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:13 2022] POST /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:30:13.487789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:13.488804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:13.498690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.499611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.500723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:13.525455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:13.759935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:13.773140 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a9c6a2b-6b1d-4da7-ac0c-3b68f61f73df tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.363157 Jul 26 04:30:13.774846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 558/1171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:13 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:13.798261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8770967c-3678-4496-be5e-36e2000eab8a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c12700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:13.943516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:13.955730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-423a4a3f-8b35-42a4-83f6-428ca11b4477 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1536 microversion: 2.1 time: 0.473107 Jul 26 04:30:13.956946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 614/1172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:13 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1536 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:14.000293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8770967c-3678-4496-be5e-36e2000eab8a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.207636 Jul 26 04:30:14.001092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 559/1173] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:13 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:14.162061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:14.165289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:14.209886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.213153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.221983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.222525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.415262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:14.419704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:14.424256 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d26a152-653b-41b5-b8e6-077e5d52524b tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1476 microversion: 2.1 time: 0.279511 Jul 26 04:30:14.426931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:14.427845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:14.428679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 615/1174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:14 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:14.435788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.436470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.437443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.438044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.583429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:14.596106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e21e0c1-70ae-4eba-80ac-191f8eaa3891 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1543 microversion: 2.1 time: 0.173520 Jul 26 04:30:14.596697 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 560/1175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:14 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:14.617063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:14.618273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:14.625227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.625684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.626505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.626948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.711539 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4dfbed7b-69a8-453e-b8bb-d30c16c60af1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098523 Jul 26 04:30:14.712170 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 616/1176] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:30:14 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:14.799169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:14.799792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:14.810059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.811040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.811331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.811780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.857079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a68444c-8743-408b-b3ed-f27a931bdf3a req-9a2b560f-a4ab-404c-86c6-4b7ad7001154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8295eba4-7896-4474-90a9-91a6db08cfdb", "name": "network-vif-plugged", "status": "completed", "tag": "b9ff22bc-41b3-458b-af9b-b765dbedc3bf"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:14.873711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a68444c-8743-408b-b3ed-f27a931bdf3a req-9a2b560f-a4ab-404c-86c6-4b7ad7001154 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.874326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a68444c-8743-408b-b3ed-f27a931bdf3a req-9a2b560f-a4ab-404c-86c6-4b7ad7001154 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.890087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a68444c-8743-408b-b3ed-f27a931bdf3a req-9a2b560f-a4ab-404c-86c6-4b7ad7001154 service nova] Creating event network-vif-plugged:b9ff22bc-41b3-458b-af9b-b765dbedc3bf for instance 8295eba4-7896-4474-90a9-91a6db08cfdb on n-h1-848886-16 Jul 26 04:30:14.895845 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a68444c-8743-408b-b3ed-f27a931bdf3a req-9a2b560f-a4ab-404c-86c6-4b7ad7001154 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043337 Jul 26 04:30:14.896797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 617/1177] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:14.979029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:14.980587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:14.986546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:14.988791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.989403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:14.990423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:14.991034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:15.156988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:15.164736 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab075920-6f84-49f9-9975-f9bd1108f5a2 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1529 microversion: 2.1 time: 0.191226 Jul 26 04:30:15.180869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 618/1178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:14 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1529 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:15.183803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:15.186027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56c70f2c-990b-4283-b600-b02d9dfca1aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58aa8b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:15.194704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29340a30-23d7-44cc-a60d-ed101f278ac1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.399224 Jul 26 04:30:15.195142 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 561/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:14 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:15.201419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:15.202219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:15.210026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:15.210515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:15.211897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:15.212345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:15.234625 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-56c70f2c-990b-4283-b600-b02d9dfca1aa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.052591 Jul 26 04:30:15.235751 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 619/1180] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:15 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:15.450978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:15.451823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:15.461560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:15.462304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:15.463109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:15.463558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:15.488014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:15.496402 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de8f77a4-8a07-40da-bca9-7e39317e2b1c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1529 microversion: 2.1 time: 0.299256 Jul 26 04:30:15.510261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 562/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:15 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1529 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:15.519328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7c7ba6f-a392-4ef7-85bc-a9493a7c4501 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:15.520183 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:15.520183 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:15.525631 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c7c7ba6f-a392-4ef7-85bc-a9493a7c4501 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] HTTP exception thrown: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7c7ba6f-a392-4ef7-85bc-a9493a7c4501 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Request method failure captured: Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/flavors/9dad9420-0839-431b-b22f-e57d83afc363 HTTP/1.1 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32ziSMjZkodmzT_eNrkYf7IFrzC0trmU0Id4Ef9H4S9_gI1JTMbH3n1IGy17MtUROFU3P9fa7BGZmnPbbjkmF7rpswoOAW8dIO04a-TSI41eEVkZoTwmnaXJN8pVfL3MOXEgbPYzDNyx_WOsFAuWk8iOoz6jhEijktpjZnH8V235x-E Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e4b3d1d9a52c4ee8ba060d5c850a8805 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MigrationsAdminTest-302300402 Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:30:15.534507 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e4b3d1d9a52c4ee8ba060d5c850a8805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4b3d1d9a52c4ee8ba060d5c850a8805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4b3d1d9a52c4ee8ba060d5c850a8805"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e4b3d1d9a52c4ee8ba060d5c850a8805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MigrationsAdminTest-302300402 Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e4b3d1d9a52c4ee8ba060d5c850a8805 Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MigrationsAdminTest-302300402 Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MigrationsAdminTest-302300402-project-admin Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4c60ace439e84127980801b84a7ae45a Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MigrationsAdminTest-302300402-project-admin Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. Jul 26 04:30:15.536205 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '9dad9420-0839-431b-b22f-e57d83afc363'} Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:15.537179 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. Jul 26 04:30:15.538741 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:15.540623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7c7ba6f-a392-4ef7-85bc-a9493a7c4501 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Returning 404 to user: Flavor 9dad9420-0839-431b-b22f-e57d83afc363 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:15.540623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7c7ba6f-a392-4ef7-85bc-a9493a7c4501 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/9dad9420-0839-431b-b22f-e57d83afc363" status: 404 len: 109 microversion: 2.1 time: 0.020599 Jul 26 04:30:15.540623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 563/1182] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:15 2022] DELETE /compute/v2.1/flavors/9dad9420-0839-431b-b22f-e57d83afc363 => generated 109 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:15.630004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:15.639928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bd41550-9087-405d-9645-dece833354f7 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1476 microversion: 2.1 time: 0.192232 Jul 26 04:30:15.653611 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 620/1183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:15 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1476 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:15.658442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-834137591", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:15.712510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:30:16.216233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:16.216836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:16.223711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.224154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.224919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.225349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.294249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:30:16.295283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:30:16.295932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:30:16.296341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:30:16.296745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:30:16.305877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.306361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.307757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.308705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.328810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:30:16.333132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Getting quotas for user e78dffc5209d4419b76a331b743475fe and project 4e213406df9b410c83cedd80196bba85. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:30:16.345810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:30:16.348189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:30:16.373048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:16.394533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9f1f032-e21a-4be9-9b1b-465603b81c01 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.181632 Jul 26 04:30:16.395333 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 621/1184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:16 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:16.400105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd70c022-847d-48c9-941c-644ba24a4bfe tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b595ca60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:16.419430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9af0e10f-a4de-4b8c-8f32-d143aa0c863e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764679 Jul 26 04:30:16.420133 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 564/1185] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:30:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:30:16.431045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2f5484fe-6eb4-4fe4-8ace-9765f42465cd req-fa308fc7-06c2-4941-bf7f-458786fdfd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:16.445083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2f5484fe-6eb4-4fe4-8ace-9765f42465cd req-fa308fc7-06c2-4941-bf7f-458786fdfd5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.446270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2f5484fe-6eb4-4fe4-8ace-9765f42465cd req-fa308fc7-06c2-4941-bf7f-458786fdfd5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.457481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd70c022-847d-48c9-941c-644ba24a4bfe tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.060690 Jul 26 04:30:16.461009 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 622/1186] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:16 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:16.462322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2f5484fe-6eb4-4fe4-8ace-9765f42465cd req-fa308fc7-06c2-4941-bf7f-458786fdfd5e service nova] Creating event network-changed:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:30:16.470479 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2f5484fe-6eb4-4fe4-8ace-9765f42465cd req-fa308fc7-06c2-4941-bf7f-458786fdfd5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043292 Jul 26 04:30:16.471643 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 565/1187] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:16.473105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c90f5431-6ed3-4349-aa4c-7122532f3651 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:16.473714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c90f5431-6ed3-4349-aa4c-7122532f3651 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:16.542807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c90f5431-6ed3-4349-aa4c-7122532f3651 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:16.549575 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c90f5431-6ed3-4349-aa4c-7122532f3651 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1212 microversion: 2.1 time: 0.081060 Jul 26 04:30:16.550548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 623/1188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:16 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:16.668132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:16.668840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:16.684697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.685638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.688640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.689316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.859421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:16.871128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-228fbe34-10ba-4e61-b76e-1e4e1bd78105 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1461 microversion: 2.1 time: 0.211925 Jul 26 04:30:16.871724 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 566/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:16 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1461 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:16.900629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:16.903701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:16.912170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.912924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.913912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.914960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.941444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-unplugged", "status": "completed", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}, {"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-plugged", "status": "completed", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:16.959498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:16.960477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:16.976474 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] Creating event network-vif-unplugged:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:30:16.977311 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] Creating event network-vif-plugged:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:30:16.987510 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c1e9c11b-27a7-410f-ba2b-8036859a31bb req-c1e5ca8b-c961-46e2-9724-4d28365ae522 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051360 Jul 26 04:30:16.988828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 567/1190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:17.038768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10ba0700-e8fb-49a8-9156-22b2887cb392 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.142875 Jul 26 04:30:17.043472 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 624/1191] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:16 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:17.049109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.049813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.058117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.058592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.059553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.060157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.103664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.104515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.104958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lazy-loading 'fault' on Instance uuid 8295eba4-7896-4474-90a9-91a6db08cfdb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:17.257183 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-019b667b-6bd8-4c46-a045-358263df49f9 tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1597 microversion: 2.1 time: 0.211562 Jul 26 04:30:17.260193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 568/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:17 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1597 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:17.281140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:17.286084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.298574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.299115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.299972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.300614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.380659 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a94cad50-3638-4690-b79d-ceaf8569aa5c tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action" status: 202 len: 0 microversion: 2.1 time: 0.103675 Jul 26 04:30:17.381354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 625/1193] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:17 2022] POST /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:30:17.389837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.390625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.397898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.398391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.401327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.402210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.421132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.422107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.433196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.433895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.435510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.436200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.571565 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1eeb742-8082-45ac-8c9c-a44e6807e19a tempest-ServersAdminTestJSON-776861089 tempest-ServersAdminTestJSON-776861089-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1614 microversion: 2.1 time: 0.184564 Jul 26 04:30:17.591278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 569/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:17 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1614 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:17.606754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ac8c8e7-dbc0-4b98-8c6d-2e2a4d79f176 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5bbbd30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.668170 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ac8c8e7-dbc0-4b98-8c6d-2e2a4d79f176 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.075551 Jul 26 04:30:17.668880 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 570/1195] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:17 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:17.679275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.686411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.706234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.706958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.710089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.710873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.740112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:17.752762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c94ae2b1-00d5-415b-972a-e58da5de0ab1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1514 microversion: 2.1 time: 0.335863 Jul 26 04:30:17.755872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 626/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:17 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:17.780365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:17.783706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:17.798981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.799760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.801391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:17.802834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:17.879879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:30:17.904054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:17.919338 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e47ccd80-e669-4c16-9a41-7b77b4127dd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1272 microversion: 2.1 time: 0.247441 Jul 26 04:30:17.930324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 571/1197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:17 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:18.078678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85729ff0-6e10-4970-b62c-45ca18e3dc79 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 204 len: 0 microversion: 2.1 time: 0.321153 Jul 26 04:30:18.079787 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 627/1198] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:17 2022] DELETE /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:30:18.089505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:18.090373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:18.098322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.099731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.101420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.102879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.109644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:18.334947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:18.345165 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b834228-6414-4760-8d8d-9ed23293184a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1469 microversion: 2.1 time: 0.261273 Jul 26 04:30:18.346145 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 572/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:18 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:18.683531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca1d4aeb-9a7d-4d3c-99e7-c79a7ecc8bf3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58bdca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:18.736136 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca1d4aeb-9a7d-4d3c-99e7-c79a7ecc8bf3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.056736 Jul 26 04:30:18.736640 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 628/1200] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:18 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:18.778698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:18.779309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:18.787825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.788198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.788970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.789955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.941503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:18.942689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:18.951473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.952406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.954059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:18.954540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:18.988538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:18.997363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52e30025-8691-424d-a57b-2c8ee1687dea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.222679 Jul 26 04:30:18.998496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 573/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:18 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:19.119424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:19.127244 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bd70610-d1bb-44b0-87c0-9587dc9337cc tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.189734 Jul 26 04:30:19.128601 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 629/1202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:18 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:19.374340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:19.374969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:19.384168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:19.386373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:19.388152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:19.391110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:19.660128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:19.671237 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15164309-3f0d-42da-8d17-fe71e2169ec1 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 200 len: 1469 microversion: 2.1 time: 0.300728 Jul 26 04:30:19.685903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 574/1203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:19 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:19.752387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c9551eb-422e-481f-8cec-e76ecbe1957f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59b81f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:19.824056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c9551eb-422e-481f-8cec-e76ecbe1957f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.075413 Jul 26 04:30:19.831422 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 630/1204] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:19 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:19.887482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-33c24cae-cb60-4723-ae73-945bd500b9a5 req-262d30fb-6c75-4e0d-a039-9466cc098b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:19.910591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-33c24cae-cb60-4723-ae73-945bd500b9a5 req-262d30fb-6c75-4e0d-a039-9466cc098b03 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:19.911080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-33c24cae-cb60-4723-ae73-945bd500b9a5 req-262d30fb-6c75-4e0d-a039-9466cc098b03 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:19.936875 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-33c24cae-cb60-4723-ae73-945bd500b9a5 req-262d30fb-6c75-4e0d-a039-9466cc098b03 service nova] Creating event network-changed:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:30:19.949898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-33c24cae-cb60-4723-ae73-945bd500b9a5 req-262d30fb-6c75-4e0d-a039-9466cc098b03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062296 Jul 26 04:30:19.950911 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 575/1205] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:20.007396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ec7c7b9f-cfb8-4f58-bc95-5ef722815d18 req-a898b63f-06ea-452f-b30a-17aab601feb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadde0fb-19ef-4eca-8151-f7bc15d74b61", "name": "network-vif-deleted", "tag": "4759b812-ba82-4555-a673-7db41a172cfc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:20.020390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.021347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:20.022552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ec7c7b9f-cfb8-4f58-bc95-5ef722815d18 req-a898b63f-06ea-452f-b30a-17aab601feb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.025498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ec7c7b9f-cfb8-4f58-bc95-5ef722815d18 req-a898b63f-06ea-452f-b30a-17aab601feb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.032182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.032924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.034042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.034725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.054576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ec7c7b9f-cfb8-4f58-bc95-5ef722815d18 req-a898b63f-06ea-452f-b30a-17aab601feb4 service nova] Creating event network-vif-deleted:4759b812-ba82-4555-a673-7db41a172cfc for instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 on n-h1-848886-16 Jul 26 04:30:20.061117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ec7c7b9f-cfb8-4f58-bc95-5ef722815d18 req-a898b63f-06ea-452f-b30a-17aab601feb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057510 Jul 26 04:30:20.062672 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 631/1206] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:20.153618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.155496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:20.170898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.172363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.173480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.174280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.285017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:20.293221 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c3fd448-4109-4d61-80d3-d1d3476da329 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.277694 Jul 26 04:30:20.293789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 576/1207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:20 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:20.335468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:20.343269 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-16ed5302-1bcc-43aa-97ec-02e313772c69 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.197817 Jul 26 04:30:20.343834 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 632/1208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:20 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:20.693585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.694205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: fadde0fb-19ef-4eca-8151-f7bc15d74b61] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:20.701460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.701843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.702640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.703072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.719603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] HTTP exception thrown: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Request method failure captured: Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 HTTP/1.1 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3215WXg2lMRbabD4vhUnkfQtzEzVz5V0VwIDKBwOvJO8YMvDIL2D8OBh3uNAtXeqsSyGBqYDgS2Awr3jCS66VEkQLQdA4BTtvn_7g9V_kfzU-E8Xx9GCy173tuDEefyKYkgtQoe4GodfMUJL7FaoJBBSwFBkxcFOu1JjgCYc3PgpWRg Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:30:20.721240 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b33bcb62a45c48aabc5f1c4e8e7fc0f0 Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. Jul 26 04:30:20.722919 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'fadde0fb-19ef-4eca-8151-f7bc15d74b61'} Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:20.723938 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. Jul 26 04:30:20.725522 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:20.727209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Returning 404 to user: Instance fadde0fb-19ef-4eca-8151-f7bc15d74b61 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:20.727209 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e50e1dfc-904b-4077-8863-4bd2a37c0ac4 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61" status: 404 len: 111 microversion: 2.1 time: 0.033031 Jul 26 04:30:20.727209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 577/1209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:20 2022] GET /compute/v2.1/servers/fadde0fb-19ef-4eca-8151-f7bc15d74b61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:20.732323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.732826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:20.739043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.739485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.740240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.740670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.769270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:30:20.796540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:20.838806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c747a657-dfe9-4643-a95a-da3bba8f6069 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5c11ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.846853 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8998696a-6780-410a-86bd-24d900a98ecd tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 204 len: 0 microversion: 2.1 time: 0.118316 Jul 26 04:30:20.847350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 633/1210] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:20 2022] DELETE /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:30:20.856736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:20.857528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:20.863443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.863890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.864809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:20.865114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:20.885355 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c747a657-dfe9-4643-a95a-da3bba8f6069 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.050509 Jul 26 04:30:20.885915 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 578/1211] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:20 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:21.003077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:21.010638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf450bab-842e-46a5-ad85-7838b533a2da tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1469 microversion: 2.1 time: 0.159110 Jul 26 04:30:21.011230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 634/1212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:20 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:21.181064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8b53e87e-c3d9-4252-ba0d-90d50fcf16d8 req-62becae9-84de-4dc0-9a08-f7808d52ca33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e46c6d2-15c9-4d22-88ab-46713a88a208", "name": "network-vif-plugged", "status": "completed", "tag": "d6fc979e-4b1a-4de9-b284-53e7a6b1dd03"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:21.192669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8b53e87e-c3d9-4252-ba0d-90d50fcf16d8 req-62becae9-84de-4dc0-9a08-f7808d52ca33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:21.193112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8b53e87e-c3d9-4252-ba0d-90d50fcf16d8 req-62becae9-84de-4dc0-9a08-f7808d52ca33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:21.203775 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8b53e87e-c3d9-4252-ba0d-90d50fcf16d8 req-62becae9-84de-4dc0-9a08-f7808d52ca33 service nova] Creating event network-vif-plugged:d6fc979e-4b1a-4de9-b284-53e7a6b1dd03 for instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 on n-h2-848886-16 Jul 26 04:30:21.208814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8b53e87e-c3d9-4252-ba0d-90d50fcf16d8 req-62becae9-84de-4dc0-9a08-f7808d52ca33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Jul 26 04:30:21.209431 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 579/1213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:21.315978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:21.316593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:21.322795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:21.323248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:21.324024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:21.324462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:21.365635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:21.366431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:21.375441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:21.376131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:21.377206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:21.377643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:21.468288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:21.476075 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-172701f5-afc4-4d94-a206-7e0ad9229734 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.164191 Jul 26 04:30:21.477382 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 635/1214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:21 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:21.518523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:21.526763 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4628115-d86e-425c-8e34-d6bea91cee53 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.165194 Jul 26 04:30:21.527324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 580/1215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:21 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:21.900830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1ef4274-247b-4935-a310-aebda03dc73c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58aa550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:21.945992 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e1ef4274-247b-4935-a310-aebda03dc73c tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.049088 Jul 26 04:30:21.946552 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 636/1216] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:21 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:22.032591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:22.033121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:22.039897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.040340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.041122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.041584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.176345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:22.185202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66427a5e-919c-4e0d-b6c9-5f5cc067bd76 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1469 microversion: 2.1 time: 0.156718 Jul 26 04:30:22.185808 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 581/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:22 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:22.497527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:22.498134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:22.504343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.504789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.505549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.505985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.547415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:22.548158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:22.554504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.555678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.556840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:22.557348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:22.637953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:22.645644 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ebbfad35-6f43-41ed-8133-3561ee3d9f57 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.152698 Jul 26 04:30:22.646423 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 637/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:22 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:22.691458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:22.699704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14fdcba0-bac4-4bcc-81c3-1ffa88fa06e9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.156110 Jul 26 04:30:22.700285 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 582/1219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:22 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:22.960468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cc4a3e1a-cd43-4246-8856-896c531feab6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58aa160>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:23.005751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cc4a3e1a-cd43-4246-8856-896c531feab6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.048974 Jul 26 04:30:23.006435 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 638/1220] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:22 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:23.206920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:23.207522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:23.210404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:23.218399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.218946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.219902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.220494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.257997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ca96348d-be5a-4000-a7c7-07ee3c1a9cd2 req-817565e6-f787-4767-8088-950961e2025a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a92aba-ac5b-4fe0-9ea4-2dcb683568ad", "name": "network-vif-unplugged", "status": "completed", "tag": "40bcbc35-dea5-405e-adce-ebaf7713e0db"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:23.269899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca96348d-be5a-4000-a7c7-07ee3c1a9cd2 req-817565e6-f787-4767-8088-950961e2025a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.270595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca96348d-be5a-4000-a7c7-07ee3c1a9cd2 req-817565e6-f787-4767-8088-950961e2025a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.284044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ca96348d-be5a-4000-a7c7-07ee3c1a9cd2 req-817565e6-f787-4767-8088-950961e2025a service nova] Creating event network-vif-unplugged:40bcbc35-dea5-405e-adce-ebaf7713e0db for instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad on n-h2-848886-16 Jul 26 04:30:23.291459 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ca96348d-be5a-4000-a7c7-07ee3c1a9cd2 req-817565e6-f787-4767-8088-950961e2025a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036252 Jul 26 04:30:23.292720 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 639/1221] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:23.376445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:23.385745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-05021678-c321-4c06-b659-b9f4d615f667 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 200 len: 1469 microversion: 2.1 time: 0.182692 Jul 26 04:30:23.386338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 583/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:23 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:23.557852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-dd6f46bc-f874-40e1-82c8-b30665b06aea req-a41beafc-5fdb-4787-9e1d-de75ece7b581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6129d35-4751-405e-b635-7b779fe46f3e", "name": "network-vif-deleted", "tag": "6989b633-c962-4bf2-ba18-1d258858cdf8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:23.570635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dd6f46bc-f874-40e1-82c8-b30665b06aea req-a41beafc-5fdb-4787-9e1d-de75ece7b581 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.571186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dd6f46bc-f874-40e1-82c8-b30665b06aea req-a41beafc-5fdb-4787-9e1d-de75ece7b581 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.583878 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-dd6f46bc-f874-40e1-82c8-b30665b06aea req-a41beafc-5fdb-4787-9e1d-de75ece7b581 service nova] Creating event network-vif-deleted:6989b633-c962-4bf2-ba18-1d258858cdf8 for instance b6129d35-4751-405e-b635-7b779fe46f3e on n-h1-848886-16 Jul 26 04:30:23.590819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-dd6f46bc-f874-40e1-82c8-b30665b06aea req-a41beafc-5fdb-4787-9e1d-de75ece7b581 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Jul 26 04:30:23.591502 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 640/1223] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:23.667779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:23.668383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:23.675586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.676080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.677065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.677540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.721201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:23.721899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:23.729048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.729500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.730307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:23.730755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:23.818402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:23.827613 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f1e6a3d-409a-45e0-9dd9-70c953dddfcf tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.164351 Jul 26 04:30:23.828352 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 584/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:23 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:23.875690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:23.884389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2a1f5ba-2c21-4539-8797-0f5ce3333f8d tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.166403 Jul 26 04:30:23.884646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 641/1225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:23 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:24.022810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7584e232-c27f-47ff-b5e1-b2e51faee84d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b95280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.067566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7584e232-c27f-47ff-b5e1-b2e51faee84d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.048721 Jul 26 04:30:24.068077 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 585/1226] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:24 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:24.408240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.408801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: b6129d35-4751-405e-b635-7b779fe46f3e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:24.415693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.416144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.416904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.417335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.431075 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] HTTP exception thrown: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Request method failure captured: Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e HTTP/1.1 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3215WXg2lMRbabD4vhUnkfQtzEzVz5V0VwIDKBwOvJO8YMvDIL2D8OBh3uNAtXeqsSyGBqYDgS2Awr3jCS66VEkQLQdA4BTtvn_7g9V_kfzU-E8Xx9GCy173tuDEefyKYkgtQoe4GodfMUJL7FaoJBBSwFBkxcFOu1JjgCYc3PgpWRg Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:24.432679 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: b33bcb62a45c48aabc5f1c4e8e7fc0f0 Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. Jul 26 04:30:24.434235 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b6129d35-4751-405e-b635-7b779fe46f3e'} Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:24.435065 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. Jul 26 04:30:24.436618 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:24.438064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Returning 404 to user: Instance b6129d35-4751-405e-b635-7b779fe46f3e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:24.438064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f116aa87-90a1-4232-aa1f-f5ce05b48ed8 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e" status: 404 len: 111 microversion: 2.1 time: 0.029974 Jul 26 04:30:24.438064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 642/1227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:24 2022] GET /compute/v2.1/servers/b6129d35-4751-405e-b635-7b779fe46f3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:24.443409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.443908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:24.451880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.452337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.453099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.453540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.477665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:30:24.552961 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e4dc8e6-1eb5-4e97-a42a-c482dd90650a tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 204 len: 0 microversion: 2.1 time: 0.113940 Jul 26 04:30:24.553631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 586/1228] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:24 2022] DELETE /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:30:24.562779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.563383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:24.569298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.569767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.570534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.571186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.706433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:24.714830 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf512def-ef31-42d0-8606-b1ea34699d1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1467 microversion: 2.1 time: 0.155781 Jul 26 04:30:24.715406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 643/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:24 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1467 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:24.850854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.851556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:24.858479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.858938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.859716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.860159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.907816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:24.910952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:24.915674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.916126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:24.916905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:24.917480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:25.008151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:25.018234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5740abf2-1de0-498b-90d8-05147d7e16ee tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.171553 Jul 26 04:30:25.019061 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 587/1230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:24 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:25.056935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:25.064363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b50661f-f910-42ba-be2e-2383f2647a23 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.162753 Jul 26 04:30:25.065165 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 644/1231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:24 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:25.082858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aeb33141-600d-43bd-a0c4-b5cea617dc5b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5baf700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:25.129121 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aeb33141-600d-43bd-a0c4-b5cea617dc5b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.049985 Jul 26 04:30:25.129795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 588/1232] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:25 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:25.307198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c3443f0c-3428-4608-8388-ad9b1146a158 req-4f2c2e2e-450c-41d6-b4d8-f81347d4b0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-plugged", "status": "completed", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:25.316823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c3443f0c-3428-4608-8388-ad9b1146a158 req-4f2c2e2e-450c-41d6-b4d8-f81347d4b0d2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:25.317272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c3443f0c-3428-4608-8388-ad9b1146a158 req-4f2c2e2e-450c-41d6-b4d8-f81347d4b0d2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:25.328318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c3443f0c-3428-4608-8388-ad9b1146a158 req-4f2c2e2e-450c-41d6-b4d8-f81347d4b0d2 service nova] Creating event network-vif-plugged:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:30:25.333167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c3443f0c-3428-4608-8388-ad9b1146a158 req-4f2c2e2e-450c-41d6-b4d8-f81347d4b0d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030245 Jul 26 04:30:25.333749 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 645/1233] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:25.737769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:25.738421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:25.745346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:25.745797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:25.746599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:25.747037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:25.883191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:25.890809 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95098853-1104-4ef2-a45c-ed0b28704619 tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1467 microversion: 2.1 time: 0.157825 Jul 26 04:30:25.891373 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 589/1234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:25 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1467 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:26.040178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:26.040869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:26.048115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.048594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.049371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.049806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.088295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:26.089047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:26.095331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.095899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.096774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.097332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.250790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:26.259810 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4cb376c3-9a7b-407e-9f18-ab0513445ada tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1312 microversion: 2.1 time: 0.178332 Jul 26 04:30:26.266706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:26.273647 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 590/1235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:26 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:26.278420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b9da05d-8e32-4254-9aaf-69c4065ea379 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.242301 Jul 26 04:30:26.279036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f46e4b7f-0c57-458c-a1ff-755b25e8e098 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b954c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:26.279731 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 646/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:26 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:26.318853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:26.327614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f46e4b7f-0c57-458c-a1ff-755b25e8e098 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.052722 Jul 26 04:30:26.328538 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 591/1237] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:26 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:26.548568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:26.552588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "80c1e0a3-b802-43b2-bee0-e1d13401a858"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:26.555303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:26.562396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.562931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.563799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.564310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.591151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:26.595925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-093652ba-8767-42ef-853f-4f604ce0a9d1 req-d487ca5d-c0e3-4e58-8cc0-f7feb876fd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8295eba4-7896-4474-90a9-91a6db08cfdb", "name": "network-vif-deleted", "tag": "b9ff22bc-41b3-458b-af9b-b765dbedc3bf"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:26.610983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-093652ba-8767-42ef-853f-4f604ce0a9d1 req-d487ca5d-c0e3-4e58-8cc0-f7feb876fd64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.611696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-093652ba-8767-42ef-853f-4f604ce0a9d1 req-d487ca5d-c0e3-4e58-8cc0-f7feb876fd64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.628366 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-093652ba-8767-42ef-853f-4f604ce0a9d1 req-d487ca5d-c0e3-4e58-8cc0-f7feb876fd64 service nova] Creating event network-vif-deleted:b9ff22bc-41b3-458b-af9b-b765dbedc3bf for instance 8295eba4-7896-4474-90a9-91a6db08cfdb on n-h1-848886-16 Jul 26 04:30:26.636995 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-093652ba-8767-42ef-853f-4f604ce0a9d1 req-d487ca5d-c0e3-4e58-8cc0-f7feb876fd64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046410 Jul 26 04:30:26.637889 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 592/1238] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:26.762946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] HTTP exception thrown: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Request method failure captured: Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments/2d20e276-64be-4236-bf37-44011b92ca24 HTTP/1.1 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 74 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321LZXlg753ZejGGIUWzU3p1EzVttwF9I70LTV8zb-k1o-5tPusqABnWhrdxTZEolGtyJsPWD2zBjQcravs8obEz2ImrcTV1tpmKISTbEdWFeKSqlryzXte0EZwA3Vvcpxx9dP_LAN8iepfDR6jhsR-z2cnhkXL_tGrN3QX4FttmnWk Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b07ec7238dc94deaad9acf2ef6a39182 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:30:26.766655 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b07ec7238dc94deaad9acf2ef6a39182 Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesAdminNegativeTest-1828865201-project-admin Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2bfdeb5295fa4fd5a522b9cf36ce5ce3 Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesAdminNegativeTest-1828865201-project-admin Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: {"volumeAttachment": {"volumeId": "80c1e0a3-b802-43b2-bee0-e1d13401a858"}} Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:26.768261 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '77a9d026-f007-4d08-9d3d-f64b9a6e536b', 'id': '2d20e276-64be-4236-bf37-44011b92ca24', 'body': {'volumeAttachment': {'volumeId': '80c1e0a3-b802-43b2-bee0-e1d13401a858'}}} Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:30:26.769176 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. (HTTP 404) (Request-ID: req-c929f58c-dc30-473f-8701-36daaf02faf9) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:30:26.770294 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:26.772115 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. Jul 26 04:30:26.773429 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:26.774896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Returning 400 to user: Volume 80c1e0a3-b802-43b2-bee0-e1d13401a858 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:26.774896 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-53351708-9e4e-4617-a40e-d53fb1486209 tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments/2d20e276-64be-4236-bf37-44011b92ca24" status: 400 len: 107 microversion: 2.1 time: 0.344869 Jul 26 04:30:26.774896 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 647/1239] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Jul 26 04:30:26 2022] PUT /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments/2d20e276-64be-4236-bf37-44011b92ca24 => generated 107 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:30:26.835729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:26.836518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:26.843159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.843559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.844353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.844791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.912763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:26.913493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:26.921156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.921721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.922617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.923069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.954890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:26.955353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:26.955815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lazy-loading 'fault' on Instance uuid 8295eba4-7896-4474-90a9-91a6db08cfdb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:26.985346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:26.989920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lazy-loading 'services' on Instance uuid 77a9d026-f007-4d08-9d3d-f64b9a6e536b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:27.001467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33bcb62a45c48aabc5f1c4e8e7fc0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ecbd875cdc46a384524202af6c60e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:27.009343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1dc81190-755c-4f00-941a-1b719c84f30c tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 200 len: 1302 microversion: 2.1 time: 0.100420 Jul 26 04:30:27.010114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 648/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:26 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:27.105719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d885ad16-6dcf-4616-9a45-56444f279c3e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "DELETE /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments/2d20e276-64be-4236-bf37-44011b92ca24" status: 202 len: 0 microversion: 2.1 time: 0.275044 Jul 26 04:30:27.106339 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 593/1241] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:30:26 2022] DELETE /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments/2d20e276-64be-4236-bf37-44011b92ca24 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:27.114826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.119053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.126462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.127107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.128258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.128711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.176338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1fef4612-6ccb-4d5e-9cbb-c1fa401a06eb tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064754 Jul 26 04:30:27.182744 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 649/1242] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:27.281754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.282522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.289936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.290586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.291382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.291813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.302139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.302895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.310519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.311072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.312514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.312514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.439620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:27.448005 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a654460-69c8-47a8-98fb-5a06cbd26cec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1462 microversion: 2.1 time: 0.170736 Jul 26 04:30:27.448648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 594/1243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1462 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:27.451330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:27.453108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e7b00e1-b5e6-41ba-af48-d54839ac2436 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b0fca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.459793 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0db1ec62-d373-4318-9da5-18652a28240f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.163108 Jul 26 04:30:27.462761 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 650/1244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:27.468175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.468779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.474929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.475376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.476134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.476565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.500374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e7b00e1-b5e6-41ba-af48-d54839ac2436 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.050699 Jul 26 04:30:27.500943 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 595/1245] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:27.608938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bb4a847-5bc2-4565-b345-7d0f9a7d531b tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1615 microversion: 2.1 time: 0.144117 Jul 26 04:30:27.609502 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 651/1246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1615 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:27.629996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:27.630598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.637538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.637925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.638914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.639357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.668445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4c60ace439e84127980801b84a7ae45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b3d1d9a52c4ee8ba060d5c850a8805', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:27.669039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] flavor_id is None. Assuming migration. {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 04:30:27.669432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 04:30:27.704515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2975bbc1-0cb4-4f47-a1f0-03dc1c52cef5 req-dcd4620f-2fc6-4088-978b-d7f3cb841cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a92aba-ac5b-4fe0-9ea4-2dcb683568ad", "name": "network-vif-plugged", "status": "completed", "tag": "40bcbc35-dea5-405e-adce-ebaf7713e0db"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:27.714853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2975bbc1-0cb4-4f47-a1f0-03dc1c52cef5 req-dcd4620f-2fc6-4088-978b-d7f3cb841cbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.721596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2975bbc1-0cb4-4f47-a1f0-03dc1c52cef5 req-dcd4620f-2fc6-4088-978b-d7f3cb841cbc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.738087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2975bbc1-0cb4-4f47-a1f0-03dc1c52cef5 req-dcd4620f-2fc6-4088-978b-d7f3cb841cbc service nova] Creating event network-vif-plugged:40bcbc35-dea5-405e-adce-ebaf7713e0db for instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad on n-h2-848886-16 Jul 26 04:30:27.744003 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2975bbc1-0cb4-4f47-a1f0-03dc1c52cef5 req-dcd4620f-2fc6-4088-978b-d7f3cb841cbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043031 Jul 26 04:30:27.744983 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 652/1247] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:27.789142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-57be0fcc-efe6-4f2c-bfe6-ca9018aa1c3f tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81/action" status: 202 len: 0 microversion: 2.1 time: 0.162898 Jul 26 04:30:27.789846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 596/1248] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:27 2022] POST /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:27.799670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:27.800277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:27.811570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.812144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:27.813496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:27.813993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.004319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:28.012514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a57d1999-ed48-4996-8eb5-774d9be2858f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1471 microversion: 2.1 time: 0.217956 Jul 26 04:30:28.013082 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 653/1249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:27 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:28.031914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:28.032528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] [instance: 8295eba4-7896-4474-90a9-91a6db08cfdb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:28.038653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.039879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.040993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.041636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.059892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] HTTP exception thrown: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Request method failure captured: Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb HTTP/1.1 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3215WXg2lMRbabD4vhUnkfQtzEzVz5V0VwIDKBwOvJO8YMvDIL2D8OBh3uNAtXeqsSyGBqYDgS2Awr3jCS66VEkQLQdA4BTtvn_7g9V_kfzU-E8Xx9GCy173tuDEefyKYkgtQoe4GodfMUJL7FaoJBBSwFBkxcFOu1JjgCYc3PgpWRg Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:30:28.061781 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ecbd875cdc46a384524202af6c60e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b2ecbd875cdc46a384524202af6c60e1 Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminTestJSON-360535237 Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b33bcb62a45c48aabc5f1c4e8e7fc0f0 Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminTestJSON-360535237-project Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. Jul 26 04:30:28.063289 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '8295eba4-7896-4474-90a9-91a6db08cfdb'} Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:28.064097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. Jul 26 04:30:28.065287 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:28.067651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] Returning 404 to user: Instance 8295eba4-7896-4474-90a9-91a6db08cfdb could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:28.068738 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c916798-2b04-4745-8bba-5adb76df2e1d tempest-ServersAdminTestJSON-360535237 tempest-ServersAdminTestJSON-360535237-project] 10.222.0.43 "GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb" status: 404 len: 111 microversion: 2.1 time: 0.042221 Jul 26 04:30:28.069768 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 597/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:28 2022] GET /compute/v2.1/servers/8295eba4-7896-4474-90a9-91a6db08cfdb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:28.189343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:28.191522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:28.199716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.200255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.201287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.201963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.234085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:28.240637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdc45b47-4572-44be-8ebf-e99aada6b5a4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055516 Jul 26 04:30:28.241375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 654/1251] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:28 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:28.481895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:28.482573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:28.489477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.489936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.490805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.491246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.515004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5043dd93-3a1e-43f0-8073-57a040f2a0c7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5949280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:28.570498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5043dd93-3a1e-43f0-8073-57a040f2a0c7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.059097 Jul 26 04:30:28.572134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 655/1252] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:28 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:28.732648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:28.742429 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02bb629c-a239-4495-909c-da32e26a3cea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.264750 Jul 26 04:30:28.743401 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 598/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:28 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:28.860182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:28.861016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:28.875843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.876348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:28.877061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:28.877499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.041716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:29.042956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:29.060448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.064184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.065146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.067350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:29.069013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.084183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a65d5ec0-483d-411e-bfd4-154b070bb6f2 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 2343 microversion: 2.25 time: 0.227993 Jul 26 04:30:29.085129 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 656/1254] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:28 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 2343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:30:29.110441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:29.116199 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:29.116199 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:29.118721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.120543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.123737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.125371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.177635 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3de997d-781a-43bf-9c28-b96b0b8e67e4 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.073532 Jul 26 04:30:29.178792 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 657/1255] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Jul 26 04:30:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:30:29.254314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:29.256544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:29.290546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.291346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.293017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.300031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.369622 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3c380df-788a-4264-850a-88a7103dd569 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120327 Jul 26 04:30:29.371173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 658/1256] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:29 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:29.400433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:29.413458 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af4aa710-415b-412b-9396-5514f848032c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1471 microversion: 2.1 time: 0.382860 Jul 26 04:30:29.414626 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 599/1257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:29 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:29.591151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81d1dbab-25a6-4d8b-a35d-e301bd2854cc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b595c3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:29.715588 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81d1dbab-25a6-4d8b-a35d-e301bd2854cc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.133430 Jul 26 04:30:29.717337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 659/1258] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:29 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:29.764971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:29.765832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:29.787208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.787965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:29.789489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:29.790782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:30.315418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:30.329242 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c96a76e2-6666-4708-bad8-efa554b6f692 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1520 microversion: 2.1 time: 0.568002 Jul 26 04:30:30.332205 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 600/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:29 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1520 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:30.384703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:30.388411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:30.399608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:30.400649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:30.403938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:30.404625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:30.438405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:30.439075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:30.444786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f321e68-b463-4685-b7e5-4d773eda0e25 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065002 Jul 26 04:30:30.446564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 660/1260] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:30 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:30.448674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:30.451361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:30.452361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:30.454214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:30.734599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed581404-ca86-41c9-8be7-0cb3c97ba295 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58bd1f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:30.814760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:30.829988 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2f054d5-ca97-41e1-8d2e-354b451ec16e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1471 microversion: 2.1 time: 0.394552 Jul 26 04:30:30.834767 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 601/1261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:30 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:30.861371 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed581404-ca86-41c9-8be7-0cb3c97ba295 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.132444 Jul 26 04:30:30.871673 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 661/1262] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:30 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:31.353499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:31.354032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:31.366621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.367644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.376959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.383929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.458504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:31.466049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:31.499217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.500581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.504429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.507986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.678362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3230871-9a59-419b-8052-66102c2068f4 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224294 Jul 26 04:30:31.682227 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 662/1263] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:31 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:31.747882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:31.767196 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19293e74-9854-44a0-ab53-f09bc123fe9d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1505 microversion: 2.1 time: 0.418233 Jul 26 04:30:31.768599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 602/1264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:31 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:31.792922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:31.793780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:31.809173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.810829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.812065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.812722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.866999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:31.868978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:31.894675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.896873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:31.898050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:31.899698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.230928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:32.246024 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa80a580-94a6-4189-84e2-82a64d5c878e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1471 microversion: 2.1 time: 0.387007 Jul 26 04:30:32.246024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 603/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:31 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:32.274316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f15212a-0ae6-480b-acd5-eca646a55fc2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b0f5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:32.303130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:32.326111 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d3b8aba-e6dd-4a1d-ab94-004118ca9ab6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 200 len: 1505 microversion: 2.1 time: 0.541007 Jul 26 04:30:32.339935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 663/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:31 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:32.351673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:32.356870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:32.375920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.378718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f15212a-0ae6-480b-acd5-eca646a55fc2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.118527 Jul 26 04:30:32.379854 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 604/1267] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:32 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:32.384893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.387539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.388003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.453799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ab53a4-245b-486e-a6a3-0f523463c519", "device": "/dev/xvdb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:32.457129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:32.460585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:30:32.481518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.482352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.483688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.484354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.659908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db41d229-a1aa-45f3-8179-c928cd3358e6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 204 len: 0 microversion: 2.1 time: 0.312014 Jul 26 04:30:32.660976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 664/1268] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:32 2022] DELETE /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:30:32.946180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:32.949124 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:32.949124 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:32.950749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.952991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.954061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:32.954936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:32.974232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:32.990784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6787ea6-e783-49bc-899a-c6518a30b23f tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.328082 Jul 26 04:30:33.000674 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 665/1269] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:32 2022] GET /compute/v2.1/os-services => generated 949 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:33.006484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:33.009006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:33.016800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.017250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.018303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.018742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.063944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d296c825-afdd-4c75-9500-4ddcce0258b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061892 Jul 26 04:30:33.068652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 666/1270] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:33 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:33.069580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-176918171", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "79148372-8626-42a1-9ce2-ec3332744087"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:33.140044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] validate_networks() for [('79148372-8626-42a1-9ce2-ec3332744087', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:30:33.721801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:30:33.722996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:30:33.723656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:30:33.724341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:30:33.724914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:30:33.738345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.739903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.740812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.741147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.764194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:30:33.769995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for user baadf645f9914104a5e50c7bced4ffea and project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:30:33.789392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:30:33.791634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:30:33.854076 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ca38a03-4b40-4a93-b40b-ddb86eb745b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788393 Jul 26 04:30:33.860705 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 667/1271] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:30:33.865242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:33.868008 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:33.868008 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:33.869239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.869686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.870744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.870964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.900671 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ad277fd-7e78-46c8-a65b-83577df79370 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-848886-16" status: 200 len: 581 microversion: 2.1 time: 0.038726 Jul 26 04:30:33.901150 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 668/1272] 10.222.0.43 () {58 vars in 1174 bytes} [Tue Jul 26 04:30:33 2022] GET /compute/v2.1/os-services?host=n-d-848886-16 => generated 581 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:33.913551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:33.915151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:33.922822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.923271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:33.924048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:33.924482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.125981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:34.154097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d21d556c-d476-4ac2-b27b-349250fcd5e7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.240681 Jul 26 04:30:34.161325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 669/1273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:33 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:34.184495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4699a027-3836-44a0-84c1-c71b17260535 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a22040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:34.269742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4699a027-3836-44a0-84c1-c71b17260535 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.106944 Jul 26 04:30:34.278329 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 670/1274] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:34 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:34.283261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3103d36f-f400-48c4-8ae1-d764f4b81824 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:34.284006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3103d36f-f400-48c4-8ae1-d764f4b81824 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:34.333141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2d82ca3-84b5-4860-b9bf-ba103f992f63 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.882922 Jul 26 04:30:34.340498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 605/1275] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Jul 26 04:30:32 2022] POST /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 194 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:30:34.350952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:34.360696 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:34.360696 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:34.364898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.365701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.366772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.367988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.411929 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53a3c563-ae45-4efb-b994-df54a175d094 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.070069 Jul 26 04:30:34.413475 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 606/1276] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:30:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:34.437355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:34.448186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:34.512295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.532582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.535036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.538664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.554834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3103d36f-f400-48c4-8ae1-d764f4b81824 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:34.564834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3103d36f-f400-48c4-8ae1-d764f4b81824 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1217 microversion: 2.1 time: 0.291159 Jul 26 04:30:34.573086 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 671/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:34 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:34.581983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:34.584889 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:34.584889 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:34.590422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.594759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.595839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:34.596471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:34.631194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3962980a-1568-431b-a1db-2d75a50cc9db tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216060 Jul 26 04:30:34.636982 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 607/1278] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:34 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:34.649032 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2a3f4eb-47f0-451a-871a-5d5a23d841a9 tempest-ServicesAdminTestJSON-332618892 tempest-ServicesAdminTestJSON-332618892-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.074653 Jul 26 04:30:34.649865 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 672/1279] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:34 2022] GET /compute/v2.1/os-services => generated 949 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:35.202388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:35.203026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:35.224066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:35.224527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:35.225308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:35.240142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:35.297247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e91e54e-a4b9-499c-b209-3fd920122f80 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5848ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:35.458833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e91e54e-a4b9-499c-b209-3fd920122f80 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.176094 Jul 26 04:30:35.460321 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 673/1280] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:35 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:35.590574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:35.591539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:35.623312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:35.628866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:35.634039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:35.641912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:35.966117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:35.970509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:35.974996 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-baea8bb6-74a3-4c88-b943-341b087556f1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1269 microversion: 2.1 time: 0.392097 Jul 26 04:30:35.978891 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 674/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:35 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1269 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:36.001001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:36.002309 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63bc0844-1390-44e7-9dad-5d6c182c2761 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.816452 Jul 26 04:30:36.016846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 608/1282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:35 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:36.026621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:36.041677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:36.042250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:36.044714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:36.044714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:36.061286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7995c2a9-cd13-414d-83dd-3eb797736202 req-d6592f5e-519f-456b-97fe-442cf68a8c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a92aba-ac5b-4fe0-9ea4-2dcb683568ad", "name": "network-vif-deleted", "tag": "40bcbc35-dea5-405e-adce-ebaf7713e0db"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:36.074841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7995c2a9-cd13-414d-83dd-3eb797736202 req-d6592f5e-519f-456b-97fe-442cf68a8c0f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:36.075648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7995c2a9-cd13-414d-83dd-3eb797736202 req-d6592f5e-519f-456b-97fe-442cf68a8c0f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:36.138036 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7995c2a9-cd13-414d-83dd-3eb797736202 req-d6592f5e-519f-456b-97fe-442cf68a8c0f service nova] Creating event network-vif-deleted:40bcbc35-dea5-405e-adce-ebaf7713e0db for instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad on n-h2-848886-16 Jul 26 04:30:36.150498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02ccd859-749e-4ca9-860a-dcc5067b46af tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167810 Jul 26 04:30:36.153308 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 675/1283] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:30:35 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:30:36.172839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7995c2a9-cd13-414d-83dd-3eb797736202 req-d6592f5e-519f-456b-97fe-442cf68a8c0f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109180 Jul 26 04:30:36.173843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 609/1284] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:36.480710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfbe1e64-ef04-4c66-a292-6b764054bc62 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b585ca60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:36.608375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1054649050", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "344cfeb5-a6b4-4376-acc0-c3b9d9d153f8"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:36.615271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfbe1e64-ef04-4c66-a292-6b764054bc62 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.144785 Jul 26 04:30:36.615862 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 676/1285] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:36 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:36.759738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] validate_networks() for [('344cfeb5-a6b4-4376-acc0-c3b9d9d153f8', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:30:37.002608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:37.003574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:37.020328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.024386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.030387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.032282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.593634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:30:37.594377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:30:37.594864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:30:37.595283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:30:37.595697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:30:37.624591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.626735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.633578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.635506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.687442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:30:37.694364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Getting quotas for user 152c5727614449b39b6cdb3d3d402c32 and project 36672ddcc2c242aabf0d03895b4ee3ed. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:30:37.729768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:30:37.737021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:30:37.826897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:37.847691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7997435e-8014-400f-b01c-c0185604bd82 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1275 microversion: 2.1 time: 0.845350 Jul 26 04:30:37.850619 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 677/1286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:36 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1275 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:37.868992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:37.873112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:37.904960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.904960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.907594 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de752342-79d2-475e-b7b9-27f1315f9e5d tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304344 Jul 26 04:30:37.921344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:37.921757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 610/1287] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:30:37.922244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:37.943467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe7aa6a3-21c1-41e9-8552-a125ebb5fcc6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59e7790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:38.108581 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe7aa6a3-21c1-41e9-8552-a125ebb5fcc6 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.185160 Jul 26 04:30:38.109170 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 611/1288] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:37 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:38.121668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b766060d-6eb4-4d4c-81e8-84dfde0fe843 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:38.126879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b766060d-6eb4-4d4c-81e8-84dfde0fe843 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:38.250195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b766060d-6eb4-4d4c-81e8-84dfde0fe843 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:38.261181 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b766060d-6eb4-4d4c-81e8-84dfde0fe843 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1218 microversion: 2.1 time: 0.149958 Jul 26 04:30:38.267568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 612/1289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:38 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:38.526004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:38.536656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95138bdb-351a-4738-af66-1ee5dbfb38a1 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.683070 Jul 26 04:30:38.538275 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 678/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:37 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:38.874876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:38.876466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:38.893778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:38.894413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:38.895506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:38.896399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:38.973555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:39.124189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f79aa62e-c355-4bbf-8f85-c049b2dd23de tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58523a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:39.241439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f79aa62e-c355-4bbf-8f85-c049b2dd23de tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.121867 Jul 26 04:30:39.248078 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 679/1291] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:39 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:39.284252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:39.285540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:39.301331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:39.311127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:39.313898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:39.314407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:39.442676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:39.451285 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bab3f958-eeb6-4f48-80b2-e2327a2cabfd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.580530 Jul 26 04:30:39.457058 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 613/1292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:38 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:39.565090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:39.565714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:39.620892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:39.639374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:39.645197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:39.646994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:39.663656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:39.667697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84670b6c-ee3f-495a-b05f-80820f7b65dc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1214 microversion: 2.1 time: 0.381474 Jul 26 04:30:39.668359 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 680/1293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:39 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1214 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:39.683743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:40.260905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:40.273775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4324963a-477a-4952-8edf-4d1f7ee52e6f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58489d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:40.294325 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9ab4216-4142-454a-9424-683fd386cdab tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.730720 Jul 26 04:30:40.329118 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 614/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:39 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:40.427863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4324963a-477a-4952-8edf-4d1f7ee52e6f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.162443 Jul 26 04:30:40.428433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 681/1295] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:40 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:40.480330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:40.481228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:40.500958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:40.501769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:40.502974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:40.503893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:40.688898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:40.689828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:40.702030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:40.706738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:40.711900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:40.712758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:40.937383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:40.945556 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d178cb8-a99c-435a-9e4c-00d5a5180897 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.469407 Jul 26 04:30:40.952244 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 615/1296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:40 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:41.052304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:41.064704 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0dcde3a0-d37d-49d8-b891-722283a21477 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1276 microversion: 2.1 time: 0.379637 Jul 26 04:30:41.078903 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 682/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:40 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1276 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:41.324244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:41.325587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:41.344528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:41.344981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:41.350284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:41.353302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:41.443919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c7f5123c-d636-45d7-bb86-ed782b253e5e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5852160>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:41.637515 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c7f5123c-d636-45d7-bb86-ed782b253e5e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.198099 Jul 26 04:30:41.638638 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 683/1298] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:41 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:41.877942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:41.895264 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50916379-684a-4306-9c3c-a60f0fbb3fe9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.573424 Jul 26 04:30:41.911575 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 616/1299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:41 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:41.987458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:41.991379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:42.031502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.032630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.035245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.037320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.088685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:42.089542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:42.110567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.112129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.124831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.135967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.233594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:42.243149 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0077654c-9f49-4c77-a62e-f9bb972ed7e0 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1276 microversion: 2.1 time: 0.159167 Jul 26 04:30:42.278596 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 617/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:42 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:42.363817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7863ca7f-0b3b-4c34-a963-706b5d65ca39 req-cfe068f4-023e-4b8f-99e1-aeb6d47f01ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b180c32-da9e-41e0-87e4-38ce6ad21508", "tag": "13a5564a-1362-4d29-8fa8-442be70c1126"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:42.390373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7863ca7f-0b3b-4c34-a963-706b5d65ca39 req-cfe068f4-023e-4b8f-99e1-aeb6d47f01ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.390971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7863ca7f-0b3b-4c34-a963-706b5d65ca39 req-cfe068f4-023e-4b8f-99e1-aeb6d47f01ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.423435 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7863ca7f-0b3b-4c34-a963-706b5d65ca39 req-cfe068f4-023e-4b8f-99e1-aeb6d47f01ea service nova] Creating event network-changed:13a5564a-1362-4d29-8fa8-442be70c1126 for instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 on n-h1-848886-16 Jul 26 04:30:42.446340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7863ca7f-0b3b-4c34-a963-706b5d65ca39 req-cfe068f4-023e-4b8f-99e1-aeb6d47f01ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086308 Jul 26 04:30:42.447656 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 618/1301] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:42.801628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:42.808381 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:42.808381 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:42.810760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.811295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.812112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.812733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.847548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:42.864258 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-990c04e8-4d00-4b17-8323-881b8a330506 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.308468 Jul 26 04:30:42.866794 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-da732578-2520-4ff1-aa87-224dde824084 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.892684 Jul 26 04:30:42.868188 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 684/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:41 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:42.874019 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 619/1303] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:42.877353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9717bce6-cb90-4f76-8ec7-8936424571eb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5860940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:42.879238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:42.879960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:42.888438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.889140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.890093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:42.890655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:42.926566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:30:42.998803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9717bce6-cb90-4f76-8ec7-8936424571eb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.129200 Jul 26 04:30:42.999678 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 685/1304] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:42 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:43.005229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.008252 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:43.008252 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:43.009559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.009959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.025447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.025961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.071764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c532592d-4f76-43fa-8261-23af75552ec6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 204 len: 0 microversion: 2.1 time: 0.196189 Jul 26 04:30:43.072533 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 620/1305] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:42 2022] DELETE /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:30:43.081658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.082458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:43.089676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.090534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.091554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.092188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.110212 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2ec5911-abe6-42da-85f4-8a9c9aececf7 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.108958 Jul 26 04:30:43.125085 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 686/1306] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:30:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:43.130004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.142947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:43.151783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.152534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.153480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.154080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.305201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:43.317865 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1ff705b-561b-4a56-aae6-85cd5b9b9445 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.240401 Jul 26 04:30:43.322222 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 621/1307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:43.328711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.332164 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:43.332164 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:43.333801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.334511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.336233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.336904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.367653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:43.416313 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e8ffceb-f9b2-471e-97b6-91aa48490bad tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.092209 Jul 26 04:30:43.420923 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 622/1308] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/os-services => generated 949 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:43.432416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.432646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:43.452870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.453349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.454259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.454938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.585680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:43.597006 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab161421-89ef-43d9-b478-311ad6ef3300 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1714 microversion: 2.1 time: 0.470523 Jul 26 04:30:43.597401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 687/1309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1714 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:43.624737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.637892 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:43.637892 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:43.639328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.639782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.640579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.649950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.724349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10ae9b87-1076-4ed3-b108-01b360a6d007 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-848886-16&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.103169 Jul 26 04:30:43.724965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 688/1310] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/os-services?host=n-d-848886-16&binary=xxx => generated 16 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:30:43.738361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:43.740929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.751850 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91e657ef-f418-4a99-b0d7-039805ff7be9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.329594 Jul 26 04:30:43.752445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 623/1311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:43.776564 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:43.776564 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:43.778259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.780516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.782454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.784463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.815633 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d47f3823-da45-456b-bf02-6e3b0a935b18 tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.078201 Jul 26 04:30:43.816167 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 689/1312] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/os-services => generated 949 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:43.829260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.831881 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:43.831881 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:43.833111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.833566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.834405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.834853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.887144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-abf9c227-7c8b-48fc-997b-72787529f06c tempest-ServicesAdminNegativeTestJSON-1501188679 tempest-ServicesAdminNegativeTestJSON-1501188679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.060661 Jul 26 04:30:43.888045 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 624/1313] 10.222.0.43 () {58 vars in 1198 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:30:43.888352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:43.888979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:43.897752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.898234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:43.899030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:43.899475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.079297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dbba09ef-5118-4191-947d-96b8aab96648 tempest-ServicesAdminNegativeTestJSON-937541042 tempest-ServicesAdminNegativeTestJSON-937541042-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:44.081840 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:44.081840 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:30:44.084023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dbba09ef-5118-4191-947d-96b8aab96648 tempest-ServicesAdminNegativeTestJSON-937541042 tempest-ServicesAdminNegativeTestJSON-937541042-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4320b4112b2941d19823bb8bb37c3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4e71c8eaa2457f8c77bbec7109d4ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dbba09ef-5118-4191-947d-96b8aab96648 tempest-ServicesAdminNegativeTestJSON-937541042 tempest-ServicesAdminNegativeTestJSON-937541042-project] Request method failure captured: Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi323wzVoFHuQ9pIM5q4cT-W7AxmHkJ2Rhu-kF7k3W2j_t5MFIJLsERVdNG_A-ZpH500O2OeXgJTCD9onIbSqz-LiQJrB0YVh2uuwuDFJD0m94rEJ0q-8N2PDWdUI793z_KAVQdXB15Gzud20bODpNvr4_Q9yIFkgTryhr4zKs0P0QaDU Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: fc4e71c8eaa2457f8c77bbec7109d4ed Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-937541042 Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:30:44.085812 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fc4e71c8eaa2457f8c77bbec7109d4ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc4e71c8eaa2457f8c77bbec7109d4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fc4e71c8eaa2457f8c77bbec7109d4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fc4e71c8eaa2457f8c77bbec7109d4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-937541042 Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: fc4e71c8eaa2457f8c77bbec7109d4ed Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-937541042 Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServicesAdminNegativeTestJSON-937541042-project Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4320b4112b2941d19823bb8bb37c3706 Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-937541042-project Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:30:44.087223 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:30:44.088038 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:30:44.089233 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:44.090619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dbba09ef-5118-4191-947d-96b8aab96648 tempest-ServicesAdminNegativeTestJSON-937541042 tempest-ServicesAdminNegativeTestJSON-937541042-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:44.090619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dbba09ef-5118-4191-947d-96b8aab96648 tempest-ServicesAdminNegativeTestJSON-937541042 tempest-ServicesAdminNegativeTestJSON-937541042-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.191622 Jul 26 04:30:44.095317 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 625/1314] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:30:44.105960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1886f506-a4ad-4f78-8b35-04f4291b15e1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a3e310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:44.162291 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1886f506-a4ad-4f78-8b35-04f4291b15e1 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.065936 Jul 26 04:30:44.163534 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 626/1315] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:44 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:44.189143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:44.200376 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1687533-e21e-4e0d-a1fa-7e6f0c5cd347 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.316025 Jul 26 04:30:44.201999 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 690/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:43 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:44.347403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:44.349148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:44.374138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.374826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.375785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.377865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.630347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:44.630841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:44.637399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:44.657558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.658464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.661073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.661520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.664384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:44.674599 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ceba9e71-4883-4aed-bf96-48a2709832e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.336049 Jul 26 04:30:44.676635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 627/1317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:44 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:44.773583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:44.774502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:44.797535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.797832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:44.798648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:44.799131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:45.061674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:45.073186 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cea571bb-1934-42a0-8d75-221fc6bf379f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.303579 Jul 26 04:30:45.087814 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 628/1318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:44 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:45.180792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d69739b9-f7b3-4ddf-b70f-52c5e45d9e99 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a088b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:45.262748 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d69739b9-f7b3-4ddf-b70f-52c5e45d9e99 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.087327 Jul 26 04:30:45.263631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 629/1319] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:45 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:45.278899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:45.279790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:45.296593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:45.297343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:45.298423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:45.299462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:45.420917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:45.450495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54f3a36a-9470-49c6-946e-a2b5c23ed16f tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1714 microversion: 2.1 time: 0.811961 Jul 26 04:30:45.450495 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 691/1320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:44 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1714 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:45.673493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:45.696139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf41d1e7-5dde-41ae-9f13-21c60c553950 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.428802 Jul 26 04:30:45.698381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:45.699193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:45.709190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:45.714303 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 630/1321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:45 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:45.715751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:45.716831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:45.717301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.058913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:46.075586 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c83d9cd9-660e-4b2f-9773-35c856d3fe55 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.382522 Jul 26 04:30:46.094442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:46.094745 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 692/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:45 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:46.095237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:46.105475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.109861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.111881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.113632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.279063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cbf38dca-7ef0-4448-b33f-1b1490a1a7a3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b58604c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:46.403142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cbf38dca-7ef0-4448-b33f-1b1490a1a7a3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.129768 Jul 26 04:30:46.405193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 693/1323] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:46 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:46.430673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8d5a82ad-77d1-47a3-9610-c098ff3b3173 req-4e22d17b-9556-4bc2-b92a-f7dfb7a32b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a7d851-35f2-4d64-891b-ebefa161b4ef", "tag": "1598385f-d3f1-4dc7-bad7-4f95ea8b109b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:46.449846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d5a82ad-77d1-47a3-9610-c098ff3b3173 req-4e22d17b-9556-4bc2-b92a-f7dfb7a32b99 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.450334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d5a82ad-77d1-47a3-9610-c098ff3b3173 req-4e22d17b-9556-4bc2-b92a-f7dfb7a32b99 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.476402 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8d5a82ad-77d1-47a3-9610-c098ff3b3173 req-4e22d17b-9556-4bc2-b92a-f7dfb7a32b99 service nova] Creating event network-changed:1598385f-d3f1-4dc7-bad7-4f95ea8b109b for instance c0a7d851-35f2-4d64-891b-ebefa161b4ef on n-h2-848886-16 Jul 26 04:30:46.490508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8d5a82ad-77d1-47a3-9610-c098ff3b3173 req-4e22d17b-9556-4bc2-b92a-f7dfb7a32b99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062315 Jul 26 04:30:46.493010 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 694/1324] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:46.505986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:46.507998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:46.516157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.516896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.517899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.518553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.794376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:46.803490 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77f19340-3909-4805-b410-5df862fd998e tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.713796 Jul 26 04:30:46.814915 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 631/1325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:46 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:46.822362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:46.822628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:46.823431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:46.836381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.836561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.838238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:46.838692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:46.846789 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9535c3f5-a0d6-4cf2-8b3a-f15f8b74ddc6 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1714 microversion: 2.1 time: 0.352409 Jul 26 04:30:46.852258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 695/1326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:46 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1714 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:47.115532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:47.117554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:47.136568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.137401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.139528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.144360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.282903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:47.293636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9825a36-46e2-4b6c-a706-e6b1bc0b4c4b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.475042 Jul 26 04:30:47.309899 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 632/1327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:46 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:47.419118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d8f580e-07b1-4367-80da-60a2d9873285 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a08430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:47.425296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:47.441859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6eee2225-4060-4841-8a50-b59e1ffa25e4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.335210 Jul 26 04:30:47.445121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 696/1328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:47 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:47.501251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d8f580e-07b1-4367-80da-60a2d9873285 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.086337 Jul 26 04:30:47.515065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 633/1329] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:47 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:47.806985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a6c60719-0225-47a6-b3fe-f505ad452c2c req-feb8853e-f8f7-48e3-817f-75d616ba08b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed302b-9ce6-4a6a-bb6c-d326bf843614", "name": "network-vif-deleted", "tag": "4f19db3d-3527-4c9b-8728-a7bdf509825d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:47.826979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a6c60719-0225-47a6-b3fe-f505ad452c2c req-feb8853e-f8f7-48e3-817f-75d616ba08b0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.828841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a6c60719-0225-47a6-b3fe-f505ad452c2c req-feb8853e-f8f7-48e3-817f-75d616ba08b0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.845803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:47.847588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:47.868490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a6c60719-0225-47a6-b3fe-f505ad452c2c req-feb8853e-f8f7-48e3-817f-75d616ba08b0 service nova] Creating event network-vif-deleted:4f19db3d-3527-4c9b-8728-a7bdf509825d for instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 on n-h2-848886-16 Jul 26 04:30:47.873980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.877107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.879465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.880288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.885839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a6c60719-0225-47a6-b3fe-f505ad452c2c req-feb8853e-f8f7-48e3-817f-75d616ba08b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086448 Jul 26 04:30:47.894566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 697/1330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:30:47.915205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:47.915947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:47.932161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.932776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:47.933728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:47.936828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:48.233132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:48.248338 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7adf6631-2d34-417b-958d-f7dff149d13b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.414224 Jul 26 04:30:48.249522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 634/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:47 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:48.333836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:48.334542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:48.338789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:48.352197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:48.355049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:48.357877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:48.358741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:48.420440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:48.571823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:48.581631 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0a85c7a-754b-402f-a112-9e37b1a097f5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1646 microversion: 2.1 time: 0.684905 Jul 26 04:30:48.582692 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 698/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:47 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1646 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:48.590667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:48.593440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:48.606792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:48.610485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:48.611505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:48.612111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:48.660050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:48.669690 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d16cdb6-38ad-4957-8d48-995c8cf11243 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.341810 Jul 26 04:30:48.683590 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 635/1333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:48 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:48.688919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-57606e61-82ce-4360-929c-6961f437b112 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a1e280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:48.743442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-57606e61-82ce-4360-929c-6961f437b112 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.058434 Jul 26 04:30:48.745180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 636/1334] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:48 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:48.843823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:48.855792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fde3e457-aeb5-4eca-b180-7df4e726709a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.271655 Jul 26 04:30:48.856839 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 699/1335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:48 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:49.274695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a4fc97e1-7e17-4302-8a56-1660c238a2ce req-a89df77f-ccd8-4dbf-8e20-91bc26be9c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b180c32-da9e-41e0-87e4-38ce6ad21508", "name": "network-vif-plugged", "status": "completed", "tag": "13a5564a-1362-4d29-8fa8-442be70c1126"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:49.284202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:49.285100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:49.318777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.325062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.325193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a4fc97e1-7e17-4302-8a56-1660c238a2ce req-a89df77f-ccd8-4dbf-8e20-91bc26be9c0d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.325633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a4fc97e1-7e17-4302-8a56-1660c238a2ce req-a89df77f-ccd8-4dbf-8e20-91bc26be9c0d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.329835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.333567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.367558 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a4fc97e1-7e17-4302-8a56-1660c238a2ce req-a89df77f-ccd8-4dbf-8e20-91bc26be9c0d service nova] Creating event network-vif-plugged:13a5564a-1362-4d29-8fa8-442be70c1126 for instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 on n-h1-848886-16 Jul 26 04:30:49.379953 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a4fc97e1-7e17-4302-8a56-1660c238a2ce req-a89df77f-ccd8-4dbf-8e20-91bc26be9c0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109623 Jul 26 04:30:49.381597 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 637/1336] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:49.608729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:49.610830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:49.621737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.622352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.623058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.623430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.764785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:49.773724 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b899fcd8-288e-42a8-bf42-3d53e35cb5b9 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.497383 Jul 26 04:30:49.774381 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 700/1337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:49 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:49.787117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:49.787117 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bbdc03ad-4e6a-4a60-9e80-e337213faf27 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1646 microversion: 2.1 time: 0.182715 Jul 26 04:30:49.789063 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 638/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:49 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1646 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:49.794792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:49.795810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:49.802336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.803042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.804750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.805701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.810318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b43bb1a2-ebf3-49a9-85e5-2d0541cce7f0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5848b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:49.893406 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b43bb1a2-ebf3-49a9-85e5-2d0541cce7f0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.086775 Jul 26 04:30:49.893986 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 701/1339] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:49 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:49.908099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:49.909555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:49.920990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.921846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:49.922671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:49.923142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.013549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:50.024125 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-574f7c81-43b1-48e0-8de5-a89986935839 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1317 microversion: 2.1 time: 0.233591 Jul 26 04:30:50.025099 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 639/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:49 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:50.195294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:50.213263 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d70a78bc-22f0-4d8b-b506-9999e89c2540 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.308971 Jul 26 04:30:50.217735 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 702/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:49 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:50.794802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:50.795427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:50.804071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:50.804529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.805314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:50.810735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:50.811348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:50.814257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.827972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:50.828821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.830294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:50.830972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.943549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:50.944002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:50.951450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lazy-loading 'fault' on Instance uuid 41ed302b-9ce6-4a6a-bb6c-d326bf843614 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:51.032979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d778337f6d54635ad8c536069f671f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddbcd869e65464a829b3527f13a2cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:51.052039 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5fc08ba3-d949-47eb-b0ff-50c6125c60ca tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 200 len: 1354 microversion: 2.1 time: 0.244943 Jul 26 04:30:51.052630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 703/1342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:50 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 1354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:51.059699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5289d4e-6d32-4c1c-9105-cd4deeeb4add tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5848670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:51.145717 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5289d4e-6d32-4c1c-9105-cd4deeeb4add tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1453 microversion: 2.1 time: 0.091466 Jul 26 04:30:51.146772 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 704/1343] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:51 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:51.165368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:51.171986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:51.188365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.188823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.189902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.190135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.345954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:51.357317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffbcdd25-d9b7-4f78-a1a7-746a1efe6944 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.566629 Jul 26 04:30:51.366877 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 640/1344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:50 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:51.372821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:51.373780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:51.384137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.390701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.391863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.392528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.487186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:51.498956 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-364344f0-4269-417a-b97d-9f48abbf77d3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1506 microversion: 2.1 time: 0.349127 Jul 26 04:30:51.514334 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 705/1345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:51 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:51.523654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:51.523924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:51.541861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.542575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.545259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:51.548925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:51.789760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:51.805710 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-278a3122-9e17-4246-9b17-82324fc1d5e6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.437373 Jul 26 04:30:51.808090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:51.813666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 641/1346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:51 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.001139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:52.010844 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8aebf69d-aa94-4f93-b6f4-aa7eabe14422 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1506 microversion: 2.1 time: 0.493906 Jul 26 04:30:52.011875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 706/1347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:51 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:52.031538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:52.034703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.042144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.042645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.043691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.044446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.073712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.074508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.083848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.087504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.091330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.092274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.120298 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 HTTP/1.1 Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:52.121955 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:52.123306 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '41ed302b-9ce6-4a6a-bb6c-d326bf843614'} Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:52.124092 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:52.125373 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.130902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:52.131916 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f81c65f-caee-4659-b070-1f5ed4725111 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 404 len: 111 microversion: 2.1 time: 0.062711 Jul 26 04:30:52.136901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 707/1348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:30:52.141801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.142340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.159392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.159780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.160726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.164985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.186648 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-826e564a-e7d0-4410-b633-f81cbee267cd tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "PUT /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1078 microversion: 2.1 time: 0.158853 Jul 26 04:30:52.187286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 642/1349] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:30:52 2022] PUT /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1078 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.193595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61adc6a3-9629-445e-bbd1-e066f7ea4f93 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f01550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.195242 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 HTTP/1.1 Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:52.197042 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.198376 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ef59c1b4-b601-40f3-89d4-f23378e0c742'} Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:52.199136 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.200306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.209318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:52.211968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4f1b336e-d5af-4b92-97b1-087876b970e5 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 404 len: 111 microversion: 2.1 time: 0.073882 Jul 26 04:30:52.215784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 708/1350] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:52 2022] DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:52.221560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.221856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.228982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.229514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.230582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.231186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.283587 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61adc6a3-9629-445e-bbd1-e066f7ea4f93 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1462 microversion: 2.1 time: 0.095037 Jul 26 04:30:52.284168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 643/1351] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.294280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.298990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.309249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.310945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.311903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.312643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.342436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 HTTP/1.1 Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:30:52.346666 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.348273 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ef59c1b4-b601-40f3-89d4-f23378e0c742'} Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:52.349238 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:52.351175 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:30:52.353666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:52.354768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-560cbeae-e7ea-4ee8-91f3-5d30982d0278 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 404 len: 111 microversion: 2.1 time: 0.069519 Jul 26 04:30:52.355632 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 644/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:52.362922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44a7dad7-575c-4c4d-8159-fc6bc6bec691 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a301f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.418128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44a7dad7-575c-4c4d-8159-fc6bc6bec691 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 200 len: 1462 microversion: 2.1 time: 0.061198 Jul 26 04:30:52.419239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 645/1353] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 1462 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.424195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67333312-6936-47b2-8df7-3b7f584a7df0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '.version_select at 0x7f38b5a91160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.447658 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67333312-6936-47b2-8df7-3b7f584a7df0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136406778" status: 202 len: 0 microversion: 2.1 time: 0.026841 Jul 26 04:30:52.451692 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 646/1354] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136406778 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:52.458447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.459319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.467547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.468001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.468983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.469137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:52.469600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.480266 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5a1ef7d-4cea-40e4-bc2f-e7c1c39e6378 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1504 microversion: 2.1 time: 0.263326 Jul 26 04:30:52.481233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 709/1355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.486043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.488265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.498066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:52.507497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.508255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.509416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.510300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.750290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:52.756490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:52.766698 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e591e77-b96c-44de-91d0-5b8240e89685 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.312852 Jul 26 04:30:52.779362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2172e337-7661-430f-bdbc-ea3e7888c27e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1480 microversion: 2.1 time: 0.294416 Jul 26 04:30:52.780936 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 647/1356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.795659 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 710/1357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1480 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:52.799852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.801424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.825981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.827976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.831816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.833318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.835384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:52.836248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:52.844879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.845603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:52.847428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:52.848397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.146708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:53.174100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1e27b18-8c89-4a77-a708-1656b4f603ca tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 2421 microversion: 2.25 time: 0.343666 Jul 26 04:30:53.176039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 711/1358] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 2421 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:30:53.194940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:53.196991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:53.203969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.204832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.206145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.206833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.410354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:53.423180 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b397dba0-047a-4ddc-9804-bd08ebe87d85 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1504 microversion: 2.1 time: 0.640001 Jul 26 04:30:53.434907 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 648/1359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:52 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1504 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:53.442372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": "auto"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:53.449152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:53.456111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.456578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.457387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.457509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:53.457823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.469825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8479df2b-78ef-442a-8c00-78884213d207 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.292439 Jul 26 04:30:53.470518 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 712/1360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:53 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:53.476056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:53.479751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:53.487565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.488984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.489999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.490718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.511670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'flavor' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:30:53.530253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:30:53.595498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:30:53.595986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:30:53.596472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:30:53.597123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:30:53.597545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:30:53.680325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:53.687258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.687807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.688578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.689023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.723505 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dedd5dac-ecba-429a-9181-191dce63b70e tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "POST /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508/action" status: 202 len: 1110 microversion: 2.1 time: 0.251279 Jul 26 04:30:53.724200 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 713/1361] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:53 2022] POST /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508/action => generated 1110 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 04:30:53.729011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91298a6e-964c-401b-8677-daa78af5ae68 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:53.729852 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:53.729852 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:53.750731 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-91298a6e-964c-401b-8677-daa78af5ae68 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1004109337" status: 202 len: 0 microversion: 2.1 time: 0.025374 Jul 26 04:30:53.751825 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 714/1362] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:30:53 2022] DELETE /compute/v2.1/flavors/1004109337 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:53.757968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:53.758660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:53.768003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.768589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.769339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:53.769727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:53.799188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:53.853551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:53.987756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:53.998506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cd2b119-b8b6-4005-8901-63337bab43b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.245095 Jul 26 04:30:53.999554 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 715/1363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:53 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:54.004484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e81eb5b-d79a-4ef6-b066-52fbb9bde744 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:54.049125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e81eb5b-d79a-4ef6-b066-52fbb9bde744 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.048152 Jul 26 04:30:54.050174 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 716/1364] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:30:53 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:54.061110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:54.062182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:54.077112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.077643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.078510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.078960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.306759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:54.316889 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-611d297f-4a8d-4af2-8f72-c7b621e3ae02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1467 microversion: 2.1 time: 0.260402 Jul 26 04:30:54.331879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 717/1365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:54 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:54.342770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:54.344467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:54.358021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.358968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.359916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.360438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.564579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:54.573791 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f2d0019a-cdef-42d0-8deb-42740d490454 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.243473 Jul 26 04:30:54.574411 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 718/1366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:54 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:54.579416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca4d7c94-c567-4be2-be66-00d156e2204e tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:54.580158 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:30:54.580158 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:30:54.599880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca4d7c94-c567-4be2-be66-00d156e2204e tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1027405834" status: 202 len: 0 microversion: 2.1 time: 0.024324 Jul 26 04:30:54.605142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 719/1367] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:30:54 2022] DELETE /compute/v2.1/flavors/1027405834 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:30:54.610520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-404179540"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:54.613459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:54.621137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.621547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.622964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.623506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.864021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cc24af8-757b-4ea8-988b-fd98b38a6d90 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "POST /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650/action" status: 202 len: 0 microversion: 2.1 time: 0.247533 Jul 26 04:30:54.866340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 720/1368] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:30:54 2022] POST /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:30:54.871314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:54.873010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:54.886399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.886854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:54.887771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:54.888532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.046448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:55.058706 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89726c51-948d-4e3e-868d-d1335d674168 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.190444 Jul 26 04:30:55.061215 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 721/1369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:54 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:55.078134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1d01ccb-d663-4d1c-9fcf-e8774a3a4847 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.100712 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b1d01ccb-d663-4d1c-9fcf-e8774a3a4847 tempest-ServersWithSpecificFlavorTestJSON-1616566435 tempest-ServersWithSpecificFlavorTestJSON-1616566435-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037881 Jul 26 04:30:55.101523 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 722/1370] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:55.129545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e825b50f-a7af-4edf-b224-d1fd1008c4d4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59361f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.174946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e825b50f-a7af-4edf-b224-d1fd1008c4d4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.064098 Jul 26 04:30:55.175698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 723/1371] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:55.190277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ae2224e8-be59-4f61-ae16-83617026689f req-715ae6c1-8ea6-40d3-94a0-59b2e76a75fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a7d851-35f2-4d64-891b-ebefa161b4ef", "name": "network-vif-plugged", "status": "completed", "tag": "1598385f-d3f1-4dc7-bad7-4f95ea8b109b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:55.200446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ae2224e8-be59-4f61-ae16-83617026689f req-715ae6c1-8ea6-40d3-94a0-59b2e76a75fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.200878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ae2224e8-be59-4f61-ae16-83617026689f req-715ae6c1-8ea6-40d3-94a0-59b2e76a75fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.214111 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ae2224e8-be59-4f61-ae16-83617026689f req-715ae6c1-8ea6-40d3-94a0-59b2e76a75fc service nova] Creating event network-vif-plugged:1598385f-d3f1-4dc7-bad7-4f95ea8b109b for instance c0a7d851-35f2-4d64-891b-ebefa161b4ef on n-h2-848886-16 Jul 26 04:30:55.219915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ae2224e8-be59-4f61-ae16-83617026689f req-715ae6c1-8ea6-40d3-94a0-59b2e76a75fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040049 Jul 26 04:30:55.221052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 724/1372] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:55.228169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.229062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.236829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.237551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.238474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.239421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.394126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:55.402880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a2199cc-aca6-443a-9862-7718fef05788 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.180453 Jul 26 04:30:55.410300 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 725/1373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:55.410300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.410300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.416198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.416198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.417198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.418127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.432926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 HTTP/1.1 Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:55.434442 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.435804 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '41ed302b-9ce6-4a6a-bb6c-d326bf843614'} Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:55.436569 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.437775 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.439135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:55.439135 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e842476-8508-4bdb-88d0-4c3da90a37a0 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 404 len: 111 microversion: 2.1 time: 0.031462 Jul 26 04:30:55.439135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 726/1374] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:55 2022] DELETE /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:55.446106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.446792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: 41ed302b-9ce6-4a6a-bb6c-d326bf843614] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.453519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.454230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.454797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.455247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.469944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:55.471234 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 HTTP/1.1 Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:55.473151 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.474534 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '41ed302b-9ce6-4a6a-bb6c-d326bf843614'} Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:55.475824 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. Jul 26 04:30:55.477034 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.478101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance 41ed302b-9ce6-4a6a-bb6c-d326bf843614 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:55.478101 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4742e2b-77cd-4581-84df-e68ba7efdf54 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614" status: 404 len: 111 microversion: 2.1 time: 0.033670 Jul 26 04:30:55.478101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 727/1375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/servers/41ed302b-9ce6-4a6a-bb6c-d326bf843614 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:55.485268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.485817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.492778 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c5d4205-7976-4bc1-9f52-ac9802f3e692 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/action" status: 202 len: 0 microversion: 2.25 time: 2.056402 Jul 26 04:30:55.497543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.497793 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 649/1376] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:30:53 2022] POST /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/action => generated 0 bytes in 2062 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:30:55.499027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.500478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.501154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.503299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.504257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.514256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.515081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.516079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.516686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.525608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 HTTP/1.1 Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:55.528180 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.529679 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ef59c1b4-b601-40f3-89d4-f23378e0c742'} Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:55.530483 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.531887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.533322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:55.534904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e49b0161-5df2-4abe-b189-89f0620c120c tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 404 len: 111 microversion: 2.1 time: 0.053026 Jul 26 04:30:55.538687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 728/1377] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:30:55 2022] DELETE /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:55.551727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.552355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] [instance: ef59c1b4-b601-40f3-89d4-f23378e0c742] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.558674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.559131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.559976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.560421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.576619 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] HTTP exception thrown: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Request method failure captured: Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 HTTP/1.1 Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi320hfbH6D1dyobOPxNevlFNpmVwab3dROzR0IbC5RPQRcQvCm7aqFy8pyTRkoWMgV3an7LlTuNIQSu2fp-hVQRzKMFBvrw1grJbNQsev1LzQJIObF0jPtieQ8B0TloDzU3mZsU4BStXlWWGqS1guWeyAUqp0NgYdx-FInhBraIpjAwY Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:30:55.578548 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ddbcd869e65464a829b3527f13a2cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6ddbcd869e65464a829b3527f13a2cbf Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060 Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1d778337f6d54635ad8c536069f671f0 Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1762328060-project Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.580143 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ef59c1b4-b601-40f3-89d4-f23378e0c742'} Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:30:55.585490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. Jul 26 04:30:55.587147 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:30:55.588584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] Returning 404 to user: Instance ef59c1b4-b601-40f3-89d4-f23378e0c742 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:30:55.588584 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5437811-12df-4466-a5ab-631c39a18ee4 tempest-ServersWithSpecificFlavorTestJSON-1762328060 tempest-ServersWithSpecificFlavorTestJSON-1762328060-project] 10.222.0.43 "GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742" status: 404 len: 111 microversion: 2.1 time: 0.033213 Jul 26 04:30:55.588584 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 729/1378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/servers/ef59c1b4-b601-40f3-89d4-f23378e0c742 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:30:55.598044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:55.598044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:55.609738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.610347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.610967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:55.611438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:55.771115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:55.781599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:55.783577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:55.785057 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2e6d9f1-a65c-4d7f-b848-f0b4be2442ad tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.286316 Jul 26 04:30:55.801605 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 650/1379] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:30:56.076411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:56.082141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:56.083149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:56.084762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6827c1d5-cf25-49b4-830b-427f43a77bae tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.493229 Jul 26 04:30:56.097877 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 730/1380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:55 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:56.098121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.098121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.098121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.098606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.190252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4ff2b00-75f0-44b6-b1cf-b0a068efcde0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b59368b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:56.243214 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4ff2b00-75f0-44b6-b1cf-b0a068efcde0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.056808 Jul 26 04:30:56.244357 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 731/1381] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:56 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:56.386402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:56.396093 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2bb0f230-e4d4-4619-9a99-dcc9f3260cde tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.318886 Jul 26 04:30:56.400083 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 651/1382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:56 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:56.428460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:56.429953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:56.438048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.438754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.439961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.441191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.808150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:56.808766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:56.819796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.820516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.821473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:56.822113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:56.928634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:56.952264 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a7a0dd7-b96a-42b1-af05-719f470bfe56 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.519520 Jul 26 04:30:56.956071 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 732/1383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:56 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:57.073654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:57.085901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:57.088336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:57.089731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bfd51d3f-0fa7-4e52-aad0-26a915aa0320 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.286151 Jul 26 04:30:57.090812 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 652/1384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:56 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:30:57.106117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:57.106849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:57.117255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:57.117799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:57.119233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:57.123183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:57.247987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bb089add-ab3e-45c0-8cf7-cbe1d87a5010 req-a2a8d163-5d2b-46ce-99dc-0f63f49e8798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e46c6d2-15c9-4d22-88ab-46713a88a208", "name": "network-vif-unplugged", "status": "completed", "tag": "d6fc979e-4b1a-4de9-b284-53e7a6b1dd03"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:30:57.267217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bb089add-ab3e-45c0-8cf7-cbe1d87a5010 req-a2a8d163-5d2b-46ce-99dc-0f63f49e8798 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:57.267729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bb089add-ab3e-45c0-8cf7-cbe1d87a5010 req-a2a8d163-5d2b-46ce-99dc-0f63f49e8798 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:57.286568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bb089add-ab3e-45c0-8cf7-cbe1d87a5010 req-a2a8d163-5d2b-46ce-99dc-0f63f49e8798 service nova] Creating event network-vif-unplugged:d6fc979e-4b1a-4de9-b284-53e7a6b1dd03 for instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 on n-h2-848886-16 Jul 26 04:30:57.293508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bb089add-ab3e-45c0-8cf7-cbe1d87a5010 req-a2a8d163-5d2b-46ce-99dc-0f63f49e8798 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049066 Jul 26 04:30:57.294536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 653/1385] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:30:57.303957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2169a5b1-845f-4d2d-aa6a-89209ba1b6b9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a1e310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:57.359316 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2169a5b1-845f-4d2d-aa6a-89209ba1b6b9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.063120 Jul 26 04:30:57.367707 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 654/1386] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:57 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:57.395617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:57.406192 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39f4e83a-cc33-41dd-b5f3-3911e2b7e240 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1318 microversion: 2.1 time: 0.303957 Jul 26 04:30:57.406777 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 733/1387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:57 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:57.422112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:57.422869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:57.429838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:57.430333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:57.431126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:57.431569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:57.720860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:57.737809 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e9a5adf-4188-43d6-9ecb-11ebd07e1edf tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.320245 Jul 26 04:30:57.739443 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 655/1388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:57 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:57.980764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:57.981398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:58.010255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.012672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.016264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.019099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.113782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:58.117548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:58.139097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.140582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.141845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.143303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.155996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:30:58.447199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:58.459439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73466610-4d0b-4664-85d6-af719e137470 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.484377 Jul 26 04:30:58.460685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 734/1389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:57 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:58.478828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eed8e18c-3320-414f-b534-4cf83002ea6f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a8f3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:58.551577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eed8e18c-3320-414f-b534-4cf83002ea6f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.089502 Jul 26 04:30:58.552653 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 735/1390] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:58 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:58.559578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:58.560686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:58.575743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:58.591125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.594966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.597107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:58.598232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.599284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.606832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:58.608641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6a475de-cb11-45f4-ad59-e5fa2523b91b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.498918 Jul 26 04:30:58.609631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 656/1391] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:58 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:30:58.761016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:58.763043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:58.775404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.778116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.779204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:58.782608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:58.847268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:58.866279 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fdc6636-8a35-4ab3-b8b4-4bb76d2d751f tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1509 microversion: 2.1 time: 0.311699 Jul 26 04:30:58.869324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 736/1392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:58 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:59.103565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:30:59.115488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-828a7dc6-4266-4066-aae0-aceb393139fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.358382 Jul 26 04:30:59.132699 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 657/1393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:58 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:30:59.484504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:59.485118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:59.503295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:59.513396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:59.517173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:59.522936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:59.568479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae4f6dc9-f68e-4325-ae45-25ae22b46506 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a425e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:59.661756 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae4f6dc9-f68e-4325-ae45-25ae22b46506 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.097779 Jul 26 04:30:59.668358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 658/1394] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:30:59 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:30:59.679273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:30:59.684158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:30:59.699720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:59.706812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:30:59.707908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:30:59.709978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:00.118320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:00.136125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e75b2f89-469b-44d8-ad3f-7292c97eaba3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.655316 Jul 26 04:31:00.150820 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 737/1395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:30:59 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:00.159441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:00.160071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:00.176280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:00.179283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:00.184859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:00.185627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:00.227881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:00.246263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:00.249012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:00.250256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98a4fb87-dbe3-4b2c-a044-51fd7b6020b1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.580752 Jul 26 04:31:00.250819 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 659/1396] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:30:59 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:00.624310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:00.648676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2d2bf63-83ac-4520-a46b-14abb615570e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.496284 Jul 26 04:31:00.650041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 738/1397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:00 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:00.683476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-727dfeeb-46b8-488f-9106-8d26ba3da194 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a425e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:00.774194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-727dfeeb-46b8-488f-9106-8d26ba3da194 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.096078 Jul 26 04:31:00.775113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 660/1398] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:00 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:01.157169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:01.158327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:01.166300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.184344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.185550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.186178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.275517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:01.276999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:01.291091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.291549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.292340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.294964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.516984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:01.528736 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78fcb40b-5c2c-4448-86a4-aafa0f098fea tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.375350 Jul 26 04:31:01.529345 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 739/1399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:01 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:01.595346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:01.610307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:01.611828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:01.613038 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d1a4615-00a1-4df3-b871-b66638eab062 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.342624 Jul 26 04:31:01.613595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 661/1400] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:01 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:01.679454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:01.680087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:01.690974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.691441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.696482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.696961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.724592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3a2f7645-8358-4490-a223-4d7265f8ba7e"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:01.727372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:01.739480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.742744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.743749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:01.744360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:01.886735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] HTTP exception thrown: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Request method failure captured: Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef/os-volume_attachments/7713e6fa-308c-4b3b-896d-b8be33e0d788 HTTP/1.1 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 74 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321LZXlg753ZejGGIUWzU3p1EzVttwF9I70LTV8zb-k1o-5tPusqABnWhrdxTZEolGtyJsPWD2zBjQcravs8obEz2ImrcTV1tpmKISTbEdWFeKSqlryzXte0EZwA3Vvcpxx9dP_LAN8iepfDR6jhsR-z2cnhkXL_tGrN3QX4FttmnWk Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b07ec7238dc94deaad9acf2ef6a39182 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 04:31:01.892887 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b07ec7238dc94deaad9acf2ef6a39182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b07ec7238dc94deaad9acf2ef6a39182 Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1828865201 Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesAdminNegativeTest-1828865201-project-admin Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2bfdeb5295fa4fd5a522b9cf36ce5ce3 Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesAdminNegativeTest-1828865201-project-admin Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: {"volumeAttachment": {"volumeId": "3a2f7645-8358-4490-a223-4d7265f8ba7e"}} Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:31:01.894344 n-d-848886-16 devstack@n-api.service[119487]: exception: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': 'c0a7d851-35f2-4d64-891b-ebefa161b4ef', 'id': '7713e6fa-308c-4b3b-896d-b8be33e0d788', 'body': {'volumeAttachment': {'volumeId': '3a2f7645-8358-4490-a223-4d7265f8ba7e'}}} Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:31:01.895157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. (HTTP 404) (Request-ID: req-1fea5937-29ca-4e19-8b37-2f227e11ebfb) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:31:01.896395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:01.898083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. Jul 26 04:31:01.901534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:01.906268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] Returning 404 to user: Volume 7713e6fa-308c-4b3b-896d-b8be33e0d788 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:01.906268 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1f9adbbc-1245-44ff-82e5-d589794c5c0f tempest-VolumesAdminNegativeTest-1828865201 tempest-VolumesAdminNegativeTest-1828865201-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef/os-volume_attachments/7713e6fa-308c-4b3b-896d-b8be33e0d788" status: 404 len: 109 microversion: 2.1 time: 0.174548 Jul 26 04:31:01.906268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 662/1401] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Jul 26 04:31:01 2022] PUT /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef/os-volume_attachments/7713e6fa-308c-4b3b-896d-b8be33e0d788 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:31:01.921113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc66562e-19d5-4e14-8083-1c3a7294a6cb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a45040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:01.963527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:01.974944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2ce0d79-0bbe-419f-aa34-492f61255180 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.299544 Jul 26 04:31:01.975681 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 740/1402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:01 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:02.033851 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc66562e-19d5-4e14-8083-1c3a7294a6cb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.123954 Jul 26 04:31:02.035585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 663/1403] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:01 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:02.552551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:02.553702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:02.573157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:02.573611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:02.574422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:02.574858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:02.640935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:02.642133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:02.652067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:02.655919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:02.658760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:02.660861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:02.730541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:02.744309 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-255baac7-1ffd-4c1f-b9fd-c843c8793bae tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.194189 Jul 26 04:31:02.747623 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 741/1404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:02 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:03.000240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:03.000240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:03.029395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:03.031207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:03.034540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:03.039096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:03.352162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:03.368330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:03.379395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:03.385290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31bc7979-4443-46af-8ffd-195be215fde4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.743981 Jul 26 04:31:03.387782 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 664/1405] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:02 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:03.398070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c092bd7-ee04-466f-914f-6a80601c5ac7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad5d430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:03.407167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:03.423613 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d828d008-0906-440d-83da-3708054bad79 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1476 microversion: 2.1 time: 0.430373 Jul 26 04:31:03.425924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 742/1406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:02 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:03.535574 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6c092bd7-ee04-466f-914f-6a80601c5ac7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.146266 Jul 26 04:31:03.540844 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 665/1407] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:03 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:03.773778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:03.774539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:03.791655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:03.792459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:03.795991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:03.797268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:04.030616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:04.061299 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-648da828-a604-4a95-ad04-c61af746e762 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.295925 Jul 26 04:31:04.074668 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 743/1408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:03 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:04.414537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:04.417766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:04.453855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:04.454653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:04.471820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:04.472287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:04.479381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:04.480591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:04.481001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:04.481989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:04.482650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:04.491711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:05.247044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:05.270354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:05.272429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:05.273826 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f83591ce-65e8-4e63-904f-bb3afeb34273 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.865191 Jul 26 04:31:05.299516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 666/1409] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:04 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:05.309431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bee45a90-117e-40d0-bd76-4289bf4ba2a3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad5d820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:05.372490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:05.417839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a954e0d-b165-45f1-b73c-1e3c27222ad9 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1475 microversion: 2.1 time: 0.936307 Jul 26 04:31:05.430234 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 744/1410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:04 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1475 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:05.436153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1c6bccf7-04cb-4b86-9c66-7f0961cae047 req-235d59fb-fe21-4a90-8dc0-db7045490761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-plugged", "status": "completed", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:05.483844 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bee45a90-117e-40d0-bd76-4289bf4ba2a3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.178228 Jul 26 04:31:05.484950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1c6bccf7-04cb-4b86-9c66-7f0961cae047 req-235d59fb-fe21-4a90-8dc0-db7045490761 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:05.484950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1c6bccf7-04cb-4b86-9c66-7f0961cae047 req-235d59fb-fe21-4a90-8dc0-db7045490761 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:05.494764 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 667/1411] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:05 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:05.502718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:05.503190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:05.532146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:05.532613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:05.533471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:05.534203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:05.538540 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1c6bccf7-04cb-4b86-9c66-7f0961cae047 req-235d59fb-fe21-4a90-8dc0-db7045490761 service nova] Creating event network-vif-plugged:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:31:05.602030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1c6bccf7-04cb-4b86-9c66-7f0961cae047 req-235d59fb-fe21-4a90-8dc0-db7045490761 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177411 Jul 26 04:31:05.607227 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 745/1412] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:06.307898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:06.308920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:06.335200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:06.335200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:06.335620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:06.342932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:06.650062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:06.714538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48758ec4-4129-45e3-bf40-b351d549ab43 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 1.218515 Jul 26 04:31:06.715132 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 668/1413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:05 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:06.744036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:06.751785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:06.783888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:06.785215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:06.786480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:06.787782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:07.296654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:07.316924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:07.324253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:07.331170 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e23f49e-a88d-40de-a0a1-dabd8a8abfdf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 1.028287 Jul 26 04:31:07.334436 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 746/1414] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:06 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:31:07.353101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c4bd6e9-c12f-4484-a6f2-e6250f9a6363 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a928b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:07.449687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2c4bd6e9-c12f-4484-a6f2-e6250f9a6363 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.111955 Jul 26 04:31:07.450282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 747/1415] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:07 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:07.474005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-unplugged", "status": "completed", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:07.519031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:07.523735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:07.565210 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] Creating event network-vif-unplugged:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h2-848886-16 Jul 26 04:31:07.577883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] Instance c0b76d7a-3694-4097-948a-c43cbd851b81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:31:07.619988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8d1e1081-3805-4282-95c8-cf4cc8d9cb4c req-36320dc6-ba6a-438d-b690-0535cfd3272e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156981 Jul 26 04:31:07.627280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 748/1416] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:07.743225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:07.744208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:07.762668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:07.771019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:07.773491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:07.775281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:08.272204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:08.285979 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2104c093-aa10-451c-8094-1c50ec77d269 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1475 microversion: 2.1 time: 1.564237 Jul 26 04:31:08.286954 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 669/1417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:06 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1475 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:08.296213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:08.298747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:08.313552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:08.321834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:08.323104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:08.323729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:08.397352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:08.642469 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-316d2a04-64aa-4548-b05a-69fbbb1e868b tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 204 len: 0 microversion: 2.1 time: 0.351258 Jul 26 04:31:08.648611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 670/1418] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:08 2022] DELETE /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:08.661418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:08.670538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:08.685169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:08.688347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:08.690887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:08.705852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:09.436337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:09.444038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:09.451973 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6ad4332-657c-49b5-b43d-a05f5bf26f62 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 1.713637 Jul 26 04:31:09.454317 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 749/1419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:07 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:09.467111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d59bafc-3ec0-4512-add6-2a6f9918d7c9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b55dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:09.595933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d59bafc-3ec0-4512-add6-2a6f9918d7c9 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.140096 Jul 26 04:31:09.600498 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 750/1420] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:09 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:09.608860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:09.610051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:09.648591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:09.650050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:09.651090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:09.654209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:09.654946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:09.660864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:09.675700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:09.682540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-878d47af-e847-4ce2-8e21-ae8ab0fadc53 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 1.029815 Jul 26 04:31:09.684299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 671/1421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:08 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:09.699922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:09.705008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:09.740215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:09.743476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:09.744515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:09.747373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:10.276209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:10.302040 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6cb90de2-cc23-42f6-98a3-bf8d8f1cfb6e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1475 microversion: 2.1 time: 0.612601 Jul 26 04:31:10.305295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 672/1422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:09 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1475 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:10.333690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:10.357894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:10.366881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:10.390900 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] Creating event network-changed:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h2-848886-16 Jul 26 04:31:10.408196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:10.410082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] Instance c0b76d7a-3694-4097-948a-c43cbd851b81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:31:10.423583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62f2a7c1-f5de-45ed-9cf3-2f375c385e63 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1515 microversion: 2.1 time: 0.820547 Jul 26 04:31:10.424514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 751/1423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:09 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1515 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:10.431856 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-25da3432-309d-46ae-b25b-0788f297229c req-c9ea7433-1eb3-44bd-8a13-eb07bcb4151e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121682 Jul 26 04:31:10.434448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 673/1424] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:10.477606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:10.478942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:10.492383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:10.493254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:10.494471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:10.497672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:10.615921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35dcca6d-71bd-49fd-a7d4-dda806cce8d7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a309d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:10.679438 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-35dcca6d-71bd-49fd-a7d4-dda806cce8d7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.068595 Jul 26 04:31:10.683863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 674/1425] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:10 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:10.709868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:10.710976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:10.736483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:10.742732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:10.754490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:10.755435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:11.178524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:11.179456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:11.187650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:11.191944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3091f12-186f-484a-be23-70f1925b0942 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.715757 Jul 26 04:31:11.193746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 752/1426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:10 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:11.199193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:11.206320 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a4d274e-e78e-45ad-a8b8-d574f2502147 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.501097 Jul 26 04:31:11.214291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 675/1427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:10 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:11.327514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:11.328427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:11.346747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:11.347804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:11.350130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:11.350936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:11.449985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:11.450637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:11.461837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:11.469510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:11.470458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:11.470920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:12.159065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:12.181346 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0552b7ec-db52-4879-abd1-d80b736e268b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1475 microversion: 2.1 time: 0.851652 Jul 26 04:31:12.183871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 753/1428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:11 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:12.205844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b846aa36-fb86-4e48-8ebd-a1324eb9c696 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b61895e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:12.241284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:12.254521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16acaee5-1f23-44d3-9c39-cc86909fb160 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1515 microversion: 2.1 time: 0.808574 Jul 26 04:31:12.263592 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 676/1429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:11 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1515 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:12.271093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:12.284227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:12.292731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:12.293793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:12.294638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:12.295778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:12.326504 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b846aa36-fb86-4e48-8ebd-a1324eb9c696 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.137631 Jul 26 04:31:12.334324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 754/1430] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:12 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:12.338528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:12.339147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:12.373528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:12.373768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:12.375412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:12.375866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:12.954651 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:31:12.956018 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 04:31:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b (ip 10.222.0.43) !!! Jul 26 04:31:12.960047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:12.963888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:12.975819 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-311f619a-a439-4486-9c79-39225d53f6e9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.710241 Jul 26 04:31:12.976947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 677/1431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:12 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:12.992670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b3057451-b544-4acc-b327-dc9701977b79 req-3b6a9e72-1f2a-4f24-b06b-2d410f4749a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a7d851-35f2-4d64-891b-ebefa161b4ef", "name": "network-vif-deleted", "tag": "1598385f-d3f1-4dc7-bad7-4f95ea8b109b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:13.023286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b3057451-b544-4acc-b327-dc9701977b79 req-3b6a9e72-1f2a-4f24-b06b-2d410f4749a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:13.024504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b3057451-b544-4acc-b327-dc9701977b79 req-3b6a9e72-1f2a-4f24-b06b-2d410f4749a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:13.035935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:13.041040 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b3057451-b544-4acc-b327-dc9701977b79 req-3b6a9e72-1f2a-4f24-b06b-2d410f4749a2 service nova] Creating event network-vif-deleted:1598385f-d3f1-4dc7-bad7-4f95ea8b109b for instance c0a7d851-35f2-4d64-891b-ebefa161b4ef on n-h2-848886-16 Jul 26 04:31:13.047020 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b3057451-b544-4acc-b327-dc9701977b79 req-3b6a9e72-1f2a-4f24-b06b-2d410f4749a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066036 Jul 26 04:31:13.047616 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 678/1432] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:13.062193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:13.063698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:13.064895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43bd6185-e2e6-43ab-903e-ab4fe9a75407 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.736594 Jul 26 04:31:13.065704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 755/1433] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:12 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:13.204642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:13.205330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:13.207505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:13.229022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:13.229022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:13.229793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:13.242000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:13.287842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:13.289324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:13.310999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:13.311809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:13.312841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:13.314734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:13.562490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:13.574398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-83e18f49-6b1c-4848-91c7-0d43670e0cfc tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1473 microversion: 2.1 time: 0.293007 Jul 26 04:31:13.576101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 756/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:13 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:13.583951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e702fb7-a7bd-42d7-a964-85ee3b9f40b2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a495e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:13.721001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:13.745595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0ebc78f-e6e3-4188-ab81-febe94612402 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1473 microversion: 2.1 time: 0.540282 Jul 26 04:31:13.747441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 679/1435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:13 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1473 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:14.002494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:14.003407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:14.031618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:14.036072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:14.044300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:14.044300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:14.521876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:14.536234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92baddfd-a7ef-47fd-b740-28907d2b81d9 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.538447 Jul 26 04:31:14.544483 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 680/1436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:13 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:14.544483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:14.544483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:14.555389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:14.555844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:14.556631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:14.557214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:15.285459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:15.303105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:15.308922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:15.319844 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-82f4300e-a855-44d8-9b06-5eacfb0089d8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.781409 Jul 26 04:31:15.337880 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 681/1437] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:14 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:15.358903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:15.359770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:15.381606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:15.387602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:15.391056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:15.399537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:15.908225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:15.920420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c34ecf11-224a-4654-8358-eb6ff0b94c8a tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 200 len: 1303 microversion: 2.1 time: 0.580962 Jul 26 04:31:15.922518 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 682/1438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:15 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 1303 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:15.932990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:15.933874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:15.945308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:15.947336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:15.951074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:15.953741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:16.393452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:16.401916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c030540-8c9b-49d7-b84a-22aa84795719 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1473 microversion: 2.1 time: 0.478121 Jul 26 04:31:16.402541 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 683/1439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:15 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1473 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:16.426128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:16.428987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:16.449968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:16.450483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:16.455588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:16.459559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.064961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:17.075671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88dcf4ad-e689-4e15-9368-864ef8c672b5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.662766 Jul 26 04:31:17.078760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 684/1440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:16 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:17.091146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:17.091992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:17.107467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.117472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.118827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.119440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.453511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:17.466718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:17.470945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:17.478728 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c25e72cd-3665-4fe4-949b-9ffb9fc3ad62 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.398644 Jul 26 04:31:17.480464 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 685/1441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:17 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:17.495943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:17.498861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: c0a7d851-35f2-4d64-891b-ebefa161b4ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:17.513809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.514691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.518251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.518966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.542314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] HTTP exception thrown: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Request method failure captured: Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef HTTP/1.1 Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3207TNreXk-FL0GFVzyGHMhVlNlsFfwF-WbHj4vGg3JmJBc9-MZN-n17gf8UFmooBGANRCWt6xB4x9sS-LkPb0Re3BupFG7MZuaTeGhn5F6H49ZQy1Hunkh_W5o7dXRuITNukkZSp1cIC2hakiTzoY6zVTYJ0VD7uxOkA6GUDCtbMcU Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 36672ddcc2c242aabf0d03895b4ee3ed Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:31:17.544372 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 36672ddcc2c242aabf0d03895b4ee3ed Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesAdminNegativeTest-213685342-project Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 152c5727614449b39b6cdb3d3d402c32 Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesAdminNegativeTest-213685342-project Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. Jul 26 04:31:17.545801 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c0a7d851-35f2-4d64-891b-ebefa161b4ef'} Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:17.546934 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. Jul 26 04:31:17.549270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:17.553063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Returning 404 to user: Instance c0a7d851-35f2-4d64-891b-ebefa161b4ef could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:17.554217 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9112714-cf67-4101-9c90-b3729fbd0dd8 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef" status: 404 len: 111 microversion: 2.1 time: 0.072488 Jul 26 04:31:17.555327 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 686/1442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:17 2022] GET /compute/v2.1/servers/c0a7d851-35f2-4d64-891b-ebefa161b4ef => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:17.574926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:17.580276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:17.597622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.603134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:17.604974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:17.605681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:18.240150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:18.258132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51dbabc5-dd3a-4e5a-893b-5f98e7c1ff2e tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1470 microversion: 2.1 time: 0.701411 Jul 26 04:31:18.272239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 687/1443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:17 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1470 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:18.298677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ef985550-938f-4657-95b7-5c3f86b026ba req-a1e28293-d837-42f3-8f58-3486eb8e7187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:18.331068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ef985550-938f-4657-95b7-5c3f86b026ba req-a1e28293-d837-42f3-8f58-3486eb8e7187 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:18.346503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ef985550-938f-4657-95b7-5c3f86b026ba req-a1e28293-d837-42f3-8f58-3486eb8e7187 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:18.389373 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ef985550-938f-4657-95b7-5c3f86b026ba req-a1e28293-d837-42f3-8f58-3486eb8e7187 service nova] Creating event network-vif-unplugged:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:31:18.419983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ef985550-938f-4657-95b7-5c3f86b026ba req-a1e28293-d837-42f3-8f58-3486eb8e7187 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144943 Jul 26 04:31:18.424839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 688/1444] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:18.459070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:18.460613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:18.500666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:18.501585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:18.508044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:18.509510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:19.291988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:19.305211 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-920fb54b-b5f9-4c38-94d9-c8c54639fa0f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.876092 Jul 26 04:31:19.305802 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 689/1445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:18 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:19.351645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:19.371129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:19.409667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:19.410125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:19.427541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:19.428497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:19.834353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e702fb7-a7bd-42d7-a964-85ee3b9f40b2 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 6.256487 Jul 26 04:31:19.835665 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 757/1446] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:13 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 6259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:19.843466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:19.850840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:19.868267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:19.869394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:19.871153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:19.874798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:20.118822 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e3341e7-14e7-47a3-b59e-3f9bb9fcc457 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "POST /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81/action" status: 202 len: 0 microversion: 2.1 time: 0.781405 Jul 26 04:31:20.127400 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 690/1447] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:31:19 2022] POST /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:31:20.178443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:20.179244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:20.217775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:20.218253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:20.229041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:20.229527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:20.445938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:20.456545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:20.458039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:20.501604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-06348784-3d3e-4e14-95bb-089c8b9a0717 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.662181 Jul 26 04:31:20.511100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 758/1448] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:19 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:20.592705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:20.599651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:20.628779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:20.631292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:20.634358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:20.635721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:21.166188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:21.181220 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4d87216-1f2e-4fbf-b1a5-0a1b4d16e2c2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.640516 Jul 26 04:31:21.193504 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 759/1449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:20 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:21.213848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0acf5dcf-f644-4ff5-a2b4-b5576cd8371b req-9c1ba679-5f00-4311-84a4-54823a81ba75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:21.229908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:21.252151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0acf5dcf-f644-4ff5-a2b4-b5576cd8371b req-9c1ba679-5f00-4311-84a4-54823a81ba75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:21.253818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0acf5dcf-f644-4ff5-a2b4-b5576cd8371b req-9c1ba679-5f00-4311-84a4-54823a81ba75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:21.295879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0acf5dcf-f644-4ff5-a2b4-b5576cd8371b req-9c1ba679-5f00-4311-84a4-54823a81ba75 service nova] Creating event network-changed:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:31:21.302113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0acf5dcf-f644-4ff5-a2b4-b5576cd8371b req-9c1ba679-5f00-4311-84a4-54823a81ba75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106932 Jul 26 04:31:21.306667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 760/1450] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:21.327327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-877c1482-a7bf-41c1-a313-46c516cabe0b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5fcb160>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:21.402833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:21.410843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b85e358e-4687-41ba-9379-885e6e83b494 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 1.280705 Jul 26 04:31:21.436532 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 691/1451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:20 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:21.465821 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-877c1482-a7bf-41c1-a313-46c516cabe0b tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.157645 Jul 26 04:31:21.481181 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 761/1452] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:21 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:21.538231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:21.538717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:21.553162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:21.555214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:21.556258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:21.558454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.215693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:22.216442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:22.233452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:22.244985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.249070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:22.257335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.781648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:22.793434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:22.801186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:22.803713 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d621bc61-2b39-4d8b-b92c-8a4b70921dcd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 1.271038 Jul 26 04:31:22.810439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:22.820528 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e31ff552-4aaa-4e75-9b11-085ef6a5671c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 0.609061 Jul 26 04:31:22.828734 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 762/1454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:22 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:22.838431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-plugged", "status": "completed", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:22.839795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 692/1454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:21 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:31:22.873450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:22.874067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:22.876352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:22.885258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.902619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:22.903066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.915412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:22.915988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:22.920683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] Creating event network-vif-plugged:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h2-848886-16 Jul 26 04:31:22.939713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] Instance c0b76d7a-3694-4097-948a-c43cbd851b81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:31:22.995979 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c193178d-a691-433c-8f6d-255d79a39273 req-376039d5-26f9-4f75-904b-78fa72e83336 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165647 Jul 26 04:31:22.999385 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 763/1455] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:23.005228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-982bd2b2-6d07-4be0-ab0e-dc3e9a6a3918 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a92940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:23.158924 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-982bd2b2-6d07-4be0-ab0e-dc3e9a6a3918 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.155981 Jul 26 04:31:23.159901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 764/1456] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:22 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:23.581619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:23.605787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7b0805d-9ac0-4a73-a235-152743e35265 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.756046 Jul 26 04:31:23.640353 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 693/1457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:22 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:23.853987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:23.855481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:23.856158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:23.858718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:23.871584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:23.873535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:23.876655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:23.877601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:23.879856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:23.893551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:23.897115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:23.897576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:24.159339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:24.173075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:24.180923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:24.182189 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db0e06e2-db40-413c-9dff-25dc9e6c4358 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.343842 Jul 26 04:31:24.183089 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 765/1458] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:23 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:24.187923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-690a52ab-d81b-40ea-bb9a-59c9cef12c22 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b63750d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:24.264875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-690a52ab-d81b-40ea-bb9a-59c9cef12c22 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.080466 Jul 26 04:31:24.266456 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 766/1459] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:24 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:24.642249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:24.643184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:24.660809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:24.661685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:24.662696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:24.663289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:24.896474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:24.907375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:24.910771 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac253e3d-cae9-489e-b659-653102fad589 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1515 microversion: 2.1 time: 1.064216 Jul 26 04:31:24.919122 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 694/1460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:23 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1515 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:25.009430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:25.023441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00ec5c7d-359e-46af-9449-f39b0e469a72 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.386230 Jul 26 04:31:25.033535 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 767/1461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:24 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:25.217675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:25.219015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:25.230058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:25.232682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:25.237266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:25.238006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:25.281495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9965ab5c-f5db-4b2c-8b9e-42f45ab78226 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a49ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:25.379568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9965ab5c-f5db-4b2c-8b9e-42f45ab78226 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.102304 Jul 26 04:31:25.387701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 768/1462] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:25 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:25.522496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:25.535587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:25.538052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:25.539270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1528a423-b095-4083-9b8e-6a808b9ceefb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.326227 Jul 26 04:31:25.540152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 695/1463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:25 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:25.940219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:25.940219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:25.965476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:25.966453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:25.971739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:25.983624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:26.059209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:26.060437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:26.071461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:26.074555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:26.076188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:26.078821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:26.352385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:26.363628 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfa530ce-aeac-48ac-b18d-ae3f30413e50 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.309127 Jul 26 04:31:26.365431 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 696/1464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:26 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:26.408833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-451a4004-e0df-4159-821e-932bc82ee898 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38baca3d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:26.488636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-451a4004-e0df-4159-821e-932bc82ee898 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.083819 Jul 26 04:31:26.491747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:26.497019 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 697/1465] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:26 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:26.504459 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ef45ff6-94a5-4893-a3d6-f7495a6ce1af tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1533 microversion: 2.1 time: 0.570084 Jul 26 04:31:26.505078 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 769/1466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:25 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1533 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:27.018811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:27.019605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:27.028740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.042934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.044075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.044690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.092575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:27.140611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:27.141488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:27.159632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.165120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.165999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.178085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.289768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7903a05-085e-48cb-8d2a-1b3065e47180 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "DELETE /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 204 len: 0 microversion: 2.1 time: 0.274586 Jul 26 04:31:27.294882 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 770/1467] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:27 2022] DELETE /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:27.307747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:27.308793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:27.326421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.327273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.328362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.330315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.815986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:27.832235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:27.836462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:27.838350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:27.839772 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7757d151-8cdd-4834-abb9-7b2850a1497c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 1.272787 Jul 26 04:31:27.846186 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a241c23-bea6-4c72-85c5-d5af72aebe26 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1681 microversion: 2.1 time: 0.542909 Jul 26 04:31:27.849451 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 698/1468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:26 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:27.857653 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 771/1469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:27 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1681 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:27.878552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdadcc68-7a72-4c51-91d1-e7d09372b249 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b6190b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:27.883744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:27.884371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:27.905010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.905481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.909105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:27.909966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:27.990188 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bdadcc68-7a72-4c51-91d1-e7d09372b249 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1452 microversion: 2.1 time: 0.122234 Jul 26 04:31:27.991034 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 772/1470] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:27 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:28.005600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:28.022456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:28.040408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.047655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.048906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.057281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.291888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:28.300139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb8e262f-57c6-44e0-a612-db77c479904c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.449180 Jul 26 04:31:28.314351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 699/1471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:27 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:28.361369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:28.366927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:28.373228 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7dcfa4a1-13a1-4da4-8c96-ba4f1afc1fb4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1521 microversion: 2.1 time: 0.381061 Jul 26 04:31:28.384505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 773/1472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:27 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:28.591873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Calling method '.version_select at 0x7f38baca3940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:28.593088 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:31:28.593088 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:31:28.594707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.595504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.625276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.629469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.663934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.667186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.685109 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e7fa168c-5dba-4280-8297-856283e68824 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.369355 Jul 26 04:31:28.686298 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 700/1473] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:31:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:28.697446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Calling method '.version_select at 0x7f38b61d6e50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:28.698452 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:31:28.698452 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:31:28.699795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.700260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.723201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.723724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.739071 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a1ec6a3-13ee-47d1-b8f9-567c1d46a371 tempest-HypervisorAdminV228Test-1854452142 tempest-HypervisorAdminV228Test-1854452142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.038211 Jul 26 04:31:28.742006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 774/1474] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:31:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:28.882103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:28.883148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:28.883779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:28.884947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:28.902746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.904097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.904592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.905505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.906027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.907989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:28.908890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:28.909536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:29.272555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:29.304731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:29.313914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:29.319940 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dba24702-3b55-4105-b63b-80432e7315fb tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.449618 Jul 26 04:31:29.324229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 701/1475] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:28 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:29.344911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:29.355976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-513ddb92-4f82-4429-a78e-c1bf88f96842 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1681 microversion: 2.1 time: 0.482165 Jul 26 04:31:29.359281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 775/1476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:28 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1681 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:29.361034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7be0ac6d-1768-4808-a241-22124043cc87 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad75670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:29.369677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:29.374245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:29.394607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:29.396038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:29.401630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:29.402435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:29.812965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:29.821236 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-597f1d9b-8f1f-48a4-9194-14b617773bfe tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.459867 Jul 26 04:31:29.834259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 776/1477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:29 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:29.839449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:29.846120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:29.877817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:29.882797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:29.887300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:29.891091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:30.913177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:30.929665 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cad53120-8750-4345-b3cc-e89b142b74bb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1521 microversion: 2.1 time: 1.093353 Jul 26 04:31:30.937336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 777/1478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:29 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1521 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:30.955129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:30.956051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:30.982466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:30.983454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:30.984558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:30.987113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:31.916227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:31.937743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:31.939953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:31.945621 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c187ab9-4fe3-4648-b414-c76bc1fc6354 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 1.007063 Jul 26 04:31:31.949890 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 778/1479] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:30 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:31.966859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:31.971580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:31.991902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:31.994879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:32.009328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:32.010127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:32.431162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152c5727614449b39b6cdb3d3d402c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36672ddcc2c242aabf0d03895b4ee3ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:32.446966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cc7d381a-680a-4eae-885e-beeb9ae41f97 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 200 len: 1614 microversion: 2.1 time: 0.495635 Jul 26 04:31:32.449837 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 779/1480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:31 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 1614 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:32.471064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-unplugged", "status": "completed", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:32.510416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:32.516743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:32.553946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] Creating event network-vif-unplugged:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:31:32.574689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] Instance c0b76d7a-3694-4097-948a-c43cbd851b81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:31:32.605417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-75f1f196-3ed3-4531-bce6-f6b80f9dc213 req-c20425e2-7c64-4ca4-ac41-e274869c8458 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151834 Jul 26 04:31:32.607420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 780/1481] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:32.622433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:32.625953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:32.677518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:32.678101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:32.680464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:32.680944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:33.539038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:33.553114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d6b1b755-9e3d-4765-90c5-e057a6804aa5 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.941624 Jul 26 04:31:33.554589 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 781/1482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:32 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:33.559939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a33be149-719e-49fb-9ed5-527d149efdeb req-a71f83a1-930d-4015-9867-513afa1fff2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:33.576139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a33be149-719e-49fb-9ed5-527d149efdeb req-a71f83a1-930d-4015-9867-513afa1fff2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:33.576883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a33be149-719e-49fb-9ed5-527d149efdeb req-a71f83a1-930d-4015-9867-513afa1fff2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:33.603898 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a33be149-719e-49fb-9ed5-527d149efdeb req-a71f83a1-930d-4015-9867-513afa1fff2c service nova] Creating event network-vif-unplugged:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h2-848886-16 Jul 26 04:31:33.609921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a33be149-719e-49fb-9ed5-527d149efdeb req-a71f83a1-930d-4015-9867-513afa1fff2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053713 Jul 26 04:31:33.610789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 782/1483] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:33.632639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:33.634757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:33.644500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:33.645732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:33.647197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:33.648041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.429818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:34.438388 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12dd2250-7605-40fc-bbb4-42a2ff069d40 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1521 microversion: 2.1 time: 0.826165 Jul 26 04:31:34.441224 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 783/1484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:33 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1521 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:34.453834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4351d5da-ff11-402d-ad74-2ab832e51755 req-bc4427b9-9ce5-48ea-a1e1-9bf72c1d0e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a9d026-f007-4d08-9d3d-f64b9a6e536b", "name": "network-vif-deleted", "tag": "7de0d3c4-7692-4f24-ac6e-acfb2c47ed82"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:34.473764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4351d5da-ff11-402d-ad74-2ab832e51755 req-bc4427b9-9ce5-48ea-a1e1-9bf72c1d0e0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.474667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4351d5da-ff11-402d-ad74-2ab832e51755 req-bc4427b9-9ce5-48ea-a1e1-9bf72c1d0e0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.497816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4351d5da-ff11-402d-ad74-2ab832e51755 req-bc4427b9-9ce5-48ea-a1e1-9bf72c1d0e0b service nova] Creating event network-vif-deleted:7de0d3c4-7692-4f24-ac6e-acfb2c47ed82 for instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b on n-h2-848886-16 Jul 26 04:31:34.516865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4351d5da-ff11-402d-ad74-2ab832e51755 req-bc4427b9-9ce5-48ea-a1e1-9bf72c1d0e0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073222 Jul 26 04:31:34.518113 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 784/1485] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:34.527330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:34.532946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:34.546346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.549437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.550589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.555815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.573122 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7be0ac6d-1768-4808-a241-22124043cc87 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1461 microversion: 2.1 time: 5.223887 Jul 26 04:31:34.581938 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 702/1486] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:29 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1461 bytes in 5235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:34.595036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:34.595657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] [instance: 77a9d026-f007-4d08-9d3d-f64b9a6e536b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:34.617887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.618382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.619178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.619624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.667352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] HTTP exception thrown: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Request method failure captured: Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b HTTP/1.1 Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3207TNreXk-FL0GFVzyGHMhVlNlsFfwF-WbHj4vGg3JmJBc9-MZN-n17gf8UFmooBGANRCWt6xB4x9sS-LkPb0Re3BupFG7MZuaTeGhn5F6H49ZQy1Hunkh_W5o7dXRuITNukkZSp1cIC2hakiTzoY6zVTYJ0VD7uxOkA6GUDCtbMcU Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 36672ddcc2c242aabf0d03895b4ee3ed Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:31:34.668913 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_36672ddcc2c242aabf0d03895b4ee3ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 36672ddcc2c242aabf0d03895b4ee3ed Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-213685342 Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesAdminNegativeTest-213685342-project Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 152c5727614449b39b6cdb3d3d402c32 Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesAdminNegativeTest-213685342-project Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. Jul 26 04:31:34.670417 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '77a9d026-f007-4d08-9d3d-f64b9a6e536b'} Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:34.671361 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. Jul 26 04:31:34.672657 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:34.673804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Returning 404 to user: Instance 77a9d026-f007-4d08-9d3d-f64b9a6e536b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:34.673804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9be1b286-0a1b-414e-8812-f779bed91b60 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b" status: 404 len: 111 microversion: 2.1 time: 0.087211 Jul 26 04:31:34.692640 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 703/1487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:34 2022] GET /compute/v2.1/servers/77a9d026-f007-4d08-9d3d-f64b9a6e536b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:34.697506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:34.698114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:34.711950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.713339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.714143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:34.714606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:34.890890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:34.904926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:34.906798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:34.908512 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-253c051b-9b1b-4c09-9380-06fcc77c780b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.387550 Jul 26 04:31:34.909566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 785/1488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:34 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:34.928566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58ff8117-f305-4da8-9ca2-c11a6b56793f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a5a3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:34.937469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:34.952293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8836dead-8f99-4dd2-bed7-ebfa302519e8 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.257955 Jul 26 04:31:34.954104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 704/1489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:34 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:35.005452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58ff8117-f305-4da8-9ca2-c11a6b56793f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 200 len: 1461 microversion: 2.1 time: 0.094517 Jul 26 04:31:35.006463 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 786/1490] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:34 2022] GET /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:35.011225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bcfa4435-78fa-4195-b782-f7814f9dc659 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] Calling method '.version_select at 0x7f38b5b550d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:35.055432 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bcfa4435-78fa-4195-b782-f7814f9dc659 tempest-VolumesAdminNegativeTest-213685342 tempest-VolumesAdminNegativeTest-213685342-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068114541" status: 202 len: 0 microversion: 2.1 time: 0.047662 Jul 26 04:31:35.059976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 787/1491] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068114541 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:31:35.067484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:35.068462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:35.076148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.076862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.077974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.078616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.246021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:35.274136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.274523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.314804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:35.323571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] Creating event network-changed:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:31:35.327114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94ce5a23-64cc-4c91-91b5-409f35b0066e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1480 microversion: 2.1 time: 0.266073 Jul 26 04:31:35.342427 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 788/1492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:35 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1480 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:35.347715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] Instance c0b76d7a-3694-4097-948a-c43cbd851b81 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:31:35.385038 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c39a35fb-d012-418b-9acc-02e7c9c413c6 req-ceda7e66-af03-4dff-9b65-2d3668e6d572 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429326 Jul 26 04:31:35.385647 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 705/1493] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:35.469281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:35.470108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:35.483012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.483667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.485789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.487597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.744019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d8e7b5ed-6a96-48bb-86f2-b4c42000690a req-ea1c4536-b1b7-477a-8c25-cd852e5f430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b180c32-da9e-41e0-87e4-38ce6ad21508", "name": "network-vif-plugged", "status": "completed", "tag": "13a5564a-1362-4d29-8fa8-442be70c1126"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:35.759596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d8e7b5ed-6a96-48bb-86f2-b4c42000690a req-ea1c4536-b1b7-477a-8c25-cd852e5f430d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.761581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d8e7b5ed-6a96-48bb-86f2-b4c42000690a req-ea1c4536-b1b7-477a-8c25-cd852e5f430d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.794361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d8e7b5ed-6a96-48bb-86f2-b4c42000690a req-ea1c4536-b1b7-477a-8c25-cd852e5f430d service nova] Creating event network-vif-plugged:13a5564a-1362-4d29-8fa8-442be70c1126 for instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 on n-h1-848886-16 Jul 26 04:31:35.813617 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d8e7b5ed-6a96-48bb-86f2-b4c42000690a req-ea1c4536-b1b7-477a-8c25-cd852e5f430d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074129 Jul 26 04:31:35.814570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 706/1494] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:35.917515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:35.928317 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-49c5e498-3008-4031-bdd7-94828da38468 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1521 microversion: 2.1 time: 0.466236 Jul 26 04:31:35.929547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 789/1495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:35 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:35.932553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:35.933251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:35.941099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.942362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.944160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.944774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.978993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:35.979603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:35.994761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.995281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:35.996399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:35.996844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:36.131094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:36.141864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:36.149035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:36.150916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-933d6310-5feb-4e5c-bcba-9f707b02944c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.222275 Jul 26 04:31:36.155488 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 707/1496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:35 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:36.401057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-268ebcc7-3b1e-4a38-ad22-20e09c701ee4 tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] Calling method '.version_select at 0x7f38bad5dd30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:36.821240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:36.831484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80988291-a091-4b59-acf9-5cd133a8cc37 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1469 microversion: 2.1 time: 0.858017 Jul 26 04:31:36.849562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 790/1497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:35 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1469 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:36.860258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:36.861051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:36.865219 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-268ebcc7-3b1e-4a38-ad22-20e09c701ee4 tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 8107 microversion: 2.1 time: 0.708305 Jul 26 04:31:36.866280 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 708/1498] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:36 2022] GET /compute/v2.1/os-networks => generated 8107 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:36.873514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:36.874289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:36.876140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:36.876289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3450999d-b760-4fa0-89e0-13f825679d46 tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] Calling method '.version_select at 0x7f38bad5d280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:36.876980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.038273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3450999d-b760-4fa0-89e0-13f825679d46 tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks/75c51b10-d4e1-485c-a436-7f097bc72177" status: 200 len: 652 microversion: 2.1 time: 0.167166 Jul 26 04:31:37.038927 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 709/1499] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:31:36 2022] GET /compute/v2.1/os-networks/75c51b10-d4e1-485c-a436-7f097bc72177 => generated 652 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:37.045998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.046890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:37.056695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.057612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.058663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.059307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.278054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:37.290906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:37.292240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d3abade-304f-4120-a97f-36ed1ab07a53 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1467 microversion: 2.1 time: 0.441045 Jul 26 04:31:37.293229 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 791/1500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:36 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1467 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:37.297941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf48a5d0-b5a0-4999-8e3b-de38324effca tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] Calling method '.version_select at 0x7f38b5a22310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.311041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5481bad1-c855-40e1-b23a-88bb65f69457 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1521 microversion: 2.1 time: 0.270610 Jul 26 04:31:37.311978 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 710/1501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:37.323409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.325111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:37.338933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.339433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.340367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.340800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.521422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:37.534168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:37.536647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:37.538012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ce90035-b4d7-41a1-9486-58b49c1097c5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1811 microversion: 2.25 time: 0.224826 Jul 26 04:31:37.550906 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 711/1502] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1811 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:37.561214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9fe01d0-e79e-4ead-a2e3-2348db93e04e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a3e5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.588030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf48a5d0-b5a0-4999-8e3b-de38324effca tempest-NetworksTest-2010374472 tempest-NetworksTest-2010374472-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 8107 microversion: 2.1 time: 0.293637 Jul 26 04:31:37.589995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 792/1503] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/os-networks => generated 8107 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:37.696758 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9fe01d0-e79e-4ead-a2e3-2348db93e04e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?changes-since=2022-07-26T04%3A29%3A19Z" status: 200 len: 2329 microversion: 2.1 time: 0.144172 Jul 26 04:31:37.697600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 712/1504] 10.222.0.43 () {58 vars in 1199 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/images?changes-since=2022-07-26T04%3A29%3A19Z => generated 2329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:37.715903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a4d45ac-5817-4a71-b9fb-b164b50ca274 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b6190820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.803416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a4d45ac-5817-4a71-b9fb-b164b50ca274 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1630183410" status: 200 len: 485 microversion: 2.1 time: 0.093067 Jul 26 04:31:37.804269 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 793/1505] 10.222.0.43 () {58 vars in 1231 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1630183410 => generated 485 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:37.820084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f51597fc-50b7-4490-80bb-61ec68aaccdc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad75940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.856594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:37.857220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:37.883026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.883490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.889175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:37.891039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:37.971767 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f51597fc-50b7-4490-80bb-61ec68aaccdc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?server=a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 957 microversion: 2.1 time: 0.158305 Jul 26 04:31:37.976248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 713/1506] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/images?server=a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 957 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:37.988313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5712d650-0dff-4a64-8eaa-561cc0ee6963 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a175e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.117136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5712d650-0dff-4a64-8eaa-561cc0ee6963 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 485 microversion: 2.1 time: 0.133263 Jul 26 04:31:38.117926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 714/1507] 10.222.0.43 () {58 vars in 1317 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 485 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:38.131182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46fa6993-9f5c-4034-8041-385f59e63547 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bacb78b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.261647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46fa6993-9f5c-4034-8041-385f59e63547 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 485 microversion: 2.1 time: 0.135839 Jul 26 04:31:38.267937 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 715/1508] 10.222.0.43 () {58 vars in 1303 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 485 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:38.276111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c2a6429-dbdf-4f09-82a2-5820a6691b29 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bac9ba60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.499746 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c2a6429-dbdf-4f09-82a2-5820a6691b29 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.227554 Jul 26 04:31:38.502225 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 716/1509] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:38.508395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.511729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:38.519353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.524337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:38.525804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.538619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:38.639693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:38.655470 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab323b1b-149c-4b21-bf3c-79407596916f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1462 microversion: 2.1 time: 0.805660 Jul 26 04:31:38.656337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 794/1510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:37 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1462 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:38.661283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce37be1f-3d97-48ae-aabf-0f19f01ebfc0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a5a700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.788839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce37be1f-3d97-48ae-aabf-0f19f01ebfc0 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.131214 Jul 26 04:31:38.798972 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 795/1511] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:38.804659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.805456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:38.819633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.820353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:38.821354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.821963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:38.892688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:38.904439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c285389-d09c-465e-a9b6-f5b82abaeb88 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1506 microversion: 2.1 time: 0.400246 Jul 26 04:31:38.905424 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 717/1512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:38.916668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:38.919834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:38.935799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.935799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:38.938648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:38.939214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:39.304952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:39.321252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:39.336747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:39.339558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f727e55a-374b-459e-93f6-f975c18f7775 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1801 microversion: 2.25 time: 0.539373 Jul 26 04:31:39.344252 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 796/1513] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1801 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:39.356781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2aa49544-3c42-471f-b5c7-58deb84739f4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b6097e50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:39.597062 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2aa49544-3c42-471f-b5c7-58deb84739f4 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.251243 Jul 26 04:31:39.605762 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 797/1514] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:39 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:39.610223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:39.616520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:39.632335 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95b498ba-d5a3-4ae4-9ec4-7e2a62e02a33 tempest-MigrationsAdminTest-302300402 tempest-MigrationsAdminTest-302300402-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1615 microversion: 2.1 time: 0.723414 Jul 26 04:31:39.633509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 718/1515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:38 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1615 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:39.644396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:39.645015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:39.645850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:39.648950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:39.733519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:40.181571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:40.197891 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e6c67fd-788a-4f9f-a151-17929b5c466a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 200 len: 1506 microversion: 2.1 time: 0.590569 Jul 26 04:31:40.199922 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 798/1516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:39 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:40.211792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67e1ad81-780f-4876-9846-345bd7edca55 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '.version_select at 0x7f38b5a5adc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.241894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e1ad81-780f-4876-9846-345bd7edca55 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.243510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e1ad81-780f-4876-9846-345bd7edca55 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.273408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67e1ad81-780f-4876-9846-345bd7edca55 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 4084 microversion: 2.25 time: 0.072286 Jul 26 04:31:40.285241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 799/1517] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/os-migrations => generated 4084 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:40.295145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb8954a2-2ec6-4070-867c-87ee6e4d678e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5ef54c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.318066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8fbcd2de-494a-48d5-bc86-29d147edc3be req-509188b5-da7d-4e4a-8eed-6f4100490c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-unplugged", "status": "completed", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:40.345889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8fbcd2de-494a-48d5-bc86-29d147edc3be req-509188b5-da7d-4e4a-8eed-6f4100490c1d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.346591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8fbcd2de-494a-48d5-bc86-29d147edc3be req-509188b5-da7d-4e4a-8eed-6f4100490c1d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.374817 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8fbcd2de-494a-48d5-bc86-29d147edc3be req-509188b5-da7d-4e4a-8eed-6f4100490c1d service nova] Creating event network-vif-unplugged:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:31:40.384123 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8fbcd2de-494a-48d5-bc86-29d147edc3be req-509188b5-da7d-4e4a-8eed-6f4100490c1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.734052 Jul 26 04:31:40.388957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 719/1518] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:40.403673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.404509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:40.421205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.421888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.426819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.427354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.479281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:40.489487 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb8954a2-2ec6-4070-867c-87ee6e4d678e tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?changes-since=2022-07-26T04%3A29%3A15Z" status: 200 len: 7008 microversion: 2.1 time: 0.201762 Jul 26 04:31:40.493784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 800/1519] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-26T04%3A29%3A15Z => generated 7008 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:40.503505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.509019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:40.517419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.522074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.523357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.523968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.622231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:40.713320 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cc93bbc-ed61-4a04-9e1e-ec7bbdeea3eb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 204 len: 0 microversion: 2.1 time: 0.321385 Jul 26 04:31:40.715168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 720/1520] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:40 2022] DELETE /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:40.737032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.737801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:40.749421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.750235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.751742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.753470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.792613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:40.808514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e796fcc-259a-4b02-aede-426bfb9505ab tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 204 len: 0 microversion: 2.1 time: 0.311590 Jul 26 04:31:40.812795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 801/1521] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:40 2022] DELETE /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:40.819403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5961a01-85d8-46a1-8170-8e505857172d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5e81c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.909464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5961a01-85d8-46a1-8170-8e505857172d tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1630183410" status: 200 len: 665 microversion: 2.1 time: 0.095150 Jul 26 04:31:40.921394 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 802/1522] 10.222.0.43 () {58 vars in 1252 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1630183410 => generated 665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:40.928060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:40.929160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:40.936438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.936900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.937693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:40.938141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:40.950348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:40.974263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f012fe2e-5fc1-4351-a400-7eb6713ae13a tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 2421 microversion: 2.25 time: 0.253895 Jul 26 04:31:40.977553 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 721/1523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 2421 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:40.985149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94476110-e191-47a8-953a-e0e75a7b7efb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38baca99d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:41.052949 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-94476110-e191-47a8-953a-e0e75a7b7efb tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1465 microversion: 2.1 time: 0.073661 Jul 26 04:31:41.062695 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 722/1524] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1465 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:41.071393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:41.071393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:41.075465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:41.076208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:41.077002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:41.077444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:41.243221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:41.267983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce3b3e36-acbc-44da-9317-49ebce51da5b tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 2421 microversion: 2.25 time: 0.211654 Jul 26 04:31:41.268723 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 723/1525] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:31:41 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 2421 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:31:41.289111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-942318731", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "79148372-8626-42a1-9ce2-ec3332744087"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:41.357431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:41.376180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5e95273-df08-4c09-9b14-188b470de489 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1468 microversion: 2.1 time: 0.453583 Jul 26 04:31:41.376943 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 803/1526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:40 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:41.380036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] validate_networks() for [('79148372-8626-42a1-9ce2-ec3332744087', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:31:41.401349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f940511a-2157-4886-9fb9-58d449f6c937 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a47430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:41.504692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f940511a-2157-4886-9fb9-58d449f6c937 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1465 microversion: 2.1 time: 0.125937 Jul 26 04:31:41.507794 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 804/1527] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jul 26 04:31:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:41.514951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:41.515666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:41.531648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:41.532414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:41.533375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:41.537437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:41.876525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lazy-loading 'services' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:42.088815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:31:42.089421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:31:42.090000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:31:42.090992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:31:42.091584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:31:42.104900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.105488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.106639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.107184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.121454 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec3b4efb-bd90-427d-98ff-fec710479415 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments/c2ab53a4-245b-486e-a6a3-0f523463c519" status: 202 len: 0 microversion: 2.25 time: 0.611479 Jul 26 04:31:42.125309 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 805/1528] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Jul 26 04:31:41 2022] DELETE /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments/c2ab53a4-245b-486e-a6a3-0f523463c519 => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:42.132146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:31:42.134144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea087a07-5b62-442b-a48d-eab3633c3adc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b55dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.137338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Getting quotas for user baadf645f9914104a5e50c7bced4ffea and project ee165a6fc00141a8bd12a11cba73c653. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:31:42.152118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:31:42.155070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:31:42.231275 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-037a4764-94f8-481a-97a7-c78876afb8c6 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961343 Jul 26 04:31:42.240674 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 724/1529] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:31:42.261506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.272834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:42.295932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.295932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.295932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.295932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.373089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea087a07-5b62-442b-a48d-eab3633c3adc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.249431 Jul 26 04:31:42.376457 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67d8bc53-0beb-4062-a802-736683035a14 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131210 Jul 26 04:31:42.376728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 806/1530] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:42.376813 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 725/1531] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:42.391029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2368ce8d-6b9d-4f29-8978-c65a6cf9067a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.391844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2368ce8d-6b9d-4f29-8978-c65a6cf9067a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:42.400132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46648f0a-25cf-4f49-b649-aaa2a62c51b8 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad7bee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.513844 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46648f0a-25cf-4f49-b649-aaa2a62c51b8 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.117339 Jul 26 04:31:42.514458 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 726/1532] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:42.547224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.547839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:42.556739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:42.595208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.595208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.597080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.599170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.846895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:42.859722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5eb286d-7c4e-43b9-8cdd-6402bf62b75a tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1468 microversion: 2.1 time: 0.344225 Jul 26 04:31:42.860842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 727/1533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1468 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:42.872820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8aad5f14-19e7-4a62-9a63-d83031945f84 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5b0f310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:42.939191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8aad5f14-19e7-4a62-9a63-d83031945f84 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b" status: 200 len: 784 microversion: 2.1 time: 0.075381 Jul 26 04:31:42.939854 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 728/1534] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:42.957468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f2ddeb39-216a-438d-b20d-7e43c6536ff3 req-3a51fc8a-1cdc-46c5-a798-de8f0f9f2ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-plugged", "status": "completed", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:42.972094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f2ddeb39-216a-438d-b20d-7e43c6536ff3 req-3a51fc8a-1cdc-46c5-a798-de8f0f9f2ab2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:42.972522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f2ddeb39-216a-438d-b20d-7e43c6536ff3 req-3a51fc8a-1cdc-46c5-a798-de8f0f9f2ab2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:42.980655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2368ce8d-6b9d-4f29-8978-c65a6cf9067a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:42.990917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2368ce8d-6b9d-4f29-8978-c65a6cf9067a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1217 microversion: 2.1 time: 0.615108 Jul 26 04:31:42.992744 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 807/1535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1217 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:43.002287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b02e0c53-da49-4388-a5c5-a39eb09c8e84 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b617e430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:43.027106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f2ddeb39-216a-438d-b20d-7e43c6536ff3 req-3a51fc8a-1cdc-46c5-a798-de8f0f9f2ab2 service nova] Creating event network-vif-plugged:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:31:43.045444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f2ddeb39-216a-438d-b20d-7e43c6536ff3 req-3a51fc8a-1cdc-46c5-a798-de8f0f9f2ab2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101280 Jul 26 04:31:43.046433 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 729/1536] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:43.084855 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b02e0c53-da49-4388-a5c5-a39eb09c8e84 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 835 microversion: 2.1 time: 0.089203 Jul 26 04:31:43.085789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 808/1537] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:31:42 2022] GET /compute/v2.1/images/detail?limit=1 => generated 835 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:43.106494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16d9f966-498b-4526-bef7-4008c45e0971 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bacdde50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:43.402002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:43.404945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:43.448472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:43.449738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:43.452992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:43.454921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:43.552217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-462351c0-19c3-4afc-83f9-90adcc5c2b08 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151191 Jul 26 04:31:43.555324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 809/1538] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:43 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:31:43.888936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:43.889856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:43.916559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:43.917022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:43.917827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:43.926765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:44.937972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16d9f966-498b-4526-bef7-4008c45e0971 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33" status: 204 len: 0 microversion: 2.1 time: 1.836809 Jul 26 04:31:44.939298 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 730/1539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:43 2022] DELETE /compute/v2.1/images/404baaa3-9f00-4e1c-8742-35fdb6ab4b33 => generated 0 bytes in 1839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:44.946400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:44.949427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:45.268873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:45.280987 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bab1584-4f9f-46b0-af14-6d10781092ec tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 200 len: 1468 microversion: 2.1 time: 1.400765 Jul 26 04:31:45.283884 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 810/1540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:43 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 1468 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:45.295250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:45.307251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:45.321380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:45.333068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:45.336075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:45.336773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:45.425051 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c6b86db-c8d8-40c8-b429-c2d816ca8485 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139607 Jul 26 04:31:45.441987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 811/1541] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:45 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:45.457995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a6ecdbe1-64e1-4cde-9d4c-91a36c4a6272 req-a667060a-6fa9-4e02-9620-d13d3c4ba2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b76d7a-3694-4097-948a-c43cbd851b81", "name": "network-vif-deleted", "tag": "737ed4d7-b11c-403c-9551-abeba532a026"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:45.493796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a6ecdbe1-64e1-4cde-9d4c-91a36c4a6272 req-a667060a-6fa9-4e02-9620-d13d3c4ba2c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:45.498450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a6ecdbe1-64e1-4cde-9d4c-91a36c4a6272 req-a667060a-6fa9-4e02-9620-d13d3c4ba2c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:45.535883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a6ecdbe1-64e1-4cde-9d4c-91a36c4a6272 req-a667060a-6fa9-4e02-9620-d13d3c4ba2c8 service nova] Creating event network-vif-deleted:737ed4d7-b11c-403c-9551-abeba532a026 for instance c0b76d7a-3694-4097-948a-c43cbd851b81 on n-h1-848886-16 Jul 26 04:31:45.569089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:45.569554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:45.570411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:45.570863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:45.572090 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a6ecdbe1-64e1-4cde-9d4c-91a36c4a6272 req-a667060a-6fa9-4e02-9620-d13d3c4ba2c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128014 Jul 26 04:31:45.576422 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 812/1542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:45.886324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:45.898841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e86e1ab-1757-461a-a957-149801db245b tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1275 microversion: 2.1 time: 0.958218 Jul 26 04:31:45.915056 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 731/1543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:44 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1275 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:45.916852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e731f142-93d8-4fd9-bea9-eb7364af020e tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T04%3A31%3A44.920935&end=2022-07-27T04%3A31%3A44.920935" status: 404 len: 112 microversion: - time: 0.338899 Jul 26 04:31:45.917589 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 813/1544] 10.222.0.43 () {58 vars in 1316 bytes} [Tue Jul 26 04:31:45 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T04%3A31%3A44.920935&end=2022-07-27T04%3A31%3A44.920935 => generated 112 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 04:31:45.924735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c66a5d5-da6f-4187-b832-4fa73ca26466 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5a1ef70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:45.928774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b988fe2c-624a-4286-9548-67d4205a73eb tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] Calling method '.version_select at 0x7f38b6189700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:45.951104 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b988fe2c-624a-4286-9548-67d4205a73eb tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b988fe2c-624a-4286-9548-67d4205a73eb tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] Request method failure captured: Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-simple-tenant-usage/627031ba13124198afc851d816d1c40b?start=2022-07-27T04%3A31%3A44.920935&end=2022-07-25T04%3A31%3A44.920935 HTTP/1.1 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi324w6uD2oB7pmICJDyxYO8Ru5Dkc5yTwqQ3pLBakD9nXlhIc8NTwkpw7-WRgiIK4OyyGhtUwu7zkBty-g0GBHHjswu-A7f7CWBDNBWs4DLIVBnF_ja7DvBaquxll0xZfPanSpV7KCzxMWqRwCYYkEdZEyrNvfJYqBGtOODRwh2hqG2M Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 9ba57f9b110942b3b005035ed42d9cb1 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-700341942 Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:31:45.966830 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ba57f9b110942b3b005035ed42d9cb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ba57f9b110942b3b005035ed42d9cb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ba57f9b110942b3b005035ed42d9cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ba57f9b110942b3b005035ed42d9cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-700341942 Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 9ba57f9b110942b3b005035ed42d9cb1 Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-700341942 Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TenantUsagesNegativeTestJSON-700341942-project-admin Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 0f5ecd4ce5424c7bb8da70dfcec58c6d Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-700341942-project-admin Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid start time. The start time cannot occur after the end time. Jul 26 04:31:45.968418 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '627031ba13124198afc851d816d1c40b'} Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 04:31:45.969202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b988fe2c-624a-4286-9548-67d4205a73eb tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:45.970841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b988fe2c-624a-4286-9548-67d4205a73eb tempest-TenantUsagesNegativeTestJSON-700341942 tempest-TenantUsagesNegativeTestJSON-700341942-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/627031ba13124198afc851d816d1c40b?start=2022-07-27T04%3A31%3A44.920935&end=2022-07-25T04%3A31%3A44.920935" status: 400 len: 111 microversion: 2.1 time: 0.044895 Jul 26 04:31:45.971586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 814/1545] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jul 26 04:31:45 2022] GET /compute/v2.1/os-simple-tenant-usage/627031ba13124198afc851d816d1c40b?start=2022-07-27T04%3A31%3A44.920935&end=2022-07-25T04%3A31%3A44.920935 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:31:46.203115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58a790af-c98f-4eae-886a-4a0ea322da0d tempest-TenantUsagesNegativeTestJSON-1696666608 tempest-TenantUsagesNegativeTestJSON-1696666608-project] Calling method '.version_select at 0x7f38b59afaf0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:46.213786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-58a790af-c98f-4eae-886a-4a0ea322da0d tempest-TenantUsagesNegativeTestJSON-1696666608 tempest-TenantUsagesNegativeTestJSON-1696666608-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '2b6f4462105c4f0ca4fff3b412cd0dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627031ba13124198afc851d816d1c40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58a790af-c98f-4eae-886a-4a0ea322da0d tempest-TenantUsagesNegativeTestJSON-1696666608 tempest-TenantUsagesNegativeTestJSON-1696666608-project] Request method failure captured: Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T04%3A31%3A44.920935&end=2022-07-27T04%3A31%3A44.920935&detailed=1 HTTP/1.1 Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi324v04o9aLjlfySLTJRX3xxueeghI8dCd0sHtB-8fubH1cbk5KZhAU_0271g5J3zv_mQTeDHUOQKMHY_9SEPoLV7j1GuUtlSStHzMSi2q1BPDIfP7pSyahSbIk-PI-iXH-KIWTc5157iRcwrmj1gn9ZMQx6B1GOZ7xkZHSA9rPpMz_s Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 627031ba13124198afc851d816d1c40b Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1696666608 Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:31:46.229447 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/627031ba13124198afc851d816d1c40b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/627031ba13124198afc851d816d1c40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/627031ba13124198afc851d816d1c40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_627031ba13124198afc851d816d1c40b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1696666608 Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 627031ba13124198afc851d816d1c40b Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1696666608 Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TenantUsagesNegativeTestJSON-1696666608-project Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b6f4462105c4f0ca4fff3b412cd0dab Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1696666608-project Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:31:46.231166 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:31:46.232577 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:31:46.234719 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:31:46.236887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 04:31:46.236887 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.240800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58a790af-c98f-4eae-886a-4a0ea322da0d tempest-TenantUsagesNegativeTestJSON-1696666608 tempest-TenantUsagesNegativeTestJSON-1696666608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:46.242207 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58a790af-c98f-4eae-886a-4a0ea322da0d tempest-TenantUsagesNegativeTestJSON-1696666608 tempest-TenantUsagesNegativeTestJSON-1696666608-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T04%3A31%3A44.920935&end=2022-07-27T04%3A31%3A44.920935&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.262936 Jul 26 04:31:46.243442 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 815/1546] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Jul 26 04:31:45 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T04%3A31%3A44.920935&end=2022-07-27T04%3A31%3A44.920935&detailed=1 => generated 123 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:46.315281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:46.318012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: c0b76d7a-3694-4097-948a-c43cbd851b81] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:46.335291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.336015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:46.337116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.339431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:46.376904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] HTTP exception thrown: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Request method failure captured: Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 HTTP/1.1 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfUyJfjjC0XKFGiz71MwNH8V9XcG1xCCb1a0tO6zQ-vzb18FZnol7yIGlzHYh2Rx-CkIzsifW5tNN44PNaii5eAbqubFRYTZ8Q-yHc0_naVUqZm-X3BUZOiRW4ynYQ3zfTMYHDCT-9QASGP_RgzP4o5Gb4q5uR4cnkTvU4wbnWT_I Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:31:46.395514 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4e213406df9b410c83cedd80196bba85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4e213406df9b410c83cedd80196bba85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-MigrationsAdminTest-670480508-project Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e78dffc5209d4419b76a331b743475fe Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-MigrationsAdminTest-670480508-project Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. Jul 26 04:31:46.397286 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c0b76d7a-3694-4097-948a-c43cbd851b81'} Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:46.398306 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. Jul 26 04:31:46.399785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:46.404417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Returning 404 to user: Instance c0b76d7a-3694-4097-948a-c43cbd851b81 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:46.407649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f740d46-4858-430d-b9fc-61652640e36f tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81" status: 404 len: 111 microversion: 2.1 time: 0.099226 Jul 26 04:31:46.409746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 816/1547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:46 2022] GET /compute/v2.1/servers/c0b76d7a-3694-4097-948a-c43cbd851b81 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:46.423270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:46.425069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:46.467151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.470668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:46.473657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.475298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:46.587304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:46.867199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a850926b-daa5-47dd-86df-bf9d723f2155 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 204 len: 0 microversion: 2.1 time: 0.451773 Jul 26 04:31:46.867791 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 817/1548] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:46 2022] DELETE /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:46.888421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:46.893746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:46.903835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:46.944937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.946771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:46.950918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:46.953852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.055102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-047fb130-f12d-48b7-b11a-ce7fb6e79e8d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.184353 Jul 26 04:31:47.056835 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 818/1549] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:46 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:47.072587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8ad7c647-28af-4b1e-b8a7-2894ba3e07a0 req-d58e0bdb-6eeb-43d4-a5d9-9848fdb62441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b180c32-da9e-41e0-87e4-38ce6ad21508", "name": "network-vif-deleted", "tag": "13a5564a-1362-4d29-8fa8-442be70c1126"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:47.099920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8ad7c647-28af-4b1e-b8a7-2894ba3e07a0 req-d58e0bdb-6eeb-43d4-a5d9-9848fdb62441 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.101403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8ad7c647-28af-4b1e-b8a7-2894ba3e07a0 req-d58e0bdb-6eeb-43d4-a5d9-9848fdb62441 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.118751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8ad7c647-28af-4b1e-b8a7-2894ba3e07a0 req-d58e0bdb-6eeb-43d4-a5d9-9848fdb62441 service nova] Creating event network-vif-deleted:13a5564a-1362-4d29-8fa8-442be70c1126 for instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 on n-h1-848886-16 Jul 26 04:31:47.145624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8ad7c647-28af-4b1e-b8a7-2894ba3e07a0 req-d58e0bdb-6eeb-43d4-a5d9-9848fdb62441 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086800 Jul 26 04:31:47.151604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 819/1550] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:47.166377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:47.167690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:47.191025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.194438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.196535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.198440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.407814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2c66a5d5-da6f-4187-b832-4fa73ca26466 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5" status: 204 len: 0 microversion: 2.1 time: 1.491407 Jul 26 04:31:47.408663 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 732/1551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:45 2022] DELETE /compute/v2.1/images/1f56be0e-180d-41f3-aea2-f5e4c4e32ed5 => generated 0 bytes in 1493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:47.419982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:47.420944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:47.430205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.431011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.432243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.432921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.611715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:47.623652 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed44f0f7-a368-425f-b8b0-9757c1a2a096 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1535 microversion: 2.1 time: 0.207411 Jul 26 04:31:47.625106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 733/1552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:47 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:47.631296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:47.632244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:47.640178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.641755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.641891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:47.642493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:47.891181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:47.906459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1e5d7c4-fe12-4dec-8e41-c1983c437a4a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.279429 Jul 26 04:31:47.907416 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 734/1553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:47 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:47.913274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41ef7323-f31c-4f09-bab0-c4884e474caa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad7b160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:47.978261 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65a3553c-c8c3-4eb6-bf14-1abc95a2a336 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1815 microversion: 2.1 time: 0.818599 Jul 26 04:31:47.980974 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 820/1554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:47 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1815 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:48.006402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:48.011549 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:31:48.011549 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:31:48.013350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.014424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.017071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.019722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.068511 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e6cc582-1977-4d62-b0b3-d61c4a933b3a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.066370 Jul 26 04:31:48.086597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 821/1555] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:31:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:48.091890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:48.100532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:48.112298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.121304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.122398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.122994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.196895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76f3bba2-2c7f-4d2f-9a47-6b4167bfde6d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108634 Jul 26 04:31:48.198938 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 822/1556] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:48 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:48.647535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:48.648375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:48.672187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.674399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.687626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:48.688436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:48.761152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:49.542687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:49.554857 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41869df6-99c0-4c69-b08e-fb406a79ab4c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1535 microversion: 2.1 time: 0.912345 Jul 26 04:31:49.562636 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 823/1557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:48 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1535 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:49.574178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:49.574817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:49.599212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.599498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.600143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.600583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.731513 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41ef7323-f31c-4f09-bab0-c4884e474caa tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875" status: 204 len: 0 microversion: 2.1 time: 1.809009 Jul 26 04:31:49.731513 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 735/1558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:47 2022] DELETE /compute/v2.1/images/cbeee472-939a-49e7-9bf5-34480a8d5875 => generated 0 bytes in 1810 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:49.731513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:49.731513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:49.743224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.751087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.752217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.752831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.801061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2647f3f2-ba46-435c-808f-cbdc06e1205d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080495 Jul 26 04:31:49.801993 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 736/1559] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:49 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:49.807456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:49.807961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:49.815281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.815745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.817301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:49.817750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:49.867960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:50.096482 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e6bd730-19c7-41a6-8a9a-83ff60463ce5 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 204 len: 0 microversion: 2.1 time: 0.293153 Jul 26 04:31:50.099236 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 737/1560] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:49 2022] DELETE /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:50.124720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:50.134614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:50.167670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.168131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.168938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.169387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.456039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:50.467107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-884361b3-07e4-4483-9608-d50f0bdf0c02 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1473 microversion: 2.1 time: 0.362483 Jul 26 04:31:50.470199 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 738/1561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:50 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:50.578379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:50.578997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:50.590041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.590041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.591207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.592118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.793913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:50.818541 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6509cc97-79a7-4c13-892f-c0e3fa51f95d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 1.254604 Jul 26 04:31:50.820115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 824/1562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:49 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:50.826387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:50.829760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:50.841722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.842207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.843686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:50.845313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:50.902797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:50.917977 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8351d33a-1eb5-4661-bd2d-1bcc4f4ee217 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1535 microversion: 2.1 time: 0.342009 Jul 26 04:31:50.918638 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 739/1563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:50 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1535 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:50.937720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef88aec4-af5b-4216-9f1d-25080cf6988d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116202 Jul 26 04:31:50.938622 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 825/1564] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:50 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:51.494586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:51.496434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:51.508608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:51.510679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:51.511907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:51.514579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:51.872846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b37a4f69-fe42-408e-bb69-bf02cab8a150 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Action: 'create', calling method: .version_select at 0x7f38baccb9d0>, body: {"keypair": {"name": "tempest-keypair-509040463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOGDXNcjMp/9YNocLvCCB2+M8oSemLKZhTrvah1cQCv4/B/9YO11sOMoJzDU/QNADvOitzORwlbRV323y/s7BflutXZZhYnd7n4N6pDTslNK50DUeua/kK55+u4fAuezA=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:51.895596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b37a4f69-fe42-408e-bb69-bf02cab8a150 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Getting quotas for project e800d69d45344db3b81768036fb2484c. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:31:51.900686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b37a4f69-fe42-408e-bb69-bf02cab8a150 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Getting quotas for user 63b834d3a2c84d8b96cc2312f76d4468 and project e800d69d45344db3b81768036fb2484c. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:31:51.934985 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b37a4f69-fe42-408e-bb69-bf02cab8a150 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.452761 Jul 26 04:31:51.937894 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 740/1565] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:31:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:51.949414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-02661ac1-a891-416d-b6bb-843cebd7f691 req-4b898b19-0c5c-47dc-9257-407a43d458cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd05404-0fa8-4fe7-a558-d7ce7ee4336a", "name": "network-vif-deleted", "tag": "6f4edb2d-2a68-462d-aa23-29cd2e865ab7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:51.962222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-02661ac1-a891-416d-b6bb-843cebd7f691 req-4b898b19-0c5c-47dc-9257-407a43d458cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:51.962987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-02661ac1-a891-416d-b6bb-843cebd7f691 req-4b898b19-0c5c-47dc-9257-407a43d458cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:51.976167 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-02661ac1-a891-416d-b6bb-843cebd7f691 req-4b898b19-0c5c-47dc-9257-407a43d458cc service nova] Creating event network-vif-deleted:6f4edb2d-2a68-462d-aa23-29cd2e865ab7 for instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a on n-h1-848886-16 Jul 26 04:31:51.982593 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-02661ac1-a891-416d-b6bb-843cebd7f691 req-4b898b19-0c5c-47dc-9257-407a43d458cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038415 Jul 26 04:31:51.983840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 741/1566] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:51.991217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:51.992683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:51.999949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.000698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.001734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.002396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.105990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:52.119113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d09ed774-b327-4a27-8a93-6cd12dec693f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1473 microversion: 2.1 time: 0.634486 Jul 26 04:31:52.131495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:52.132397 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 826/1567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:51 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.236456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c22e9e7-b9af-470b-8f4b-116b816a2a4f tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.248865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c22e9e7-b9af-470b-8f4b-116b816a2a4f tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.114127 Jul 26 04:31:52.250481 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 827/1568] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:52.257764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.258800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:52.268421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.272310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.273581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.274239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.328725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.330289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.330993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lazy-loading 'fault' on Instance uuid 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:52.447520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:52.457399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27e93151-4ff4-4b23-8b82-175d401b9776 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 200 len: 1369 microversion: 2.1 time: 0.204195 Jul 26 04:31:52.458344 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 828/1569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.483696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.490985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:52.504293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.504756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.504902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:52.505560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.506023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.518517 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95360ab2-f601-4c55-a95c-f3ea0be2cd00 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.533139 Jul 26 04:31:52.520097 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 742/1570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:51 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.530676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f6c1694-b295-4d36-9e62-8a2fb10eec33", "device": "/dev/xvdb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:52.539705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:52.548076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.553167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.555469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:52.557237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:52.574586 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-903b4220-cd21-45b8-8a88-0a9738daffa3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098902 Jul 26 04:31:52.575814 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 829/1571] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:31:52.582203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-838a75a1-e688-4068-9ac0-576ac4949cd3 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.620116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-838a75a1-e688-4068-9ac0-576ac4949cd3 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.042929 Jul 26 04:31:52.630452 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 830/1572] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.639848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a1bcc14-8e57-4ae8-98a6-ba51a4303a67 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.655800 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a1bcc14-8e57-4ae8-98a6-ba51a4303a67 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023829 Jul 26 04:31:52.664765 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 831/1573] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:52.671098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-037af840-9ab8-4ade-b2a6-7ff1692f64cb tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.681500 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-037af840-9ab8-4ade-b2a6-7ff1692f64cb tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014141 Jul 26 04:31:52.682412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 832/1574] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:52.694708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad7712b8-1fb8-4c7d-8736-ab1f117de1d2 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.744997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad7712b8-1fb8-4c7d-8736-ab1f117de1d2 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.054851 Jul 26 04:31:52.746637 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 833/1575] 10.222.0.43 () {58 vars in 1165 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.773921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26da261f-e0ad-4620-b30e-15251ddc9981 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.785826 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26da261f-e0ad-4620-b30e-15251ddc9981 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023820 Jul 26 04:31:52.787197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 834/1576] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:52.805184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd1f8e36-854f-4e50-964c-da520b7ca6c8 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.821688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:52.845647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd1f8e36-854f-4e50-964c-da520b7ca6c8 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.049320 Jul 26 04:31:52.848159 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 835/1577] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:52.868260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36269d2a-8a00-4abd-a2ce-79a6aef95fef tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.891827 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36269d2a-8a00-4abd-a2ce-79a6aef95fef tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032077 Jul 26 04:31:52.903045 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 836/1578] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:52.908806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5ce71c5-f6b4-4c85-ba7a-1073e08a5708 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.919998 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5ce71c5-f6b4-4c85-ba7a-1073e08a5708 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015556 Jul 26 04:31:52.920997 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 837/1579] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:52.940334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d0dcb29-54ed-4af8-9def-0e3bbf2a633d tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:52.990238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:53.008380 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d0dcb29-54ed-4af8-9def-0e3bbf2a633d tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.077618 Jul 26 04:31:53.019830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 838/1580] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:31:52 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.031111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ddd64d4-8cb4-417f-9202-17d35f109bf4 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.042842 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ddd64d4-8cb4-417f-9202-17d35f109bf4 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020514 Jul 26 04:31:53.053062 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 839/1581] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:53.069875 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c39b0122-afc1-47e8-ab00-518e35a3d9b2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548413 Jul 26 04:31:53.072095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14148538-215a-4c27-bac1-c0a5bac0522e tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.081337 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 743/1582] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:31:52 2022] POST /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:53.107908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14148538-215a-4c27-bac1-c0a5bac0522e tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.049215 Jul 26 04:31:53.118219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 840/1583] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.127137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9cd64a0-9eb1-4327-a7f4-f583a43c336f tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.137694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9cd64a0-9eb1-4327-a7f4-f583a43c336f tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015414 Jul 26 04:31:53.138731 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 744/1584] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:53.146278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.147044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:53.162420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.162891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.163678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.164116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.168098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f4b937d-09d5-4221-b970-335aea1c387c tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.199643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f4b937d-09d5-4221-b970-335aea1c387c tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.040066 Jul 26 04:31:53.200663 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 745/1585] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.224363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a92b26c1-966e-4cb0-8f8d-a9d00778963a tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.244476 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a92b26c1-966e-4cb0-8f8d-a9d00778963a tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025148 Jul 26 04:31:53.244476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 746/1586] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:53.256702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4103676-d1a4-4b4a-b41a-e4e5e03b411e tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.266933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4103676-d1a4-4b4a-b41a-e4e5e03b411e tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013414 Jul 26 04:31:53.268123 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 747/1587] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:31:53.285289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ad9f94f-dd67-426b-a7ae-caf61dea2934 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.293268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:53.306240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9634eb04-d91f-4eb6-b4c7-84181dcd126a tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1431 microversion: 2.1 time: 0.163851 Jul 26 04:31:53.307022 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 841/1588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1431 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.341201 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ad9f94f-dd67-426b-a7ae-caf61dea2934 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.063166 Jul 26 04:31:53.341795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 748/1589] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:31:53.355561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70913f78-1c9a-4b76-887b-28fb47ba7a75 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.377398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-70913f78-1c9a-4b76-887b-28fb47ba7a75 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025349 Jul 26 04:31:53.381630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 842/1590] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.398321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2fc3539f-bb4c-4456-acc8-2c73698d3246 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.407501 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2fc3539f-bb4c-4456-acc8-2c73698d3246 tempest-FlavorsV2TestJSON-212113718 tempest-FlavorsV2TestJSON-212113718-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014553 Jul 26 04:31:53.416525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 749/1591] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:53.489406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.490316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:53.513531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.515310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.518647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.519376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.554581 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] HTTP exception thrown: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Request method failure captured: Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a HTTP/1.1 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zfUyJfjjC0XKFGiz71MwNH8V9XcG1xCCb1a0tO6zQ-vzb18FZnol7yIGlzHYh2Rx-CkIzsifW5tNN44PNaii5eAbqubFRYTZ8Q-yHc0_naVUqZm-X3BUZOiRW4ynYQ3zfTMYHDCT-9QASGP_RgzP4o5Gb4q5uR4cnkTvU4wbnWT_I Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:31:53.562970 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4e213406df9b410c83cedd80196bba85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4e213406df9b410c83cedd80196bba85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MigrationsAdminTest-670480508-project Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: e78dffc5209d4419b76a331b743475fe Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MigrationsAdminTest-670480508-project Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. Jul 26 04:31:53.564763 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '5cd05404-0fa8-4fe7-a558-d7ce7ee4336a'} Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:53.565662 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. Jul 26 04:31:53.567755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:31:53.572585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Returning 404 to user: Instance 5cd05404-0fa8-4fe7-a558-d7ce7ee4336a could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:53.575838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7f6b207-df3b-49cd-a144-a75d723829d6 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a" status: 404 len: 111 microversion: 2.1 time: 0.100010 Jul 26 04:31:53.592317 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 750/1592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/servers/5cd05404-0fa8-4fe7-a558-d7ce7ee4336a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:53.604977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a92a1838-eb9e-45bd-b096-c64ec0eeadd7 req-b8809185-0bdd-4729-99a9-c7d8a0d34958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e46c6d2-15c9-4d22-88ab-46713a88a208", "name": "network-vif-deleted", "tag": "d6fc979e-4b1a-4de9-b284-53e7a6b1dd03"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:53.611569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.612300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:53.629144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a92a1838-eb9e-45bd-b096-c64ec0eeadd7 req-b8809185-0bdd-4729-99a9-c7d8a0d34958 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.630373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a92a1838-eb9e-45bd-b096-c64ec0eeadd7 req-b8809185-0bdd-4729-99a9-c7d8a0d34958 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.631684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.632145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.632927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.635592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.660574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a92a1838-eb9e-45bd-b096-c64ec0eeadd7 req-b8809185-0bdd-4729-99a9-c7d8a0d34958 service nova] Creating event network-vif-deleted:d6fc979e-4b1a-4de9-b284-53e7a6b1dd03 for instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 on n-h2-848886-16 Jul 26 04:31:53.676202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a92a1838-eb9e-45bd-b096-c64ec0eeadd7 req-b8809185-0bdd-4729-99a9-c7d8a0d34958 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232204 Jul 26 04:31:53.679746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 843/1593] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:53.693300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.699094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:53.712281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.717361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.718401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:53.719303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:53.781856 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-211d71f9-95a0-4718-a4ef-0da7580af6d5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.099940 Jul 26 04:31:53.783063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 844/1594] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:53.801384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6668cc5e-8e48-4b48-8844-c6ba66c418ad tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '.version_select at 0x7f38b5ee85e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:53.886885 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6668cc5e-8e48-4b48-8844-c6ba66c418ad tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807465575" status: 202 len: 0 microversion: 2.1 time: 0.101070 Jul 26 04:31:53.888918 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 845/1595] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807465575 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:31:54.048431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4987671d-f925-4a3c-a65e-b4b1605a7dca req-aa36273e-a471-4d08-b30e-2e1f78c3cca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f3f1a3c-1b06-40cd-883d-a748a501f4d6", "tag": "245956b2-14f0-4c23-8049-57695917d889"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:54.080108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4987671d-f925-4a3c-a65e-b4b1605a7dca req-aa36273e-a471-4d08-b30e-2e1f78c3cca5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:54.080673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4987671d-f925-4a3c-a65e-b4b1605a7dca req-aa36273e-a471-4d08-b30e-2e1f78c3cca5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:54.101363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4987671d-f925-4a3c-a65e-b4b1605a7dca req-aa36273e-a471-4d08-b30e-2e1f78c3cca5 service nova] Creating event network-changed:245956b2-14f0-4c23-8049-57695917d889 for instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 on n-h2-848886-16 Jul 26 04:31:54.104195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:54.113067 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-219f9de5-79db-4e74-9034-04ff640521f2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.517253 Jul 26 04:31:54.120444 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 751/1596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:53 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:54.139140 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4987671d-f925-4a3c-a65e-b4b1605a7dca req-aa36273e-a471-4d08-b30e-2e1f78c3cca5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090531 Jul 26 04:31:54.140667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 846/1597] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:31:54.337927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:54.338756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:54.350273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:54.350736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:54.351732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:54.352888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:54.428089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:54.428535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:54.428994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lazy-loading 'fault' on Instance uuid 8e46c6d2-15c9-4d22-88ab-46713a88a208 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:54.576680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:54.589656 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d5af5e6-90c8-47dd-83a6-8e78d4763fa3 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1308 microversion: 2.1 time: 0.253157 Jul 26 04:31:54.590568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 752/1598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:54 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:55.138287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:55.139260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:55.152478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.158805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.160653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.161236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.445596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:55.446400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:55.470086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.470541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.472484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.472947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.521986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:55.679889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e12ab60-d42f-4d9d-be80-ae216a4db6ee tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 204 len: 0 microversion: 2.1 time: 0.238035 Jul 26 04:31:55.680901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 753/1599] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:55 2022] DELETE /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:31:55.693314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:55.696200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:55.716958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.717670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.719106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.719561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.732551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:55.782558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-60e3fdba-7fc2-418e-89f8-91f10b174fd3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.645704 Jul 26 04:31:55.784591 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 847/1600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:55 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:55.806907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.807137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:55.807765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.808366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lazy-loading 'fault' on Instance uuid 8e46c6d2-15c9-4d22-88ab-46713a88a208 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:31:55.812771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:55.828533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.829082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.830831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:55.831807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:55.899679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:55.912985 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5fa641f3-5f90-4014-8782-ee98694c87dc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 200 len: 1308 microversion: 2.1 time: 0.226944 Jul 26 04:31:55.915841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 754/1601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:55 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:56.357401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:56.375232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20961e27-e0e6-4a8e-b169-b7d6ed693af4 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1467 microversion: 2.1 time: 0.581851 Jul 26 04:31:56.375869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 848/1602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:55 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1467 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:56.675322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-568497897", "imageRef": "a6261816-e759-49e2-abac-3bf447570c5c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2e176a22-5b2f-46ff-90a7-2e30337e3b59"}], "security_groups": [{"name": "tempest-securitygroup--1072212549"}], "key_name": "tempest-keypair-509040463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:31:56.810888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:56.811892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:56.826182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:56.827741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:56.830235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:56.833789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.162456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] validate_networks() for [('2e176a22-5b2f-46ff-90a7-2e30337e3b59', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:31:57.167190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:57.187838 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71024e4c-0cfb-4852-93e8-3494d1e045fb tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.383577 Jul 26 04:31:57.189387 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 849/1603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:56 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:57.197560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:57.202982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: 8e46c6d2-15c9-4d22-88ab-46713a88a208] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:57.224007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.225945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.226855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.227329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.266345 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] HTTP exception thrown: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Request method failure captured: Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 HTTP/1.1 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi322aUlXXEExny7TLrlZ_5E1ysUtE_2B0613wmMaHIWPb8L6Q92YsKlL8avmyrdd0XwHSu6sWoX3_lpkw3OgjKBG1Qu6rVLXal5NNK7wHGkoRGu3n3OzpodkLK0-T5HT2XLX2Ec_VArxJqEWj9smMZU24JyjiSvB5N1bPTzeAGpAPnkA Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8a6fbc239a6f4a4b80e5ba267fdb3e61 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:31:57.267984 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8a6fbc239a6f4a4b80e5ba267fdb3e61 Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListImageFiltersTestJSON-651377738-project Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14044a2c939440da9b93daeb4e21242b Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListImageFiltersTestJSON-651377738-project Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. Jul 26 04:31:57.270559 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8e46c6d2-15c9-4d22-88ab-46713a88a208'} Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:31:57.271463 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. Jul 26 04:31:57.273090 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:31:57.276738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Returning 404 to user: Instance 8e46c6d2-15c9-4d22-88ab-46713a88a208 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:31:57.277679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a4beb9e0-8503-47da-9741-dc9e4e56b754 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208" status: 404 len: 111 microversion: 2.1 time: 0.086926 Jul 26 04:31:57.283139 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 850/1604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:57 2022] GET /compute/v2.1/servers/8e46c6d2-15c9-4d22-88ab-46713a88a208 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:31:57.310375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:57.311145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:57.322757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.324131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.326195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.327364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.380110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:31:57.544160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ca0e5f6-2b50-4244-b35b-a91164390d51 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 204 len: 0 microversion: 2.1 time: 0.250607 Jul 26 04:31:57.550839 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 851/1605] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:31:57 2022] DELETE /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:31:57.556625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:57.557781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:57.568060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.568903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.569926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.570566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.879450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:57.898857 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d45abcf-06fa-4cc4-a19c-7de2ffaaf75c tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1467 microversion: 2.1 time: 0.341763 Jul 26 04:31:57.900499 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 852/1606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:57 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:57.911658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:57.912596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:57.926175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.926885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:57.927843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:57.928445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.043963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:58.347247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:58.384207 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01d4b3ae-2049-48d3-8112-55c5acc56214 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1473 microversion: 2.1 time: 0.482389 Jul 26 04:31:58.398540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 853/1607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:57 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1473 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:58.404947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:58.405561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:58.426711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.429779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.432165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.432165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.451214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:31:58.636231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:31:58.637669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:31:58.638425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:31:58.639125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:31:58.639552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:31:58.664147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.664937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.666768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.667896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.743965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Getting quotas for project e800d69d45344db3b81768036fb2484c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:31:58.762589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Getting quotas for user 63b834d3a2c84d8b96cc2312f76d4468 and project e800d69d45344db3b81768036fb2484c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:31:58.792737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:31:58.795676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6261816-e759-49e2-abac-3bf447570c5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:31:58.827776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:58.848003 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-589f44a0-346a-40d5-8d9b-5ff27fd162b8 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.452417 Jul 26 04:31:58.850702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 854/1608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:58 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:58.904272 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ee990e4-19d5-465b-8058-da77099f89c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.232929 Jul 26 04:31:58.905076 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 755/1609] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:31:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:31:58.916517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f14baad-ff3b-429b-a716-a2369b54de76 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:58.917276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f14baad-ff3b-429b-a716-a2369b54de76 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:58.926794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:58.927661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:58.936101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.936923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:58.937880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:58.938705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:59.040649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0f14baad-ff3b-429b-a716-a2369b54de76 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:59.051343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f14baad-ff3b-429b-a716-a2369b54de76 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1244 microversion: 2.1 time: 0.138744 Jul 26 04:31:59.063463 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 855/1610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:58 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:59.232320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:31:59.258314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c01e6cf0-990a-41a8-94f9-df9c0d613c5b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1467 microversion: 2.1 time: 0.335420 Jul 26 04:31:59.262355 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 756/1611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:58 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1467 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:31:59.405461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:59.406080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:59.439260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:59.442611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:59.444087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:59.444947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:59.872197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:31:59.872902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:31:59.904119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:59.905080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:31:59.908436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:31:59.909185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:00.513013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:00.523166 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9232ea5-fd5b-4d59-b814-93881411e5c1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.655801 Jul 26 04:32:00.543263 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 757/1612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:59 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:00.550931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:00.563423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:00.571378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:00.572044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:00.573010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:00.578829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:00.711242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:00.719779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cca6ba7b-a520-42f1-9c64-258cf5e39b12 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1473 microversion: 2.1 time: 1.318377 Jul 26 04:32:00.726243 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 856/1613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:31:59 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1473 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:00.731418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:00.734483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:00.747257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:00.749415 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca0239a9-eb77-4e72-8a19-b0b158dee805 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1304 microversion: 2.1 time: 0.204787 Jul 26 04:32:00.771000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:00.771480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:00.772300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:00.772746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:00.782317 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 758/1614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:00 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:01.548197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:01.548819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:01.566989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:01.605915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:01.606577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:01.615436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:01.616211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:02.027223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:02.053577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e05c834-0f6a-4e16-9b5a-91723696a112 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 200 len: 1467 microversion: 2.1 time: 1.325927 Jul 26 04:32:02.084230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 857/1615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:00 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 1467 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:02.104163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:02.110540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:02.150413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:02.152286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:02.158914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:02.160477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:02.722584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:02.733818 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e9882d5-5117-4ff8-bf6c-7eab05ab811f tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 1.189466 Jul 26 04:32:02.739885 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 759/1616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:01 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:02.748892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:02.750804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:02.771108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:02.773139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:02.775628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:02.777587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.300020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:03.301754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14044a2c939440da9b93daeb4e21242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6fbc239a6f4a4b80e5ba267fdb3e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:03.340383 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9bc86396-06ed-4ac2-8260-1d3546b90bfc tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 200 len: 1431 microversion: 2.1 time: 1.273120 Jul 26 04:32:03.340973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 858/1617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:02 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 1431 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:03.348463 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bae073ae-60a3-4f22-88e3-5e68c130ca3c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1302 microversion: 2.1 time: 0.596575 Jul 26 04:32:03.353052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 760/1618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:02 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1302 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:03.361801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2303c3d9-7e78-49ba-9e8b-e0bc30d98d9f req-9f98413d-7307-4160-b741-54e23be4325b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4f03d1-a8d0-425d-a569-519280cec48f", "name": "network-vif-deleted", "tag": "b49be29e-0880-4115-9059-758d97a76bdb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:03.375210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:03.375840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: fb4f03d1-a8d0-425d-a569-519280cec48f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:03.421913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2303c3d9-7e78-49ba-9e8b-e0bc30d98d9f req-9f98413d-7307-4160-b741-54e23be4325b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.422452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2303c3d9-7e78-49ba-9e8b-e0bc30d98d9f req-9f98413d-7307-4160-b741-54e23be4325b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.424256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.424647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.425602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.426089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.530669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2303c3d9-7e78-49ba-9e8b-e0bc30d98d9f req-9f98413d-7307-4160-b741-54e23be4325b service nova] Creating event network-vif-deleted:b49be29e-0880-4115-9059-758d97a76bdb for instance fb4f03d1-a8d0-425d-a569-519280cec48f on n-h2-848886-16 Jul 26 04:32:03.547370 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] HTTP exception thrown: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Request method failure captured: Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f HTTP/1.1 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zfUyJfjjC0XKFGiz71MwNH8V9XcG1xCCb1a0tO6zQ-vzb18FZnol7yIGlzHYh2Rx-CkIzsifW5tNN44PNaii5eAbqubFRYTZ8Q-yHc0_naVUqZm-X3BUZOiRW4ynYQ3zfTMYHDCT-9QASGP_RgzP4o5Gb4q5uR4cnkTvU4wbnWT_I Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:32:03.556270 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4e213406df9b410c83cedd80196bba85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4e213406df9b410c83cedd80196bba85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-MigrationsAdminTest-670480508-project Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e78dffc5209d4419b76a331b743475fe Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-MigrationsAdminTest-670480508-project Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. Jul 26 04:32:03.558014 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'fb4f03d1-a8d0-425d-a569-519280cec48f'} Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:03.562084 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. Jul 26 04:32:03.563707 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:03.565785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Returning 404 to user: Instance fb4f03d1-a8d0-425d-a569-519280cec48f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:03.565785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd12a3ce-10ab-46e4-8597-358b4427f6fb tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f" status: 404 len: 111 microversion: 2.1 time: 0.202301 Jul 26 04:32:03.565785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 859/1619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:03 2022] GET /compute/v2.1/servers/fb4f03d1-a8d0-425d-a569-519280cec48f => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:03.566111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2303c3d9-7e78-49ba-9e8b-e0bc30d98d9f req-9f98413d-7307-4160-b741-54e23be4325b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200400 Jul 26 04:32:03.566111 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 761/1620] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:03.587493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:03.588013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:03.606132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:03.608011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.608479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.609278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.609719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.685735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:32:03.760406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:03.761209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:03.784796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.795271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:03.800462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:03.804077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.048394 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31522f37-365a-41ad-b6e3-64407ea29c01 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 204 len: 0 microversion: 2.1 time: 0.478463 Jul 26 04:32:04.050556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 860/1621] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:32:03 2022] DELETE /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:04.059595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:04.060603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:04.070689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.071966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.073528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.074302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.364074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:04.386909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-156542b4-e66c-4b51-af8c-94a5417cc5d4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.631441 Jul 26 04:32:04.387901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 762/1622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:03 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:04.395071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:04.396340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] [instance: a3d474cc-d23f-49b6-80b6-8c1912016650] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:04.408083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.410111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.411391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.412171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.436982 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] HTTP exception thrown: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Request method failure captured: Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 HTTP/1.1 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322aUlXXEExny7TLrlZ_5E1ysUtE_2B0613wmMaHIWPb8L6Q92YsKlL8avmyrdd0XwHSu6sWoX3_lpkw3OgjKBG1Qu6rVLXal5NNK7wHGkoRGu3n3OzpodkLK0-T5HT2XLX2Ec_VArxJqEWj9smMZU24JyjiSvB5N1bPTzeAGpAPnkA Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 8a6fbc239a6f4a4b80e5ba267fdb3e61 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:04.439245 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a6fbc239a6f4a4b80e5ba267fdb3e61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 8a6fbc239a6f4a4b80e5ba267fdb3e61 Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-651377738 Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListImageFiltersTestJSON-651377738-project Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14044a2c939440da9b93daeb4e21242b Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListImageFiltersTestJSON-651377738-project Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. Jul 26 04:32:04.441709 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'a3d474cc-d23f-49b6-80b6-8c1912016650'} Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:04.442659 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. Jul 26 04:32:04.444219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:04.447700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Returning 404 to user: Instance a3d474cc-d23f-49b6-80b6-8c1912016650 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:04.448958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1046852f-b49e-4328-bf91-8b9f3ed3c483 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650" status: 404 len: 111 microversion: 2.1 time: 0.059119 Jul 26 04:32:04.450560 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 763/1623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:04 2022] GET /compute/v2.1/servers/a3d474cc-d23f-49b6-80b6-8c1912016650 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:04.457735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:04.459711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:04.469385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.470017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.471381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.472227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.575634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:04.598200 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b38faf6d-5be6-412b-90b6-489453ddb02b tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1468 microversion: 2.1 time: 0.543281 Jul 26 04:32:04.607806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 861/1624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:04 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1468 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:04.632731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af290c5b-8de7-45c9-9d3a-08287286d11f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38bad24700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:04.700528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:04.709849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-911fafbc-9ea5-4f4f-8954-17d3dc125c9a tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1302 microversion: 2.1 time: 0.258053 Jul 26 04:32:04.710740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 764/1625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:04 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1302 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:04.741134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dfe30f23-c97c-4a2e-b80d-52304f729dd1 req-7ed2f709-81fe-4b9c-baac-9819dafc87cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3f1a3c-1b06-40cd-883d-a748a501f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "245956b2-14f0-4c23-8049-57695917d889"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:04.764643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfe30f23-c97c-4a2e-b80d-52304f729dd1 req-7ed2f709-81fe-4b9c-baac-9819dafc87cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:04.765220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfe30f23-c97c-4a2e-b80d-52304f729dd1 req-7ed2f709-81fe-4b9c-baac-9819dafc87cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:04.786570 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dfe30f23-c97c-4a2e-b80d-52304f729dd1 req-7ed2f709-81fe-4b9c-baac-9819dafc87cc service nova] Creating event network-vif-plugged:245956b2-14f0-4c23-8049-57695917d889 for instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 on n-h2-848886-16 Jul 26 04:32:04.794191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dfe30f23-c97c-4a2e-b80d-52304f729dd1 req-7ed2f709-81fe-4b9c-baac-9819dafc87cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066330 Jul 26 04:32:04.795376 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 765/1626] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:05.409844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:05.410864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:05.440891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:05.441347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:05.442304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:05.443042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:05.935532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:05.952790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:05.968736 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-777d28eb-7e54-42ec-b442-39e9ec0644b7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1317 microversion: 2.1 time: 0.563464 Jul 26 04:32:05.971390 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 766/1627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:05 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:05.976300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:05.977352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:05.985387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:05.987672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:05.988572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:05.992629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:06.561733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e78dffc5209d4419b76a331b743475fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e213406df9b410c83cedd80196bba85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:06.575322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51685105-dc9d-4080-bccd-d75ce84e9fd7 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 200 len: 1468 microversion: 2.1 time: 0.598960 Jul 26 04:32:06.576753 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 767/1628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:05 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:06.585352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:06.586381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:06.604770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:06.606951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:06.610711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:06.611394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:07.558978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:07.644942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba330d6d-ec73-4d3d-a980-b33cadd3b0b8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 1.064033 Jul 26 04:32:07.648472 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 768/1629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:06 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:07.701249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-31f23645-ac58-405f-945c-49ede4803d1f req-8974c6c8-3a83-4a9c-b385-1307e6f7674f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d474cc-d23f-49b6-80b6-8c1912016650", "name": "network-vif-deleted", "tag": "61188968-9f71-4a4d-a2bc-f54ef373a1b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:07.750002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-31f23645-ac58-405f-945c-49ede4803d1f req-8974c6c8-3a83-4a9c-b385-1307e6f7674f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:07.772421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-31f23645-ac58-405f-945c-49ede4803d1f req-8974c6c8-3a83-4a9c-b385-1307e6f7674f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:07.850904 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-31f23645-ac58-405f-945c-49ede4803d1f req-8974c6c8-3a83-4a9c-b385-1307e6f7674f service nova] Creating event network-vif-deleted:61188968-9f71-4a4d-a2bc-f54ef373a1b7 for instance a3d474cc-d23f-49b6-80b6-8c1912016650 on n-h2-848886-16 Jul 26 04:32:07.873639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-31f23645-ac58-405f-945c-49ede4803d1f req-8974c6c8-3a83-4a9c-b385-1307e6f7674f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204096 Jul 26 04:32:07.891412 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 769/1630] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:07.916461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:07.923347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:07.963536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:07.964006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:07.967804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:07.970594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:08.720057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:08.783595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:08.844380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:08.857166 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-333fbf8f-4101-4292-bd1a-a55f45e54e2d tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1507 microversion: 2.1 time: 0.963966 Jul 26 04:32:08.864988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 770/1631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:07 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1507 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:08.885509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:08.887595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] [instance: cacf3c58-8195-4b00-abed-0463d23e7774] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:08.922117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:08.923922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:08.926043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:08.926806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:08.953890 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] HTTP exception thrown: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Request method failure captured: Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 HTTP/1.1 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zfUyJfjjC0XKFGiz71MwNH8V9XcG1xCCb1a0tO6zQ-vzb18FZnol7yIGlzHYh2Rx-CkIzsifW5tNN44PNaii5eAbqubFRYTZ8Q-yHc0_naVUqZm-X3BUZOiRW4ynYQ3zfTMYHDCT-9QASGP_RgzP4o5Gb4q5uR4cnkTvU4wbnWT_I Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:08.957420 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4e213406df9b410c83cedd80196bba85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e213406df9b410c83cedd80196bba85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4e213406df9b410c83cedd80196bba85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4e213406df9b410c83cedd80196bba85 Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MigrationsAdminTest-670480508 Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MigrationsAdminTest-670480508-project Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: e78dffc5209d4419b76a331b743475fe Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MigrationsAdminTest-670480508-project Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. Jul 26 04:32:08.959188 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'cacf3c58-8195-4b00-abed-0463d23e7774'} Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:08.960202 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. Jul 26 04:32:08.962985 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:08.966833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] Returning 404 to user: Instance cacf3c58-8195-4b00-abed-0463d23e7774 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:08.967955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13bd0f41-cc4e-4404-97c2-1343d0392758 tempest-MigrationsAdminTest-670480508 tempest-MigrationsAdminTest-670480508-project] 10.222.0.43 "GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774" status: 404 len: 111 microversion: 2.1 time: 0.101036 Jul 26 04:32:08.969568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 771/1632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:08 2022] GET /compute/v2.1/servers/cacf3c58-8195-4b00-abed-0463d23e7774 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:08.986501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:08.991402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:09.040077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:09.042378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:09.047630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:09.051434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:09.054797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:09.618962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:09.631451 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41c3ad3e-640d-4e5b-9e7d-b05647bba034 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.660064 Jul 26 04:32:09.646060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 772/1633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:08 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:09.655825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:09.656452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:09.672798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:09.673516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:09.678651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:09.679463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:10.204644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:10.214577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fbe6526-7a5b-4e25-a872-1fd9b2db7dd1 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1507 microversion: 2.1 time: 0.567249 Jul 26 04:32:10.234194 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 773/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:09 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:10.256872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-233aa728-fc89-4498-a93b-15dee1e449a3 req-e25f6473-b954-412c-bd6f-d660c18b7f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5e0949-3144-4c93-8105-17009421339f", "tag": "4a1838b6-7db1-4475-8856-f970c8acfb66"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:10.314316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-233aa728-fc89-4498-a93b-15dee1e449a3 req-e25f6473-b954-412c-bd6f-d660c18b7f64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:10.315761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-233aa728-fc89-4498-a93b-15dee1e449a3 req-e25f6473-b954-412c-bd6f-d660c18b7f64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:10.380331 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-233aa728-fc89-4498-a93b-15dee1e449a3 req-e25f6473-b954-412c-bd6f-d660c18b7f64 service nova] Creating event network-changed:4a1838b6-7db1-4475-8856-f970c8acfb66 for instance 3d5e0949-3144-4c93-8105-17009421339f on n-h1-848886-16 Jul 26 04:32:10.397886 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-233aa728-fc89-4498-a93b-15dee1e449a3 req-e25f6473-b954-412c-bd6f-d660c18b7f64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168008 Jul 26 04:32:10.402260 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 774/1635] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:10.426967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:10.438579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:10.464155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:10.467159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:10.469173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:10.472213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:10.656643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-953a3e2d-53d2-4159-814a-568a57d542e2 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "PUT /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1079 microversion: 2.1 time: 0.243888 Jul 26 04:32:10.669714 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 775/1636] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:32:10 2022] PUT /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1079 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:10.687486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:10.688116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:10.705302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:10.709334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:10.712504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:10.713151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:11.475792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:11.498213 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5662f506-aa6b-447c-b703-5ef7c9112fb9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.821311 Jul 26 04:32:11.511208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 776/1637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:10 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:11.528229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:11.534288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:11.557309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:11.558684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:11.559783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:11.560434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:12.534489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:12.551335 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d67e36df-45b2-4fa5-be5f-4de62f11c907 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1505 microversion: 2.1 time: 1.032614 Jul 26 04:32:12.569824 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 777/1638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:11 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1505 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:12.595563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-df0dc251-cdc6-454a-b120-206415598059 req-b57d5b77-4eb2-41c1-8c5b-73c07bdd8679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacf3c58-8195-4b00-abed-0463d23e7774", "name": "network-vif-deleted", "tag": "3e74e481-e33e-469e-a945-c453fe028de6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:12.641210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df0dc251-cdc6-454a-b120-206415598059 req-b57d5b77-4eb2-41c1-8c5b-73c07bdd8679 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:12.641669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df0dc251-cdc6-454a-b120-206415598059 req-b57d5b77-4eb2-41c1-8c5b-73c07bdd8679 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:12.709483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-df0dc251-cdc6-454a-b120-206415598059 req-b57d5b77-4eb2-41c1-8c5b-73c07bdd8679 service nova] Creating event network-vif-deleted:3e74e481-e33e-469e-a945-c453fe028de6 for instance cacf3c58-8195-4b00-abed-0463d23e7774 on n-h1-848886-16 Jul 26 04:32:12.720624 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-df0dc251-cdc6-454a-b120-206415598059 req-b57d5b77-4eb2-41c1-8c5b-73c07bdd8679 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147465 Jul 26 04:32:12.723728 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 778/1639] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:12.737380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:12.738534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:12.755020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:12.755611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:12.757085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:12.760194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:13.390283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eea104f9-4c78-4593-a363-3374efb5c2de tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1861 microversion: 2.1 time: 0.664922 Jul 26 04:32:13.405609 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 779/1640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:12 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1861 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:13.431467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:13.432089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:13.460384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:13.460836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:13.461647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:13.462090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:14.066726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:14.448542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:14.466300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00c1d460-6063-4ca3-a8c0-e2b91cc97fa3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 1.059126 Jul 26 04:32:14.467533 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 780/1641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:13 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:14.493125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:14.493778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:14.512403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:14.512861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:14.513655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:14.523434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:14.589696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:15.095922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:15.105025 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69dff763-b7fe-4b42-8c78-0e8b0eb406d5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1505 microversion: 2.1 time: 0.636966 Jul 26 04:32:15.105691 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 781/1642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:14 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:15.113715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:15.116328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:15.144060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:15.145588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:15.147808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:15.151117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:15.263892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lazy-loading 'flavor' on Instance uuid 5a9c8e7c-643b-4e11-ba67-181651b63baf {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:32:15.302781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:32:19.273822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af290c5b-8de7-45c9-9d3a-08287286d11f tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57" status: 204 len: 0 microversion: 2.1 time: 14.663390 Jul 26 04:32:19.277883 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 862/1643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:04 2022] DELETE /compute/v2.1/images/de489e73-ea14-49f1-ac1e-7790654fcf57 => generated 0 bytes in 14666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:19.589010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79a3334c-13ec-42a3-9bd6-1c4d266a64d5 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Calling method '.version_select at 0x7f38b593d0d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:19.689808 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34bdddd8-142f-4b06-99bd-27b623373856 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/action" status: 202 len: 0 microversion: 2.1 time: 4.582813 Jul 26 04:32:19.690521 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 782/1644] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:32:15 2022] POST /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/action => generated 0 bytes in 4584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:32:19.700335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:19.702775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:19.750254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:19.750710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:19.751842 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79a3334c-13ec-42a3-9bd6-1c4d266a64d5 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.472111 Jul 26 04:32:19.752813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:19.765322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 863/1645] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:32:19 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:19.766651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:19.782509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:19.784129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:19.801218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:19.802126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:19.804276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:19.805776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:19.855517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:20.020145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39e63ce3-21e1-43f4-9b8c-dd09412d7766 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "PUT /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1081 microversion: 2.1 time: 0.325680 Jul 26 04:32:20.020789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 783/1646] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:32:19 2022] PUT /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1081 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:20.160091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63065aa7-2e9c-4e44-8718-987b23640910 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] Calling method '.version_select at 0x7f38b5bbbaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:20.161310 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:32:20.161310 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:32:20.205287 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63065aa7-2e9c-4e44-8718-987b23640910 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.182877 Jul 26 04:32:20.215086 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 784/1647] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Jul 26 04:32:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:32:20.239940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d95b569-1e65-46e0-b7fa-c59f9d26f870 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5bcdc10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:20.548066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:20.560695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-914d19b0-a020-4ec6-acc3-d4cf64aebeb7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.793149 Jul 26 04:32:20.561280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 864/1648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:19 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:20.574470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:20.574470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:20.586525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:20.586978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:20.587767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:20.588206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:20.677836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d95b569-1e65-46e0-b7fa-c59f9d26f870 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e" status: 204 len: 0 microversion: 2.1 time: 0.450497 Jul 26 04:32:20.679036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 785/1649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:20 2022] DELETE /compute/v2.1/images/1937919d-7974-45e0-b602-646a682ae77e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:20.684377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc143ccb-b509-4866-bab3-6136adf8c746 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Action: 'create', calling method: .version_select at 0x7f38b5bb1ee0>, body: {"pool": "non_exist_pool"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:20.727202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-dc143ccb-b509-4866-bab3-6136adf8c746 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] HTTP exception thrown: Floating IP pool not found. Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc143ccb-b509-4866-bab3-6136adf8c746 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Request method failure captured: Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 26 Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi325ONBkANnRFSSAjw9ZXorGe0Uc4yZzplHG__Q0famgg0mWnV8Zoyo8riiyTmNNiWjdqud4DpHhU1d0bioJ1eqQxDxfccHCr2F4oqmOn65N5joZhriGICaTxlGOdKU9uTgHVRIKDJYlrQGNkgkvEagfHfCISZntcGtnhUVYRY-BmY5M Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0d3e0e903436486bbce197860e9a380c Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:20.729730 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0d3e0e903436486bbce197860e9a380c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0d3e0e903436486bbce197860e9a380c Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsNegativeTestJSON-133740098-project Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 938fc5cdbbc74347a4988bfa0f6b4fd1 Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-133740098-project Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: {"pool": "non_exist_pool"} Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: exception: Floating IP pool not found. Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 26 04:32:20.731269 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:20.732315 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc143ccb-b509-4866-bab3-6136adf8c746 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Returning 404 to user: Floating IP pool not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:20.735164 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc143ccb-b509-4866-bab3-6136adf8c746 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.050785 Jul 26 04:32:20.738425 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 786/1650] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:32:20 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:32:20.744424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:20.744970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:20.753440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:20.753950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:20.754788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:20.755231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:20.940914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:20.955500 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3a923b6-477a-402f-be0e-e18d39e56775 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.392471 Jul 26 04:32:20.956650 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 865/1651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:20 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:20.969142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b9e45c3-fe64-4c46-9149-21321c3febd5 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5851430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:20.973953 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:32:20.973953 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:32:20.978593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:20.987698 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86d05cba-0bde-4844-a8a7-6ed54f14bb50 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1507 microversion: 2.1 time: 0.248079 Jul 26 04:32:20.988267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 787/1652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:20 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:21.069802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52f2bb21-f12b-4185-a47c-a7b2c12e3863 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Action: 'create', calling method: .version_select at 0x7f38baccbdc0>, body: {"pool": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:21.250411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b9e45c3-fe64-4c46-9149-21321c3febd5 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.291602 Jul 26 04:32:21.251176 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 866/1653] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Jul 26 04:32:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:32:21.257390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb679b80-d849-4911-a916-e80efd0527d7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] Calling method '.version_select at 0x7f38b5f578b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:21.568182 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb679b80-d849-4911-a916-e80efd0527d7 tempest-ListImageFiltersTestJSON-651377738 tempest-ListImageFiltersTestJSON-651377738-project] 10.222.0.43 "DELETE /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e" status: 204 len: 0 microversion: 2.1 time: 0.315332 Jul 26 04:32:21.568786 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 867/1654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:21 2022] DELETE /compute/v2.1/images/e2f5e5f1-f8fc-4e11-9e2e-47dd89351f4e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:21.577008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Calling method '.version_select at 0x7f38b5ee80d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:21.651997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 20b673f4-572e-4d73-984e-bf57e117841b could not be found", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:32:21.652913 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] HTTP exception thrown: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Request method failure captured: Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-floating-ips/20b673f4-572e-4d73-984e-bf57e117841b HTTP/1.1 Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi325ONBkANnRFSSAjw9ZXorGe0Uc4yZzplHG__Q0famgg0mWnV8Zoyo8riiyTmNNiWjdqud4DpHhU1d0bioJ1eqQxDxfccHCr2F4oqmOn65N5joZhriGICaTxlGOdKU9uTgHVRIKDJYlrQGNkgkvEagfHfCISZntcGtnhUVYRY-BmY5M Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0d3e0e903436486bbce197860e9a380c Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:32:21.655048 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d3e0e903436486bbce197860e9a380c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0d3e0e903436486bbce197860e9a380c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0d3e0e903436486bbce197860e9a380c Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-133740098 Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsNegativeTestJSON-133740098-project Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 938fc5cdbbc74347a4988bfa0f6b4fd1 Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-133740098-project Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: exception: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '20b673f4-572e-4d73-984e-bf57e117841b'} Jul 26 04:32:21.656684 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:32:21.657664 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 20b673f4-572e-4d73-984e-bf57e117841b could not be found Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ceaecf3-a5b6-4030-8897-eef70e5381d5'] Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b. Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:21.659788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:21.661277 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:21.662736 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b Jul 26 04:32:21.662736 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:21.663809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] Returning 404 to user: Floating IP not found for ID 20b673f4-572e-4d73-984e-bf57e117841b {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:21.664834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e9b6ebd9-dd3c-4d73-a0d5-4d0c5599ba09 tempest-FloatingIPsNegativeTestJSON-133740098 tempest-FloatingIPsNegativeTestJSON-133740098-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/20b673f4-572e-4d73-984e-bf57e117841b" status: 404 len: 111 microversion: 2.1 time: 0.092059 Jul 26 04:32:21.666824 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 868/1655] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:32:21 2022] DELETE /compute/v2.1/os-floating-ips/20b673f4-572e-4d73-984e-bf57e117841b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:21.672821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:21.682382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:21.706093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:21.706867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:21.707869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:21.708509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:22.241531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:22.255761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd010604-21f8-4092-9995-18ffa218772c tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1507 microversion: 2.1 time: 0.587622 Jul 26 04:32:22.256338 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 869/1656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:21 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:22.266044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-298eac6d-f85b-44b8-b7d0-99774f63e701 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] Calling method '.version_select at 0x7f38b5a92a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:22.266862 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:32:22.266862 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:32:22.299632 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-298eac6d-f85b-44b8-b7d0-99774f63e701 tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.041444 Jul 26 04:32:22.301830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 870/1657] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Jul 26 04:32:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:32:22.320386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:22.326799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:22.350760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:22.353551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:22.355649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:22.356293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:22.725815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:22.750208 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2f330d2-27a5-48a5-9c81-9df2dffcd27d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.445939 Jul 26 04:32:22.755514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 871/1658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:22 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:22.772612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:22.773806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:22.794605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:22.808716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:22.811134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:22.813506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.320889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:23.332521 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-068a6cf1-dd8c-4d33-897b-62ef0e4f2eff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.570418 Jul 26 04:32:23.333380 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 872/1659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:22 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:23.343509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:23.348082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:23.362763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.367373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.369585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.370283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.487933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:32:23.703739 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-445eda8e-288f-4307-893c-3afbb25267c3 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 204 len: 0 microversion: 2.1 time: 0.367573 Jul 26 04:32:23.706801 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 873/1660] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:32:23 2022] DELETE /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:23.711599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d6f13c6e-3e07-4055-abec-0731d95aacad tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] Action: 'update', calling method: .version_select at 0x7f38bad240d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:23.722862 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:32:23.722862 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:32:23.846353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d6f13c6e-3e07-4055-abec-0731d95aacad tempest-QuotaClassesAdmin257Test-1773941797 tempest-QuotaClassesAdmin257Test-1773941797-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.139091 Jul 26 04:32:23.847310 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 874/1661] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Jul 26 04:32:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:32:23.874684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:23.876120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:23.896478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.900099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.903899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.904696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.910602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52f2bb21-f12b-4185-a47c-a7b2c12e3863 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.915679 Jul 26 04:32:23.912217 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 788/1662] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:32:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:23.917854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:23.919152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:23.952005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.957623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:23.959573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:23.961608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:24.030077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:32:24.249680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Instance is already in deleting state, ignoring this request Jul 26 04:32:24.259288 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-020d015c-39f8-45cd-a8f1-0196da286d98 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 204 len: 0 microversion: 2.1 time: 0.410108 Jul 26 04:32:24.260221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 875/1663] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:32:23 2022] DELETE /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:24.279180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d7c03bb4-4717-4a74-b1ca-1c26dcddaccb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Action: 'create', calling method: .version_select at 0x7f38b587b670>, body: {"pool": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:24.382005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:24.398703 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e9937bd-9c77-4b7f-894f-f89091399742 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.485118 Jul 26 04:32:24.416145 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 789/1664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:23 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:24.423489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:24.435093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:24.457230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:24.461017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:24.463618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:24.465611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:24.849843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:24.860668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-533b428a-c37a-4351-aa02-1865b018bcce tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1513 microversion: 2.1 time: 0.441092 Jul 26 04:32:24.866199 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 790/1665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:24 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1513 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:24.882267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:24.890376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:24.910271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:24.915606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:24.918867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:24.919634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:25.248842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:25.268078 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc5fd956-72f4-449c-af49-9d4574666a46 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.399163 Jul 26 04:32:25.270836 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 791/1666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:24 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:25.567612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77189898-10bc-4c75-91e7-8b701b13ceac tempest-ListImageFiltersNegativeTestJSON-1872575911 tempest-ListImageFiltersNegativeTestJSON-1872575911-project] Calling method '.version_select at 0x7f38b5c11ca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:25.613971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-77189898-10bc-4c75-91e7-8b701b13ceac tempest-ListImageFiltersNegativeTestJSON-1872575911 tempest-ListImageFiltersNegativeTestJSON-1872575911-project] HTTP exception thrown: Image not found. Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77189898-10bc-4c75-91e7-8b701b13ceac tempest-ListImageFiltersNegativeTestJSON-1872575911 tempest-ListImageFiltersNegativeTestJSON-1872575911-project] Request method failure captured: Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/images/1218fc85-ce0e-4955-980e-4dc1dd1e944d HTTP/1.1 Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi325YHgOmE51FoUcOANnBW2sRX5iopAPBT5WuzZbF0KQbAUXAEE74spagtAiG--mIagfKroSp8KIpkLQ23TAxwO3oYwtbdV9VxzAjURigjC9lz0l6Df7qSS8atEKHQTlwhUh9Pzm7DaXiHJ5OgtlWTBEMJCGii21sOBacvg3O24_pVqo Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e5badc5b4d924a81bb4638d9ed122a9d Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1872575911 Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:25.661904 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e5badc5b4d924a81bb4638d9ed122a9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e5badc5b4d924a81bb4638d9ed122a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e5badc5b4d924a81bb4638d9ed122a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e5badc5b4d924a81bb4638d9ed122a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1872575911 Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e5badc5b4d924a81bb4638d9ed122a9d Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1872575911 Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListImageFiltersNegativeTestJSON-1872575911-project Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 9d568769d5b74dc5aa66a2574a7997aa Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1872575911-project Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1218fc85-ce0e-4955-980e-4dc1dd1e944d'} Jul 26 04:32:25.663673 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:32:25.664806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1218fc85-ce0e-4955-980e-4dc1dd1e944d Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:32:25.666052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1218fc85-ce0e-4955-980e-4dc1dd1e944d could not be found. Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:32:25.667454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:25.668648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77189898-10bc-4c75-91e7-8b701b13ceac tempest-ListImageFiltersNegativeTestJSON-1872575911 tempest-ListImageFiltersNegativeTestJSON-1872575911-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:25.669649 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77189898-10bc-4c75-91e7-8b701b13ceac tempest-ListImageFiltersNegativeTestJSON-1872575911 tempest-ListImageFiltersNegativeTestJSON-1872575911-project] 10.222.0.43 "GET /compute/v2.1/images/1218fc85-ce0e-4955-980e-4dc1dd1e944d" status: 404 len: 62 microversion: 2.1 time: 0.392542 Jul 26 04:32:25.669649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 792/1667] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:32:25 2022] GET /compute/v2.1/images/1218fc85-ce0e-4955-980e-4dc1dd1e944d => generated 62 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:32:25.672121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:25.674188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:25.691370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:25.691903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:25.693920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:25.696374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:26.598333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:26.611385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96bcc357-664c-4e6c-8d1a-dc51a9dbea5d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.944265 Jul 26 04:32:26.615353 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 793/1668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:25 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:26.625448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:26.636488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:26.655902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:26.656375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:26.657175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:26.662513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:27.101830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baadf645f9914104a5e50c7bced4ffea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee165a6fc00141a8bd12a11cba73c653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:27.123600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3b3a9d52-1ef3-4efb-a2fd-9350fc8ebdd7 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 200 len: 1471 microversion: 2.1 time: 0.504179 Jul 26 04:32:27.125986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 794/1669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:26 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:27.147177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:27.148938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:27.178924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:27.179900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:27.180912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:27.184852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.105630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:28.131759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab04241a-38f5-45d2-99ce-cf79bf6c95b5 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.994258 Jul 26 04:32:28.143106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 795/1670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:27 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:28.176505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-97443622-f59e-4ba3-94f7-0164da1bf0bb req-9b42512e-a4a6-4339-ab14-01cf363bccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5e0949-3144-4c93-8105-17009421339f", "name": "network-vif-plugged", "status": "completed", "tag": "4a1838b6-7db1-4475-8856-f970c8acfb66"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:28.209245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97443622-f59e-4ba3-94f7-0164da1bf0bb req-9b42512e-a4a6-4339-ab14-01cf363bccc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.209789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97443622-f59e-4ba3-94f7-0164da1bf0bb req-9b42512e-a4a6-4339-ab14-01cf363bccc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.232637 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-97443622-f59e-4ba3-94f7-0164da1bf0bb req-9b42512e-a4a6-4339-ab14-01cf363bccc0 service nova] Creating event network-vif-plugged:4a1838b6-7db1-4475-8856-f970c8acfb66 for instance 3d5e0949-3144-4c93-8105-17009421339f on n-h1-848886-16 Jul 26 04:32:28.239617 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-97443622-f59e-4ba3-94f7-0164da1bf0bb req-9b42512e-a4a6-4339-ab14-01cf363bccc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094959 Jul 26 04:32:28.242262 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 796/1671] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:28.269170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:28.269887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:28.304375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.304852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.305645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.306090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.331831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d7c03bb4-4717-4a74-b1ca-1c26dcddaccb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.068339 Jul 26 04:32:28.333191 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 876/1672] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:32:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:28.338535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3b9d2009-cd62-4545-b43f-50278e6471fa req-a2b5d25b-b921-465f-8ba0-ab8f15c80865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3f1a3c-1b06-40cd-883d-a748a501f4d6", "name": "network-vif-deleted", "tag": "245956b2-14f0-4c23-8049-57695917d889"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:28.377944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b9d2009-cd62-4545-b43f-50278e6471fa req-a2b5d25b-b921-465f-8ba0-ab8f15c80865 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.378603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b9d2009-cd62-4545-b43f-50278e6471fa req-a2b5d25b-b921-465f-8ba0-ab8f15c80865 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.431779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3b9d2009-cd62-4545-b43f-50278e6471fa req-a2b5d25b-b921-465f-8ba0-ab8f15c80865 service nova] Creating event network-vif-deleted:245956b2-14f0-4c23-8049-57695917d889 for instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 on n-h2-848886-16 Jul 26 04:32:28.451227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3b9d2009-cd62-4545-b43f-50278e6471fa req-a2b5d25b-b921-465f-8ba0-ab8f15c80865 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111885 Jul 26 04:32:28.452265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 877/1673] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:28.473240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:28.477237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 7f3f1a3c-1b06-40cd-883d-a748a501f4d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:28.505336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.507198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.510660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.511797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:28.568176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] HTTP exception thrown: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Request method failure captured: Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 HTTP/1.1 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi322pjfaCsodpIJz-TktktM8Q5haixBtWsNdRVs1iT-MMnHnvMBN5DYIsme90FAUBI7u7H7MfVLhTFCd9zCt_JW6ewl7ioRcEGHnJlplFvkfOWA_RlkCXY1GR-q5wC5zkY1yZAkn6k3AY_i0SqyHtcwlU8snInSziWB8qE892JYAOGkI Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:32:28.575061 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: baadf645f9914104a5e50c7bced4ffea Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. Jul 26 04:32:28.576968 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7f3f1a3c-1b06-40cd-883d-a748a501f4d6'} Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:28.577836 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. Jul 26 04:32:28.580179 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:32:28.588006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Returning 404 to user: Instance 7f3f1a3c-1b06-40cd-883d-a748a501f4d6 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:28.589591 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be409e7c-bce6-4bfa-9f78-c4f97be4bc30 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6" status: 404 len: 111 microversion: 2.1 time: 0.132492 Jul 26 04:32:28.591576 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 878/1674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:28 2022] GET /compute/v2.1/servers/7f3f1a3c-1b06-40cd-883d-a748a501f4d6 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:28.605818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91c4812c-9ed6-45f8-b6cc-96574b82eed3 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Action: 'create', calling method: .version_select at 0x7f38b6190430>, body: {"pool": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:28.908580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:28.937464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67b73e34-489d-4e31-8df3-85a219164bd7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.693184 Jul 26 04:32:28.940477 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 797/1675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:28 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:28.962877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:28.963669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:28.996147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:28.996451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:29.007538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:29.008004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:29.075463 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] HTTP exception thrown: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Request method failure captured: Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 HTTP/1.1 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322pjfaCsodpIJz-TktktM8Q5haixBtWsNdRVs1iT-MMnHnvMBN5DYIsme90FAUBI7u7H7MfVLhTFCd9zCt_JW6ewl7ioRcEGHnJlplFvkfOWA_RlkCXY1GR-q5wC5zkY1yZAkn6k3AY_i0SqyHtcwlU8snInSziWB8qE892JYAOGkI Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:29.082660 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: baadf645f9914104a5e50c7bced4ffea Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.084714 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1b180c32-da9e-41e0-87e4-38ce6ad21508'} Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:29.085628 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.087509 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.098907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Returning 404 to user: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:29.102530 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc1dcb02-2a4b-4b52-bd85-cf4a0bc2135a tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 404 len: 111 microversion: 2.1 time: 0.160807 Jul 26 04:32:29.107070 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 798/1676] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:32:28 2022] DELETE /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:29.113833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:29.121057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 1b180c32-da9e-41e0-87e4-38ce6ad21508] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:29.153119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:29.155742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:29.166878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:29.167407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:29.206879 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] HTTP exception thrown: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Request method failure captured: Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 HTTP/1.1 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322pjfaCsodpIJz-TktktM8Q5haixBtWsNdRVs1iT-MMnHnvMBN5DYIsme90FAUBI7u7H7MfVLhTFCd9zCt_JW6ewl7ioRcEGHnJlplFvkfOWA_RlkCXY1GR-q5wC5zkY1yZAkn6k3AY_i0SqyHtcwlU8snInSziWB8qE892JYAOGkI Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:29.211976 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: baadf645f9914104a5e50c7bced4ffea Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.213559 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1b180c32-da9e-41e0-87e4-38ce6ad21508'} Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:29.214625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. Jul 26 04:32:29.216267 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:29.222415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Returning 404 to user: Instance 1b180c32-da9e-41e0-87e4-38ce6ad21508 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:29.223653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-192184d7-56f6-42b6-a27a-342d76398719 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508" status: 404 len: 111 microversion: 2.1 time: 0.115305 Jul 26 04:32:29.225269 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 799/1677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:29 2022] GET /compute/v2.1/servers/1b180c32-da9e-41e0-87e4-38ce6ad21508 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:29.232807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:29.236505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:29.273304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:29.274053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:29.279518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:29.280097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:30.134326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:30.143780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-367f2d28-1362-43f8-9dba-653b3bd85997 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.916971 Jul 26 04:32:30.158260 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 800/1678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:29 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:30.175565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:30.177327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:30.198490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:30.198939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:30.199773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:30.204993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:30.205610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:30.253424 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] HTTP exception thrown: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Request method failure captured: Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad HTTP/1.1 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322pjfaCsodpIJz-TktktM8Q5haixBtWsNdRVs1iT-MMnHnvMBN5DYIsme90FAUBI7u7H7MfVLhTFCd9zCt_JW6ewl7ioRcEGHnJlplFvkfOWA_RlkCXY1GR-q5wC5zkY1yZAkn6k3AY_i0SqyHtcwlU8snInSziWB8qE892JYAOGkI Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:30.263036 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: baadf645f9914104a5e50c7bced4ffea Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:30.264806 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '47a92aba-ac5b-4fe0-9ea4-2dcb683568ad'} Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:30.265755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:30.267083 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:30.279478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Returning 404 to user: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:30.281425 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce1b1c26-1620-4668-a606-be5a0d0ce1e5 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "DELETE /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 404 len: 111 microversion: 2.1 time: 0.121876 Jul 26 04:32:30.284417 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 801/1679] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:32:30 2022] DELETE /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:30.302625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:30.310310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:30.322444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:30.324477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:30.326322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:30.327621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:31.045051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:31.053538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fb59c8f-def4-41af-b1d2-5303bff5f6d9 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1370 microversion: 2.1 time: 0.762349 Jul 26 04:32:31.057351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 802/1680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:30 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1370 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:31.067523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:31.070660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] [instance: 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:31.085971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:31.089709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:31.091024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:31.091703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:31.123052 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] HTTP exception thrown: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Request method failure captured: Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad HTTP/1.1 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi322pjfaCsodpIJz-TktktM8Q5haixBtWsNdRVs1iT-MMnHnvMBN5DYIsme90FAUBI7u7H7MfVLhTFCd9zCt_JW6ewl7ioRcEGHnJlplFvkfOWA_RlkCXY1GR-q5wC5zkY1yZAkn6k3AY_i0SqyHtcwlU8snInSziWB8qE892JYAOGkI Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:32:31.127480 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ee165a6fc00141a8bd12a11cba73c653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: ee165a6fc00141a8bd12a11cba73c653 Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046843828 Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: baadf645f9914104a5e50c7bced4ffea Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046843828-project Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:31.128924 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '47a92aba-ac5b-4fe0-9ea4-2dcb683568ad'} Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:32:31.129855 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. Jul 26 04:32:31.132655 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:32:31.140084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] Returning 404 to user: Instance 47a92aba-ac5b-4fe0-9ea4-2dcb683568ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:32:31.141232 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6da6af89-5990-4916-a1ca-e7a52b9422e4 tempest-ServerDiskConfigTestJSON-2046843828 tempest-ServerDiskConfigTestJSON-2046843828-project] 10.222.0.43 "GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad" status: 404 len: 111 microversion: 2.1 time: 0.082600 Jul 26 04:32:31.142848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 803/1681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:31 2022] GET /compute/v2.1/servers/47a92aba-ac5b-4fe0-9ea4-2dcb683568ad => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:32:31.167329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:31.167929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:31.179642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:31.184510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:31.185803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:31.186426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:32.029010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:32.043666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-356d6b4e-a8d0-4036-a35d-911f628304da tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.880116 Jul 26 04:32:32.044297 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 804/1682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:31 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:32.076895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:32.077510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:32.079993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=85 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:32.099194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:32.100047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:32.100990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:32.101603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:32.352095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-91c4812c-9ed6-45f8-b6cc-96574b82eed3 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.758110 Jul 26 04:32:32.352845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 879/1683] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:32:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:32.366046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3cf2ad50-f488-426e-b4ae-5cf382612a14 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Action: 'create', calling method: .version_select at 0x7f38b5dc0790>, body: {"pool": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:32.423547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:32.435853 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0b2f63f-6639-499f-b45c-2c70c2b451a8 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1556 microversion: 2.1 time: 0.361015 Jul 26 04:32:32.451143 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 805/1684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:32 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1556 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:32.463870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:32.464957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:32.479846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:32.481688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:32.483877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:32.484850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:32.639791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4a04ea3-a5bb-4b93-8508-5194520970af tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179904 Jul 26 04:32:32.640457 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 806/1685] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:32:32 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:33.030506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-298325561", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:33.109111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:32:33.109458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:32:33.110264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:32:33.110973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:32:33.111632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:32:33.125252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:33.125715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:33.127800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:33.128253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:33.151617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Getting quotas for project 8239168ae1dc4ab3b96ff63e634e07b3. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:33.159550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Getting quotas for user e6216e6c6163453996bfaef90608afad and project 8239168ae1dc4ab3b96ff63e634e07b3. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:33.175541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:32:33.178587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:32:33.259789 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c649a629-2741-4909-95e6-5f923d73c059 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.591672 Jul 26 04:32:33.267464 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 807/1686] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:32:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:32:33.273061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-715144430", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "96b59dc4-002c-4352-aa03-a56e9ddf1f5b"}], "block_device_mapping_v2": [{"uuid": "b8311363-42ff-493b-ac6f-84930e70814e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:33.402013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] validate_networks() for [('96b59dc4-002c-4352-aa03-a56e9ddf1f5b', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:32:33.843376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:34.639311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:32:34.639964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:32:34.640860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:32:34.642075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:32:34.642716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:32:34.661456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:34.662009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:34.663045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:34.663641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:34.691699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:34.701928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Getting quotas for user e06c8cb7d10e4818a7e40396b93e54ab and project 3fad7dba9e8f4520b59697fd89d3e370. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:34.840261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:32:34.843729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8311363-42ff-493b-ac6f-84930e70814e',volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:32:35.148647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55b81dc6-1063-427e-b5cd-b2ee0e86ac38 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.879726 Jul 26 04:32:35.151797 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 808/1687] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:32:35.162282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:35.164366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:35.193713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:35.195467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:35.196764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:35.197419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:35.219361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:35.607344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:35.621038 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fd46e94-9e53-4220-805c-52fc9cfaddcd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.467865 Jul 26 04:32:35.625037 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 809/1688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:35 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:35.639799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:35.643912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:35.662235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:35.662702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:35.663495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:35.663930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:35.960439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:35.971687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:35.983019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.019447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4567896d-340b-4061-9705-aa125faab387 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "PUT /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1416 microversion: 2.75 time: 0.380547 Jul 26 04:32:36.022591 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 810/1689] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Jul 26 04:32:35 2022] PUT /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1416 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:36.036570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:36.037198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:36.192440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.218183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.220880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.222704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea464e79-600e-4c5a-be2a-095ce2c69699 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1103 microversion: 2.25 time: 0.198938 Jul 26 04:32:36.224249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 811/1690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:36 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1103 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:36.242307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:36.242937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:36.253579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:36.254195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:36.255221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:36.255880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:36.263128 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3cf2ad50-f488-426e-b4ae-5cf382612a14 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.900466 Jul 26 04:32:36.263730 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 880/1691] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:32:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:36.270547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e320ec50-b4dc-4fc6-8949-1fc888d713e0 req-d9d58b1f-07fb-457c-afc0-d24a8cdc2f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5e0949-3144-4c93-8105-17009421339f", "tag": "4a1838b6-7db1-4475-8856-f970c8acfb66"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:36.302380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e320ec50-b4dc-4fc6-8949-1fc888d713e0 req-d9d58b1f-07fb-457c-afc0-d24a8cdc2f06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:36.302849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e320ec50-b4dc-4fc6-8949-1fc888d713e0 req-d9d58b1f-07fb-457c-afc0-d24a8cdc2f06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:36.325674 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e320ec50-b4dc-4fc6-8949-1fc888d713e0 req-d9d58b1f-07fb-457c-afc0-d24a8cdc2f06 service nova] Creating event network-changed:4a1838b6-7db1-4475-8856-f970c8acfb66 for instance 3d5e0949-3144-4c93-8105-17009421339f on n-h1-848886-16 Jul 26 04:32:36.348122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e320ec50-b4dc-4fc6-8949-1fc888d713e0 req-d9d58b1f-07fb-457c-afc0-d24a8cdc2f06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082952 Jul 26 04:32:36.348746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 881/1692] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:36.357682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4005e690-f31b-4dc9-8ea9-17e8d489bb04 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38baccf940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:36.423560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4005e690-f31b-4dc9-8ea9-17e8d489bb04 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601" status: 200 len: 637 microversion: 2.1 time: 0.073578 Jul 26 04:32:36.424142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 882/1693] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:32:36 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601 => generated 637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:36.437506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9fbcbee-388c-45eb-9077-41586aacf5b7 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38bad5a040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:36.463340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.473070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.475834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:36.482244 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4199d352-0c8b-4431-a643-d7b21f1374c7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1416 microversion: 2.75 time: 0.255967 Jul 26 04:32:36.495610 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 812/1694] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:36 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1416 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:36.507075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5b8d930c-f2db-4d7a-a5c9-a6733ad57155 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38b5a3e8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:36.629189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5b8d930c-f2db-4d7a-a5c9-a6733ad57155 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:36.636474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5b8d930c-f2db-4d7a-a5c9-a6733ad57155 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:37.103838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5b8d930c-f2db-4d7a-a5c9-a6733ad57155 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.606612 Jul 26 04:32:37.104848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 813/1695] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:36 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:37.110611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:37.113181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:37.116043 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f9fbcbee-388c-45eb-9077-41586aacf5b7 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/14786fbd-ba84-4209-8f32-e23c7714607c" status: 200 len: 141 microversion: 2.1 time: 0.683715 Jul 26 04:32:37.119608 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 883/1696] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:36 2022] GET /compute/v2.1/os-floating-ips/14786fbd-ba84-4209-8f32-e23c7714607c => generated 141 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:37.128140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:37.128917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:37.129933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:37.130817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:37.131355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4bfc22f-2969-41e9-a241-f2ea5392b95c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38b587b430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:37.515789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:37.532759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3dfc6126-4c5f-4921-b29e-73e0d34cd9ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.425579 Jul 26 04:32:37.534789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 814/1697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:37 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:37.542283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9de82b5b-234e-4d0c-bc45-9b45e72cb0fb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38b5c12280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:37.745249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4bfc22f-2969-41e9-a241-f2ea5392b95c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "DELETE /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.624180 Jul 26 04:32:37.745831 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 884/1698] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Jul 26 04:32:37 2022] DELETE /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_version => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:32:37.752217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:37.759591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:37.770114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:37.770758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:37.772196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:37.772714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:38.158409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.169193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.171279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.172743 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-410d951b-1c82-4ee0-8fc4-5f226ee422cf tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1232 microversion: 2.25 time: 0.425531 Jul 26 04:32:38.174365 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 885/1699] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:37 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1232 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:38.180772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:38.182271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:38.198657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:38.199927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:38.201657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:38.202502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:38.505728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.523568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.530065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:38.551157 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc7f02ba-335f-4da5-85b5-418781ab73d6 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1416 microversion: 2.75 time: 0.375270 Jul 26 04:32:38.551781 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 886/1700] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:38 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1416 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:38.573944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96f69122-b93f-4033-bc31-8b580bbd2989 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38baccfc10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:38.656433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96f69122-b93f-4033-bc31-8b580bbd2989 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 37 microversion: 2.1 time: 0.088096 Jul 26 04:32:38.657690 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 887/1701] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:38 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 37 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:38.670410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:38.674473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:38.697098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:38.708095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:38.716311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:38.716703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:39.019778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:39.034661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c95cfff0-2336-4490-bf24-519e04d27901 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.371242 Jul 26 04:32:39.049040 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 888/1702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:38 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:39.049040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5bf73469-f60c-49c0-bea2-5daf48c7a31b tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38b5fa94c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:39.120752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5bf73469-f60c-49c0-bea2-5daf48c7a31b tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:39.128282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5bf73469-f60c-49c0-bea2-5daf48c7a31b tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:39.590722 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5bf73469-f60c-49c0-bea2-5daf48c7a31b tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.553741 Jul 26 04:32:39.596873 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 889/1703] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:39 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:39.602097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:39.615067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:39.623516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:39.624248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:39.625219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:39.625858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:39.886229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:39.909136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:39.910830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:39.911951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dbc9f38c-467e-4da3-bee0-2620f1063c70 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1250 microversion: 2.25 time: 0.313807 Jul 26 04:32:39.912512 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 890/1704] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:39 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1250 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:39.917293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:39.927076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:39.929480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:39.935876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:39.941654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:39.942782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:39.943438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:40.136029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:40.149379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:40.153480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:40.169183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2830784c-07bb-4236-8c58-6be82201e7c2 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1437 microversion: 2.75 time: 0.254522 Jul 26 04:32:40.170131 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 891/1705] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:39 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1437 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:40.198231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9db066a3-8b1b-4b58-b455-e437fd0fb4a5 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38bad24b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:40.269840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9db066a3-8b1b-4b58-b455-e437fd0fb4a5 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.084574 Jul 26 04:32:40.278946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 892/1706] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Jul 26 04:32:40 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_distro => generated 33 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:40.286962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:40.287596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:40.300368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:40.303073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:40.309341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:40.309972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:40.352624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:40.554627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9de82b5b-234e-4d0c-bc45-9b45e72cb0fb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/14786fbd-ba84-4209-8f32-e23c7714607c" status: 202 len: 0 microversion: 2.1 time: 3.018457 Jul 26 04:32:40.559598 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 815/1707] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:32:37 2022] DELETE /compute/v2.1/os-floating-ips/14786fbd-ba84-4209-8f32-e23c7714607c => generated 0 bytes in 3020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:32:40.562400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:40.568250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:40.588606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:40.607975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:40.613867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:40.617532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:40.843170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:32:40.844941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:32:40.846393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:32:40.847541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:32:40.848145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:32:41.001472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.012207 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b51fc70-2994-4a78-af8d-32b97866fc75 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.731821 Jul 26 04:32:41.014829 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 893/1708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:40 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:41.028497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a2183d0-3c98-4354-a7aa-f365033ef323 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38bad24b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:41.087646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:41.124177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.129531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.135008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.135693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.151602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3a2183d0-3c98-4354-a7aa-f365033ef323 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:41.193237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3a2183d0-3c98-4354-a7aa-f365033ef323 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:41.394759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.419697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.421490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.449785 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bfb00072-7d99-4aa3-9019-200da4fc8797 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "POST /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb/action" status: 202 len: 1494 microversion: 2.75 time: 0.893336 Jul 26 04:32:41.459650 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 816/1709] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:32:40 2022] POST /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb/action => generated 1494 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 04:32:41.468395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bcc3d539-fcfe-4c60-acb0-fb06e9e80be0 req-e0c12fd9-0eea-4a38-a798-9dd835dfd8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "name": "network-vif-unplugged", "status": "completed", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:41.496207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bcc3d539-fcfe-4c60-acb0-fb06e9e80be0 req-e0c12fd9-0eea-4a38-a798-9dd835dfd8c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.513417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bcc3d539-fcfe-4c60-acb0-fb06e9e80be0 req-e0c12fd9-0eea-4a38-a798-9dd835dfd8c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.528494 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bcc3d539-fcfe-4c60-acb0-fb06e9e80be0 req-e0c12fd9-0eea-4a38-a798-9dd835dfd8c8 service nova] Creating event network-vif-unplugged:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:32:41.556214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bcc3d539-fcfe-4c60-acb0-fb06e9e80be0 req-e0c12fd9-0eea-4a38-a798-9dd835dfd8c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093341 Jul 26 04:32:41.557090 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 817/1710] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:41.564310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-daf914cb-eadf-4ff5-b3b0-d12f98305a51 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38baccb280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:41.584000 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a2183d0-3c98-4354-a7aa-f365033ef323 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.564740 Jul 26 04:32:41.584607 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 894/1711] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:41 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:41.591545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:41.595114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:41.612146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.612604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.613398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.613835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.956024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.968594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.972729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:41.974703 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a42fe06-4768-43c3-8c9a-9bfb4a7de501 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1292 microversion: 2.25 time: 0.388891 Jul 26 04:32:41.977014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 895/1712] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:41 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1292 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:41.983547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:41.984509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:41.992504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.994055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:41.994843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:41.996125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:42.212013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:42.233006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:42.235275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:42.241421 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0dd8775f-5667-4a2a-9f97-14115cf28995 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.263165 Jul 26 04:32:42.242095 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 896/1713] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:41 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:42.247186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80b67c4c-7cc5-4b60-88f7-c77b8ba1ad9e tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38bad34280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:42.306045 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80b67c4c-7cc5-4b60-88f7-c77b8ba1ad9e tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062573 Jul 26 04:32:42.307019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 897/1714] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:42 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:42.312033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:42.313231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:42.320264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:42.320983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:42.321968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:42.322659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:42.492147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:42.503229 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c7a4a423-5c3d-448b-ae9d-2cefc3753220 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.194816 Jul 26 04:32:42.518563 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 898/1715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:42 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:42.524357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e03a5955-ad8f-4dc3-bde4-aeb11b11434c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38bad348b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:42.555406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-daf914cb-eadf-4ff5-b3b0-d12f98305a51 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.996856 Jul 26 04:32:42.556240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 818/1716] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Jul 26 04:32:41 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:42.568062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4858b3cf-e56d-4e16-862d-98262de09181 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38b608fa60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:42.587796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e03a5955-ad8f-4dc3-bde4-aeb11b11434c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:42.593310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e03a5955-ad8f-4dc3-bde4-aeb11b11434c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:42.913264 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e03a5955-ad8f-4dc3-bde4-aeb11b11434c tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.393011 Jul 26 04:32:42.914052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 899/1717] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:42 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:42.943340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70e0532f-5c02-4d49-a1bc-74baee363e90 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38bad34310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:43.016464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-70e0532f-5c02-4d49-a1bc-74baee363e90 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:43.023252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-70e0532f-5c02-4d49-a1bc-74baee363e90 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:43.139926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4858b3cf-e56d-4e16-862d-98262de09181 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.576714 Jul 26 04:32:43.141537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 819/1718] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:32:42 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:43.147633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:43.148512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:43.171613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:43.174351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:43.178206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:43.178843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:43.501729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-70e0532f-5c02-4d49-a1bc-74baee363e90 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 64 microversion: 2.1 time: 0.572346 Jul 26 04:32:43.502712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 900/1719] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:42 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 64 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:43.508874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ce0cc61-0cd5-4260-a77d-0a7ce3570dcb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38bad29940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:43.650630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.661811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.674423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.675961 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80063e53-3d6e-41dd-9995-6297b5731fd9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1292 microversion: 2.25 time: 0.532842 Jul 26 04:32:43.677033 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 820/1720] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:43 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:43.699247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:43.702273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:43.717894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:43.718378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:43.719260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:43.719700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:43.954739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.968219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.970868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:43.978471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6be1aac4-4184-46df-afbf-d9f7a7782181 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.300114 Jul 26 04:32:43.979743 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 821/1721] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:43 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:43.999606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-375eaf24-8711-4471-9fcb-b725f1661723 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38baca90d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:44.061225 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-375eaf24-8711-4471-9fcb-b725f1661723 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080211 Jul 26 04:32:44.067654 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 822/1722] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:43 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 64 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:44.077486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:44.079725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:44.097127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:44.097657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:44.098517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:44.098949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:44.597836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:44.608283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d70edeff-6d34-4187-80d6-95094393e5f2 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.538427 Jul 26 04:32:44.618330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 823/1723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:44 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:44.625098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5b7aae2e-ba57-4da4-94c5-2570e209b682 req-de4fbefd-f733-48b4-ac8c-1f5ceeea8708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:44.648502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5b7aae2e-ba57-4da4-94c5-2570e209b682 req-de4fbefd-f733-48b4-ac8c-1f5ceeea8708 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:44.649489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5b7aae2e-ba57-4da4-94c5-2570e209b682 req-de4fbefd-f733-48b4-ac8c-1f5ceeea8708 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:44.663891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5b7aae2e-ba57-4da4-94c5-2570e209b682 req-de4fbefd-f733-48b4-ac8c-1f5ceeea8708 service nova] Creating event network-changed:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:32:44.671957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5b7aae2e-ba57-4da4-94c5-2570e209b682 req-de4fbefd-f733-48b4-ac8c-1f5ceeea8708 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052019 Jul 26 04:32:44.673447 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 824/1724] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:44.679530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d06c9df4-802e-46bc-b87d-f8ae7905f158 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38b5bb1940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:44.704108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:44.759584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d06c9df4-802e-46bc-b87d-f8ae7905f158 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:44.767347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d06c9df4-802e-46bc-b87d-f8ae7905f158 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:45.133005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ce0cc61-0cd5-4260-a77d-0a7ce3570dcb tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/8c74eb12-ad1f-470b-957c-028c099120bb" status: 202 len: 0 microversion: 2.1 time: 1.629071 Jul 26 04:32:45.134262 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 901/1725] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:32:43 2022] DELETE /compute/v2.1/os-floating-ips/8c74eb12-ad1f-470b-957c-028c099120bb => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:32:45.143842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:45.144963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:45.164814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:45.167813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:45.170056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:45.173443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:45.179862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d06c9df4-802e-46bc-b87d-f8ae7905f158 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504684 Jul 26 04:32:45.181072 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 825/1726] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:44 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:45.201989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:45.203186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:45.211661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:45.212467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:45.214964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:45.215625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:45.433072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.445469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.447734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.467267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61ccdacb-edbe-4474-aacc-885543676ba9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.284025 Jul 26 04:32:45.467904 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 826/1727] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:45 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:45.473999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aad89e01-5f5a-419a-a72d-cdbdab3df1b5 req-9ee1fe3d-f617-4f29-af44-ba7469ee4f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:45.501858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aad89e01-5f5a-419a-a72d-cdbdab3df1b5 req-9ee1fe3d-f617-4f29-af44-ba7469ee4f40 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:45.506560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aad89e01-5f5a-419a-a72d-cdbdab3df1b5 req-9ee1fe3d-f617-4f29-af44-ba7469ee4f40 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:45.529609 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aad89e01-5f5a-419a-a72d-cdbdab3df1b5 req-9ee1fe3d-f617-4f29-af44-ba7469ee4f40 service nova] Creating event network-changed:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h2-848886-16 Jul 26 04:32:45.535641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aad89e01-5f5a-419a-a72d-cdbdab3df1b5 req-9ee1fe3d-f617-4f29-af44-ba7469ee4f40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066269 Jul 26 04:32:45.537075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 827/1728] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:45.548596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43bd7d48-1d2c-486a-8caf-376c811306e8 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38b608f9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:45.697343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.712753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.718044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:45.719802 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c141461d-233e-4e9c-b2e5-d7c5a66a755d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1292 microversion: 2.25 time: 0.583376 Jul 26 04:32:45.720617 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 902/1729] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:45 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1292 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:45.742320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-07c34ba1-7a25-478c-a538-62fc0c0ff2ff tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update', calling method: .version_select at 0x7f38bad34ee0>, body: {"meta": {"os_version": "alt"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:45.815388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-07c34ba1-7a25-478c-a538-62fc0c0ff2ff tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:45.820665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-07c34ba1-7a25-478c-a538-62fc0c0ff2ff tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:46.120629 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-07c34ba1-7a25-478c-a538-62fc0c0ff2ff tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.388614 Jul 26 04:32:46.121628 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 903/1730] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 26 04:32:45 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata/os_version => generated 31 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:46.129366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:46.130250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:46.136964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:46.137661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:46.138189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:46.138626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:46.293874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:46.305772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5964d2bd-775f-40ff-9b5d-dc9e0b824f8d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.182798 Jul 26 04:32:46.306394 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 904/1731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:46 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:46.310944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e27b63-f6f1-45ea-b545-9f8ab5a4502a tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38b5fcb8b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:46.354172 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89e27b63-f6f1-45ea-b545-9f8ab5a4502a tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046517 Jul 26 04:32:46.361197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 905/1732] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:46 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 58 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:46.366879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2237d2f-333a-412f-8bfb-5583824d8198 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'update_all', calling method: .version_select at 0x7f38bad343a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:46.433412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b2237d2f-333a-412f-8bfb-5583824d8198 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:46.440847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b2237d2f-333a-412f-8bfb-5583824d8198 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:46.826827 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2237d2f-333a-412f-8bfb-5583824d8198 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 61 microversion: 2.1 time: 0.464171 Jul 26 04:32:46.829292 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 906/1733] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:32:46 2022] PUT /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 61 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:46.835417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:46.837079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:46.844986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:46.845447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:46.850161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:46.850619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:47.008634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.020957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.029086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.042121 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97c91e6d-72d1-47c7-bd4c-efc1a829394c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.211433 Jul 26 04:32:47.045131 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 907/1734] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:46 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:47.057874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:47.058949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:47.071617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:47.072328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:47.074226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:47.077606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:47.346537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.359074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.361799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:47.364401 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-209b81b0-5491-41a0-ab5e-168f9c7663b4 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1292 microversion: 2.25 time: 0.310320 Jul 26 04:32:47.365592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 908/1735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:47 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1292 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:47.370663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f74e5621-7e5a-4214-9ef1-90575157b4e6 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Action: 'create', calling method: .version_select at 0x7f38b5dc00d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:47.439659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f74e5621-7e5a-4214-9ef1-90575157b4e6 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:47.446920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f74e5621-7e5a-4214-9ef1-90575157b4e6 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Getting quotas for user 4f50bda34517468c93b6c8caf0d3e911 and project d3e7fa1868ec461c9444a8dba62226f1. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:47.897331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f74e5621-7e5a-4214-9ef1-90575157b4e6 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "POST /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 85 microversion: 2.1 time: 0.529948 Jul 26 04:32:47.898073 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 909/1736] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Jul 26 04:32:47 2022] POST /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 85 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:48.144023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1164559816", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2bd3c0b5-0bbc-4f0d-b0ee-cfb2948bc868"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:48.245536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] validate_networks() for [('2bd3c0b5-0bbc-4f0d-b0ee-cfb2948bc868', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:32:48.284804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43bd7d48-1d2c-486a-8caf-376c811306e8 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/f2385ce7-fa2b-4522-bf9c-34722ffd058f" status: 202 len: 0 microversion: 2.1 time: 2.746198 Jul 26 04:32:48.287020 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 828/1737] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:32:45 2022] DELETE /compute/v2.1/os-floating-ips/f2385ce7-fa2b-4522-bf9c-34722ffd058f => generated 0 bytes in 2749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:32:48.292977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:48.293727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:48.318252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:48.319764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:48.320915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:48.321364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:48.761132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:48.792730 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e46d491-25a4-4afa-ad76-aa4a5c2cfb96 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.490452 Jul 26 04:32:48.794415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 829/1738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:48 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:48.818026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98b61593-c875-4698-a113-991e6c69c7d9 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] Calling method '.version_select at 0x7f38b5a3e790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:48.889420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98b61593-c875-4698-a113-991e6c69c7d9 tempest-ImagesMetadataTestJSON-1860532776 tempest-ImagesMetadataTestJSON-1860532776-project] 10.222.0.43 "GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata" status: 200 len: 85 microversion: 2.1 time: 0.084154 Jul 26 04:32:48.890017 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 830/1739] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:32:48 2022] GET /compute/v2.1/images/cae71f2c-f32c-4288-8651-90fc2bb5e601/metadata => generated 85 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:32:48.915771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:48.919099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:48.945023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:48.947632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:48.948486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:48.949380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:49.123099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:49.138719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:49.146489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:49.168531 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93a29670-85ee-4d4d-bbab-e67be4afe812 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.269866 Jul 26 04:32:49.170653 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 831/1740] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:48 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:49.202897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10f169ab-4067-4962-8e57-d70bc012bed8 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] Calling method '.version_select at 0x7f38b5a3eaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:49.262899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:32:49.264283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:32:49.264509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:32:49.265168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:32:49.266080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:32:49.291471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:49.291934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:49.295063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:49.295856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:49.351240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Getting quotas for project a0a519d3ee764566951caddc2e7e85d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:49.373105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Getting quotas for user 91fb451630e84c87acf036c15237ec08 and project a0a519d3ee764566951caddc2e7e85d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:49.423681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Going to run 2 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:32:49.427100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 926998ed-2b09-4860-9ff9-efc0f83f8c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:32:49.474380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=926998ed-2b09-4860-9ff9-efc0f83f8c22,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:32:49.678177 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d679ec1f-7899-4e7e-a61c-4e28d341d113 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776744 Jul 26 04:32:49.684838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 910/1741] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:32:49.686054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:49.686743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:49.709011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:49.709482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:49.710337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:49.710792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:50.099237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:50.119653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:50.122914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:50.124670 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35e7704e-dd06-4594-8ca0-231aee797cd3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.442396 Jul 26 04:32:50.127012 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 911/1742] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:49 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:50.155191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:50.188854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:50.191413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Searching by: {'deleted': False, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:32:50.250445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:50.251458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:50.252583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:50.253825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:50.496420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57395206-b6ed-43c6-8fcf-2be935a8e9b9 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.367722 Jul 26 04:32:50.497100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 912/1743] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:32:50 2022] GET /compute/v2.1/servers => generated 677 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:50.512102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:50.512726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:50.541186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:50.541645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:50.546083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:50.547771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.033957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:51.049011 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71481fdd-3b24-4cc4-bee7-73e4f85ec60b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.541039 Jul 26 04:32:51.051586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 913/1744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:50 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:51.061965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:51.063446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:51.091419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.097628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.100602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.101697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.361841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:51.373534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:51.375210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:51.389234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:51.396414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb06a3f9-6f6f-45fb-bb55-755bb14a51cb tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.342051 Jul 26 04:32:51.418929 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 914/1745] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:51 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:51.427210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:51.429698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:51.439164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.441171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.442627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.443301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.606490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:51.624670 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37729028-8d74-4660-b40c-35ad9b0b5d27 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1224 microversion: 2.1 time: 0.203980 Jul 26 04:32:51.635330 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 915/1746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:51 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:51.652878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:51.654851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:51.670545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.674146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:51.675265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:51.675689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.019299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:52.030537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:52.033695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:52.035338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8112b3eb-fc0a-4dbb-80f0-5ebf7329d1ee tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.397865 Jul 26 04:32:52.063036 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 916/1747] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:51 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:52.075563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:52.076657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:52.098727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.101470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.103615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.107021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.564645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10f169ab-4067-4962-8e57-d70bc012bed8 tempest-FloatingIPDetailsTestJSON-878419556 tempest-FloatingIPDetailsTestJSON-878419556-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/0e0803ff-cd61-4f65-8656-30dd1c8bdff1" status: 202 len: 0 microversion: 2.1 time: 3.379568 Jul 26 04:32:52.565648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 832/1748] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:32:49 2022] DELETE /compute/v2.1/os-floating-ips/0e0803ff-cd61-4f65-8656-30dd1c8bdff1 => generated 0 bytes in 3394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:32:52.571885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c64a1fd0-e3e2-4dfb-b8d6-775b5476e0e2 req-1aac278c-45cc-4ccd-814d-c380c9b55547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "name": "network-vif-unplugged", "status": "completed", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:52.599707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:52.615203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e78a18ef-c6c4-4656-902c-bd8de2d37178 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.546035 Jul 26 04:32:52.633934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:52.636008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c64a1fd0-e3e2-4dfb-b8d6-775b5476e0e2 req-1aac278c-45cc-4ccd-814d-c380c9b55547 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.636457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c64a1fd0-e3e2-4dfb-b8d6-775b5476e0e2 req-1aac278c-45cc-4ccd-814d-c380c9b55547 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.641577 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 917/1749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:52 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:52.649770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:52.650354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:52.673472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.673931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.674756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.675203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.681534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c64a1fd0-e3e2-4dfb-b8d6-775b5476e0e2 req-1aac278c-45cc-4ccd-814d-c380c9b55547 service nova] Creating event network-vif-unplugged:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h2-848886-16 Jul 26 04:32:52.695680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c64a1fd0-e3e2-4dfb-b8d6-775b5476e0e2 req-1aac278c-45cc-4ccd-814d-c380c9b55547 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128078 Jul 26 04:32:52.696301 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 833/1750] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:52.710570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:52.722422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:52.739917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.746975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:52.748449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:52.749107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:53.007513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.019735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06e697cb-9e20-4480-aa2b-6edeb12d766f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1278 microversion: 2.1 time: 0.318119 Jul 26 04:32:53.021328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 834/1751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:52 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1278 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:53.069950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:53.070712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:53.080751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:53.083882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:53.084973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:53.087488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:53.220940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.231218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.233014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.239246 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d93f15a-3f06-46db-a30a-a37727990d27 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.596520 Jul 26 04:32:53.250178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 918/1752] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:52 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:53.393217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2036569841", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:53.445586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.459719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.462442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:53.464595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc40d37b-b0dd-49ad-9254-4a7475cbaa82 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.399374 Jul 26 04:32:53.466119 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 835/1753] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:53 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:53.477190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:32:53.636864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:53.638133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:53.647129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:53.647843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:53.649979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:53.650634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:53.683566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:54.105250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.119085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:32:54.119714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:32:54.120430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:32:54.120430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:32:54.120764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:32:54.131483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b265bc04-1bb9-4cea-bc6e-db1b0e6226e9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.498408 Jul 26 04:32:54.141151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 836/1754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:53 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:54.143430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.146099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.147143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.150675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.153876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:54.154874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:54.177089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.179202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.181873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.182534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.207496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Getting quotas for project 2259161ad29b4d7ea739ac0762516c77. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:32:54.212845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Getting quotas for user c2873cad521441a89fb4139e6b33147c and project 2259161ad29b4d7ea739ac0762516c77. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:32:54.237036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:32:54.241866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:32:54.345389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bfd5cb7b-0e17-4317-99bc-2ebe875ec347 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098148 Jul 26 04:32:54.346054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 919/1755] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:32:54.358320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:54.360709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:54.382324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.383128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.384774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.386873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.661533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.674330 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0559e4b0-033b-483b-9e0a-fee34446f0f7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1278 microversion: 2.1 time: 0.529581 Jul 26 04:32:54.675324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 837/1756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:54 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1278 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:54.682097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fa09fa7-42ce-404f-a5cb-fb6be2ebc509 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:54.683081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fa09fa7-42ce-404f-a5cb-fb6be2ebc509 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:54.780281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=22 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:54.810083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fa09fa7-42ce-404f-a5cb-fb6be2ebc509 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.824617 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fa09fa7-42ce-404f-a5cb-fb6be2ebc509 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1217 microversion: 2.1 time: 0.146381 Jul 26 04:32:54.825224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 838/1757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:54 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:54.830441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:54.831065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:54.852087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.852543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.853675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:54.854319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:54.854516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.870285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.875161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:54.884940 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-881d9b1a-1de3-418e-afc9-e55e648276e5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.537718 Jul 26 04:32:54.885704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 920/1758] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:54 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:55.162276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:55.162927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:55.176758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.177248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:55.179470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.181516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:55.193944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:32:55.466065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:55.479215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:55.483463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:55.485370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a53ce65-e733-4448-8159-8c2149ea86ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.659122 Jul 26 04:32:55.501865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 839/1759] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:54 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:55.700798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:55.702336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:55.710105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.710926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:55.712084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.712773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:55.784868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:55.802863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6379626f-ba73-4009-b32a-8852aee23d31 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1718 microversion: 2.1 time: 0.645823 Jul 26 04:32:55.803511 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 921/1760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:55 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1718 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:55.852684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:55.853556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:55.865082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.871845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:55.873044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:55.873689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.096782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:56.114392 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e20741d-cb1f-43cb-a319-4616ef2f87a0 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1269 microversion: 2.1 time: 0.269237 Jul 26 04:32:56.115274 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 922/1761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:55 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:56.134361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:56.139088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:56.148227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.150272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.151276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.151888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.253649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:56.263376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:56.265216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:56.274073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a25f88b9-7d25-44b2-967a-0feff8b5178a tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.143005 Jul 26 04:32:56.275824 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 923/1762] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:56 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:56.353271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:56.367537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd086343-69ef-4ed4-85ca-d83677e8e23e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.670996 Jul 26 04:32:56.368792 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 840/1763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:55 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:32:56.509783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:56.511971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:56.540577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.541044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.548339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.548936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.826437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:56.827387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:56.845991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.847222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:56.848293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:56.849921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.461883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.488384 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d64d9b1e-2154-4968-8cf7-4c4a2d76a6fb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1708 microversion: 2.1 time: 0.663117 Jul 26 04:32:57.491009 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 841/1764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:56 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1708 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:57.528820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:57.533930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:57.553632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.554474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.556395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.557885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.702282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.724702 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c717f09-e7e1-489f-a17a-f2a6a1c87a3c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1275 microversion: 2.1 time: 0.230876 Jul 26 04:32:57.726116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 842/1765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:57 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:57.729222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.733230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:57.734814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:57.738923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.755002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.755781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.756836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.757443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.762925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.764209 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-429a42b7-c937-47b7-8ba0-5ac8f1a8147e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 1.259256 Jul 26 04:32:57.765230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 924/1766] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:56 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:57.773218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:57.779765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:57.792115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.793816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.801319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.802091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:57.959876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.970333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.972218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:57.978079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ea6275f-be87-490b-807f-1f65e0fa6395 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.249334 Jul 26 04:32:57.979563 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 843/1767] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:57 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:57.986315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-982fad09-e9a6-48fc-9f36-a91a8ac7206a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '.version_select at 0x7f38b6466c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:57.990997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982fad09-e9a6-48fc-9f36-a91a8ac7206a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:57.992515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982fad09-e9a6-48fc-9f36-a91a8ac7206a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.018735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-982fad09-e9a6-48fc-9f36-a91a8ac7206a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.033497 Jul 26 04:32:58.029177 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 844/1768] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:32:57 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:58.043321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:58.043975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:58.060881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.061604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.063755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.064394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.380516 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06ab7d02-ba2d-4d80-a57b-c66d5f4dad8a tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1861 microversion: 2.1 time: 0.344847 Jul 26 04:32:58.381165 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 845/1769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:58 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1861 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:58.392667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8308335e-2ffe-4320-8d58-b1bbf042e6b5 req-b8f68a19-10f8-45ef-9d32-47799179a0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d715a20-eb86-46c5-a5f9-0dd9818497d5", "tag": "97a03895-0c73-40fd-850e-1b7a1c4786b4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:32:58.419211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8308335e-2ffe-4320-8d58-b1bbf042e6b5 req-b8f68a19-10f8-45ef-9d32-47799179a0ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.420062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8308335e-2ffe-4320-8d58-b1bbf042e6b5 req-b8f68a19-10f8-45ef-9d32-47799179a0ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.432378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:58.442536 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bdc5181c-f4fb-4095-aaf2-cb295abd6505 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.676162 Jul 26 04:32:58.444911 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 925/1770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:57 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:58.455733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:58.459109 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8308335e-2ffe-4320-8d58-b1bbf042e6b5 req-b8f68a19-10f8-45ef-9d32-47799179a0ec service nova] Creating event network-changed:97a03895-0c73-40fd-850e-1b7a1c4786b4 for instance 5d715a20-eb86-46c5-a5f9-0dd9818497d5 on n-h2-848886-16 Jul 26 04:32:58.459622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:58.465991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8308335e-2ffe-4320-8d58-b1bbf042e6b5 req-b8f68a19-10f8-45ef-9d32-47799179a0ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080765 Jul 26 04:32:58.469680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 846/1771] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:32:58.481536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.482009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.483280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.483976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.765258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:58.768619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:58.798536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.798999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:58.799800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:58.800240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.049513 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94ac7150-c6f8-482e-811a-3ca50e0520fa tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1861 microversion: 2.1 time: 0.603299 Jul 26 04:32:59.050115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 926/1772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:58 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1861 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:59.062502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:59.063125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:59.085706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.089266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.090459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.091137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.494355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.507832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46a11ae4-f79d-4167-bb57-5afa4a54340b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.758440 Jul 26 04:32:59.508419 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 847/1773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:58 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:32:59.545703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:59.546405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:59.569710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.570186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.577957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.580468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.689380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.699713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.701221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.709862 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37584494-0581-48eb-ae8d-826dc78bcbff tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.648490 Jul 26 04:32:59.710578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 927/1774] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:59 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:59.717542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:59.722341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:59.737720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.738230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.739095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.739542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.861764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lazy-loading 'services' on Instance uuid 5a9c8e7c-643b-4e11-ba67-181651b63baf {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:32:59.866950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.880071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.882136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:32:59.899921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e442acc-90b1-4c60-bb89-01ad38a4b086 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.364114 Jul 26 04:32:59.902657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 848/1775] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:32:59 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:32:59.913023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:32:59.916453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:32:59.930516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.931256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:32:59.932378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:32:59.933029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.036549 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-53b0e97a-d729-4b30-a086-3ed9b628325c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments/7f6c1694-b295-4d36-9e62-8a2fb10eec33" status: 202 len: 0 microversion: 2.1 time: 0.324666 Jul 26 04:33:00.037342 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 928/1776] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:32:59 2022] DELETE /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments/7f6c1694-b295-4d36-9e62-8a2fb10eec33 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:00.186627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:00.196864 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0b26ad97-d06c-46d7-8561-d24879f293ad tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.292635 Jul 26 04:33:00.200615 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 849/1777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:32:59 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:00.209597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:00.217267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-730634837", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "09fb1eee-d67e-48da-897c-71351baf44be"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:00.221845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:00.234449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.235650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.237411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.238288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.293890 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d98728b-06d6-4748-9b2d-506e4be9091f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091824 Jul 26 04:33:00.294353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] validate_networks() for [('09fb1eee-d67e-48da-897c-71351baf44be', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:33:00.294783 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 850/1778] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:00 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:00.300154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-377840bf-8974-496c-bfca-7095d0e332cf req-006309c5-acea-4706-9bea-948a3636acbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "name": "network-vif-plugged", "status": "completed", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:00.309806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-377840bf-8974-496c-bfca-7095d0e332cf req-006309c5-acea-4706-9bea-948a3636acbe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.310313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-377840bf-8974-496c-bfca-7095d0e332cf req-006309c5-acea-4706-9bea-948a3636acbe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.322666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-377840bf-8974-496c-bfca-7095d0e332cf req-006309c5-acea-4706-9bea-948a3636acbe service nova] Creating event network-vif-plugged:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h2-848886-16 Jul 26 04:33:00.328965 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-377840bf-8974-496c-bfca-7095d0e332cf req-006309c5-acea-4706-9bea-948a3636acbe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Jul 26 04:33:00.329930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 851/1779] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:00.531026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:00.531885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:00.539669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.541031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.543910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.545271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.824850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:00.840312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b55b67e1-71ae-4f0b-88b2-39f1e15c4676 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.314164 Jul 26 04:33:00.841721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 852/1780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:00 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:00.846981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4b510f31-2ddd-437f-a632-90aee513b9d0 req-431291e4-1aba-4163-8c75-aa463b89336f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926998ed-2b09-4860-9ff9-efc0f83f8c22", "tag": "bb7749df-2ae9-4186-84fa-02066c58ea1a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:00.857659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b510f31-2ddd-437f-a632-90aee513b9d0 req-431291e4-1aba-4163-8c75-aa463b89336f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.858407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b510f31-2ddd-437f-a632-90aee513b9d0 req-431291e4-1aba-4163-8c75-aa463b89336f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.891591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4b510f31-2ddd-437f-a632-90aee513b9d0 req-431291e4-1aba-4163-8c75-aa463b89336f service nova] Creating event network-changed:bb7749df-2ae9-4186-84fa-02066c58ea1a for instance 926998ed-2b09-4860-9ff9-efc0f83f8c22 on n-h1-848886-16 Jul 26 04:33:00.916299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4b510f31-2ddd-437f-a632-90aee513b9d0 req-431291e4-1aba-4163-8c75-aa463b89336f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068833 Jul 26 04:33:00.919115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 853/1781] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:00.935712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:00.938592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:00.975294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:00.978272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:00.994440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.000998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.267958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.281844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.288526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.289970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da6bac95-2654-41db-a981-8d89f7181667 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.369411 Jul 26 04:33:01.312767 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 854/1782] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:00 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:01.319049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:01.319764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:01.333025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.333589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.337590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.338286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.528696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.539107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.552500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.568597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de0a295f-5ae3-4d4a-9348-88a16fdc5c9e tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.253879 Jul 26 04:33:01.569531 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 855/1783] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:01 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:01.574659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4850af5d-7073-4702-b5ff-000019e29533 req-606ed725-6b94-4a8f-b0c6-77fb7e54960d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:01.599134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4850af5d-7073-4702-b5ff-000019e29533 req-606ed725-6b94-4a8f-b0c6-77fb7e54960d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.602887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4850af5d-7073-4702-b5ff-000019e29533 req-606ed725-6b94-4a8f-b0c6-77fb7e54960d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.627629 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4850af5d-7073-4702-b5ff-000019e29533 req-606ed725-6b94-4a8f-b0c6-77fb7e54960d service nova] Creating event network-changed:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:33:01.641460 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4850af5d-7073-4702-b5ff-000019e29533 req-606ed725-6b94-4a8f-b0c6-77fb7e54960d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070095 Jul 26 04:33:01.642638 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 856/1784] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:01.662329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:01.663435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:01.672162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.672960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.674020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.674771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.699468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:01.855614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:33:01.857062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:33:01.857533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:33:01.857942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:33:01.862572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:33:01.878785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.879238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.882020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:01.882637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:01.909427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Getting quotas for project 93561d56478e4e04a2f381e9a8e830ec. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:33:01.916119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Getting quotas for user 2b7961565a4f4982973fe743095ac18c and project 93561d56478e4e04a2f381e9a8e830ec. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:33:01.935702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:33:01.938910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:33:01.965790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:01.978273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-534f413e-3b86-476e-9fb9-2921524fc5e5 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.331589 Jul 26 04:33:01.980809 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 857/1785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:01 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:01.987315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:01.989907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:02.018299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.018935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.020890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.022567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.053774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd4164a6-5486-428d-aadf-bb5ece8719b8 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.996764 Jul 26 04:33:02.055383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 929/1786] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:33:02.064035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:02.064929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:02.074936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.075904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.077136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.078416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.102287 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b7aab80-fe95-4670-b30a-e8f872959a06 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120025 Jul 26 04:33:02.103135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 858/1787] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:01 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:02.116928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:02.117778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:02.210675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:02.222304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:02.224033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:02.225297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-621ecb57-169a-4f69-a394-664cddd3a49e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1258 microversion: 2.21 time: 0.121142 Jul 26 04:33:02.248664 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 859/1788] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:02 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1258 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:02.314351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:02.315145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:02.329683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.330965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.333893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.337126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.721778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:02.734398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-495d2f12-5d78-4747-bb49-9de3fbe59362 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.675964 Jul 26 04:33:02.737285 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 930/1789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:02 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:02.748513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:02.749929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:02.769083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.769855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:02.772637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:02.774778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.174631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.185069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.193873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.195380 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0dab91f5-5374-416e-bab9-9b2bda1846a5 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.886270 Jul 26 04:33:03.196462 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 860/1790] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:02 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:03.216621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:03.224982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:03.242492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.243412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.244394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.244994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.580408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.595938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.601669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.606612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:03.621531 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9d412d3-a7c1-4444-b782-febebe91b313 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.418083 Jul 26 04:33:03.622136 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 861/1791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:03 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:03.641334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:03.645519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f245760e-5d6c-4923-bd76-175d57f2347c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.905900 Jul 26 04:33:03.646478 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 931/1792] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:02 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:03.651363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:03.654029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:03.656894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:03.666330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.668461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.669131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.670183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.670993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.671618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.675393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.676105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.782528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85db2f7b-e88d-46a6-b710-ca9b42c20194 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141771 Jul 26 04:33:03.787321 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 862/1793] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:03 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:03.795700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:03.796749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:03.803774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.804508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:03.805471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:03.806078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:04.052521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.073265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.075914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.090184 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ee4526f-f5b9-438a-a1fe-ad0a973a98ac tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1310 microversion: 2.21 time: 0.429895 Jul 26 04:33:04.092395 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 932/1794] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:03 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:04.221257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:04.222030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:04.234679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:04.235179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:04.236043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:04.239165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:04.579872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.595426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.597114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:04.598318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c4d8936-50e3-4107-9d88-b19358f1b3ed tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1280 microversion: 2.25 time: 0.382885 Jul 26 04:33:04.602505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 933/1795] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:04 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1280 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:33:04.645359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:04.646261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:04.654079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:04.654926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:04.655975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:04.656648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.102670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.119374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-28b333b8-0e47-4969-8e97-a7e856922287 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 1.330822 Jul 26 04:33:05.132353 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 863/1796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:03 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:05.142793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:05.143406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:05.157717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.158823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.160192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.162070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.301340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.322060 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b680fd5-4f3b-475d-803a-07e59c9753d4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.680769 Jul 26 04:33:05.327233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 934/1797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:04 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:05.362000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:05.369087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:05.391182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.391629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.392492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.392939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.438130 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-286b9642-247b-4d5d-a229-cc71934c086c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101052 Jul 26 04:33:05.438753 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 935/1798] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:05 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:05.444430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:05.445498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:05.463609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.464073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.465942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.467970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.494051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.528097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.540426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.554546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b01ae2ba-8ea5-4c74-ab75-afbc82341e57 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.420989 Jul 26 04:33:05.574207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 864/1799] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:05 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:05.603130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.612619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.614556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:05.615882 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab2e6542-8a71-4f29-bc81-6ad0c569e28f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1316 microversion: 2.21 time: 0.176128 Jul 26 04:33:05.616630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 936/1800] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:05 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:05.622292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:05.623243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:05.630958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.631819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.632876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.633552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.892545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bb876cdc-681d-4fcb-a53e-6f0ca8293b48 req-191230ed-b0c7-4770-84c1-8187738c0a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d715a20-eb86-46c5-a5f9-0dd9818497d5", "name": "network-vif-plugged", "status": "completed", "tag": "97a03895-0c73-40fd-850e-1b7a1c4786b4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:05.928944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bb876cdc-681d-4fcb-a53e-6f0ca8293b48 req-191230ed-b0c7-4770-84c1-8187738c0a8b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:05.929498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bb876cdc-681d-4fcb-a53e-6f0ca8293b48 req-191230ed-b0c7-4770-84c1-8187738c0a8b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:05.970482 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bb876cdc-681d-4fcb-a53e-6f0ca8293b48 req-191230ed-b0c7-4770-84c1-8187738c0a8b service nova] Creating event network-vif-plugged:97a03895-0c73-40fd-850e-1b7a1c4786b4 for instance 5d715a20-eb86-46c5-a5f9-0dd9818497d5 on n-h2-848886-16 Jul 26 04:33:05.979672 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bb876cdc-681d-4fcb-a53e-6f0ca8293b48 req-191230ed-b0c7-4770-84c1-8187738c0a8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092457 Jul 26 04:33:05.982655 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 937/1801] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:33:06.055638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.079940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.084793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.086579 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6222540-8427-4627-9f4e-bc6cbe8600ca tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1476 microversion: 2.25 time: 0.468062 Jul 26 04:33:06.087841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 865/1802] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:05 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:06.142966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.144619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.168576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.169138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.170025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.170570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.404956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.406086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.420563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.421558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.423341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.423868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.456518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:06.467426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.478189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93898fae-0dd4-4d0d-8131-51ec0c6cd99f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.339805 Jul 26 04:33:06.480858 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 866/1803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:06.495400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.496191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.506834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.507291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.508126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.508602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.623578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 9ea4a327-fde9-4c05-8fde-43bf09a176a1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:06.648468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c9b188f-1d5f-4cf7-b834-61797e8f9cdf tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1970 microversion: 2.25 time: 0.541391 Jul 26 04:33:06.650135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 938/1804] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1970 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:06.662457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.665417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.674262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.679232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.680198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.680760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.748410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4b1d3c2-9fec-4073-b5e8-7b00cb9428d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097100 Jul 26 04:33:06.753594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 939/1805] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:06.763255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.764149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.774457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.775045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.775801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.776102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.918090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.931302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.933776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:06.942356 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79fd3de8-72fd-416d-8095-fb418105385c tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.187471 Jul 26 04:33:06.943808 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 940/1806] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:06.950001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:06.951074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:06.969466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.970621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:06.971664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:06.973908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.002125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:07.020162 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0cbec559-d261-48ef-b6c6-91903746b79d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.536629 Jul 26 04:33:07.022376 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 867/1807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:07.033773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:07.035249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:07.054303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.056120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.059173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.059678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.227055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:07.237813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:07.239698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:07.242506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca1c3175-2b19-426f-a01b-37d5f66f627d tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.296813 Jul 26 04:33:07.242669 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 941/1808] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:06 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:07.377775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 9ea4a327-fde9-4c05-8fde-43bf09a176a1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:07.394304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab19d979-e515-48a0-8ab3-81d72483b5b9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1970 microversion: 2.25 time: 0.369761 Jul 26 04:33:07.411221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 868/1809] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:07 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1970 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:07.417647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:07.421687 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:33:07.421687 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:33:07.423719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.424621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.425913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.426543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.455698 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-366b0738-2e6d-470d-b127-90e841058738 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.042099 Jul 26 04:33:07.456892 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 942/1810] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Jul 26 04:33:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:33:07.474947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-848886-16", "block_migration": "auto"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:07.477886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:07.485953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.486775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.487798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.488440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.502816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:07.503427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:07.513703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.514192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.515142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.515576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.526552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'flavor' on Instance uuid 9ea4a327-fde9-4c05-8fde-43bf09a176a1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:07.555013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Going to try to live migrate instance to n-h1-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:33:07.819049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:07.830393 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-229bd76c-1cb3-4e56-a437-b03755f16136 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.332491 Jul 26 04:33:07.834449 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 943/1811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:07 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:07.848076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:07.856522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:07.865785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:07.897916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.898678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.899477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:07.899934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:07.963411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28593844-3d41-4026-87aa-0aa4b328863a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127636 Jul 26 04:33:07.965880 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 944/1812] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:07 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:33:07.983723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:07.985516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:08.000125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.000710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.004387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.005790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.280759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:08.331361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:08.336966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:08.349726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08089c8f-bfa7-44d7-8ec8-cc0956b210a8 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1446 microversion: 2.75 time: 0.382331 Jul 26 04:33:08.362259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 945/1813] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:07 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1446 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:08.362259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-44f2a741-a80c-4f5e-97bc-2984298e2083 req-15044cef-fd7f-41eb-9dbc-f4c1452899f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c79d4f-a6ee-496b-ba5e-6c5168a618e0", "tag": "d9bf39ed-9821-452e-b381-22b3cf6a75d8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:08.383223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-44f2a741-a80c-4f5e-97bc-2984298e2083 req-15044cef-fd7f-41eb-9dbc-f4c1452899f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.383676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-44f2a741-a80c-4f5e-97bc-2984298e2083 req-15044cef-fd7f-41eb-9dbc-f4c1452899f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.407692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-44f2a741-a80c-4f5e-97bc-2984298e2083 req-15044cef-fd7f-41eb-9dbc-f4c1452899f6 service nova] Creating event network-changed:d9bf39ed-9821-452e-b381-22b3cf6a75d8 for instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 on n-h1-848886-16 Jul 26 04:33:08.417769 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-44f2a741-a80c-4f5e-97bc-2984298e2083 req-15044cef-fd7f-41eb-9dbc-f4c1452899f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061900 Jul 26 04:33:08.418435 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 946/1814] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:08.431889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:08.432936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:08.463583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.478368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.481382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.482105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.804272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:08.816195 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61f22668-93d1-4904-8ac8-d25451b4e05b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.392930 Jul 26 04:33:08.830969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 947/1815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:08 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:08.838268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:08.839287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:08.846446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.847514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:08.848572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:08.849245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.065399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.077469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.079325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.080543 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8a81ea3-1cfe-4b3d-93c9-931249928f5e tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.247885 Jul 26 04:33:09.095698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 948/1816] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:08 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:09.105014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f08b43c1-7bca-4f00-9503-5531800ddb82 req-81731c58-9cf8-4c23-ad4d-88817628b5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926998ed-2b09-4860-9ff9-efc0f83f8c22", "name": "network-vif-plugged", "status": "completed", "tag": "bb7749df-2ae9-4186-84fa-02066c58ea1a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:09.123028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f08b43c1-7bca-4f00-9503-5531800ddb82 req-81731c58-9cf8-4c23-ad4d-88817628b5de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.123485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f08b43c1-7bca-4f00-9503-5531800ddb82 req-81731c58-9cf8-4c23-ad4d-88817628b5de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.152467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f08b43c1-7bca-4f00-9503-5531800ddb82 req-81731c58-9cf8-4c23-ad4d-88817628b5de service nova] Creating event network-vif-plugged:bb7749df-2ae9-4186-84fa-02066c58ea1a for instance 926998ed-2b09-4860-9ff9-efc0f83f8c22 on n-h1-848886-16 Jul 26 04:33:09.159030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f08b43c1-7bca-4f00-9503-5531800ddb82 req-81731c58-9cf8-4c23-ad4d-88817628b5de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061949 Jul 26 04:33:09.161180 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 949/1817] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:09.164902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:09.165591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:09.172803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.173264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.174071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.175154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.517189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.527981 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1b4eb45-713c-411a-bbcb-802ee0fd7c89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.366969 Jul 26 04:33:09.528875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 950/1818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:09 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:09.542531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:09.543373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:09.561883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.562705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.563734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.564777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.658701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.673066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.674732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:09.686291 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97a89256-4e44-4de5-814a-6df5f0d8f936 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1452 microversion: 2.75 time: 0.153508 Jul 26 04:33:09.695578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 951/1819] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:09 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:09.841411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:09.842955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:09.853838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.854703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:09.856427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:09.857131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.173486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.190540 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-598a35bf-88b2-454b-8cb0-4db6bfe83bfa tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.356760 Jul 26 04:33:10.191746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 952/1820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:09 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:10.197095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:10.198042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:10.205337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.208415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.208415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.208415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.468811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.481475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.483070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.484296 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5b202284-d503-43fb-8761-5d81162666e3 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.291277 Jul 26 04:33:10.493912 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 953/1821] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:10 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:10.549501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:10.550132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:10.556530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.557027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.558683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.559332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.764277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.772216 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a0f0fb8-efaf-47bd-bac5-bd34f18529be tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.227306 Jul 26 04:33:10.779393 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 954/1822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:10 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:10.791904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:10.792777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:10.800619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.801390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.802466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:10.803115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:10.941418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.953232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.955187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:10.961148 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1aa66c48-0c82-440d-93fc-c2658c694a8f tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1452 microversion: 2.75 time: 0.179404 Jul 26 04:33:10.962272 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 955/1823] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:10 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:11.214929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:11.215574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:11.229221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:11.230906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:11.231804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:11.232166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:11.462041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:11.465686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:11.472680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12ed8abf-2a76-4357-8625-40d9ebcfad84 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1320 microversion: 2.1 time: 0.264243 Jul 26 04:33:11.486275 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 956/1824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:11 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:11.490311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0133742c-04ed-49ee-a4a1-1b2ccb67db09"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:11.494381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:11.504422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:11.505204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:11.506211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:11.507073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:11.929017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=46 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:12.003458 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a77b07d0-010a-49d5-a6c3-b9b4ed028d1e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "POST /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517387 Jul 26 04:33:12.010544 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 957/1825] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:33:11 2022] POST /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:12.025183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:12.026420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:12.038662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.044997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.047151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.047622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.216193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:12.226901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.240973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.243113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.245061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55e3f439-bd9a-4311-bab2-942d9daea8cc tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.230241 Jul 26 04:33:12.246006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 958/1826] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:12 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:12.251643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:12.252252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:12.266010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.266681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.267519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.267962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.652629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.665874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ecdb2532-adcb-4b34-b5cd-f2c1f8af607c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.418365 Jul 26 04:33:12.676771 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 959/1827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:12 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:12.682892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:12.692170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:12.718231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.719063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.725769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:12.726543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:12.928535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.945853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.949450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:12.964176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-852b5fef-7e76-4478-9735-f0d58613b3da tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1452 microversion: 2.75 time: 0.284469 Jul 26 04:33:12.965026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 960/1828] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:12 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:12.998317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-eaa394b5-f79f-4b75-af7f-f7d9936de7b3 req-d4dbd02b-651e-4a26-b8b4-74062f40e21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-plugged", "status": "completed", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:13.028149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eaa394b5-f79f-4b75-af7f-f7d9936de7b3 req-d4dbd02b-651e-4a26-b8b4-74062f40e21f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.028695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eaa394b5-f79f-4b75-af7f-f7d9936de7b3 req-d4dbd02b-651e-4a26-b8b4-74062f40e21f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.058029 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-eaa394b5-f79f-4b75-af7f-f7d9936de7b3 req-d4dbd02b-651e-4a26-b8b4-74062f40e21f service nova] Creating event network-vif-plugged:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:33:13.070808 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-eaa394b5-f79f-4b75-af7f-f7d9936de7b3 req-d4dbd02b-651e-4a26-b8b4-74062f40e21f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081751 Jul 26 04:33:13.072663 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 961/1829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:13.084260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:13.084961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:13.103383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.103836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.104620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.105057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.426758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:13.445007 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a3cee0c-297a-4ea0-ba25-8c741fa3faa7 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 200 len: 1507 microversion: 2.1 time: 0.367606 Jul 26 04:33:13.446128 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 962/1830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:13 2022] GET /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:13.464212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:13.465594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:13.483348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.485035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.487601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.489445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.852541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:13.862887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:13.864908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:13.866538 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2fb17d13-7fe6-49ca-9a45-9851705ffaad tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.411678 Jul 26 04:33:13.867890 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 963/1831] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:13 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:13.874390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:13.877326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 926998ed-2b09-4860-9ff9-efc0f83f8c22] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:13.885749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.886519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:13.887652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:13.888297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.117719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:14.127817 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b742df1-cf80-4da5-b472-d74c1eb24426 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/926998ed-2b09-4860-9ff9-efc0f83f8c22" status: 200 len: 1507 microversion: 2.1 time: 0.257873 Jul 26 04:33:14.129206 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 964/1832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:13 2022] GET /compute/v2.1/servers/926998ed-2b09-4860-9ff9-efc0f83f8c22 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:14.147826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:14.148869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:14.158483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.159082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.161823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.162766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.209152 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ccf39b3-e678-48f7-922a-945f74679294 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1/action" status: 202 len: 0 microversion: 2.25 time: 6.742185 Jul 26 04:33:14.209925 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 869/1833] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:33:07 2022] POST /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1/action => generated 0 bytes in 6745 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:14.218212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:14.219011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:14.258146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.258540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.259345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.259893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.518342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:14.544750 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78030c9c-af9b-438a-be91-f8da2609f36b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1317 microversion: 2.1 time: 0.398017 Jul 26 04:33:14.546978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 965/1834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:14 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:14.566026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:14.566828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 926998ed-2b09-4860-9ff9-efc0f83f8c22] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:14.575426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.576135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.577654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.578426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.587781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:14.603536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:14.608931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:14.622390 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e338e66-c33c-47d3-8edf-3a20aad1cc86 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1437 microversion: 2.75 time: 0.411198 Jul 26 04:33:14.627122 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 870/1835] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:14 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1437 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:14.636402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:14.639708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:14.661204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 926998ed-2b09-4860-9ff9-efc0f83f8c22] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:14.661894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.663031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.667974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:14.668684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:14.846308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b65e7d3f-4f3a-440e-a4e4-d2fea471eeb1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "DELETE /compute/v2.1/servers/926998ed-2b09-4860-9ff9-efc0f83f8c22" status: 204 len: 0 microversion: 2.1 time: 0.282843 Jul 26 04:33:14.852087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 966/1836] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:33:14 2022] DELETE /compute/v2.1/servers/926998ed-2b09-4860-9ff9-efc0f83f8c22 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:15.087349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:15.090643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:15.122544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.123222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.124633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.125073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.310640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:33:15.312106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:33:15.314227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:33:15.315423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:33:15.315953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:33:15.372445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:15.383391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:15.389658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:15.391569 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93a0da3e-acd5-4956-9be5-f58638156f5d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.762295 Jul 26 04:33:15.392699 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 871/1837] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:14 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:15.405018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:15.405860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:15.416023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.416881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.417858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.418772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.432454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:15.445029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.445791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.447092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.447621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.496360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 5d715a20-eb86-46c5-a5f9-0dd9818497d5] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:15.508052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:15.828527 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec21b30b-f76b-4179-a543-7229bfb61690 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5" status: 204 len: 0 microversion: 2.1 time: 0.433239 Jul 26 04:33:15.830571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 872/1838] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:33:15 2022] DELETE /compute/v2.1/servers/5d715a20-eb86-46c5-a5f9-0dd9818497d5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:15.836656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:15.837753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:15.881974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:15.890004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:15.893904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.894758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.897021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.902996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.933520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfb4f0bf-e1e0-47be-8cce-78608c27e579 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb/action" status: 202 len: 1942 microversion: 2.75 time: 1.079789 Jul 26 04:33:15.938704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 967/1839] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:33:14 2022] POST /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb/action => generated 1942 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 04:33:15.952619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-af5091d5-d800-46de-932d-4844ef4a26a1 req-ab60d3f6-f970-4015-aba6-1cf77f48c01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c79d4f-a6ee-496b-ba5e-6c5168a618e0", "name": "network-vif-plugged", "status": "completed", "tag": "d9bf39ed-9821-452e-b381-22b3cf6a75d8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:15.972890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-af5091d5-d800-46de-932d-4844ef4a26a1 req-ab60d3f6-f970-4015-aba6-1cf77f48c01b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:15.973679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-af5091d5-d800-46de-932d-4844ef4a26a1 req-ab60d3f6-f970-4015-aba6-1cf77f48c01b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:15.993816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-af5091d5-d800-46de-932d-4844ef4a26a1 req-ab60d3f6-f970-4015-aba6-1cf77f48c01b service nova] Creating event network-vif-plugged:d9bf39ed-9821-452e-b381-22b3cf6a75d8 for instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 on n-h1-848886-16 Jul 26 04:33:16.001889 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-af5091d5-d800-46de-932d-4844ef4a26a1 req-ab60d3f6-f970-4015-aba6-1cf77f48c01b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061628 Jul 26 04:33:16.002848 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 968/1840] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:16.014914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:16.019351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:16.037426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.038967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.040019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.040693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.047621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:16.405384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:16.417686 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b06f247-d8f1-4996-aae7-fe01f135be4a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1466 microversion: 2.1 time: 0.411651 Jul 26 04:33:16.418311 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 969/1841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:16 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:16.424219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:16.424819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:16.446127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.451004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.452592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.453044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.678430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:16.705063 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0bcac6b-7847-425c-8f5d-f46751cf683c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.283430 Jul 26 04:33:16.706797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 970/1842] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:16 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:16.722626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:16.728008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-97907670", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2bd3c0b5-0bbc-4f0d-b0ee-cfb2948bc868"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:16.734521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:16.736115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:16.737323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec71fafb-0470-4feb-9d21-e47c102e754f tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1358 microversion: 2.21 time: 0.905404 Jul 26 04:33:16.741498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 873/1843] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:15 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1358 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:16.760986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:16.761604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:16.773272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.774355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.775370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:16.776541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:16.858056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] validate_networks() for [('2bd3c0b5-0bbc-4f0d-b0ee-cfb2948bc868', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:33:17.182901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:17.197566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:17.203250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:17.206249 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6b7ffa4-fd02-40c1-b88a-58f60297b42f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.463655 Jul 26 04:33:17.210983 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 874/1844] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:16 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:17.221725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1382280072", "metadata": {"image_type": "test"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:17.227038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:17.252616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:17.253151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:17.256739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:17.258255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:17.364888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Getting quotas for project 2259161ad29b4d7ea739ac0762516c77. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:33:17.377821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Getting quotas for user c2873cad521441a89fb4139e6b33147c and project 2259161ad29b4d7ea739ac0762516c77. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:33:17.434523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:17.903963 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9ec30ec-d219-4ff0-b8ac-b7752d6fd5bb tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "POST /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765/action" status: 202 len: 0 microversion: 2.1 time: 0.675131 Jul 26 04:33:17.920399 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 875/1845] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:33:17 2022] POST /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:33:17.944251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:17.945376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:17.962334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:17.964927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:17.966021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:17.966650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:18.703379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:18.768473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-525cd5e8-2966-44ed-a776-e419122a57a7 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.843410 Jul 26 04:33:18.773188 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 876/1846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:17 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:18.789030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:18.804804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:18.824102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:18.825412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:18.828717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:18.829343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:19.297366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.308273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.309895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.312418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d403745-a1bf-4ba1-b016-c992f9d4f3c5 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1551 microversion: 2.21 time: 0.526772 Jul 26 04:33:19.313014 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 877/1847] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:18 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1551 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:19.320826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-950071f3-fc35-4d60-97db-c5ad8f285032 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5bb1940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:19.392343 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-950071f3-fc35-4d60-97db-c5ad8f285032 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.077904 Jul 26 04:33:19.393221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 878/1848] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:19 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:19.409971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:19.411030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:19.430613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:19.431460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:19.433533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:19.434192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:19.698707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.714059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.718185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:19.723725 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41052af3-b95b-4403-b44d-661f9b298f60 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.326730 Jul 26 04:33:19.725291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 879/1849] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:19 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:19.734001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6749d661-71ba-4e1a-b59a-c78ea3abc1f0 req-3d539f24-31cb-4b01-a243-1f29838cb181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926998ed-2b09-4860-9ff9-efc0f83f8c22", "name": "network-vif-deleted", "tag": "bb7749df-2ae9-4186-84fa-02066c58ea1a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:19.758294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6749d661-71ba-4e1a-b59a-c78ea3abc1f0 req-3d539f24-31cb-4b01-a243-1f29838cb181 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:19.760593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6749d661-71ba-4e1a-b59a-c78ea3abc1f0 req-3d539f24-31cb-4b01-a243-1f29838cb181 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:19.803856 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6749d661-71ba-4e1a-b59a-c78ea3abc1f0 req-3d539f24-31cb-4b01-a243-1f29838cb181 service nova] Creating event network-vif-deleted:bb7749df-2ae9-4186-84fa-02066c58ea1a for instance 926998ed-2b09-4860-9ff9-efc0f83f8c22 on n-h1-848886-16 Jul 26 04:33:19.829311 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6749d661-71ba-4e1a-b59a-c78ea3abc1f0 req-3d539f24-31cb-4b01-a243-1f29838cb181 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100369 Jul 26 04:33:19.829844 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 880/1850] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:19.946611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e6fd712a-8a56-4f19-9b62-dcbd41895f09 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5a3e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1721516453", "description": "tempest-description-1862241646"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:19.993272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:33:19.993783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:33:19.994163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:33:19.995022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:33:19.995437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:33:20.011268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.012086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.013053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.014483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.045352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Getting quotas for project a0a519d3ee764566951caddc2e7e85d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:33:20.059497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Getting quotas for user 91fb451630e84c87acf036c15237ec08 and project a0a519d3ee764566951caddc2e7e85d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:33:20.085388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Going to run 2 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:33:20.095846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:33:20.172186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=f889b3d4-7704-4c1f-8ebf-8adf04aa15f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:33:20.235526 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e6fd712a-8a56-4f19-9b62-dcbd41895f09 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.404387 Jul 26 04:33:20.243676 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 881/1851] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:19 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:20.243676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:20.243676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:20.264215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.264754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.265474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.265913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.356378 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35f6741c-fd9b-4c16-ba03-c2b0ddd2c44e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.648047 Jul 26 04:33:20.357181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:20.359552 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 971/1852] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:33:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 3652 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:33:20.374134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:20.377324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:20.405075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.406331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.408933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.409417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.616939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:20.644574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a92172a0-bd59-4a61-ba0f-2e7ddb9a0c6b tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.282156 Jul 26 04:33:20.646322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 972/1853] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:20 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:20.670651 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6ed44c4-e6db-4d3f-8595-4df13cefda28 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 204 len: 0 microversion: 2.21 time: 0.432221 Jul 26 04:33:20.672141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 882/1854] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:33:20 2022] DELETE /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:33:20.678008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:20.682508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4377f0ea-3c42-48d6-8be7-03e70b2c367f tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38bac5d310>, body: {"security_group_rule": {"parent_group_id": "d67a3b0d-2f56-4395-87ac-768cded25765", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:20.704252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:20.705048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Searching by: {'deleted': False, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:33:20.806409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.806972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:20.807701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:20.808147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.075175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:33:21.167475 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78a8d544-e8cb-4dcb-ad62-1fbd7217b22d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.493687 Jul 26 04:33:21.168065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 883/1855] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:33:20 2022] GET /compute/v2.1/servers => generated 1001 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:21.183168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-159c4ac5-51ea-48bf-a782-f2c8f3476da5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5f019d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:21.265994 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4377f0ea-3c42-48d6-8be7-03e70b2c367f tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.618031 Jul 26 04:33:21.267646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 973/1856] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:20 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:21.272380 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-159c4ac5-51ea-48bf-a782-f2c8f3476da5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.096140 Jul 26 04:33:21.273273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:21.273662 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 884/1857] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:21 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:21.274650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:21.276810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:21.286890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.287344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.287472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:21.288712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.289290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:21.289587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.304409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.305381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.306450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.307142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.538071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.547799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.556634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.559511 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4e08279-dba4-4d2a-b8e5-df63677585fb tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1557 microversion: 2.21 time: 0.290438 Jul 26 04:33:21.561327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 974/1858] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:21 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1557 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:21.566472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6c09e2c-9675-4ab7-9154-b54e1a5cd1cf tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:21.567333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6c09e2c-9675-4ab7-9154-b54e1a5cd1cf tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:21.599385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.609841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.613311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.614843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13ebc152-0f99-4ebe-a981-37e26b36b0b2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.337749 Jul 26 04:33:21.615998 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 885/1859] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:21 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:21.622180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c98fee45-d62e-4327-b6a1-0bcbb06a356b tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5dd8280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1538223734", "description": "tempest-description-1544597533"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:21.701448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6c09e2c-9675-4ab7-9154-b54e1a5cd1cf tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:21.712695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6c09e2c-9675-4ab7-9154-b54e1a5cd1cf tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1216 microversion: 2.1 time: 0.146550 Jul 26 04:33:21.727121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 975/1860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:21 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:21.752231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:21.759230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:21.790441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.791306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.792362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:21.793488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:21.970848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:22.018599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7bb8cd8a-c059-4210-a60d-a06a60bfc65a tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.283553 Jul 26 04:33:22.030071 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 976/1861] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:21 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:22.049536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3bfb9383-3299-4ffe-8423-d1987a8d3d14 req-ccc8f079-003a-4d20-b2de-b3a6b30cc690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d715a20-eb86-46c5-a5f9-0dd9818497d5", "name": "network-vif-deleted", "tag": "97a03895-0c73-40fd-850e-1b7a1c4786b4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:22.080762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3bfb9383-3299-4ffe-8423-d1987a8d3d14 req-ccc8f079-003a-4d20-b2de-b3a6b30cc690 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:22.082914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3bfb9383-3299-4ffe-8423-d1987a8d3d14 req-ccc8f079-003a-4d20-b2de-b3a6b30cc690 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:22.103385 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3bfb9383-3299-4ffe-8423-d1987a8d3d14 req-ccc8f079-003a-4d20-b2de-b3a6b30cc690 service nova] Creating event network-vif-deleted:97a03895-0c73-40fd-850e-1b7a1c4786b4 for instance 5d715a20-eb86-46c5-a5f9-0dd9818497d5 on n-h2-848886-16 Jul 26 04:33:22.111744 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3bfb9383-3299-4ffe-8423-d1987a8d3d14 req-ccc8f079-003a-4d20-b2de-b3a6b30cc690 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079540 Jul 26 04:33:22.120175 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 977/1862] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:22.199889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c98fee45-d62e-4327-b6a1-0bcbb06a356b tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.582093 Jul 26 04:33:22.201341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 886/1863] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:21 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:22.227736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b1ebac5-1688-49aa-ae5d-1223d8294930 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38babf1ca0>, body: {"security_group_rule": {"parent_group_id": "336264ba-1a7c-4990-b946-3f41f63a44c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:22.291087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74a0eabb-0864-4cc5-8653-b75073349d47 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5d9a550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:22.414524 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74a0eabb-0864-4cc5-8653-b75073349d47 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.126987 Jul 26 04:33:22.422823 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 887/1864] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:22 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:22.583507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:22.584860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:22.618646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:22.620022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:22.621661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:22.623997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:22.720050 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b1ebac5-1688-49aa-ae5d-1223d8294930 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.509769 Jul 26 04:33:22.722481 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 978/1865] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:22 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:22.739620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:22.744228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:22.753881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:22.754537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:22.755624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:22.756461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:22.918546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:22.930924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:22.943858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b7961565a4f4982973fe743095ac18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93561d56478e4e04a2f381e9a8e830ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:22.945351 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89ba4749-50e4-46b3-aa93-44f97844ac76 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 200 len: 1557 microversion: 2.21 time: 0.365783 Jul 26 04:33:22.947283 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 888/1866] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:22 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 1557 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:22.959306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c57cc370-40ec-4c58-9978-8d424a395c3f tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5d9a040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1481985434", "description": "tempest-description-584894653"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:23.556009 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c57cc370-40ec-4c58-9978-8d424a395c3f tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.607194 Jul 26 04:33:23.567102 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 889/1867] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:23.573984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:23.574857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:23.621268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:23.621869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:23.622631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:23.623186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:23.649143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:23.745606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:23.766401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1640e2f4-2bc4-4c5b-8599-fd65216e823d tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1274 microversion: 2.1 time: 0.197822 Jul 26 04:33:23.767215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 890/1868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:23 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:23.788329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:23.789329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:23.799301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:23.800071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:23.803419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:23.804078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:23.905412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:23.943941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3b1d4dd-e57c-447d-924e-9ff729a687b8 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.160666 Jul 26 04:33:23.945578 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 891/1869] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:23 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:23.953306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-48eb3760-7126-4483-a222-7327ac1d083b req-795ffe5f-ae0f-4393-a64a-c7831e49f8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c79d4f-a6ee-496b-ba5e-6c5168a618e0", "name": "network-vif-deleted", "tag": "d9bf39ed-9821-452e-b381-22b3cf6a75d8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:23.979207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-48eb3760-7126-4483-a222-7327ac1d083b req-795ffe5f-ae0f-4393-a64a-c7831e49f8c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:23.980001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-48eb3760-7126-4483-a222-7327ac1d083b req-795ffe5f-ae0f-4393-a64a-c7831e49f8c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.022236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-48eb3760-7126-4483-a222-7327ac1d083b req-795ffe5f-ae0f-4393-a64a-c7831e49f8c9 service nova] Creating event network-vif-deleted:d9bf39ed-9821-452e-b381-22b3cf6a75d8 for instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 on n-h1-848886-16 Jul 26 04:33:24.035857 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-48eb3760-7126-4483-a222-7327ac1d083b req-795ffe5f-ae0f-4393-a64a-c7831e49f8c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088404 Jul 26 04:33:24.037368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 892/1870] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:24.057234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6d07e0c-3979-44d4-ae54-d53e0c62d08b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bac9b550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.166978 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6d07e0c-3979-44d4-ae54-d53e0c62d08b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.127400 Jul 26 04:33:24.168153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 893/1871] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:24 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:24.177826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2ebd988-15bf-4d64-a30d-c982c3659613 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5a428b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1553924882", "description": "tempest-description-161241028"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:24.247012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:24.305442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:24.314362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:24.317675 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2794dd43-ec75-4c13-9093-06e3ab3ed700 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 1.593916 Jul 26 04:33:24.320765 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 979/1872] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:22 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:24.348045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.349367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:24.360499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.361345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.362705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.363616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.382440 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] HTTP exception thrown: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Request method failure captured: Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 HTTP/1.1 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3257K5jl0ADOlimpRMd4z3QK6EuD9BuHoV7pnqEBtJR5-M2u_nxjZmRgpAoEWS3g_fK2kIT7o2ie9f2SSlHqmA_cb7DUO6Mzg17g-kxNM96etYqHBc2QeecBmvc0fdph--oOD5AMp8ogwfgV_MadDyEaG6w2qarfOwKCkpK9lj8byQU Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:24.384769 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b7961565a4f4982973fe743095ac18c Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.387038 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '30c79d4f-a6ee-496b-ba5e-6c5168a618e0'} Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:24.389151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.390937 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.394906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Returning 404 to user: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:24.395830 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef8b0fd2-d4e0-4cd4-a6a1-75636e07ac2b tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 404 len: 111 microversion: 2.21 time: 0.072739 Jul 26 04:33:24.401048 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 980/1873] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:24 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:33:24.408522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '.version_select at 0x7f38babf1ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.409618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:24.418071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.418809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.419815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.420688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.462509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2ebd988-15bf-4d64-a30d-c982c3659613 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.292810 Jul 26 04:33:24.463333 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 894/1874] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:24.480265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74f7e1e0-8780-4611-ad0f-000165268622 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5fdd820>, body: {"security_group_rule": {"parent_group_id": "8945628d-5018-4acb-b91b-ec3757a52c78", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8676408a-fa77-4c35-b59d-f01384d7b45a"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:24.574777 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5db92aba-884a-4720-bedc-45fda5651427 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.171822 Jul 26 04:33:24.584101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 981/1875] 10.222.0.43 () {60 vars in 1337 bytes} [Tue Jul 26 04:33:24 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0/os-instance-actions => generated 611 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:33:24.595843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.597075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:24.605852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.608040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.609702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.610555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.630537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] HTTP exception thrown: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Request method failure captured: Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 HTTP/1.1 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3257K5jl0ADOlimpRMd4z3QK6EuD9BuHoV7pnqEBtJR5-M2u_nxjZmRgpAoEWS3g_fK2kIT7o2ie9f2SSlHqmA_cb7DUO6Mzg17g-kxNM96etYqHBc2QeecBmvc0fdph--oOD5AMp8ogwfgV_MadDyEaG6w2qarfOwKCkpK9lj8byQU Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:24.633612 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b7961565a4f4982973fe743095ac18c Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.635549 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '30c79d4f-a6ee-496b-ba5e-6c5168a618e0'} Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:24.636557 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.638104 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.641969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Returning 404 to user: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:24.643586 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef56bfa4-26ea-4c86-ae1e-cf026b901999 tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 404 len: 111 microversion: 2.21 time: 0.053988 Jul 26 04:33:24.648309 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 982/1876] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:33:24 2022] DELETE /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:33:24.656321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.657293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] [instance: 30c79d4f-a6ee-496b-ba5e-6c5168a618e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:24.664999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.665438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.666415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.667029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.683149 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] HTTP exception thrown: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Request method failure captured: Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 HTTP/1.1 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3257K5jl0ADOlimpRMd4z3QK6EuD9BuHoV7pnqEBtJR5-M2u_nxjZmRgpAoEWS3g_fK2kIT7o2ie9f2SSlHqmA_cb7DUO6Mzg17g-kxNM96etYqHBc2QeecBmvc0fdph--oOD5AMp8ogwfgV_MadDyEaG6w2qarfOwKCkpK9lj8byQU Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:24.685689 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_93561d56478e4e04a2f381e9a8e830ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 93561d56478e4e04a2f381e9a8e830ec Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972176 Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b7961565a4f4982973fe743095ac18c Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972176-project Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.687894 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '30c79d4f-a6ee-496b-ba5e-6c5168a618e0'} Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:24.688729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. Jul 26 04:33:24.690061 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:24.693124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] Returning 404 to user: Instance 30c79d4f-a6ee-496b-ba5e-6c5168a618e0 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:24.694890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4340b1f-6de3-47e8-8e4f-ec88988824bd tempest-InstanceActionsV221TestJSON-128972176 tempest-InstanceActionsV221TestJSON-128972176-project] 10.222.0.43 "GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0" status: 404 len: 111 microversion: 2.21 time: 0.044669 Jul 26 04:33:24.699985 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 983/1877] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:24 2022] GET /compute/v2.1/servers/30c79d4f-a6ee-496b-ba5e-6c5168a618e0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:33:24.790414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:24.792243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:24.809070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.812821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:24.814463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:24.815554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:25.038733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:25.056290 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7de788bf-4247-4cb5-975d-71290296c564 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1274 microversion: 2.1 time: 0.270318 Jul 26 04:33:25.057804 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 984/1878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:24 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:25.063105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:25.066661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:25.081137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:25.084781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:25.088021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:25.088677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:25.251758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:25.322318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1783d2f8-e979-4116-907b-8955b53d3056 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.263135 Jul 26 04:33:25.332327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 985/1879] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:25 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:25.337870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45c83992-9bcf-4812-899e-89f03cc94710 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52d51f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:25.425914 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74f7e1e0-8780-4611-ad0f-000165268622 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.953613 Jul 26 04:33:25.427198 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 895/1880] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:24 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:25.431313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:25.432042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:25.453445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:25.459577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:25.460676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:25.460893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:25.844784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45c83992-9bcf-4812-899e-89f03cc94710 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.518541 Jul 26 04:33:25.852401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 986/1881] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:25 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:25.865795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36161607-4335-43fc-8847-808b94801785 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b52cd5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1797395025", "description": "tempest-description-1205957537"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:26.326930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:26.337519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:26.352893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:26.354132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e384f01-bfaa-4d7e-a9da-0598c9989573 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.926377 Jul 26 04:33:26.354715 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 896/1882] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:25 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:26.378668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:26.379655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:26.391927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:26.399327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:26.400333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:26.400893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:27.351544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:27.363482 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-981e5685-880f-4c4a-b8e9-8527bfd96e74 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 1.007707 Jul 26 04:33:27.370409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 897/1883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:26 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:27.391040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6d5caf58-f419-4502-8a44-d8ce71f55238 req-30597b16-e415-4124-8598-60e7e3e664fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-plugged", "status": "completed", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:27.432553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6d5caf58-f419-4502-8a44-d8ce71f55238 req-30597b16-e415-4124-8598-60e7e3e664fa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:27.433489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6d5caf58-f419-4502-8a44-d8ce71f55238 req-30597b16-e415-4124-8598-60e7e3e664fa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:27.464410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6d5caf58-f419-4502-8a44-d8ce71f55238 req-30597b16-e415-4124-8598-60e7e3e664fa service nova] Creating event network-vif-plugged:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:33:27.473077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6d5caf58-f419-4502-8a44-d8ce71f55238 req-30597b16-e415-4124-8598-60e7e3e664fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098810 Jul 26 04:33:27.479341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 898/1884] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:27.486612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:27.487751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:27.500549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:27.504051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:27.506764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:27.509099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:27.549855 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36161607-4335-43fc-8847-808b94801785 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.696182 Jul 26 04:33:27.551973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 987/1885] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:27.564322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0fc47e9-579b-4b51-90fa-67f81ffcae73 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bad34040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:27.788275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:27.820148 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5abdc2c2-18ac-429c-88c7-271d5cace904 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.338289 Jul 26 04:33:27.827795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 899/1886] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:27 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:27.845223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:27.845862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:27.875086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:27.878995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:27.881821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:27.882593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:28.167905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:28.190695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:28.196964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:28.202629 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf46e927-2d2f-45e4-a640-71da29467a3d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.371637 Jul 26 04:33:28.204903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 900/1887] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:27 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:28.228824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1624f9c8-aab5-494c-bb4c-3cc7d9c79df0 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5a424c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1359566989", "description": "tempest-description-1546897424"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:29.414098 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1624f9c8-aab5-494c-bb4c-3cc7d9c79df0 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.207631 Jul 26 04:33:29.424648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 901/1888] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:29.430385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:29.431161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:29.455984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:29.457069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:29.457932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:29.458407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.025091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:30.451719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:30.471751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1efd1654-da49-4012-a3d0-32ccede3496e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 1.045630 Jul 26 04:33:30.474100 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 902/1889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:29 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:30.487725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a9ece24c-9a93-45e2-acf6-06d036fb2f42 req-2e74499f-5068-469f-8249-0a604a692320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f889b3d4-7704-4c1f-8ebf-8adf04aa15f3", "tag": "2b0e7939-ad0b-4d2b-8c66-9e55c426af9b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:30.528611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9ece24c-9a93-45e2-acf6-06d036fb2f42 req-2e74499f-5068-469f-8249-0a604a692320 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:30.531411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9ece24c-9a93-45e2-acf6-06d036fb2f42 req-2e74499f-5068-469f-8249-0a604a692320 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.555415 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a9ece24c-9a93-45e2-acf6-06d036fb2f42 req-2e74499f-5068-469f-8249-0a604a692320 service nova] Creating event network-changed:2b0e7939-ad0b-4d2b-8c66-9e55c426af9b for instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 on n-h1-848886-16 Jul 26 04:33:30.570446 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a9ece24c-9a93-45e2-acf6-06d036fb2f42 req-2e74499f-5068-469f-8249-0a604a692320 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088311 Jul 26 04:33:30.572509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 903/1890] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:30.603188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:30.603906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:30.621528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:30.623645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.625814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:30.626347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.793081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:30.846489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cb368a4-abd0-4490-bdaa-02bb7b3bc700 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.270738 Jul 26 04:33:30.853116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 904/1891] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:30 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:30.861553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:30.864793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:30.883861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:30.885581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.885581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:30.886023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:30.960987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:31.113887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:31.131860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:31.136582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:31.138946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a74157e-10ea-447a-bc41-0a1b2dac0af8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.283885 Jul 26 04:33:31.145457 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 905/1892] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:30 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:31.157673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:31.160698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:31.199308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.202647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:31.207594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.209027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:31.267480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0fc47e9-579b-4b51-90fa-67f81ffcae73 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 3.713998 Jul 26 04:33:31.268839 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 988/1893] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:27 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 3716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:31.277994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97945651-7d32-4936-a25e-41f6ca98a0a9 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b52cd280>, body: {"security_group_rule": {"parent_group_id": "1cdfa515-2c09-46ac-a1ac-97366fc3a8ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "35d810fe-fe2f-4e79-b1c9-ac71d30c7e58"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:31.305087 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53e8feb8-8df0-45b5-a4f5-57838f8d95ba tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156580 Jul 26 04:33:31.305865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 906/1894] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:31 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:31.324533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:31.325604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:31.346699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.347314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:31.348474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.349023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:31.509989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lazy-loading 'services' on Instance uuid 3d5e0949-3144-4c93-8105-17009421339f {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:31.674747 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8b58d61-1b08-4136-9543-9b80a8383a0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments/0133742c-04ed-49ee-a4a1-1b2ccb67db09" status: 202 len: 0 microversion: 2.1 time: 0.360332 Jul 26 04:33:31.681567 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 907/1895] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:33:31 2022] DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments/0133742c-04ed-49ee-a4a1-1b2ccb67db09 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:31.697911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:31.699086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:31.708893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:31.717092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.718779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:31.721010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:31.723310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.099882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:32.122995 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b9cc18a-7353-4772-b906-5bc12ccd03b4 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.438461 Jul 26 04:33:32.127615 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 908/1896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:31 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:32.145294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:32.145941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:32.154321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:32.154856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.170815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:32.174634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.336883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:32.401082 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-abe6f18b-2424-4eae-ae89-603eba8a8983 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.259622 Jul 26 04:33:32.406918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 909/1897] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:32 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:32.422045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:32.423065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:32.446300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:32.447057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.448458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:32.449022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.722183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97945651-7d32-4936-a25e-41f6ca98a0a9 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.449404 Jul 26 04:33:32.723896 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 989/1898] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:31 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:32.730122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa6c6c2b-40e2-49da-bd56-24c54a45c42d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b529aaf0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:32.781615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:32.785517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:32.799868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:32.806002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:32.807518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41b03304-bf09-448b-bf1d-7ea97b285f76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.399538 Jul 26 04:33:32.813250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 910/1899] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:32 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:32.826514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-75667ac4-8fa8-4002-afb8-a8512790851d req-4ffbb9c1-8ac3-405b-a489-815e2676482c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449c9d5a-345c-4465-adde-e07f3ba00bd5", "tag": "f7d17068-d453-428a-84e2-f3b04b4945d8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:32.851387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-75667ac4-8fa8-4002-afb8-a8512790851d req-4ffbb9c1-8ac3-405b-a489-815e2676482c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:32.852099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-75667ac4-8fa8-4002-afb8-a8512790851d req-4ffbb9c1-8ac3-405b-a489-815e2676482c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:32.881944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa6c6c2b-40e2-49da-bd56-24c54a45c42d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.156219 Jul 26 04:33:32.886498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-75667ac4-8fa8-4002-afb8-a8512790851d req-4ffbb9c1-8ac3-405b-a489-815e2676482c service nova] Creating event network-changed:f7d17068-d453-428a-84e2-f3b04b4945d8 for instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 on n-h2-848886-16 Jul 26 04:33:32.895589 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 990/1900] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:32 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:32.907568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-75667ac4-8fa8-4002-afb8-a8512790851d req-4ffbb9c1-8ac3-405b-a489-815e2676482c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091178 Jul 26 04:33:32.911440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 911/1901] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:32.912003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76502211-7704-45ab-b213-af0753e0041e tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b522c3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:33.150735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:33.151526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:33.169933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.177477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:33.178365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.178813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:33.446698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:33.458125 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f788df5-89e9-4b81-9610-80dfd04325db tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.312752 Jul 26 04:33:33.460895 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 912/1902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:33 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:33:33.468406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:33.469601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:33.478892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.479798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:33.480926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.482081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:33.586133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:33.634573 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9f48d3ef-418b-4abe-8536-b7f5a21f4ec1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.160545 Jul 26 04:33:33.635635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 913/1903] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:33 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:33.840211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:33.841587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:33.868062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.871559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:33.879201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:33.880461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:34.171149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:34.184399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:34.188084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:34.192566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c0d5365-2ec2-4616-af3f-dd3e3fe7736f tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.358438 Jul 26 04:33:34.195040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 914/1904] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:33 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:34.205886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39b0fd62-3560-408d-a01c-8f5eb5feb34c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5a42ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:34.279352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39b0fd62-3560-408d-a01c-8f5eb5feb34c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.082598 Jul 26 04:33:34.280668 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 915/1905] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:34 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:34.405573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76502211-7704-45ab-b213-af0753e0041e tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/35d810fe-fe2f-4e79-b1c9-ac71d30c7e58" status: 202 len: 0 microversion: 2.1 time: 1.506427 Jul 26 04:33:34.407036 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 991/1906] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:32 2022] DELETE /compute/v2.1/os-security-groups/35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:34.415459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0abbf333-4d6e-4d74-ae82-781942e96c5a tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38bad5d1f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:34.486513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:34.487534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:34.500237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:34.500958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:34.501963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:34.506885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:34.530300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0abbf333-4d6e-4d74-ae82-781942e96c5a tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/1cdfa515-2c09-46ac-a1ac-97366fc3a8ee" status: 200 len: 248 microversion: 2.1 time: 0.118423 Jul 26 04:33:34.531052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 916/1907] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:33:34 2022] GET /compute/v2.1/os-security-groups/1cdfa515-2c09-46ac-a1ac-97366fc3a8ee => generated 248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:34.545858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9bb5e2b-d565-4d27-8f60-376647223d5c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38b5fedd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1848371612", "description": "tempest-description-1059391344"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:34.976344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9bb5e2b-d565-4d27-8f60-376647223d5c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.434532 Jul 26 04:33:34.978118 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 917/1908] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:33:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:34.984720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:34.985589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:35.003695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:35.005547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:35.005547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:35.009367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:35.063931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:35.075620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39553824-0e9a-4fd9-8e61-504d95013292 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.596081 Jul 26 04:33:35.076229 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 992/1909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:34 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:35.101986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-06b0263d-d841-4d83-946e-7d5300e9be1e tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38baccf8b0>, body: {"security_group_rule": {"parent_group_id": "605dbb04-f298-4aa2-8343-a687fa7c521a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:35.153969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:35.194962 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e75dd0c4-4a6a-4367-ad6d-a5d741943bb1 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.215266 Jul 26 04:33:35.195552 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 918/1910] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:34 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:35.224509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:35.225202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:35.235126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:35.235586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:35.236376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:35.240334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:35.600612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:35.600612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:35.601514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:35.601514 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e0b6f71-2636-4a0b-9a7c-fa9924a83cf2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.379236 Jul 26 04:33:35.619824 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 919/1911] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:35 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:33:35.628106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3eb7069e-6c64-403e-99a0-ed6b5b3ac0b3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5a425e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:35.713691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3eb7069e-6c64-403e-99a0-ed6b5b3ac0b3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.092249 Jul 26 04:33:35.715101 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 920/1912] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:35 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:35.733547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dfe029ab-86b9-4770-9de5-cbc3052d6fc1 req-9e8fcb4a-f0fe-460b-8483-66724c6bcf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f889b3d4-7704-4c1f-8ebf-8adf04aa15f3", "name": "network-vif-plugged", "status": "completed", "tag": "2b0e7939-ad0b-4d2b-8c66-9e55c426af9b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:35.775611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfe029ab-86b9-4770-9de5-cbc3052d6fc1 req-9e8fcb4a-f0fe-460b-8483-66724c6bcf5f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:35.777409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfe029ab-86b9-4770-9de5-cbc3052d6fc1 req-9e8fcb4a-f0fe-460b-8483-66724c6bcf5f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:35.824064 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dfe029ab-86b9-4770-9de5-cbc3052d6fc1 req-9e8fcb4a-f0fe-460b-8483-66724c6bcf5f service nova] Creating event network-vif-plugged:2b0e7939-ad0b-4d2b-8c66-9e55c426af9b for instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 on n-h1-848886-16 Jul 26 04:33:35.842234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dfe029ab-86b9-4770-9de5-cbc3052d6fc1 req-9e8fcb4a-f0fe-460b-8483-66724c6bcf5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123910 Jul 26 04:33:35.864147 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 921/1913] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:36.056554 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-06b0263d-d841-4d83-946e-7d5300e9be1e tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.979245 Jul 26 04:33:36.057784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 993/1914] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:36.071451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48acf3d8-4bee-48c7-8297-f8a3b110f400 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Action: 'create', calling method: .version_select at 0x7f38bad5d700>, body: {"security_group_rule": {"parent_group_id": "605dbb04-f298-4aa2-8343-a687fa7c521a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:36.100394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:36.101292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:36.117043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.118973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:36.120446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.128937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:36.491625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:36.505877 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bfe25e52-81ab-445f-badc-d394c948a3c0 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.407179 Jul 26 04:33:36.508824 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 994/1915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:36 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:36.528004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:36.529077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:36.536442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.537374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:36.538558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.539276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:36.719591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:36.771279 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8559ccd6-fecb-4eec-a3ce-cb2140abcdd5 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.255761 Jul 26 04:33:36.773566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 995/1916] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:36 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:36.786674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:36.787709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:36.808763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.809733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:36.811140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:36.813052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:37.125556 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48acf3d8-4bee-48c7-8297-f8a3b110f400 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.059255 Jul 26 04:33:37.126680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 922/1917] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:33:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:37.131890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-408a8dfa-d781-418e-9f31-7831308a00ac tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5f0b310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:37.183100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:37.200259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:37.205775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:37.207387 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dab34b58-94ee-4030-8679-0a61f0e568c8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.432451 Jul 26 04:33:37.213842 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 996/1918] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:36 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:37.226646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4604594-86d8-4db3-907b-6aac08bafdfd tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b529a280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:37.234042 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-408a8dfa-d781-418e-9f31-7831308a00ac tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.104921 Jul 26 04:33:37.237200 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 923/1919] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:37 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:37.358251 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4604594-86d8-4db3-907b-6aac08bafdfd tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/605dbb04-f298-4aa2-8343-a687fa7c521a" status: 200 len: 665 microversion: 2.1 time: 0.140798 Jul 26 04:33:37.359023 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 997/1920] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:33:37 2022] GET /compute/v2.1/os-security-groups/605dbb04-f298-4aa2-8343-a687fa7c521a => generated 665 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:37.374020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d924b56-6b6d-4e59-8801-4198e2e178b1 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b5f01940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:37.534035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:37.534957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:37.552369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:37.555082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:37.556177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:37.559688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:37.627649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:37.861509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d924b56-6b6d-4e59-8801-4198e2e178b1 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/f72f73da-de8d-42b7-929f-f3e43627ce83" status: 202 len: 0 microversion: 2.1 time: 0.493191 Jul 26 04:33:37.862665 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 924/1921] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Jul 26 04:33:37 2022] DELETE /compute/v2.1/os-security-group-rules/f72f73da-de8d-42b7-929f-f3e43627ce83 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:37.867302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:37.868129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:37.884672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:37.885573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:37.888704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:37.894293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:37.895468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:37.901365 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2b96f51-5c41-41a3-839d-fa70d5c81674 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.372041 Jul 26 04:33:37.921836 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 998/1922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:37 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:33:37.930467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cfd989e-392e-4c8e-998f-8ad84d3dbfca tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b5851550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.061134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:38.099312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:38.101409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9995ca8-bbb3-42d7-8be0-408e7f0efa35 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.237669 Jul 26 04:33:38.102723 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 925/1923] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:37 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:38.108324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-eaad4728-4b43-412a-86a9-c6a75cbb95d6 req-a0790ffc-dd4e-47e1-a813-1bb53e2f5e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449c9d5a-345c-4465-adde-e07f3ba00bd5", "name": "network-vif-plugged", "status": "completed", "tag": "f7d17068-d453-428a-84e2-f3b04b4945d8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:38.130939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-eaad4728-4b43-412a-86a9-c6a75cbb95d6 req-a0790ffc-dd4e-47e1-a813-1bb53e2f5e84 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:38.132326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-eaad4728-4b43-412a-86a9-c6a75cbb95d6 req-a0790ffc-dd4e-47e1-a813-1bb53e2f5e84 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:38.159683 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-eaad4728-4b43-412a-86a9-c6a75cbb95d6 req-a0790ffc-dd4e-47e1-a813-1bb53e2f5e84 service nova] Creating event network-vif-plugged:f7d17068-d453-428a-84e2-f3b04b4945d8 for instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 on n-h2-848886-16 Jul 26 04:33:38.175583 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-eaad4728-4b43-412a-86a9-c6a75cbb95d6 req-a0790ffc-dd4e-47e1-a813-1bb53e2f5e84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071124 Jul 26 04:33:38.176701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 926/1924] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:38.237374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.238482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:38.271083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:38.271878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:38.273164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:38.277384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:38.460078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2cfd989e-392e-4c8e-998f-8ad84d3dbfca tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/605dbb04-f298-4aa2-8343-a687fa7c521a" status: 202 len: 0 microversion: 2.1 time: 0.536857 Jul 26 04:33:38.464142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 999/1925] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:37 2022] DELETE /compute/v2.1/os-security-groups/605dbb04-f298-4aa2-8343-a687fa7c521a => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:38.470192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75c67e61-4438-47e3-b903-8bdb3e0972a5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b529a700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.564337 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75c67e61-4438-47e3-b903-8bdb3e0972a5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.099168 Jul 26 04:33:38.565167 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1000/1926] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:38 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:38.577656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b5fcb3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.609614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:38.618937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:33:38.619498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Neutron security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:33:38.620243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] HTTP exception thrown: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.620243 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.626003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:38.632345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:38.634447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa3de332-b51d-4e19-8b25-b6e71a33b7f8 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.401518 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Request method failure captured: Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-security-groups/35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 HTTP/1.1 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi326OEFfoRG0tN233du4wuM0I__VDjpE8IpINpL4WoAGeei4KZbHqEATiw9T7aSJw9X8KGnsQ9xzjaMQFq_TALTrvbTk7YCPwGkYnbcgcT-J0CIDNv0HZ6zZoROKMYHWDbKw0E9ebKhAnWTzm-tWIYcY8H5Abohqh2Ei0wZ-fl65UvEs Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 2440158344c04e3d96c510c780c25d15 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1320343208 Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:38.635591 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2440158344c04e3d96c510c780c25d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2440158344c04e3d96c510c780c25d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2440158344c04e3d96c510c780c25d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2440158344c04e3d96c510c780c25d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1320343208 Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 2440158344c04e3d96c510c780c25d15 Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1320343208 Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesTestJSON-1320343208-project Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 5f5284f0df51492f9e83b054a12d10fb Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1320343208-project Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.639079 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '35d810fe-fe2f-4e79-b1c9-ac71d30c7e58'} Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:33:38.640312 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:33:38.642710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.644466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] Jul 26 04:33:38.648438 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:38.650976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Returning 404 to user: Security group 35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 does not exist Jul 26 04:33:38.650976 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-38f7a132-99a9-4f44-85e7-4ec9545a5773'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:38.651355 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 927/1927] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:38 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:38.652382 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e9d69bf-d6a6-4447-b096-fe3bd754020c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/35d810fe-fe2f-4e79-b1c9-ac71d30c7e58" status: 404 len: 194 microversion: 2.1 time: 0.080637 Jul 26 04:33:38.656729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1001/1928] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:38 2022] DELETE /compute/v2.1/os-security-groups/35d810fe-fe2f-4e79-b1c9-ac71d30c7e58 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:33:38.668369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e954050f-a1ea-4b69-8106-bc5a939b6751 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b5d8ae50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.923918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:38.925074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:38.943642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:38.945433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:38.947162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:38.949803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:38.997601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e954050f-a1ea-4b69-8106-bc5a939b6751 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1cdfa515-2c09-46ac-a1ac-97366fc3a8ee" status: 202 len: 0 microversion: 2.1 time: 0.338979 Jul 26 04:33:38.998865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 928/1929] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:38 2022] DELETE /compute/v2.1/os-security-groups/1cdfa515-2c09-46ac-a1ac-97366fc3a8ee => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:39.006456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81b86f38-c80a-47e4-887f-c764a06647cb tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38bad5d1f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:39.371812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:39.387725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb98be91-8d5d-4060-a7a8-2763a7a3d47b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1316 microversion: 2.1 time: 0.469154 Jul 26 04:33:39.389189 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1002/1930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:38 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:39.394012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:39.395024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:39.402645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:39.403849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:39.404925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:39.405674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:39.446370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81b86f38-c80a-47e4-887f-c764a06647cb tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8676408a-fa77-4c35-b59d-f01384d7b45a" status: 202 len: 0 microversion: 2.1 time: 0.443472 Jul 26 04:33:39.447515 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 929/1931] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:39 2022] DELETE /compute/v2.1/os-security-groups/8676408a-fa77-4c35-b59d-f01384d7b45a => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:33:39.457884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86776bcb-b429-4e33-84ef-d36739122a6c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b54b6a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:39.584227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:39.650585 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bfc3a47-ee3c-41c3-9bd4-aa2cc3bc7c70 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.259973 Jul 26 04:33:39.653492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1003/1932] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:39 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:39.670759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d227f9e-ef3b-4380-917e-024ee794faf5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5fcb4c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:39.770962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d227f9e-ef3b-4380-917e-024ee794faf5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.115018 Jul 26 04:33:39.774129 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1004/1933] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:39 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:39.779610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:39.780340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:39.800422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:39.801000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:39.801801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:39.802329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:39.912048 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86776bcb-b429-4e33-84ef-d36739122a6c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8945628d-5018-4acb-b91b-ec3757a52c78" status: 202 len: 0 microversion: 2.1 time: 0.459716 Jul 26 04:33:39.916536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 930/1934] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:39 2022] DELETE /compute/v2.1/os-security-groups/8945628d-5018-4acb-b91b-ec3757a52c78 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:33:39.940904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad642a01-c028-4ae1-a6ce-dd037eb95e5c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b54b6e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:40.133601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:40.157006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:40.159360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:40.164847 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96533fde-fca1-4303-8a57-f44537e601f3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.389416 Jul 26 04:33:40.169101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1005/1935] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:39 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:40.410372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:40.410991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:40.420426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:40.420879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:40.425854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:40.427181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:40.474270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad642a01-c028-4ae1-a6ce-dd037eb95e5c tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/336264ba-1a7c-4990-b946-3f41f63a44c9" status: 202 len: 0 microversion: 2.1 time: 0.550030 Jul 26 04:33:40.478820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 931/1936] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:39 2022] DELETE /compute/v2.1/os-security-groups/336264ba-1a7c-4990-b946-3f41f63a44c9 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:40.487595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-09f9c00b-524a-46c4-adae-3a0d9b853d29 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] Calling method '.version_select at 0x7f38b5d8af70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:40.979703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:40.989390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-629e9dfb-7f92-4e76-a919-44608370ef80 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1503 microversion: 2.1 time: 0.582785 Jul 26 04:33:40.997221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1006/1937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:40 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:33:41.017893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:41.023210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:41.054500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-09f9c00b-524a-46c4-adae-3a0d9b853d29 tempest-SecurityGroupRulesTestJSON-1320343208 tempest-SecurityGroupRulesTestJSON-1320343208-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/d67a3b0d-2f56-4395-87ac-768cded25765" status: 202 len: 0 microversion: 2.1 time: 0.573992 Jul 26 04:33:41.055408 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 932/1938] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:33:40 2022] DELETE /compute/v2.1/os-security-groups/d67a3b0d-2f56-4395-87ac-768cded25765 => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:41.066709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a692099a-d4a3-4c2c-98eb-3188a2372c79 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bad5dca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:41.072389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.072854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:41.073662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.074125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:41.168541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a692099a-d4a3-4c2c-98eb-3188a2372c79 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.111563 Jul 26 04:33:41.180153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 933/1939] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:41 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:41.188047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:41.191270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:41.203841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.204751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:41.206012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.206789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:41.847135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:41.866346 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19caac57-bdc7-40f1-a199-e527cc6842f3 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 200 len: 1503 microversion: 2.1 time: 0.681274 Jul 26 04:33:41.868789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 934/1940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:41 2022] GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 1503 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:41.883111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:41.885032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:41.906328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.908302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:41.912083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:41.913070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:42.217081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:42.261608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15cf1565-c875-4d32-a29b-6c63c3002e83 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 1.259886 Jul 26 04:33:42.263468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1007/1941] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:41 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:42.279265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:42.281473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:42.297157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:42.306551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:42.315534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:42.316302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:42.412179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:42.589238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:42.613859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:42.615752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:42.616959 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bab5589a-d813-4662-b945-3da3d9d303b9 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.746576 Jul 26 04:33:42.618602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 935/1942] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:41 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:42.649012 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4d66692d-d9ee-4f4a-a057-f62d2bc6258f tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 204 len: 0 microversion: 2.1 time: 0.383971 Jul 26 04:33:42.650015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1008/1943] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:33:42 2022] DELETE /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:42.651119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1874467-bf3b-4cbd-9dff-a8fe32604f4e tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5d8ae50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:42.667928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:42.668203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:42.714488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:42.715087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:42.719672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:42.720235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:42.749328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1874467-bf3b-4cbd-9dff-a8fe32604f4e tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.129261 Jul 26 04:33:42.750268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 936/1944] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:42 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:42.790637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:43.008180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41dd9cc1-c282-40cc-baab-04e98d38a183 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "DELETE /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 204 len: 0 microversion: 2.1 time: 0.352173 Jul 26 04:33:43.009223 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1009/1945] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:33:42 2022] DELETE /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:43.018818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:43.020119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:43.048104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.048669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.049521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.050079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.181843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-565f34ca-bb94-4bfe-bd38-5fad5d04ccb5 req-fdf3887a-ab9e-4418-8d53-534040890fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:43.205238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-565f34ca-bb94-4bfe-bd38-5fad5d04ccb5 req-fdf3887a-ab9e-4418-8d53-534040890fa9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.205579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-565f34ca-bb94-4bfe-bd38-5fad5d04ccb5 req-fdf3887a-ab9e-4418-8d53-534040890fa9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.229383 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-565f34ca-bb94-4bfe-bd38-5fad5d04ccb5 req-fdf3887a-ab9e-4418-8d53-534040890fa9 service nova] Creating event network-vif-unplugged:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h2-848886-16 Jul 26 04:33:43.244176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-565f34ca-bb94-4bfe-bd38-5fad5d04ccb5 req-fdf3887a-ab9e-4418-8d53-534040890fa9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064512 Jul 26 04:33:43.257078 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1010/1946] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:43.270741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:43.273815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:43.285308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.286107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.287241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.287845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.340911 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdc493f4-0972-42ff-aff5-9f3fb5a3d3b7 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081062 Jul 26 04:33:43.342585 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1011/1947] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:43 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:43.345399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:43.350501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:43.352170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:43.354195 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5af1282f-9486-44f2-8724-0cfc0d3430ae tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 200 len: 1509 microversion: 2.1 time: 0.339360 Jul 26 04:33:43.355883 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 937/1948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:43 2022] GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:43.380417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.380993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.381905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.386678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.575372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:43.625032 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf5b7eb5-b267-428f-8397-526470f607f6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.280549 Jul 26 04:33:43.641780 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1012/1949] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:43 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:43.644335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:43.645260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:43.661140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.661929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.662975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:43.663610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:43.771496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a1f8866-c1ff-4fb4-8e38-c270175ddc09 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bab69040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:43.869620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a1f8866-c1ff-4fb4-8e38-c270175ddc09 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.106022 Jul 26 04:33:43.870973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1013/1950] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:43 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:43.937103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:43.947960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:43.950418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:43.952145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9f7d8d7-7284-4107-8b2d-6bee8ab81bb1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.311900 Jul 26 04:33:43.953409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 938/1951] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:43 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:44.359466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:44.362677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:44.377903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:44.381873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:44.394975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.396004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.397117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.398082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.426700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.427165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.431044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.437603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.531539 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1fc68010-8572-41d2-95c0-8448a2cc5fbc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181255 Jul 26 04:33:44.538224 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1014/1952] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:44 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments => generated 25 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:33:44.671302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:44.672411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:44.698326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.707366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.718563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.719349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.824528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:44.856582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5892a7ce-4448-4743-8b54-f250903a7a5e tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 200 len: 1509 microversion: 2.1 time: 0.480850 Jul 26 04:33:44.861086 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 939/1953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:44 2022] GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:44.869597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:44.873471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:44.887907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.888582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.889595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:44.890213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:44.949158 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-098b0fa8-ca05-4251-9284-ebb0b9ac9320 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086764 Jul 26 04:33:44.956454 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 940/1954] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:33:44 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:33:44.962629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4553ed37-5f1a-4e4b-90e5-e1a4c7476b2b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bab25310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:45.036577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4553ed37-5f1a-4e4b-90e5-e1a4c7476b2b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.078707 Jul 26 04:33:45.037474 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 941/1955] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:44 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:45.043779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:45.049008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:45.051488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:45.097131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.097867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.103181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.103591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.115045 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1d426c5-2e30-4cee-87d9-fafb60dd7cea tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.459909 Jul 26 04:33:45.120068 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1015/1956] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:44 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:45.140364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:45.141529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:45.155933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.157287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.161123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.162024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.193064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:45.198798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:45.409873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-113775d9-9f09-4577-9bb0-c9befd70a84c tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 204 len: 0 microversion: 2.1 time: 0.280981 Jul 26 04:33:45.411518 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1016/1957] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:33:45 2022] DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:45.424063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bb1be139-85a9-4b45-b008-8e2a9819a914 req-8936ca32-4e25-40e4-acc6-4846011677f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:45.447213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bb1be139-85a9-4b45-b008-8e2a9819a914 req-8936ca32-4e25-40e4-acc6-4846011677f5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.450521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bb1be139-85a9-4b45-b008-8e2a9819a914 req-8936ca32-4e25-40e4-acc6-4846011677f5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.483620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bb1be139-85a9-4b45-b008-8e2a9819a914 req-8936ca32-4e25-40e4-acc6-4846011677f5 service nova] Creating event network-changed:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h2-848886-16 Jul 26 04:33:45.505016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bb1be139-85a9-4b45-b008-8e2a9819a914 req-8936ca32-4e25-40e4-acc6-4846011677f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083688 Jul 26 04:33:45.511403 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1017/1958] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:45.524629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1709233076", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d49ad6d2-e7e8-4c36-8548-0d97bda875ad"}], "block_device_mapping_v2": [{"uuid": "1dbf82f0-a13b-4121-ab0f-52f97d3d776a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:45.682550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] validate_networks() for [('d49ad6d2-e7e8-4c36-8548-0d97bda875ad', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:33:45.705522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:45.720439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:45.724979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:45.726489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f132bd9d-2cb0-4c8a-83f3-af1fff6c20ec tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.687902 Jul 26 04:33:45.740986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 942/1959] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:45 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:45.747532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:45.748763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:45.755944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.763456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.765258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:45.765869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:45.795158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:46.184887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:46.196378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-095ef7c5-542a-4ca0-9cdc-427d6ea4e51d tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1680 microversion: 2.1 time: 0.453445 Jul 26 04:33:46.197168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 943/1960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:45 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1680 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:46.211649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:46.212418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:46.221662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.222111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.227060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.227507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.446632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:46.455332 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4d1cda1-d45f-4b8c-aa23-54106dffd5e1 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 200 len: 1467 microversion: 2.1 time: 0.257352 Jul 26 04:33:46.473451 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 944/1961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:46 2022] GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:46.478439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4e4ae356-b27e-481e-bd6a-c9877462a09e req-f8a7a371-b809-4193-995c-da7505fa7262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f889b3d4-7704-4c1f-8ebf-8adf04aa15f3", "name": "network-vif-deleted", "tag": "2b0e7939-ad0b-4d2b-8c66-9e55c426af9b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:46.506048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e4ae356-b27e-481e-bd6a-c9877462a09e req-f8a7a371-b809-4193-995c-da7505fa7262 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.508861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e4ae356-b27e-481e-bd6a-c9877462a09e req-f8a7a371-b809-4193-995c-da7505fa7262 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.534275 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4e4ae356-b27e-481e-bd6a-c9877462a09e req-f8a7a371-b809-4193-995c-da7505fa7262 service nova] Creating event network-vif-deleted:2b0e7939-ad0b-4d2b-8c66-9e55c426af9b for instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 on n-h1-848886-16 Jul 26 04:33:46.547951 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4e4ae356-b27e-481e-bd6a-c9877462a09e req-f8a7a371-b809-4193-995c-da7505fa7262 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073107 Jul 26 04:33:46.549159 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 945/1962] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:46.563493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78b9fc69-15d5-46bb-8552-10087a54320d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5fed9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:46.630676 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78b9fc69-15d5-46bb-8552-10087a54320d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.080048 Jul 26 04:33:46.642516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 946/1963] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:46 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:46.647853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:46.648818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:46.678553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.679994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.687804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.688535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.817215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:33:46.817714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:33:46.819629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:33:46.820057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:33:46.820483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:33:46.883569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.884024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.886036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:46.887793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:46.929855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:46.953466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:33:46.955994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:46.972449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Getting quotas for user 97734a3da7ef4a809b0edd23ac216dfb and project f4bb20f8c8174308901ace320bb16903. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:33:46.986189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f0af2c2-c456-4ba7-9ae1-23cc2468823c tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.342209 Jul 26 04:33:46.991739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 947/1964] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:46 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:46.998774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:47.011198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:47.030492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:47.034855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:47.036927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:47.038670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:47.159446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:33:47.161714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dbf82f0-a13b-4121-ab0f-52f97d3d776a',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:33:47.461161 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-479687a6-bdb7-4837-aa6b-eded64b2f5d0 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946859 Jul 26 04:33:47.470094 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1018/1965] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:33:47.477893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:47.479354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:47.490729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:47.491239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:47.492424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:47.492882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:47.944909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:47.955631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:47.958359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:47.959855 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eefc9594-80c4-404a-bd3e-3e497141ad75 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.965902 Jul 26 04:33:47.960837 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 948/1966] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:46 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:47.971182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84585674-5f5b-438e-964d-684045fddc72 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:47.972134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84585674-5f5b-438e-964d-684045fddc72 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:48.096794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-84585674-5f5b-438e-964d-684045fddc72 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:48.117564 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84585674-5f5b-438e-964d-684045fddc72 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1053 microversion: 2.1 time: 0.155236 Jul 26 04:33:48.118486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 949/1967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:47 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1053 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:48.140036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:48.142313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: f889b3d4-7704-4c1f-8ebf-8adf04aa15f3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:48.153466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.154243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.155295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.155912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.177597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] HTTP exception thrown: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Request method failure captured: Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 HTTP/1.1 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi325uzpJ8S44KHxy5mgEBIrj5Db6CfK_wyr9QIzUm3LhT9syCgxysZtG06_J9PFt_yneyS4gznd3j5hGr0OfBPbXA7WGfEIPfhJnTyDDtfAxNqRrRFK6kht3X0smPYpvEQbgN1_-GdJtls7pk-AG4KFZ_iYNoCDS1O-6DXF0pTOXUny8 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a0a519d3ee764566951caddc2e7e85d2 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:33:48.179939 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a0a519d3ee764566951caddc2e7e85d2 Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateTestJSON-163517234-project Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 91fb451630e84c87acf036c15237ec08 Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateTestJSON-163517234-project Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. Jul 26 04:33:48.181706 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'f889b3d4-7704-4c1f-8ebf-8adf04aa15f3'} Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:48.182685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. Jul 26 04:33:48.184685 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:48.188264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Returning 404 to user: Instance f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:48.189521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-27137dc9-8cf2-4fc9-9e00-a632c9c4f799 tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3" status: 404 len: 111 microversion: 2.1 time: 0.056515 Jul 26 04:33:48.194196 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 950/1968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:48 2022] GET /compute/v2.1/servers/f889b3d4-7704-4c1f-8ebf-8adf04aa15f3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:33:48.204764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b8378e9f-b235-4838-9acb-b5916066e66f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5e74b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:48.282003 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b8378e9f-b235-4838-9acb-b5916066e66f tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.086128 Jul 26 04:33:48.285160 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 951/1969] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:48 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:48.297086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0ebfc13c-e843-4dbf-8104-ee6ec776f408 req-734e47cd-d46d-4003-832a-b6dd09ad2928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449c9d5a-345c-4465-adde-e07f3ba00bd5", "name": "network-vif-deleted", "tag": "f7d17068-d453-428a-84e2-f3b04b4945d8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:48.317277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0ebfc13c-e843-4dbf-8104-ee6ec776f408 req-734e47cd-d46d-4003-832a-b6dd09ad2928 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.318329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0ebfc13c-e843-4dbf-8104-ee6ec776f408 req-734e47cd-d46d-4003-832a-b6dd09ad2928 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.335735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0ebfc13c-e843-4dbf-8104-ee6ec776f408 req-734e47cd-d46d-4003-832a-b6dd09ad2928 service nova] Creating event network-vif-deleted:f7d17068-d453-428a-84e2-f3b04b4945d8 for instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 on n-h2-848886-16 Jul 26 04:33:48.345046 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0ebfc13c-e843-4dbf-8104-ee6ec776f408 req-734e47cd-d46d-4003-832a-b6dd09ad2928 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057455 Jul 26 04:33:48.346490 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 952/1970] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:48.366648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:48.369909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:48.387995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.388526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.390175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.390967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.411238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:48.426064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40bdd1c0-5f6c-4338-99b6-2a8d34bddc17 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1680 microversion: 2.1 time: 0.951602 Jul 26 04:33:48.429283 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1019/1971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:47 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1680 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:48.435540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:48.436380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:48.448672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.449326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.452419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:48.455493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:48.607811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fb451630e84c87acf036c15237ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a519d3ee764566951caddc2e7e85d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:48.615997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-534cdf1c-caf4-4d1a-8a2d-b71bea81c2fb tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 200 len: 1301 microversion: 2.1 time: 0.185430 Jul 26 04:33:48.633751 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1020/1972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:48 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 1301 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:48.714448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:48.779939 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cee80860-beeb-4cf7-8791-9804ffc3f018 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1929 microversion: 2.75 time: 0.431861 Jul 26 04:33:48.780793 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 953/1973] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:48 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1929 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:48.989346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:48.989961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:48.999652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.006505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.007510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.008032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.144852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:49.145468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:49.168374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.169141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.170127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.170777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.353515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:49.371576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:49.377902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:49.382115 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f4cc7a5-53f0-4e56-a188-9235bff07a76 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.395380 Jul 26 04:33:49.398194 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1021/1974] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:48 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:49.399274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d17906a2-49a4-46cd-92c9-45be4697f3bd tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b51ae820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:49.480130 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d17906a2-49a4-46cd-92c9-45be4697f3bd tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.093913 Jul 26 04:33:49.483212 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1022/1975] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:49 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:49.495664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:49.497452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:49.515620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.516092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.516908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.517463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.727331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:49.749389 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6b97dc6-bdcb-4f87-a870-cebb4f8efaf7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1151 microversion: 2.1 time: 0.609182 Jul 26 04:33:49.749924 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 954/1976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:49 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1151 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:33:49.767430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:49.768053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] [instance: 449c9d5a-345c-4465-adde-e07f3ba00bd5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:49.791824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.792647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.794345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.794962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.835966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] HTTP exception thrown: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Request method failure captured: Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 HTTP/1.1 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi325uzpJ8S44KHxy5mgEBIrj5Db6CfK_wyr9QIzUm3LhT9syCgxysZtG06_J9PFt_yneyS4gznd3j5hGr0OfBPbXA7WGfEIPfhJnTyDDtfAxNqRrRFK6kht3X0smPYpvEQbgN1_-GdJtls7pk-AG4KFZ_iYNoCDS1O-6DXF0pTOXUny8 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a0a519d3ee764566951caddc2e7e85d2 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:33:49.847306 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0a519d3ee764566951caddc2e7e85d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a0a519d3ee764566951caddc2e7e85d2 Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateTestJSON-163517234 Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateTestJSON-163517234-project Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 91fb451630e84c87acf036c15237ec08 Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateTestJSON-163517234-project Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. Jul 26 04:33:49.849100 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '449c9d5a-345c-4465-adde-e07f3ba00bd5'} Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:49.850060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. Jul 26 04:33:49.851735 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:49.854183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] Returning 404 to user: Instance 449c9d5a-345c-4465-adde-e07f3ba00bd5 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:49.855256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c2537d7-a761-42a8-bba7-9db5e83e441b tempest-MultipleCreateTestJSON-163517234 tempest-MultipleCreateTestJSON-163517234-project] 10.222.0.43 "GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5" status: 404 len: 111 microversion: 2.1 time: 0.104058 Jul 26 04:33:49.856555 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 955/1977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:49 2022] GET /compute/v2.1/servers/449c9d5a-345c-4465-adde-e07f3ba00bd5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:33:49.861796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:49.875180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:49.882106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.882802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:49.883855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:49.884713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:50.141244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:50.159516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d5c886ed-92df-498c-8c9f-6a69afcd9f37 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1680 microversion: 2.1 time: 0.674254 Jul 26 04:33:50.178296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1023/1978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:49 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1680 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:50.413018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:50.413880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:50.420990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:50.446722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:50.448510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:50.450016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:50.461741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:50.491509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d941835-2739-4a80-b625-e495d1ed8bf6 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1935 microversion: 2.75 time: 0.633525 Jul 26 04:33:50.492756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 956/1979] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:49 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1935 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:50.503349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a7301037-efb8-4f4c-ba98-2e3926caec84 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5d9a5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:50.599454 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a7301037-efb8-4f4c-ba98-2e3926caec84 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.099795 Jul 26 04:33:50.600678 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 957/1980] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:50 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:50.689450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-46d5d60d-e67a-46fc-a014-cc609b3e0bb9 req-0c0c16e0-e8c3-4b55-b106-5b3afc896d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:50.710614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-46d5d60d-e67a-46fc-a014-cc609b3e0bb9 req-0c0c16e0-e8c3-4b55-b106-5b3afc896d81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:50.711083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-46d5d60d-e67a-46fc-a014-cc609b3e0bb9 req-0c0c16e0-e8c3-4b55-b106-5b3afc896d81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:50.767498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-46d5d60d-e67a-46fc-a014-cc609b3e0bb9 req-0c0c16e0-e8c3-4b55-b106-5b3afc896d81 service nova] Creating event network-vif-unplugged:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h2-848886-16 Jul 26 04:33:50.806554 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-46d5d60d-e67a-46fc-a014-cc609b3e0bb9 req-0c0c16e0-e8c3-4b55-b106-5b3afc896d81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116164 Jul 26 04:33:50.807261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 958/1981] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:50.853145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:50.854463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:50.901771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:50.910551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:50.914731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:50.926898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:51.280744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:51.288843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c64bfec-ce03-4c94-804c-2ca87ea00a3d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1169 microversion: 2.1 time: 0.474023 Jul 26 04:33:51.303318 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 959/1982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:50 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1169 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:51.308974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:51.309875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:51.316708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:51.327036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:51.328237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:51.328862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:51.457047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:51.475168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:51.480227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:51.485532 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b79febb9-7166-4a39-a589-d90bfc29e7d0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 1.076686 Jul 26 04:33:51.501818 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1024/1983] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:50 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:51.525582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:51.528360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:51.541207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:51.542560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:51.544972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:51.548161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:51.654371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:51.663136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1f4f721-599d-41e2-bb39-5bca502575b1 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1612 microversion: 2.1 time: 0.358411 Jul 26 04:33:51.665232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 960/1984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:51 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1612 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:51.681560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b51ab73-6361-487b-b6fb-e84924164c9b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54e2a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:51.786414 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b51ab73-6361-487b-b6fb-e84924164c9b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.117778 Jul 26 04:33:51.787193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 961/1985] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:51 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:52.274043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:52.287528 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f58ff6fb-2cb6-409d-aebd-912f8c596d67 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1935 microversion: 2.75 time: 0.766473 Jul 26 04:33:52.288656 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1025/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:51 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1935 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:52.323728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:52.325165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:52.362790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:52.363446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:52.373256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:52.375069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:52.509088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:52.510676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:52.528437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:52.534520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:52.538267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:52.541622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.398702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:53.425667 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-787178cf-3b12-4aee-9a88-f97629248497 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1211 microversion: 2.1 time: 1.105857 Jul 26 04:33:53.431918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 962/1987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:52 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1211 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:53.447964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:53.459523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:53.471515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:53.476771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:53.484805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:53.499142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-505eb3ae-0f40-4254-b7e1-1e6ffc35b1dd tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.980967 Jul 26 04:33:53.499817 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1026/1988] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:52 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:33:53.503510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.503978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.504789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.505229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.525766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eccb6a7b-91b8-477c-8ba0-860d2d391359 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bab28700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:53.661514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eccb6a7b-91b8-477c-8ba0-860d2d391359 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1422 microversion: 2.1 time: 0.151937 Jul 26 04:33:53.674588 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1027/1989] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:53 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:53.685658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4fe71b91-6586-4815-aa1d-98d19b81795a req-2342a8cd-17ad-4c70-9467-adad5b5b5f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5e0949-3144-4c93-8105-17009421339f", "name": "network-vif-deleted", "tag": "4a1838b6-7db1-4475-8856-f970c8acfb66"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:53.691942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.692423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.692877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lazy-loading 'fault' on Instance uuid 3d5e0949-3144-4c93-8105-17009421339f {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:53.792797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4fe71b91-6586-4815-aa1d-98d19b81795a req-2342a8cd-17ad-4c70-9467-adad5b5b5f8e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.800611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4fe71b91-6586-4815-aa1d-98d19b81795a req-2342a8cd-17ad-4c70-9467-adad5b5b5f8e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.847765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4fe71b91-6586-4815-aa1d-98d19b81795a req-2342a8cd-17ad-4c70-9467-adad5b5b5f8e service nova] Creating event network-vif-deleted:4a1838b6-7db1-4475-8856-f970c8acfb66 for instance 3d5e0949-3144-4c93-8105-17009421339f on n-h1-848886-16 Jul 26 04:33:53.903807 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4fe71b91-6586-4815-aa1d-98d19b81795a req-2342a8cd-17ad-4c70-9467-adad5b5b5f8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217412 Jul 26 04:33:53.908725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1028/1990] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:53.925263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:53.927067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:53.946360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.950565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:53.954943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:53.956585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.095705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b834d3a2c84d8b96cc2312f76d4468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e800d69d45344db3b81768036fb2484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:54.107831 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2a68e8c-8c08-4dc3-b623-610bb1847521 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 200 len: 1330 microversion: 2.1 time: 0.674512 Jul 26 04:33:54.108704 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 963/1991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:53 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 1330 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:54.323056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] Lazy-loading 'services' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:54.392472 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a955b57-5da8-445b-a6a7-5eec0eb7a065 tempest-ServersAdmin275Test-1947993519 tempest-ServersAdmin275Test-1947993519-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1920 microversion: 2.75 time: 0.481197 Jul 26 04:33:54.393347 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1029/1992] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:53 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1920 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:54.427414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:54.427947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:54.439435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.439940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.440774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.444577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.452737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:54.453352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:54.466489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.468040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.470862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.471320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.535379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:33:54.684590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01859c5f-a0d8-4811-b272-ad32179469a7 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "DELETE /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 204 len: 0 microversion: 2.75 time: 0.258999 Jul 26 04:33:54.687562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 964/1993] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:33:54 2022] DELETE /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:33:54.705383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:54.706574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:54.723411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.725715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.726744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:54.727714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:54.773059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:55.528057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:55.543785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:55.546571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:55.550300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2eca2293-1fb9-4f78-be88-dbbb80944a05 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.860417 Jul 26 04:33:55.553705 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 965/1994] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:54 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:55.568912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44e3fc6c-a9c6-46e3-9fc4-f75ca3ce23b1 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5483ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:55.592084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:55.612756 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4eed1df9-92cf-4d9f-9c13-7d9ed29b6dbb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1211 microversion: 2.1 time: 1.162061 Jul 26 04:33:55.615619 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1030/1995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:54 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1211 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:55.627362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:55.629957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:55.671370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:55.673497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:55.703790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:55.707039 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44e3fc6c-a9c6-46e3-9fc4-f75ca3ce23b1 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1431 microversion: 2.1 time: 0.147405 Jul 26 04:33:55.709000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:55.715905 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 966/1996] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:55 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1431 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:55.742060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:55.743665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:55.786467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:55.795925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:55.812413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:55.818196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:55.894254 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] HTTP exception thrown: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Request method failure captured: Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f HTTP/1.1 Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi324BFJ5Jcfe8rCusrzyS_eYls6rw_uAvoW9_U3omxkPliybsrBJBXDLooO-xBXng04KKveMVIXqRiBmIaZszHYcLAoVGNo7qdk7fYpTRAcLp3HpUTXORAXyJeO-dO-LsVyx1cLkSnLYvsxdP9eG3fDB5kXskKj6PBv_8hXyjXQVSmdU Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:33:55.904430 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e800d69d45344db3b81768036fb2484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e800d69d45344db3b81768036fb2484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 63b834d3a2c84d8b96cc2312f76d4468 Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:33:55.906603 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '3d5e0949-3144-4c93-8105-17009421339f'} Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:55.907755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:33:55.909565 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:33:55.913283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Returning 404 to user: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:55.918539 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b8f38a3-85a7-4788-ad6d-786fee1db8f3 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 404 len: 111 microversion: 2.1 time: 0.200054 Jul 26 04:33:55.921830 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 967/1997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:55 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:33:55.933699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55ad66f5-80b8-4623-9705-76d499f87267 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5483ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:56.013988 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55ad66f5-80b8-4623-9705-76d499f87267 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 200 len: 1431 microversion: 2.1 time: 0.090759 Jul 26 04:33:56.019093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 968/1998] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:55 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 1431 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:56.029883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89218b3a-1c14-4c3b-91dd-7f6bd20939c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '.version_select at 0x7f38b5493790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:56.069780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89218b3a-1c14-4c3b-91dd-7f6bd20939c5 tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509040463" status: 202 len: 0 microversion: 2.1 time: 0.048487 Jul 26 04:33:56.071069 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 969/1999] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509040463 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:33:56.087265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:56.088303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:56.097323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.098179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.099877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.100630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.163951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:56.184536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:56.193556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:56.201930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b822c6cc-c208-43b4-8444-eab32a07eaf9 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1443 microversion: 2.75 time: 0.583359 Jul 26 04:33:56.223043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1031/2000] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:55 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1443 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:56.578747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:56.579722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:56.608477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.610713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.612970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.615719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.626601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:56.636758 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29096d09-d880-44ad-b802-9ab879c2cf51 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1466 microversion: 2.1 time: 0.564075 Jul 26 04:33:56.650569 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 970/2001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:56 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:56.666334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:56.667070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:56.680813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.681265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.682372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:56.688739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:56.925967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:56.995600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:57.475194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.493891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.499587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.502475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3735f81a-f788-42de-8b42-075d5ff59b47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.930030 Jul 26 04:33:57.506516 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1032/2002] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:56 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:57.519111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b4c875c-9b82-4078-911d-bf1718f3c869 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b522cdc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:57.617696 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b4c875c-9b82-4078-911d-bf1718f3c869 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b" status: 200 len: 784 microversion: 2.1 time: 0.109789 Jul 26 04:33:57.618871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1033/2003] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:57 2022] GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b => generated 784 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:57.626271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:57.626946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:57.643573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:57.644047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:57.648149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:57.648612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:57.722263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:57.723001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:57.723808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lazy-loading 'fault' on Instance uuid 706a885d-5b6d-4b1f-aa96-39d989e889bb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:33:57.798485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.819675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.827146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6216e6c6163453996bfaef90608afad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8239168ae1dc4ab3b96ff63e634e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:57.841067 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5bfbe1d4-90dc-4e07-95fe-145f53f272f5 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 200 len: 1448 microversion: 2.75 time: 0.220820 Jul 26 04:33:57.845138 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1034/2004] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:57 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 1448 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:33:57.869895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2935a461-b374-4a1a-a0d6-ea0b2bc88325 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:57.883131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2935a461-b374-4a1a-a0d6-ea0b2bc88325 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022697 Jul 26 04:33:57.884111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1035/2005] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:33:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:57.896467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c0b9aaa-2257-4749-a2d8-a31c02331d26 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b522cdc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:58.111298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:58.211718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:58.220445 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-043f8a41-afec-4793-8475-5a4d6faa36ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1211 microversion: 2.1 time: 1.566697 Jul 26 04:33:58.221754 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 971/2006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:56 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1211 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:33:58.238692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e08f936d-b78c-4a51-ac7e-c4b322dda490 req-607eee44-34e8-401c-8253-e46a6f834a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:58.255806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e08f936d-b78c-4a51-ac7e-c4b322dda490 req-607eee44-34e8-401c-8253-e46a6f834a2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:58.258941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e08f936d-b78c-4a51-ac7e-c4b322dda490 req-607eee44-34e8-401c-8253-e46a6f834a2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:58.298614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e08f936d-b78c-4a51-ac7e-c4b322dda490 req-607eee44-34e8-401c-8253-e46a6f834a2c service nova] Creating event network-changed:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h1-848886-16 Jul 26 04:33:58.306969 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e08f936d-b78c-4a51-ac7e-c4b322dda490 req-607eee44-34e8-401c-8253-e46a6f834a2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082531 Jul 26 04:33:58.309964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 972/2007] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:58.532090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:58.532982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:58.555593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:58.556420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:58.560742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:58.563614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.200932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:59.230901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:59.236720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:33:59.241630 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8e01892-080d-4f6a-aa14-a0c405638492 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1486 microversion: 2.25 time: 0.715345 Jul 26 04:33:59.243920 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 973/2008] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:58 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1486 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:33:59.252853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aca2d3e4-8407-4879-b13a-b5f84df86ce2 req-61a8193d-8f27-4e94-998d-2071930d6b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-unplugged", "status": "completed", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:59.284386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aca2d3e4-8407-4879-b13a-b5f84df86ce2 req-61a8193d-8f27-4e94-998d-2071930d6b52 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.286705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aca2d3e4-8407-4879-b13a-b5f84df86ce2 req-61a8193d-8f27-4e94-998d-2071930d6b52 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.305157 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aca2d3e4-8407-4879-b13a-b5f84df86ce2 req-61a8193d-8f27-4e94-998d-2071930d6b52 service nova] Creating event network-vif-unplugged:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:33:59.336287 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c0b9aaa-2257-4749-a2d8-a31c02331d26 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "DELETE /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 204 len: 0 microversion: 2.1 time: 1.443555 Jul 26 04:33:59.341058 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1036/2009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:57 2022] DELETE /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:33:59.345913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:59.346557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] [instance: 706a885d-5b6d-4b1f-aa96-39d989e889bb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:59.352029 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aca2d3e4-8407-4879-b13a-b5f84df86ce2 req-61a8193d-8f27-4e94-998d-2071930d6b52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086595 Jul 26 04:33:59.352702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 974/2010] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:33:59.369987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.370529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.373937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:59.376217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.377135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:59.377815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.395826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:33:59.405344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.405971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.406848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.407297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.446811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] HTTP exception thrown: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Request method failure captured: Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb HTTP/1.1 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi325fWeEzh5CGcivMezRMpgz-ywnggMm73HV6kqORBp0DRm5rSGt9PcWvJU0gjq4bsZDEHZOaGVQIpc21WpNN72j654lAJps_R1PQbPSNt3cAAqcP6ggGn2fDkGsVVreLtw5A0tAc-xbiAA_JkPOxec2bv4AbmeEHiJ6f30farvse5mg Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.75 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8239168ae1dc4ab3b96ff63e634e07b3 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdmin275Test-1911870576 Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:59.449088 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8239168ae1dc4ab3b96ff63e634e07b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8239168ae1dc4ab3b96ff63e634e07b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8239168ae1dc4ab3b96ff63e634e07b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8239168ae1dc4ab3b96ff63e634e07b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdmin275Test-1911870576 Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8239168ae1dc4ab3b96ff63e634e07b3 Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdmin275Test-1911870576 Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdmin275Test-1911870576-project Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e6216e6c6163453996bfaef90608afad Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdmin275Test-1911870576-project Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. Jul 26 04:33:59.451263 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '706a885d-5b6d-4b1f-aa96-39d989e889bb'} Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:59.452352 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. Jul 26 04:33:59.453908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.456186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] Returning 404 to user: Instance 706a885d-5b6d-4b1f-aa96-39d989e889bb could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:59.459738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf533779-afa0-4974-a82e-4065272e7496 tempest-ServersAdmin275Test-1911870576 tempest-ServersAdmin275Test-1911870576-project] 10.222.0.43 "GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb" status: 404 len: 111 microversion: 2.75 time: 0.117527 Jul 26 04:33:59.477970 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1037/2011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:33:59 2022] GET /compute/v2.1/servers/706a885d-5b6d-4b1f-aa96-39d989e889bb => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:33:59.492546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d7afde3-9293-4c06-8678-f7b9b8702ec2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5264550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:33:59.549647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8d7afde3-9293-4c06-8678-f7b9b8702ec2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] HTTP exception thrown: Image not found. Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d7afde3-9293-4c06-8678-f7b9b8702ec2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Request method failure captured: Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d HTTP/1.1 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3251KP0TEHCs0UW6Ah9SXluBXSOpezHMvvc1pzvFCi5sN49ut1EfO49kGNR7a6QIxNqUmY6fP15smN9dxgWKOR3ZGdrJ1EoC71r8mXIQ_wni5VHWxrtyI7AkQP8njeNRm-7kms4UPJWnwF-eI1jguNTCRR2b3D-141XtEKngSWxVlL8 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:33:59.557768 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c2873cad521441a89fb4139e6b33147c Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '41f8d617-c97c-46ae-b776-e869bc05939d'} Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:33:59.560007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 41f8d617-c97c-46ae-b776-e869bc05939d Jul 26 04:33:59.560967 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:33:59.562203 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41f8d617-c97c-46ae-b776-e869bc05939d could not be found. Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:33:59.563457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d7afde3-9293-4c06-8678-f7b9b8702ec2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:33:59.564797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d7afde3-9293-4c06-8678-f7b9b8702ec2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 404 len: 62 microversion: 2.1 time: 0.085796 Jul 26 04:33:59.573107 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1038/2012] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:33:59 2022] GET /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:33:59.587429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1564157432"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:33:59.600485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:33:59.622714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.625420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:33:59.626556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:33:59.628217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:00.249893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:00.263120 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5417fa7-f439-4c8b-a30c-d24b7ac3b0d4 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1211 microversion: 2.1 time: 0.901887 Jul 26 04:34:00.263953 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 975/2013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:33:59 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1211 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:00.272936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:00.281221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:00.302509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:00.307363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:00.308619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:00.309206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:00.584575 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8c7913f-90db-45b1-b1fa-6f7c07f54fd2 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "POST /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765/action" status: 202 len: 0 microversion: 2.1 time: 1.008641 Jul 26 04:34:00.594722 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1039/2014] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:33:59 2022] POST /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:34:00.616544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95c7e8f8-8722-41dc-99b1-52f16c6ca897 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b51abe50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:00.715944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95c7e8f8-8722-41dc-99b1-52f16c6ca897 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.114392 Jul 26 04:34:00.719282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1040/2015] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:00 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:01.090980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:01.106213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:01.115906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:01.119276 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe2f17f0-27f4-46b1-b1f5-875bd308278b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1476 microversion: 2.25 time: 0.853945 Jul 26 04:34:01.124148 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 976/2016] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:00 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1476 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:01.146410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ff43394-468e-46dc-a225-abe5d7d54cc9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '.version_select at 0x7f38b51b49d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.150555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ff43394-468e-46dc-a225-abe5d7d54cc9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.152277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ff43394-468e-46dc-a225-abe5d7d54cc9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.204469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ff43394-468e-46dc-a225-abe5d7d54cc9 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 3232 microversion: 2.25 time: 0.062320 Jul 26 04:34:01.204946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1041/2017] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 26 04:34:01 2022] GET /compute/v2.1/os-migrations => generated 3232 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:01.220136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.220746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:01.232610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.236154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.237379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.238019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.287835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.288870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:01.315149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.315755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.320061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.320515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.549414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] Lazy-loading 'services' on Instance uuid 9ea4a327-fde9-4c05-8fde-43bf09a176a1 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:01.576887 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fea686de-d150-4653-ae0e-b6debc6fdfb6 tempest-LiveAutoBlockMigrationV225Test-235849048 tempest-LiveAutoBlockMigrationV225Test-235849048-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1970 microversion: 2.25 time: 0.360287 Jul 26 04:34:01.577481 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 977/2018] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:01 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1970 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:01.633771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.638673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:01.653787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.659560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.660650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.661266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.693103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:01.826985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:01.834255 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4b55af1-3881-4808-9046-37686e214a28 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 204 len: 0 microversion: 2.25 time: 0.214498 Jul 26 04:34:01.838649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 978/2019] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:34:01 2022] DELETE /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 04:34:01.853209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-185d9882-8947-4f81-bfc0-77a1d4b2b169 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5d9a280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.932059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-185d9882-8947-4f81-bfc0-77a1d4b2b169 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.089263 Jul 26 04:34:01.936157 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 979/2020] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:01 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:01.947575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:01.948916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:01.971062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.974499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:01.977800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:01.978689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:02.254357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:02.267692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9210da62-4684-4654-ac39-fa54d3be637f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1211 microversion: 2.1 time: 0.986482 Jul 26 04:34:02.269592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1042/2021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:01 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1211 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:02.445436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:02.467134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:02.472978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:02.477608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1ea26ff-2dab-4905-91a1-77284b410711 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1482 microversion: 2.25 time: 0.538106 Jul 26 04:34:02.478829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 980/2022] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:01 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1482 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:02.905655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1252585466", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:02.951383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-683b2ac1-50b0-4985-bb7c-2325eced9474 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54b6d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:03.045942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-683b2ac1-50b0-4985-bb7c-2325eced9474 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.099247 Jul 26 04:34:03.046565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 981/2023] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:02 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:03.053141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] validate_networks() for [('d4403894-9602-4e0c-83c5-7390139a6f7d', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:34:03.294188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:03.294872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:03.310894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:03.314079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:03.315114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:03.316555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:03.864789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:03.880278 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1e9f23a-d436-40a4-9590-528bbbcde593 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 0.592786 Jul 26 04:34:03.883430 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 982/2024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:03 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:03.893129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:03.894001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:03.914235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:03.915188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:03.919813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:03.920491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:05.068225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:34:05.069392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:34:05.070472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:34:05.071249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:34:05.071831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:34:05.093240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:05.096107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:05.097258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:05.100192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:05.131132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Getting quotas for project e26beaaf35174cbfbbf3c3ae1b82aaf9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:34:05.137996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Getting quotas for user 64ecbf62a4cb478887ab8ef6b56cd78f and project e26beaaf35174cbfbbf3c3ae1b82aaf9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:34:05.155376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:34:05.158820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:34:05.342604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33f3ec32-eedf-4e31-a8e8-98a5418f6481 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.070661 Jul 26 04:34:05.355816 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1043/2025] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:34:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:34:05.388590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b43c498-a6e3-4ebe-88df-7f04f252ea6a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52cd0d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:05.479100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b43c498-a6e3-4ebe-88df-7f04f252ea6a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.120997 Jul 26 04:34:05.483315 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1044/2026] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:05 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:05.489872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-36656d52-d26b-4ed9-be37-f9252ff53996 req-200bce20-9585-49fd-abc4-715e0d887818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea4a327-fde9-4c05-8fde-43bf09a176a1", "name": "network-vif-deleted", "tag": "ffd750f3-09b5-4186-a82d-39a1ff9d3850"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:05.511296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:05.529799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:05.537196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:05.537947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-36656d52-d26b-4ed9-be37-f9252ff53996 req-200bce20-9585-49fd-abc4-715e0d887818 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:05.538373 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3b9d01b-cc84-4911-a63b-773fcb5a336b tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1482 microversion: 2.25 time: 1.652322 Jul 26 04:34:05.538944 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 983/2027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:03 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1482 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:05.540365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-36656d52-d26b-4ed9-be37-f9252ff53996 req-200bce20-9585-49fd-abc4-715e0d887818 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:05.591081 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-36656d52-d26b-4ed9-be37-f9252ff53996 req-200bce20-9585-49fd-abc4-715e0d887818 service nova] Creating event network-vif-deleted:ffd750f3-09b5-4186-a82d-39a1ff9d3850 for instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 on n-h1-848886-16 Jul 26 04:34:05.596182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:05.596800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:05.613229 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-36656d52-d26b-4ed9-be37-f9252ff53996 req-200bce20-9585-49fd-abc4-715e0d887818 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126471 Jul 26 04:34:05.615352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1045/2028] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:05.633946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ce5c01a-7df8-4ecb-9692-7a9a85cf5a23 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:05.642524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ce5c01a-7df8-4ecb-9692-7a9a85cf5a23 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:05.645511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:05.651094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:05.661176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:05.661176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:06.889318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ce5c01a-7df8-4ecb-9692-7a9a85cf5a23 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:06.904285 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ce5c01a-7df8-4ecb-9692-7a9a85cf5a23 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1223 microversion: 2.1 time: 1.285811 Jul 26 04:34:06.911965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1046/2029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:05 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1223 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:06.959062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c09c22d0-1482-4547-845a-7744b885ab84 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52cddc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:07.106638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c09c22d0-1482-4547-845a-7744b885ab84 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.180127 Jul 26 04:34:07.111784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1047/2030] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:06 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:07.139639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:07.140322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:07.168551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:07.169009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:07.169808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:07.177104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:07.332671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:07.341271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:07.349520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:07.354989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af044980-ad44-433f-9437-ed998d13f651 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 1.768473 Jul 26 04:34:07.357054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:07.357602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 984/2031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:05 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:07.372472 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-537edd1e-fed3-4f0d-aa50-df3b54ecb6d1 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.256997 Jul 26 04:34:07.373485 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1048/2032] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:07 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:07.935504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:07.936121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:07.948132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:07.948585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:07.949573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:07.950539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:08.128712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09ef7c7f-10da-4829-91a0-1a41d61a208e tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bab69280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:08.199918 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09ef7c7f-10da-4829-91a0-1a41d61a208e tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.078158 Jul 26 04:34:08.200485 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1049/2033] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:08 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:08.380730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:08.393631 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75f81bb9-2ddd-403f-a595-7497449951c0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1219 microversion: 2.1 time: 0.458979 Jul 26 04:34:08.407418 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 985/2034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:07 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1219 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:08.423542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:08.425317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:08.454750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:08.456124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:08.462952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:08.463754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:08.532386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-557815496", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:08.633863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:34:09.305893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:09.320361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c265d5ea-2e0e-47e2-90d8-71cf991b1ae6 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 0.910994 Jul 26 04:34:09.322003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 986/2035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:08 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:09.329511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:09.330719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:09.339135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.340231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.342348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.343061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.349716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:09.485081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:34:09.486125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:34:09.486637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:34:09.487049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:34:09.487463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:34:09.525095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.530363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.532884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.537442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.639008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Getting quotas for project f6da0054c1b5445abba3f5e069ce4b14. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:34:09.659163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Getting quotas for user 6a27f94db6fd4dae956c4ade24267a84 and project f6da0054c1b5445abba3f5e069ce4b14. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:34:09.673929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:09.695533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:09.705149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:09.707218 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e82f6c22-5890-42ae-82e3-c1b8f36b70d3 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.383858 Jul 26 04:34:09.709891 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 987/2036] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:09 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:09.713205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:34:09.716957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:34:09.723672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66164d32-6122-46bb-a598-052128788ccf tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54d3700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:09.847386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66164d32-6122-46bb-a598-052128788ccf tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.134685 Jul 26 04:34:09.854620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-da4f1631-e027-4256-8d58-52ceab336b08 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565089 Jul 26 04:34:09.858588 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1050/2038] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:34:09.864656 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 988/2038] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:09 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:09.868169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:09.873543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:09.884681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:09.886334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:09.889511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.896218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.897422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.898086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.906793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.908227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.910695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:09.911346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:09.953810 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] HTTP exception thrown: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Request method failure captured: Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f HTTP/1.1 Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi324BFJ5Jcfe8rCusrzyS_eYls6rw_uAvoW9_U3omxkPliybsrBJBXDLooO-xBXng04KKveMVIXqRiBmIaZszHYcLAoVGNo7qdk7fYpTRAcLp3HpUTXORAXyJeO-dO-LsVyx1cLkSnLYvsxdP9eG3fDB5kXskKj6PBv_8hXyjXQVSmdU Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:09.955912 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e800d69d45344db3b81768036fb2484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e800d69d45344db3b81768036fb2484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 63b834d3a2c84d8b96cc2312f76d4468 Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:09.957679 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '3d5e0949-3144-4c93-8105-17009421339f'} Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:09.958726 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:09.960407 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:09.964302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Returning 404 to user: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:09.965671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7ea1f9f-5b94-4235-be3d-fd31978f7acc tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 404 len: 111 microversion: 2.1 time: 0.099898 Jul 26 04:34:09.966733 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 989/2039] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:34:09 2022] DELETE /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:34:09.971938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40b704be-1af0-4ddf-9907-d0757058efdd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:09.973807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40b704be-1af0-4ddf-9907-d0757058efdd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:10.096747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:10.105830 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3926cd7-396d-4cf2-8a03-e7ac05f2e954 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1281 microversion: 2.1 time: 0.245917 Jul 26 04:34:10.107189 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1051/2040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:09 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:10.112038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:10.140026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] [instance: 3d5e0949-3144-4c93-8105-17009421339f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:10.148518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40b704be-1af0-4ddf-9907-d0757058efdd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:10.169871 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40b704be-1af0-4ddf-9907-d0757058efdd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1213 microversion: 2.1 time: 0.197755 Jul 26 04:34:10.170555 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 990/2041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:09 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:10.206225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.206599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:10.214238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.215159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:10.264428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] HTTP exception thrown: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Request method failure captured: Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f HTTP/1.1 Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi324BFJ5Jcfe8rCusrzyS_eYls6rw_uAvoW9_U3omxkPliybsrBJBXDLooO-xBXng04KKveMVIXqRiBmIaZszHYcLAoVGNo7qdk7fYpTRAcLp3HpUTXORAXyJeO-dO-LsVyx1cLkSnLYvsxdP9eG3fDB5kXskKj6PBv_8hXyjXQVSmdU Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:10.268261 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e800d69d45344db3b81768036fb2484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e800d69d45344db3b81768036fb2484c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e800d69d45344db3b81768036fb2484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e800d69d45344db3b81768036fb2484c Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1576122894 Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 63b834d3a2c84d8b96cc2312f76d4468 Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1576122894-project Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:10.270016 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3d5e0949-3144-4c93-8105-17009421339f'} Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:10.271060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. Jul 26 04:34:10.272829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:10.274286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] Returning 404 to user: Instance 3d5e0949-3144-4c93-8105-17009421339f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:10.274286 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71b06207-6fd7-4195-aa63-66dadf82aa0e tempest-AttachSCSIVolumeTestJSON-1576122894 tempest-AttachSCSIVolumeTestJSON-1576122894-project] 10.222.0.43 "GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f" status: 404 len: 111 microversion: 2.1 time: 0.161356 Jul 26 04:34:10.278210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1052/2042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:10 2022] GET /compute/v2.1/servers/3d5e0949-3144-4c93-8105-17009421339f => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:34:10.347753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:10.348387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:10.385346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.385346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:10.385346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.387429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:10.734771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:10.735988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:10.762256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.762866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:10.763719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:10.767112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.365034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:11.376084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:11.391638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:11.396729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-994813f2-32a4-4b22-aa64-3657046a4f09 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.665349 Jul 26 04:34:11.399820 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1053/2043] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:10 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:34:11.413553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db8ab31e-06eb-4919-9b68-26d443696224 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52cda60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:11.522775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db8ab31e-06eb-4919-9b68-26d443696224 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.119170 Jul 26 04:34:11.523304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1054/2044] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:11 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:11.554299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-71609a47-541d-4f88-95d1-c9ec9f638379 req-caa8bed4-d984-41d2-8365-c1fbde0cf9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-plugged", "status": "completed", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:11.569405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:11.606752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-71609a47-541d-4f88-95d1-c9ec9f638379 req-caa8bed4-d984-41d2-8365-c1fbde0cf9c4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:11.607198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-71609a47-541d-4f88-95d1-c9ec9f638379 req-caa8bed4-d984-41d2-8365-c1fbde0cf9c4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.650546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-71609a47-541d-4f88-95d1-c9ec9f638379 req-caa8bed4-d984-41d2-8365-c1fbde0cf9c4 service nova] Creating event network-vif-plugged:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:34:11.681143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-71609a47-541d-4f88-95d1-c9ec9f638379 req-caa8bed4-d984-41d2-8365-c1fbde0cf9c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152559 Jul 26 04:34:11.685760 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1055/2045] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:11.697561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:11.707427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:11.708371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:11.709772 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2923f541-6cef-431b-b1f1-69fc46fc7f94 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 1.367618 Jul 26 04:34:11.719391 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 991/2046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:10 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:11.755399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:11.763426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.767109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:11.768477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.793137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:11.804530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:11.848592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:11.853823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.861257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:11.861869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:11.988714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:12.005448 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-265a1630-7f4f-474d-bf39-98a9b839f9ad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1281 microversion: 2.1 time: 0.318023 Jul 26 04:34:12.018624 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1056/2047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:11 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1281 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:12.385536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:12.421819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:12.422854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:12.423085 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a3e81eca-6591-4488-be57-b2522d2403ec tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1265 microversion: 2.1 time: 0.692317 Jul 26 04:34:12.436554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:12.440592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:12.443295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:12.445990 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 992/2048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:11 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1265 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:12.446444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:12.560124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1eec1841-9b25-4e70-838c-f107da2a2a01 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54d3550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:12.663635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1eec1841-9b25-4e70-838c-f107da2a2a01 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.112527 Jul 26 04:34:12.664208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 993/2049] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:12 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:12.736162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:12.737675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:12.778714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:12.779267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:12.780156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:12.784185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:12.924589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:12.943150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:12.952905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:12.959516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f02ae35-4729-46ef-b9ca-c9c36d096eba tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.539480 Jul 26 04:34:12.961817 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1057/2050] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:12 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:34:13.031748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:13.032778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:13.045285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:13.047477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:13.049673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:13.051419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:13.863773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:13.866021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:13.873945 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e375c72-977a-4991-b929-1b2388e68046 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 1.146051 Jul 26 04:34:13.889076 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 994/2051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:12 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:13.892963 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-989ad3b3-7521-4e9f-ae89-7fbd7939ec83 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.865157 Jul 26 04:34:13.908095 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1058/2052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:13 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:13.914133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c7015fd-651b-463b-be37-082fedb0b605 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bad31c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:13.919695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:13.923174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:13.936664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:13.937412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:13.938912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:13.941479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.024868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c7015fd-651b-463b-be37-082fedb0b605 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.115009 Jul 26 04:34:14.032863 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1059/2053] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:13 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:14.059179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:14.060675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:14.092817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.096571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.100578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.109554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.294909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:14.323741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:14.326250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:14.327684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c5bcf4e-8b6c-45e8-a3de-1c50fc6ac381 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.292951 Jul 26 04:34:14.329340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1060/2054] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:14 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:14.471279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ad9daf37-3fb1-43e5-9393-4b7ac74809d4 req-1a0abb5f-7879-48aa-a97f-22130ec1af01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "name": "network-vif-plugged", "status": "completed", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:14.501049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ad9daf37-3fb1-43e5-9393-4b7ac74809d4 req-1a0abb5f-7879-48aa-a97f-22130ec1af01 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.506093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ad9daf37-3fb1-43e5-9393-4b7ac74809d4 req-1a0abb5f-7879-48aa-a97f-22130ec1af01 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.525855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:14.532583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ad9daf37-3fb1-43e5-9393-4b7ac74809d4 req-1a0abb5f-7879-48aa-a97f-22130ec1af01 service nova] Creating event network-vif-plugged:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h1-848886-16 Jul 26 04:34:14.542764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da2410cb-edab-4bfb-8b32-777b65142b83 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1271 microversion: 2.1 time: 0.643848 Jul 26 04:34:14.543836 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 995/2055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:13 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1271 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:14.560272 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ad9daf37-3fb1-43e5-9393-4b7ac74809d4 req-1a0abb5f-7879-48aa-a97f-22130ec1af01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093208 Jul 26 04:34:14.561648 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1061/2056] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:34:14.897052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:14.897672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:14.919297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:14.920321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:14.921787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.923572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.925460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.928516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.938205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.944609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:14.945516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:14.945992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:15.569349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:15.579149 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51867991-afc2-4e73-8700-07b0b0d3977f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.665499 Jul 26 04:34:15.591672 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1062/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:14 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:15.608337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59b119ab-ed09-473b-bfb9-f7358b7ceac4 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b51b9af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:15.715084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59b119ab-ed09-473b-bfb9-f7358b7ceac4 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.121891 Jul 26 04:34:15.716411 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1063/2058] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:15 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:15.746699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:15.748228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:15.778449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:15.781099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:15.783160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:15.791034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:15.817468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:15.827710 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-759ce50a-6225-4950-aa3a-a51af28fc5d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1199 microversion: 2.1 time: 0.934673 Jul 26 04:34:15.846317 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 996/2059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:14 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1199 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:15.857973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:15.860134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:15.875435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:15.876071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:15.886389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:15.886973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:16.081449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:16.095737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:16.099007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:16.101173 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec92612c-5ca8-4cfd-ae18-88c20343625d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 200 len: 1265 microversion: 2.25 time: 0.382392 Jul 26 04:34:16.105547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1064/2060] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:15 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:16.609023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:16.610427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:16.624486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:16.627050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:16.631205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:16.631939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:16.892372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:16.908080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4229630d-47bb-4941-96d7-21a43ebc5949 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 1.059395 Jul 26 04:34:16.918765 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 997/2061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:15 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:16.938983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-03873b0f-c759-4706-a7a3-84744ec2dda4 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54838b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:17.073011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-03873b0f-c759-4706-a7a3-84744ec2dda4 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.151938 Jul 26 04:34:17.084134 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 998/2062] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:16 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:17.124636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:17.130653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:17.194855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:17.202870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:17.210370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:17.216935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.374076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:18.384345 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f3bed80-b474-4dab-924f-ba4d1f6f6698 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 1.779706 Jul 26 04:34:18.398767 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1065/2063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:16 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:18.411197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:18.412138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 9ea4a327-fde9-4c05-8fde-43bf09a176a1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:18.419926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:18.420668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.421673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:18.422395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.460816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] HTTP exception thrown: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Request method failure captured: Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 HTTP/1.1 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zknylEHfWeR823w5rvRhMkWejQ9fzAfWacfg5OEjDITrbxPIvg0Gdj_Li5Up7ApgnJhk9p158grGaXCGzRsPFH_t8uFlhWdTv-HXl6d5NB28pr1KzMjqkARcBNyan12qu_Hwt-L-E611tZemGhjwoKVbpcpEyQFm3pIUh_yiWE3Sk Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:18.472926 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e06c8cb7d10e4818a7e40396b93e54ab Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. Jul 26 04:34:18.474625 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '9ea4a327-fde9-4c05-8fde-43bf09a176a1'} Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:18.475524 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. Jul 26 04:34:18.476953 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:18.485339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Returning 404 to user: Instance 9ea4a327-fde9-4c05-8fde-43bf09a176a1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:18.486647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8876a1d-88a3-4934-9f34-4bce2b1de1af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1" status: 404 len: 111 microversion: 2.25 time: 0.086596 Jul 26 04:34:18.487441 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1066/2064] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:18 2022] GET /compute/v2.1/servers/9ea4a327-fde9-4c05-8fde-43bf09a176a1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:34:18.511163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-49c990e0-9ed2-4178-9021-7d4a578386cf req-fb807d60-0e4a-4a09-b858-a7c5c0b1ed38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:18.538631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-49c990e0-9ed2-4178-9021-7d4a578386cf req-fb807d60-0e4a-4a09-b858-a7c5c0b1ed38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:18.539498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-49c990e0-9ed2-4178-9021-7d4a578386cf req-fb807d60-0e4a-4a09-b858-a7c5c0b1ed38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.570930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-49c990e0-9ed2-4178-9021-7d4a578386cf req-fb807d60-0e4a-4a09-b858-a7c5c0b1ed38 service nova] Creating event network-changed:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:34:18.579568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-49c990e0-9ed2-4178-9021-7d4a578386cf req-fb807d60-0e4a-4a09-b858-a7c5c0b1ed38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086089 Jul 26 04:34:18.584512 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1067/2065] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:18.603062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:18.604337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:18.622284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:18.625113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.625968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:18.635229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:18.728990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:18.731258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:18.750100 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6090b890-4e9c-4a91-94ef-3fb29a34c712 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1382 microversion: 2.1 time: 1.651423 Jul 26 04:34:18.751459 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 999/2066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:17 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1382 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:18.765577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2549f4e-3afc-4e7d-a920-d64a77c19fcd tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54a2940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:18.900055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2549f4e-3afc-4e7d-a920-d64a77c19fcd tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.147002 Jul 26 04:34:18.900794 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1000/2067] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:18 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:19.294628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:19.302674 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34e278c1-2bee-4a45-805a-9360bf67e496 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.716055 Jul 26 04:34:19.321313 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1068/2068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:18 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:19.350446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:19.351372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:19.375867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:19.376341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:19.377204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:19.381360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:19.408786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:19.410088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:19.428155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:19.429482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:19.430847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:19.431383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:19.594760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:19.697041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=14 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:20.155773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:20.211036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:20.221109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a42bbc4-e482-4b8b-a207-492c3a0c4aad tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.814961 Jul 26 04:34:20.235176 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1069/2069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:19 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:20.240045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02ffc38c-5762-4a9c-9efe-2dfd38cb993b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b522c310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:20.329094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02ffc38c-5762-4a9c-9efe-2dfd38cb993b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.092677 Jul 26 04:34:20.331103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1070/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:20 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:20.347069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:20.348001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:20.364111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:20.366803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:20.374216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:20.375051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:20.441159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54739974-7132-4537-b4bd-125a51eea02c tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1535 microversion: 2.1 time: 1.531982 Jul 26 04:34:20.450979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1001/2071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:18 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1535 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:20.472634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:20.473564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:20.491642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:20.492428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:20.494283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:20.497479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:20.894640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:20.919067 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e0a3973-364a-426b-8573-ae1a1991e8bf tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.567120 Jul 26 04:34:20.923141 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1071/2072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:20 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:20.951717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a65a5af-96e9-4c57-9eef-5d5be1ad7d80 req-3e26d68d-8243-4ba8-92ae-6f3a9ea675cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c88409-200c-4c78-9aa2-cc1837591bb7", "tag": "74604202-2aba-456d-a065-faca04fd654a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:20.996297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a65a5af-96e9-4c57-9eef-5d5be1ad7d80 req-3e26d68d-8243-4ba8-92ae-6f3a9ea675cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:20.996745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a65a5af-96e9-4c57-9eef-5d5be1ad7d80 req-3e26d68d-8243-4ba8-92ae-6f3a9ea675cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.040666 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a65a5af-96e9-4c57-9eef-5d5be1ad7d80 req-3e26d68d-8243-4ba8-92ae-6f3a9ea675cc service nova] Creating event network-changed:74604202-2aba-456d-a065-faca04fd654a for instance 16c88409-200c-4c78-9aa2-cc1837591bb7 on n-h2-848886-16 Jul 26 04:34:21.063104 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a65a5af-96e9-4c57-9eef-5d5be1ad7d80 req-3e26d68d-8243-4ba8-92ae-6f3a9ea675cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138627 Jul 26 04:34:21.068307 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1072/2073] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:21.241865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:21.242596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:21.275549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.283673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.286696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.287391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.453688 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9594bae-a0f4-4cf2-bb9d-91362a0dbda2 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1535 microversion: 2.1 time: 0.985652 Jul 26 04:34:21.466292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1002/2074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:20 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1535 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:21.467901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d62a4b0-7af4-4d9d-b2f9-f5dff402729a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5433b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:21.612791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d62a4b0-7af4-4d9d-b2f9-f5dff402729a tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.152789 Jul 26 04:34:21.613407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1003/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:21 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:21.628822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:21.645171 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:34:21.645171 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:34:21.654458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.655800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.657460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.658141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.714617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:21.722243 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-354b9a68-1320-4a14-8c82-6c6caf0286d9 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.107529 Jul 26 04:34:21.722789 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a5c517e-4098-4d26-a664-d858e83a9238 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.485052 Jul 26 04:34:21.727307 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1004/2076] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:34:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:21.728190 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1073/2077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:21 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:21.747420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-848886-16", "block_migration": false, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:21.750120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:21.768507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.769241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.771665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.773217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.857351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lazy-loading 'flavor' on Instance uuid c6f3477d-0f5c-4825-9455-bfd7a1c0a354 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:21.882093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Going to try to live migrate instance to n-h2-848886-16 {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 04:34:21.946591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:21.948859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:21.970827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.971721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:21.974792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:21.994667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:22.792527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:22.808771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a55e04fc-8640-4a54-9b6d-75fc4ce0b2ea tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.867707 Jul 26 04:34:22.810093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1074/2078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:21 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:22.844115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-07d716ee-4f72-4e80-a59a-c356db4cbfaa tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52d5ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:22.960039 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-07d716ee-4f72-4e80-a59a-c356db4cbfaa tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.131606 Jul 26 04:34:22.961509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1075/2079] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:22 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:22.979124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:22.980373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:23.024146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:23.026866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:23.031601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:23.032423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:23.899499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:23.915393 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0bd9f5b-2b1a-4eb3-9eda-ab05be362aaa tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.951430 Jul 26 04:34:23.916749 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1076/2080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:22 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:23.934583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:23.939607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:23.965223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:23.965875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:23.974598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:23.978024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:24.625151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:24.635576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13763c88-c422-4506-afe2-bbd2401ae715 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.716240 Jul 26 04:34:24.644275 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1077/2081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:23 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:24.654871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c731f308-bb69-413d-be5e-3adb462eb678 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38babc0af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:24.780915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c731f308-bb69-413d-be5e-3adb462eb678 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.135228 Jul 26 04:34:24.788712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1078/2082] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:24 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:24.940644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:24.941423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:24.970661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:24.973969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:24.977747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:24.978642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:25.940577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-759b49e8-1057-4b2f-8625-7d4f991c4f52 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354/action" status: 202 len: 0 microversion: 2.1 time: 4.204329 Jul 26 04:34:25.941251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1005/2083] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:34:21 2022] POST /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354/action => generated 0 bytes in 4206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:34:25.949265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:25.951740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:25.982209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:25.982679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:25.988151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:25.988666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:26.188053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:26.196570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3840a60-d57d-4f6c-a532-7f12bb6047d9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 1.260333 Jul 26 04:34:26.201012 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1079/2084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:24 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:26.383840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Action: 'create', calling method: .version_select at 0x7f38bac7c280>, body: {"keypair": {"name": "tempest-keypair-1798883101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArpIsMEflWVD9sI8nE56z0k7NPFnou3+a2mdDhJZYv4gdxQSbFtWDXyfV9ctgnp3+N3BwrqVq4wdlPF5cLHN9R46P20r3oIgEz2Dy0OdF2DmFC7u+Iq+oYAgNkarvx6Ng=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:26.479474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for project 06968033322f4c8ca753d79f1c8f0ea7. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:34:26.515513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for user 8251b1935184447cb3b2425c4f3981fd and project 06968033322f4c8ca753d79f1c8f0ea7. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:34:26.549622 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [9cddab06-3356-469c-8a5c-5a060558a200] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 04:34:26.661301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:26.675636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf6b32bb-6413-46d6-b387-475d87a28551 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.733197 Jul 26 04:34:26.692010 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1006/2085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:25 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:26.706146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14f25927-4989-418b-9fe5-2fa86759ff56 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54a2dc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:26.838361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14f25927-4989-418b-9fe5-2fa86759ff56 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.145576 Jul 26 04:34:26.839493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1007/2086] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:26 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:26.865915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:26.866823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:26.897089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:26.900302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:26.904253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:26.907358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:27.565549 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [9cddab06-3356-469c-8a5c-5a060558a200] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 60196. Jul 26 04:34:27.598951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86e75fb7-4d24-47ae-9a02-715526201045 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.396285 Jul 26 04:34:27.599668 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1080/2087] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:34:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:27.612715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:27.617117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:27.633397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:27.635756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:27.639660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:27.640315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:28.192639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:28.210143 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe6d63cf-191e-4f93-ac52-9987f590df41 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.369202 Jul 26 04:34:28.214281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1008/2088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:26 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:28.228678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:28.230620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:28.258454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:28.260615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:28.264036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:28.264839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:28.694756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:28.715704 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd0350b1-8650-418a-a51f-5a57072dd15b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 1.110873 Jul 26 04:34:28.717053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1081/2089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:27 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:28.724357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-065e63a0-0ed9-4762-93fc-1f44a4860176 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b51ab9d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:28.830734 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-065e63a0-0ed9-4762-93fc-1f44a4860176 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.111578 Jul 26 04:34:28.833159 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1082/2090] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:28 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:28.841338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:28.842224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:28.871823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:28.872454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:28.874474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:28.876134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:28.969762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:29.216516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd7e2781-3242-42b9-898b-fb02649d1b2d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 204 len: 0 microversion: 2.25 time: 0.381229 Jul 26 04:34:29.221695 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1083/2091] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:34:28 2022] DELETE /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:34:29.236535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:29.237361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:29.277163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:29.284422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:29.299848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:29.300743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:29.481647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:29.499168 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9300c277-8771-4060-9264-7d4a11d6558b tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 1.283394 Jul 26 04:34:29.510612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1009/2092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:28 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:29.514644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:29.515555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:29.549827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:29.550796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:29.554566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:29.555488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:29.624978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:29.984188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:29.994779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:30.002242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:30.010322 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca6dd850-3d4c-4f66-9527-641484e59298 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1729 microversion: 2.25 time: 0.783962 Jul 26 04:34:30.013235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1084/2093] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:29 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1729 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:30.029437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-aefe80ac-9354-45cc-a2e0-debd5c9ec50a req-7df94f3a-e6d6-4d1d-89b6-0ae67a526ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "name": "network-vif-plugged", "status": "completed", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:30.069017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aefe80ac-9354-45cc-a2e0-debd5c9ec50a req-7df94f3a-e6d6-4d1d-89b6-0ae67a526ebb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:30.072303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aefe80ac-9354-45cc-a2e0-debd5c9ec50a req-7df94f3a-e6d6-4d1d-89b6-0ae67a526ebb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:30.109590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-aefe80ac-9354-45cc-a2e0-debd5c9ec50a req-7df94f3a-e6d6-4d1d-89b6-0ae67a526ebb service nova] Creating event network-vif-plugged:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:34:30.153079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-aefe80ac-9354-45cc-a2e0-debd5c9ec50a req-7df94f3a-e6d6-4d1d-89b6-0ae67a526ebb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129239 Jul 26 04:34:30.159631 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1085/2094] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:30.172756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:30.176571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:30.187016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:30.188051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:30.189257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:30.190649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:30.867737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:30.892122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e5ab25d-6087-4e5a-8793-4a9dd134d5ef tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.730809 Jul 26 04:34:30.893050 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1086/2095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:30 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:30.910338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df5ec70e-70b4-46b8-87f3-ab8af5f9e09b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38babf3430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:31.012639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df5ec70e-70b4-46b8-87f3-ab8af5f9e09b tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.117975 Jul 26 04:34:31.017083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1087/2096] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:30 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:31.042637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:31.050189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:31.099403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.106576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:31.107978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.111708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:31.367972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:31.387295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea869b07-b386-445b-bce7-780c9f1c3e8e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.881952 Jul 26 04:34:31.388216 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1010/2097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:29 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:31.397977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:31.403863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:31.420320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.421036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:31.424620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.425472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:31.607003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:31.619412 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00db1b9c-e47b-4a1f-9700-6f16254228e9 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.600104 Jul 26 04:34:31.622895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1088/2098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:31 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:31.677914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:31.750023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:31.764756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:31.772340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:31.773608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cebe5fda-7466-44e1-a898-f73488738eaa tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1729 microversion: 2.25 time: 0.382006 Jul 26 04:34:31.780963 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1011/2099] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:31 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1729 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:31.917258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:31.918178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:31.936344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.936804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:31.937613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:31.943142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.029033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39ca352c-6244-4dbb-b09a-f47abcec8d89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5447c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:32.135295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39ca352c-6244-4dbb-b09a-f47abcec8d89 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.109281 Jul 26 04:34:32.146251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1012/2100] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:32 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:32.419179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:32.422141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:32.438746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:32.460379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.461332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.463288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.464004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.508448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:32.529455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36fa5780-c3fa-4564-93c5-f7c78cbf20b8 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1323 microversion: 2.1 time: 0.613492 Jul 26 04:34:32.549431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1089/2101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:31 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:32.650929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:32.652120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:32.665236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.666698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.673731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.674580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.737159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:32.949075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:32.963339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c230fb8-3b38-40bb-95af-ad4a9e1aa6f7 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.314283 Jul 26 04:34:32.965449 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1090/2102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:32 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:32.979706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:32.980620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:32.995070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.995790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:32.996766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:32.997380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:33.274837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:33.286537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:33.288382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:33.290849 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e372ff3-26ec-4e1a-9a0a-04b3cc2de892 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1729 microversion: 2.25 time: 0.323239 Jul 26 04:34:33.304141 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1091/2103] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:32 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1729 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:33.481277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1967210332", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "e6e6d6d9-ea1a-471d-8309-2e1115e75ecc"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:33.609763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] validate_networks() for [('e6e6d6d9-ea1a-471d-8309-2e1115e75ecc', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:34:34.329288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:34:34.329981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:34:34.330676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:34:34.331278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:34:34.331865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:34:34.347183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:34.352206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:34.353790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:34.354736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:34.399373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Getting quotas for project 009a5725ed22412da5eecc8967b16fd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:34:34.409771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Getting quotas for user 1fe13602ed3b40088f0dbd2d04ab2dfe and project 009a5725ed22412da5eecc8967b16fd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:34:34.440211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:34:34.443917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:34:34.558964 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3862473d-96c6-4ad7-9e38-38b0b6b53234 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254112 Jul 26 04:34:34.560869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1092/2104] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:34:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:34:34.572692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fe16873-f6ae-46d2-8d3d-1730952ff7a6 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52cdca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:34.726721 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fe16873-f6ae-46d2-8d3d-1730952ff7a6 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.161320 Jul 26 04:34:34.734795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1093/2105] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:34 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:34.743889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:34.747730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:34.786286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:34.788797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:34.792780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:34.793245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.128438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.144840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-38274296-24d5-40df-a0ba-f7437947ca8c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1518 microversion: 2.1 time: 0.415332 Jul 26 04:34:35.145614 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1094/2106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:34 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1518 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:35.168336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:35.169352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:35.183044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.183520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.183651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.184342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.188014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.216352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0226123c-7b94-4ee5-b00a-ffe68af2a8e7 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 2.806462 Jul 26 04:34:35.218124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1013/2107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:32 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:35.236646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:35.238950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:35.273055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.273499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.285951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.286678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.589328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.608391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87e51ef9-79c0-4198-957f-2a12b13f8326 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.440114 Jul 26 04:34:35.610338 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1095/2108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:35 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:35.630197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e149342-2345-4d4c-9319-f2de19cfbc92 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:35.630785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e149342-2345-4d4c-9319-f2de19cfbc92 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:35.795946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.802091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e149342-2345-4d4c-9319-f2de19cfbc92 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.811186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.813231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:35.814787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7aec7636-9050-4420-b735-4eb71a79f14d tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1662 microversion: 2.25 time: 0.593486 Jul 26 04:34:35.816260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e149342-2345-4d4c-9319-f2de19cfbc92 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1225 microversion: 2.1 time: 0.204759 Jul 26 04:34:35.821201 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1096/2109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:35 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:35.828980 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1014/2110] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:35 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1662 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:35.842977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:35.854524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:35.857703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba809169-a6ea-4f3d-82fc-ce761f3e950d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b548c820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:35.872639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:35.874574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.875122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.875970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:35.876454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:35.912931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lazy-loading 'flavor' on Instance uuid b50dc221-caaa-424c-904a-40570389f5cc {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:35.946627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba809169-a6ea-4f3d-82fc-ce761f3e950d tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.115686 Jul 26 04:34:35.948623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1015/2111] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:35 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:36.243202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:36.244948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:36.259619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:36.260464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:36.263969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:36.264644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:36.296226 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-681c01b9-8235-423e-b14d-d6d5742c7d48 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action" status: 200 len: 32 microversion: 2.1 time: 0.456549 Jul 26 04:34:36.303014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1097/2112] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:34:35 2022] POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:34:36.329105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:36.331643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:36.342746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:36.343268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:36.344250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:36.344827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:36.950358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:36.969618 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9bb0b519-ca5e-4d27-8acf-1fc9c91a517b tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.663347 Jul 26 04:34:36.970830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1098/2113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:36 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:37.001077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:37.004129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:37.018699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.019334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.020190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.020963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.507106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:37.516065 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec740667-8cfb-4b0e-a447-3059a62b1a92 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.277316 Jul 26 04:34:37.520523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1016/2114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:36 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:37.532309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:37.540656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:37.565273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.566452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.567324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.567769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.768522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:37.777628 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5dd1a1dd-5cc4-487b-9e76-9adfe549090f tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1283 microversion: 2.1 time: 0.249690 Jul 26 04:34:37.778240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1017/2115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:37 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:37.795488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:37.803530 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f054b95-090a-4ceb-a03d-0722efa82a52 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.830284 Jul 26 04:34:37.804125 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1099/2116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:36 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:37.808219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:37.819649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:37.826546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.827268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.828267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.831846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.836518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64eea197-8951-4ca3-9c45-1a7e908c7bb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38bad34ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:37.936753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.937486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:37.938118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lazy-loading 'fault' on Instance uuid 435821de-846e-4599-9134-4fd6cac36e6b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:37.950427 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64eea197-8951-4ca3-9c45-1a7e908c7bb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.126697 Jul 26 04:34:37.954503 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1100/2117] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:37 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:37.959163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b77b2ed3-f4cc-45e6-b517-239682c2271d req-f51f58a6-4bda-47c6-89a5-a276236cbf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435821de-846e-4599-9134-4fd6cac36e6b", "name": "network-vif-deleted", "tag": "0ad5db0f-a20e-426f-931a-580ba1867477"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:37.985335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b77b2ed3-f4cc-45e6-b517-239682c2271d req-f51f58a6-4bda-47c6-89a5-a276236cbf28 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:37.985783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b77b2ed3-f4cc-45e6-b517-239682c2271d req-f51f58a6-4bda-47c6-89a5-a276236cbf28 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:38.031738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b77b2ed3-f4cc-45e6-b517-239682c2271d req-f51f58a6-4bda-47c6-89a5-a276236cbf28 service nova] Creating event network-vif-deleted:0ad5db0f-a20e-426f-931a-580ba1867477 for instance 435821de-846e-4599-9134-4fd6cac36e6b on n-h1-848886-16 Jul 26 04:34:38.049695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b77b2ed3-f4cc-45e6-b517-239682c2271d req-f51f58a6-4bda-47c6-89a5-a276236cbf28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093872 Jul 26 04:34:38.053081 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1101/2118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:38.060650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:38.072609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:38.099726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:38.100190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:38.100998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:38.101446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:39.026649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:39.036087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:39.042973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:39.062360 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fdbb35e-6b82-4ac7-accf-843fdebbed50 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 200 len: 1374 microversion: 2.25 time: 1.253365 Jul 26 04:34:39.063752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1018/2119] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:37 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 1374 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:39.068767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:39.080395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:39.103856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:39.111939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:39.118638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:39.119571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:39.231910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:39.242750 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bd976bcf-43a0-4aae-b905-e6f23a07b8cc tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 1.188284 Jul 26 04:34:39.251722 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1102/2120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:38 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:39.263552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:39.264179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:39.296131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:39.296669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:39.297416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:39.297967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.005617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:40.017363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-625c8abf-c6d4-4ef1-aebd-2ee265e8838c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.757567 Jul 26 04:34:40.020234 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1103/2121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:39 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:40.028812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:40.039099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:40.053799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.060133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.061270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.061893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.318276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:40.335807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3293362e-9550-455e-a08e-2199f2c00c5e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.270647 Jul 26 04:34:40.357259 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1019/2122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:39 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:40.363856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-64040ba9-571c-4418-964b-3990335a5ec8 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b5447550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:40.506267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-64040ba9-571c-4418-964b-3990335a5ec8 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1427 microversion: 2.1 time: 0.147229 Jul 26 04:34:40.507608 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1020/2123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:40 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:40.538959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9b5fec35-772a-41ba-83fd-a4dd2b844ad0 req-5d121615-18cb-4fd2-85d1-088a7ccc8f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c88409-200c-4c78-9aa2-cc1837591bb7", "name": "network-vif-plugged", "status": "completed", "tag": "74604202-2aba-456d-a065-faca04fd654a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:40.587271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9b5fec35-772a-41ba-83fd-a4dd2b844ad0 req-5d121615-18cb-4fd2-85d1-088a7ccc8f6e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.590606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9b5fec35-772a-41ba-83fd-a4dd2b844ad0 req-5d121615-18cb-4fd2-85d1-088a7ccc8f6e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.665417 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9b5fec35-772a-41ba-83fd-a4dd2b844ad0 req-5d121615-18cb-4fd2-85d1-088a7ccc8f6e service nova] Creating event network-vif-plugged:74604202-2aba-456d-a065-faca04fd654a for instance 16c88409-200c-4c78-9aa2-cc1837591bb7 on n-h2-848886-16 Jul 26 04:34:40.702575 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9b5fec35-772a-41ba-83fd-a4dd2b844ad0 req-5d121615-18cb-4fd2-85d1-088a7ccc8f6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182492 Jul 26 04:34:40.703254 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1021/2124] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:40.739177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:40.745157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 435821de-846e-4599-9134-4fd6cac36e6b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:40.782924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.782924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.783948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.786694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.832021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] HTTP exception thrown: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Request method failure captured: Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b HTTP/1.1 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32zknylEHfWeR823w5rvRhMkWejQ9fzAfWacfg5OEjDITrbxPIvg0Gdj_Li5Up7ApgnJhk9p158grGaXCGzRsPFH_t8uFlhWdTv-HXl6d5NB28pr1KzMjqkARcBNyan12qu_Hwt-L-E611tZemGhjwoKVbpcpEyQFm3pIUh_yiWE3Sk Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:40.850904 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: e06c8cb7d10e4818a7e40396b93e54ab Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. Jul 26 04:34:40.853155 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '435821de-846e-4599-9134-4fd6cac36e6b'} Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:40.854010 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. Jul 26 04:34:40.856896 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:40.858104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Returning 404 to user: Instance 435821de-846e-4599-9134-4fd6cac36e6b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:40.858104 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-372b4e44-fc4a-41ef-94a0-48024bd1551c tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b" status: 404 len: 111 microversion: 2.25 time: 0.129915 Jul 26 04:34:40.874860 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1022/2125] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:40 2022] GET /compute/v2.1/servers/435821de-846e-4599-9134-4fd6cac36e6b => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:34:40.889436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:40.890072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:40.953136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.953965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:40.955637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:40.956483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:41.110705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:41.122530 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c56bc85-dd5e-4c79-a36e-89a91e1cc2cc tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 1.100729 Jul 26 04:34:41.139674 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1104/2126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:40 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:41.144646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57d5aeb8-23ca-4dd0-aa92-f7a20d9097af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '.version_select at 0x7f38bab28670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:41.216656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57d5aeb8-23ca-4dd0-aa92-f7a20d9097af tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273969355" status: 204 len: 0 microversion: 2.25 time: 0.075773 Jul 26 04:34:41.220972 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1105/2127] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Jul 26 04:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273969355 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:34:41.225948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:41.226858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:41.244502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:41.246583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:41.247784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:41.248622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:41.643559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:41.643765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:41.656669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b5f71ae-460f-48cb-a898-0e88b54f2eab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.778517 Jul 26 04:34:41.659523 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57790447-c0d4-4108-b42c-b28124ddedf7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.434963 Jul 26 04:34:41.660149 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1023/2128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:40 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:41.676582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1106/2129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:41 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:41.678313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:41.686123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:41.695011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32eeacf2-3a9c-4074-9625-83d1de0ebb29 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b522c4c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:41.697473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:41.697930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:41.698751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:41.699241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:42.769311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:42.792215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f21e9042-5a27-480a-99fe-6355d494d57d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.129045 Jul 26 04:34:42.794702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1024/2130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:41 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:42.803063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:42.805600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:42.820069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:42.821767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:42.824081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:42.826822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:43.377970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32eeacf2-3a9c-4074-9625-83d1de0ebb29 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1436 microversion: 2.1 time: 1.699425 Jul 26 04:34:43.386267 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1107/2131] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:41 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1436 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:43.391589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:43.392210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:43.410481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:43.411179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:43.412161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:43.412797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:43.648413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:43.700703 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50c79c4d-69a6-46d4-808e-a60df421b733 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1313 microversion: 2.1 time: 0.903504 Jul 26 04:34:43.702085 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1025/2132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:42 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:43.709660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:43.712497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:43.724200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:43.728684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:43.744079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:43.745730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.000231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:44.014394 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae87bf35-6b58-4b04-934b-9113748ea0de tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.626960 Jul 26 04:34:44.019297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1108/2133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:43 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:44.028643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-990a7b78-0f6e-419c-ad00-bbb9a4ad0862 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b52cdca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.103478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-990a7b78-0f6e-419c-ad00-bbb9a4ad0862 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 200 len: 1436 microversion: 2.1 time: 0.082789 Jul 26 04:34:44.109145 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1109/2134] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:34:44 2022] GET /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 1436 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:44.120107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-eca1a115-b511-4c6e-ac5f-02b81be7c07e req-a41cf020-b3f7-41d3-b93a-eea180e4a321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a586bd-f45a-4c30-bedc-e775853c3909", "tag": "46059e43-773a-48db-835e-a84b55e229ff"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:44.146382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eca1a115-b511-4c6e-ac5f-02b81be7c07e req-a41cf020-b3f7-41d3-b93a-eea180e4a321 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.146875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eca1a115-b511-4c6e-ac5f-02b81be7c07e req-a41cf020-b3f7-41d3-b93a-eea180e4a321 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.160084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-eca1a115-b511-4c6e-ac5f-02b81be7c07e req-a41cf020-b3f7-41d3-b93a-eea180e4a321 service nova] Creating event network-changed:46059e43-773a-48db-835e-a84b55e229ff for instance 10a586bd-f45a-4c30-bedc-e775853c3909 on n-h1-848886-16 Jul 26 04:34:44.166644 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-eca1a115-b511-4c6e-ac5f-02b81be7c07e req-a41cf020-b3f7-41d3-b93a-eea180e4a321 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056072 Jul 26 04:34:44.167467 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1110/2135] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:44.174649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.179238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:44.200597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:44.204044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.206779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.208629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.209692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.214930 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13e8ca14-24d6-48f7-b296-87d42ac00188 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.511236 Jul 26 04:34:44.217220 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1026/2136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:43 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:44.225491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.230593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:44.243678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.246717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.249275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.249909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.378389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:44.535980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:44.545452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7593971-b3af-4e8c-a22b-df8799b14dcf tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.376635 Jul 26 04:34:44.546039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1111/2137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:44 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:44.567514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.569236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:44.592741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.593541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.594566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.595217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.629360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:44.668595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:44.674411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:44.677655 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb1bbc1c-297c-4d79-9b32-20764795518c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1466 microversion: 2.1 time: 0.456347 Jul 26 04:34:44.683488 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1027/2138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:44 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1466 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:44.707124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f021f74f-306d-48ca-9835-2b01950d3eac tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38b54015e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.832734 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4db2226-b7d3-4aa7-a4f7-398c909c7d69 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 204 len: 0 microversion: 2.25 time: 0.285120 Jul 26 04:34:44.841173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1112/2139] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:34:44 2022] DELETE /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:34:44.856741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:44.857468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:44.864602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.865286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:44.869031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:44.869531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.056861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:45.066079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2ee0b7c-841d-4434-8547-bd0bcae0ae03 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1463 microversion: 2.1 time: 0.223497 Jul 26 04:34:45.067712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1113/2140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:44 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:45.086198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:45.088900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:45.098464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.099152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.100166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.100995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.329849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:45.341357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:45.343169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:45.344607 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3698a2c-ae48-4450-aa24-b2bee4823f30 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1549 microversion: 2.25 time: 0.274747 Jul 26 04:34:45.345290 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1114/2141] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:45 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1549 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:45.351010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:45.352468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:45.369768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.370596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.371768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.372446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.553155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:45.574694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39d5b6fc-8894-478c-b9cc-b296f25f0fcb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.227458 Jul 26 04:34:45.575397 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1115/2142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:45 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:45.729172 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f021f74f-306d-48ca-9835-2b01950d3eac tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "DELETE /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d" status: 204 len: 0 microversion: 2.1 time: 1.025816 Jul 26 04:34:45.730091 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1028/2143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:44 2022] DELETE /compute/v2.1/images/791e97b9-8b1c-4ead-8cfe-52a6e725b39d => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:34:45.746778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:45.747819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:45.756020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.756792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.760206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.760953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.812886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:45.844752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Calling method '.version_select at 0x7f38bab281f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:45.856991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.858548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.892335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.893038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.914467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c482e638-15bb-4ee1-b14a-72056e159ea1 tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/f6da0054c1b5445abba3f5e069ce4b14?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677" status: 200 len: 694 microversion: 2.1 time: 0.337942 Jul 26 04:34:45.915843 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1116/2144] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jul 26 04:34:45 2022] GET /compute/v2.1/os-simple-tenant-usage/f6da0054c1b5445abba3f5e069ce4b14?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677 => generated 694 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:45.921518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:45.922786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:45.930854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.931811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:45.933080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:45.933533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.181580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:46.191606 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1293ee94-6be4-407d-9dbe-b7fe1b33d87d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.274013 Jul 26 04:34:46.207148 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1117/2145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:45 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:46.219611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7299a7a8-5d46-44f6-87b6-f3e63781e063 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '.version_select at 0x7f38babf3dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.290775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7299a7a8-5d46-44f6-87b6-f3e63781e063 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] HTTP exception thrown: Image not found. Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7299a7a8-5d46-44f6-87b6-f3e63781e063 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Request method failure captured: Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d HTTP/1.1 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3251KP0TEHCs0UW6Ah9SXluBXSOpezHMvvc1pzvFCi5sN49ut1EfO49kGNR7a6QIxNqUmY6fP15smN9dxgWKOR3ZGdrJ1EoC71r8mXIQ_wni5VHWxrtyI7AkQP8njeNRm-7kms4UPJWnwF-eI1jguNTCRR2b3D-141XtEKngSWxVlL8 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:46.293306 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c2873cad521441a89fb4139e6b33147c Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '41f8d617-c97c-46ae-b776-e869bc05939d'} Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:46.294979 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41f8d617-c97c-46ae-b776-e869bc05939d to delete Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.296005 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41f8d617-c97c-46ae-b776-e869bc05939d could not be found. Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:46.297403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7299a7a8-5d46-44f6-87b6-f3e63781e063 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7299a7a8-5d46-44f6-87b6-f3e63781e063 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "DELETE /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d" status: 404 len: 62 microversion: 2.1 time: 0.085484 Jul 26 04:34:46.300871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1118/2146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:46 2022] DELETE /compute/v2.1/images/41f8d617-c97c-46ae-b776-e869bc05939d => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:34:46.304604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '.version_select at 0x7f38bab69310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.332758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.333225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.342857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:46.346713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.347318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.350882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e49c59f1-08f6-422d-ae01-917188421e71 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.610335 Jul 26 04:34:46.360661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc46e40c-5620-42db-9418-4c0b58c1d687 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/f6da0054c1b5445abba3f5e069ce4b14?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677" status: 200 len: 694 microversion: 2.1 time: 0.063768 Jul 26 04:34:46.362650 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1029/2147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:45 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:46.363336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1119/2148] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jul 26 04:34:46 2022] GET /compute/v2.1/os-simple-tenant-usage/f6da0054c1b5445abba3f5e069ce4b14?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677 => generated 694 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:46.371673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.372461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:46.375164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.376449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:46.386913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.388855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.389034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.390030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.390442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.391109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.391481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.391630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.427990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:46.481767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:46.559881 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8761720f-6a3c-4026-adf9-d296a2933802 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 204 len: 0 microversion: 2.1 time: 0.195172 Jul 26 04:34:46.560945 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1030/2149] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:34:46 2022] DELETE /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:34:46.568372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Calling method '.version_select at 0x7f38b542b9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.594003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.594853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.616422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.617267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.724424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:46.738182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:46.739710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:46.740920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ed7cdec-19ab-4523-bbac-7e316f67e489 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1549 microversion: 2.25 time: 0.376456 Jul 26 04:34:46.741492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1120/2150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:46 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1549 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:46.758738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.759322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:46.775361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.775829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.777057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.777057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.777597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-390ce4f8-bb2b-4f7e-a35d-41265fc048bf tempest-TenantUsagesTestJSON-2138000484 tempest-TenantUsagesTestJSON-2138000484-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677&detailed=1" status: 200 len: 22402 microversion: 2.1 time: 0.214372 Jul 26 04:34:46.779208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1031/2151] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Jul 26 04:34:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T04%3A34%3A45.082677&end=2022-07-27T04%3A34%3A45.082677&detailed=1 => generated 22402 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:34:46.787097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:46.788320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:46.804354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.807924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:46.809680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:46.811508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.044825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.056939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26c6f384-144a-4c45-9e1e-85d8cdeb8de5 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1472 microversion: 2.1 time: 0.314365 Jul 26 04:34:47.071000 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1121/2152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:46 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:47.078275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.083315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:47.083947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:47.085960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c908f5c-7d6f-4155-9618-d85e788d084c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.305295 Jul 26 04:34:47.089854 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1032/2153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:46 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:47.095756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.096454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.097458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.098122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.129683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:47.216039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:47.218695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:47.232384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.233307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.234363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.234811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.296569 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8412a2f-5052-4415-9943-8c76189ed9fd tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 204 len: 0 microversion: 2.1 time: 0.223837 Jul 26 04:34:47.297753 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1122/2154] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:34:47 2022] DELETE /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:34:47.308251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f9573f55-7fbf-4365-85f9-06d688eba1b5 req-caba751e-2b2e-4fba-8fda-9a45706e3603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f92145-94ea-401f-93dd-8ad512b58d9e", "name": "network-vif-deleted", "tag": "880becbc-bb94-44e5-bbd9-23b447f549cc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:47.338570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f9573f55-7fbf-4365-85f9-06d688eba1b5 req-caba751e-2b2e-4fba-8fda-9a45706e3603 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.339308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f9573f55-7fbf-4365-85f9-06d688eba1b5 req-caba751e-2b2e-4fba-8fda-9a45706e3603 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.364821 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f9573f55-7fbf-4365-85f9-06d688eba1b5 req-caba751e-2b2e-4fba-8fda-9a45706e3603 service nova] Creating event network-vif-deleted:880becbc-bb94-44e5-bbd9-23b447f549cc for instance 39f92145-94ea-401f-93dd-8ad512b58d9e on n-h1-848886-16 Jul 26 04:34:47.380936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f9573f55-7fbf-4365-85f9-06d688eba1b5 req-caba751e-2b2e-4fba-8fda-9a45706e3603 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079532 Jul 26 04:34:47.383777 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1123/2155] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:47.398188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:47.402299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:47.418840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.423443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.425276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.426759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.473541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.494433 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9691375-8c69-424a-84c3-054440de182f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.285075 Jul 26 04:34:47.512204 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1033/2156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:47 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:47.517958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:47.518877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:47.527413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.528781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.529790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.530510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.769031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.779616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.791011 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40f8b4e4-e677-4e27-b8fe-902e81acc660 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1469 microversion: 2.1 time: 0.403332 Jul 26 04:34:47.792169 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1124/2157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:47 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1469 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:47.794263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34585af8-f3dc-45b2-a2fa-cb221cc06f08 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.278833 Jul 26 04:34:47.806182 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1034/2158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:47 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:47.806479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:47.806479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:47.806672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e05d28ed-077c-4e10-a7a1-9a8f8ff96188 req-9b4cd000-3c14-435e-8085-f27bd4340854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-unplugged", "status": "completed", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:47.814129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.814129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.814847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.815323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.845181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e05d28ed-077c-4e10-a7a1-9a8f8ff96188 req-9b4cd000-3c14-435e-8085-f27bd4340854 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.845681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e05d28ed-077c-4e10-a7a1-9a8f8ff96188 req-9b4cd000-3c14-435e-8085-f27bd4340854 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.875363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:47.876138 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e05d28ed-077c-4e10-a7a1-9a8f8ff96188 req-9b4cd000-3c14-435e-8085-f27bd4340854 service nova] Creating event network-vif-unplugged:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:34:47.879699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:47.880255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lazy-loading 'fault' on Instance uuid 39f92145-94ea-401f-93dd-8ad512b58d9e {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:47.881753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e05d28ed-077c-4e10-a7a1-9a8f8ff96188 req-9b4cd000-3c14-435e-8085-f27bd4340854 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083254 Jul 26 04:34:47.884634 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1035/2159] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:47.965329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.973746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.977902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:47.979806 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e6fae76-c9e4-4c17-b2f2-c5c11edf4654 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 200 len: 1352 microversion: 2.25 time: 0.186601 Jul 26 04:34:47.980938 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1125/2160] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:47 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 1352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:48.093516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:48.094248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:48.105896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:48.107026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:48.112447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.113132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.114127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.114668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.115047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.115413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.116203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.116642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.302325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:48.312677 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f96ddc6-aedd-44b3-9f4e-c52db033f7b7 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.210540 Jul 26 04:34:48.313790 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1126/2161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:48 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:48.320312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:48.328846 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9d240a4-9201-429f-a2a3-0c1f89b46c4c tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1472 microversion: 2.1 time: 0.240066 Jul 26 04:34:48.329466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1036/2162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:48 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:48.519194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:48.519830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:48.528654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.529292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.530338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.530787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.702479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:48.713167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c288e0e-4fe2-4c65-9468-55c1db6f9766 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.198112 Jul 26 04:34:48.714922 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1127/2163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:48 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:48.823475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:48.824790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:48.825831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:48.826553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:48.841371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.842879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.843625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.845227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.845840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.846929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:48.847821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:48.848486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.038366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.050620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd7bb560-bd4c-4704-bc22-09ff38871d81 tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1469 microversion: 2.1 time: 0.234868 Jul 26 04:34:49.051781 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1128/2164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:48 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1469 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:49.057762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.058814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: 39f92145-94ea-401f-93dd-8ad512b58d9e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.071168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.072009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.073098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.073921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.082221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:49.097604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] HTTP exception thrown: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Request method failure captured: Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e HTTP/1.1 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zknylEHfWeR823w5rvRhMkWejQ9fzAfWacfg5OEjDITrbxPIvg0Gdj_Li5Up7ApgnJhk9p158grGaXCGzRsPFH_t8uFlhWdTv-HXl6d5NB28pr1KzMjqkARcBNyan12qu_Hwt-L-E611tZemGhjwoKVbpcpEyQFm3pIUh_yiWE3Sk Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:49.099887 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e06c8cb7d10e4818a7e40396b93e54ab Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. Jul 26 04:34:49.101976 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '39f92145-94ea-401f-93dd-8ad512b58d9e'} Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:49.103187 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. Jul 26 04:34:49.104861 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:49.107625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Returning 404 to user: Instance 39f92145-94ea-401f-93dd-8ad512b58d9e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:49.108774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75df83a3-f5bd-47a8-a488-1ef9eaf5fcb0 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e" status: 404 len: 111 microversion: 2.25 time: 0.055694 Jul 26 04:34:49.109473 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1129/2165] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:49 2022] GET /compute/v2.1/servers/39f92145-94ea-401f-93dd-8ad512b58d9e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:34:49.120535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.121550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.121714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.130345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.131047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.132297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.133567 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33aed8bd-75a3-4bec-abf1-0e95c835eda9 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.318933 Jul 26 04:34:49.134826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1037/2166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:48 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:49.135908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.168141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:49.291595 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa5d5512-bda3-470a-872b-067bad8536d2 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 204 len: 0 microversion: 2.25 time: 0.174395 Jul 26 04:34:49.292564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1130/2167] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:34:49 2022] DELETE /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:34:49.300624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.301199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.309217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.309930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.311042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.311688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.335378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.336998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.353409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.354220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.355420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.356047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.583509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.604094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4703699-c89d-4ff8-b755-215182f47746 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.273665 Jul 26 04:34:49.618253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1131/2168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:49 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:49.618253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.618253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.623328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.623867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.624791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.625246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.635806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.654753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.659674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.661456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1d6bf57-1eff-4edc-999b-89f8f3431c47 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1564 microversion: 2.25 time: 0.364922 Jul 26 04:34:49.678732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1038/2169] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:49 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1564 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:49.737016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:49.738251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:49.756174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.757157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.760688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.761748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:49.940766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:49.952201 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-217f27c4-eb81-4d30-8b36-dc2f3015b731 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1472 microversion: 2.1 time: 0.346147 Jul 26 04:34:49.954896 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1132/2170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:49 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:49.971897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8110a2eb-8a74-4092-9ab6-1d60eb2be173 req-e38f48d4-90cc-4824-8ea0-b92f66fca60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a586bd-f45a-4c30-bedc-e775853c3909", "name": "network-vif-plugged", "status": "completed", "tag": "46059e43-773a-48db-835e-a84b55e229ff"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:49.984166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8110a2eb-8a74-4092-9ab6-1d60eb2be173 req-e38f48d4-90cc-4824-8ea0-b92f66fca60c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:49.985101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8110a2eb-8a74-4092-9ab6-1d60eb2be173 req-e38f48d4-90cc-4824-8ea0-b92f66fca60c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.000959 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8110a2eb-8a74-4092-9ab6-1d60eb2be173 req-e38f48d4-90cc-4824-8ea0-b92f66fca60c service nova] Creating event network-vif-plugged:46059e43-773a-48db-835e-a84b55e229ff for instance 10a586bd-f45a-4c30-bedc-e775853c3909 on n-h1-848886-16 Jul 26 04:34:50.013500 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8110a2eb-8a74-4092-9ab6-1d60eb2be173 req-e38f48d4-90cc-4824-8ea0-b92f66fca60c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052140 Jul 26 04:34:50.013988 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1133/2171] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:50.077487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:50.078047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:50.095660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.096688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.097526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.098013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.259421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:50.271820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c7e8b7c-7940-4ec1-adc0-a0be70af6b0b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.537143 Jul 26 04:34:50.272472 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1039/2172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:49 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:50.278239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:50.281680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:50.296683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.300000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.301109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.301775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.539370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:50.551746 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-661b513f-a9d5-4863-a5a8-74ffe9309fef tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1469 microversion: 2.1 time: 0.479145 Jul 26 04:34:50.552561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1134/2173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:50 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1469 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:50.628036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:50.628691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:50.643581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.644187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.645028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.646217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.677319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:50.699407 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec6816cf-3ad3-4b08-b2e0-eb0855b4e956 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.424752 Jul 26 04:34:50.710185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1040/2174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:50 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:50.710185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:50.710185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:50.721958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.722468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:50.723284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:50.723732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.066618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.075558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35185f95-14f8-4c32-aed4-bc9878399791 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1325 microversion: 2.1 time: 0.452558 Jul 26 04:34:51.076169 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1135/2175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:50 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1325 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:51.093133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:51.093677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:51.109713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.111012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.112985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.113690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.212790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.241322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.246039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06c8cb7d10e4818a7e40396b93e54ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fad7dba9e8f4520b59697fd89d3e370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.247735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79bfed9d-6def-4794-8722-dfde6314a36e tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 200 len: 1564 microversion: 2.25 time: 0.546034 Jul 26 04:34:51.248484 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1041/2176] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:50 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 1564 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:34:51.257241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2b7f1181-c620-4c9a-b279-ab85b6eb64d2 req-0aa032d8-bc8c-425e-9263-a061bbb22a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5663c86-0ddc-4546-a50d-1959846d25b6", "name": "network-vif-deleted", "tag": "2f1c7440-341f-478f-a13c-07897ade358a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:51.278605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2b7f1181-c620-4c9a-b279-ab85b6eb64d2 req-0aa032d8-bc8c-425e-9263-a061bbb22a27 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.279310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2b7f1181-c620-4c9a-b279-ab85b6eb64d2 req-0aa032d8-bc8c-425e-9263-a061bbb22a27 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.293382 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2b7f1181-c620-4c9a-b279-ab85b6eb64d2 req-0aa032d8-bc8c-425e-9263-a061bbb22a27 service nova] Creating event network-vif-deleted:2f1c7440-341f-478f-a13c-07897ade358a for instance d5663c86-0ddc-4546-a50d-1959846d25b6 on n-h1-848886-16 Jul 26 04:34:51.298946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2b7f1181-c620-4c9a-b279-ab85b6eb64d2 req-0aa032d8-bc8c-425e-9263-a061bbb22a27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048886 Jul 26 04:34:51.299585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1042/2177] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:51.306261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:51.307388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:51.322423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.323128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.324194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.324817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.447698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.456436 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5647d4e-3939-4759-93bb-17079dcd6b83 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1430 microversion: 2.1 time: 0.373162 Jul 26 04:34:51.473691 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1136/2178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:51 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1430 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:51.574673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:51.576082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:51.586950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.587905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.589302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.590003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.743312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:51.768710 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d70dfa6-d72c-4d0b-9790-234ca6fb7468 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.467311 Jul 26 04:34:51.783372 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1043/2179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:51 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:51.783372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:51.783372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:51.803876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.804365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:51.806276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:51.812805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.126310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:52.136719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6cabc616-5ff3-405e-9e74-610da3041450 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.363698 Jul 26 04:34:52.138679 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1044/2180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:51 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:52.145787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.147729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.158144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.160176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.161381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.162014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.301387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a27f94db6fd4dae956c4ade24267a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6da0054c1b5445abba3f5e069ce4b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:52.320404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b12679b-48f2-403b-9298-40c740f5ebad tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 200 len: 1427 microversion: 2.1 time: 0.750901 Jul 26 04:34:52.328635 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1137/2181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:51 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 1427 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:52.342060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.343229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] [instance: d5663c86-0ddc-4546-a50d-1959846d25b6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.352360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.353264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.354956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.355786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.390920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] HTTP exception thrown: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Request method failure captured: Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 HTTP/1.1 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32zknylEHfWeR823w5rvRhMkWejQ9fzAfWacfg5OEjDITrbxPIvg0Gdj_Li5Up7ApgnJhk9p158grGaXCGzRsPFH_t8uFlhWdTv-HXl6d5NB28pr1KzMjqkARcBNyan12qu_Hwt-L-E611tZemGhjwoKVbpcpEyQFm3pIUh_yiWE3Sk Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:52.393289 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3fad7dba9e8f4520b59697fd89d3e370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3fad7dba9e8f4520b59697fd89d3e370 Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-777800499 Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e06c8cb7d10e4818a7e40396b93e54ab Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-777800499-project Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. Jul 26 04:34:52.395685 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd5663c86-0ddc-4546-a50d-1959846d25b6'} Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:52.396777 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. Jul 26 04:34:52.399119 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.401364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] Returning 404 to user: Instance d5663c86-0ddc-4546-a50d-1959846d25b6 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:52.402312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bdd325f5-1760-407a-af9b-15cd7ac926c7 tempest-LiveAutoBlockMigrationV225Test-777800499 tempest-LiveAutoBlockMigrationV225Test-777800499-project] 10.222.0.43 "GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6" status: 404 len: 111 microversion: 2.25 time: 0.070689 Jul 26 04:34:52.408203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1138/2182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/d5663c86-0ddc-4546-a50d-1959846d25b6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:34:52.416215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-248e4226-537e-4960-b5a5-4317b605270a req-dfa53c0a-5f25-477f-8ef5-b2046be05ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4b7f22-356d-4e06-a0a1-9474c1dfd765", "name": "network-vif-deleted", "tag": "7d676aff-7642-432d-8685-04f35bbf7ec2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:52.426958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:52.437570 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4231deff-6d97-4161-9b55-48c4d7f5a090 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1523 microversion: 2.1 time: 0.296808 Jul 26 04:34:52.438800 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1045/2183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:52.439646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-248e4226-537e-4960-b5a5-4317b605270a req-dfa53c0a-5f25-477f-8ef5-b2046be05ec9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.440127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-248e4226-537e-4960-b5a5-4317b605270a req-dfa53c0a-5f25-477f-8ef5-b2046be05ec9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.465146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.465841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.466723 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-248e4226-537e-4960-b5a5-4317b605270a req-dfa53c0a-5f25-477f-8ef5-b2046be05ec9 service nova] Creating event network-vif-deleted:7d676aff-7642-432d-8685-04f35bbf7ec2 for instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 on n-h2-848886-16 Jul 26 04:34:52.480687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-248e4226-537e-4960-b5a5-4317b605270a req-dfa53c0a-5f25-477f-8ef5-b2046be05ec9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071111 Jul 26 04:34:52.484965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1139/2184] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:52.485447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.486216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.487348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.487992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.503931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.504724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.508772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:52.519179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.525552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.526979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.527598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.554940 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] HTTP exception thrown: Instance is not a member of specified network Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Request method failure captured: Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909/ips/invalid HTTP/1.1 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi327YDDJ4_waGypXBlq_QcTz0prmlkhawHKi5xIT3K_TtrIHlMT_NOHWF2r4VGqWgsPx-fvS6Z4obEyEtuQjZ6IPp-VXlE3HItN6BYEsiG7sDXSoP_V_58FxEyMPuml7Ns96vVF8trMaH2RXUtnG1v-8nr7qxHilCEsKzz6SiepL9Uxc Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:52.573854 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe13602ed3b40088f0dbd2d04ab2dfe Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance is not a member of specified network Jul 26 04:34:52.576211 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '10a586bd-f45a-4c30-bedc-e775853c3909', 'id': 'invalid'} Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 26 04:34:52.577539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.583329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:52.584641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-025ac1fb-ad34-42b9-afcd-033d67a4f449 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.126149 Jul 26 04:34:52.591246 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1046/2185] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909/ips/invalid => generated 91 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:34:52.612962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.614769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Failed to fetch instance by id 999 {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:34:52.615534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] HTTP exception thrown: Instance 999 could not be found. Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Request method failure captured: Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi327YDDJ4_waGypXBlq_QcTz0prmlkhawHKi5xIT3K_TtrIHlMT_NOHWF2r4VGqWgsPx-fvS6Z4obEyEtuQjZ6IPp-VXlE3HItN6BYEsiG7sDXSoP_V_58FxEyMPuml7Ns96vVF8trMaH2RXUtnG1v-8nr7qxHilCEsKzz6SiepL9Uxc Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:52.622528 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe13602ed3b40088f0dbd2d04ab2dfe Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 999 could not be found. Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '999'} Jul 26 04:34:52.625002 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:52.626246 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-560d7673-5e45-44dd-a44f-043d850288c9 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.032722 Jul 26 04:34:52.634544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1047/2186] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:34:52.657938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.658735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.703112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.704248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.706487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.707234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.808048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:34:52.858567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2873cad521441a89fb4139e6b33147c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2259161ad29b4d7ea739ac0762516c77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:52.890184 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a863192-4241-4249-b4d3-5b1c9440edb3 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 200 len: 1302 microversion: 2.1 time: 0.400076 Jul 26 04:34:52.893418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1140/2187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 1302 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:52.905614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:52.936251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:52.953799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.954564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:52.955529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:52.956589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.025663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:53.091207 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0a342da-b0a1-4c08-bc62-dfe151312e0c tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 204 len: 0 microversion: 2.1 time: 0.440988 Jul 26 04:34:53.096209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1048/2188] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:34:52 2022] DELETE /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:34:53.110562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:53.113721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:53.131437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.134740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.137262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.137967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.440746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:53.452494 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-154ecd12-fcd2-41eb-a1b2-93ce5d6b00bd tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.555813 Jul 26 04:34:53.453211 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1141/2189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:52 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:53.464132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:53.470769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:53.485915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.487060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.488783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.489471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.552978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:53.566997 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d279a34b-9fc2-48d9-a910-7a7956e50388 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1529 microversion: 2.1 time: 0.466352 Jul 26 04:34:53.567586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1049/2190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:53 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1529 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:53.576157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:53.577070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] [instance: 16c88409-200c-4c78-9aa2-cc1837591bb7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:53.593120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.593579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.594471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.595083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.624951 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] HTTP exception thrown: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Request method failure captured: Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 HTTP/1.1 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi326-HWF9dL84l9L1Vn3rssVaELQHFb5EpYmWXak3ZNhZZ0XgOJdtW4hI4imCZbwaBHgsG2jS3JNOvbYbgroDUs58TUKjW1SjxJdh2BpbPW21dRXYpwerl-tX86Uu5jtWqzuJhyoPJ4cdGHtd55altJlo8R1MiB27mqHD1gH6SCTiGb0 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f6da0054c1b5445abba3f5e069ce4b14 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TenantUsagesTestJSON-2007005376 Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:53.627222 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6da0054c1b5445abba3f5e069ce4b14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6da0054c1b5445abba3f5e069ce4b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6da0054c1b5445abba3f5e069ce4b14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6da0054c1b5445abba3f5e069ce4b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TenantUsagesTestJSON-2007005376 Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f6da0054c1b5445abba3f5e069ce4b14 Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2007005376 Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TenantUsagesTestJSON-2007005376-project Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 6a27f94db6fd4dae956c4ade24267a84 Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TenantUsagesTestJSON-2007005376-project Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. Jul 26 04:34:53.628867 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '16c88409-200c-4c78-9aa2-cc1837591bb7'} Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:53.629853 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. Jul 26 04:34:53.631917 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:53.637871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] Returning 404 to user: Instance 16c88409-200c-4c78-9aa2-cc1837591bb7 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:53.639136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15b97bf5-6933-4db8-9d1d-b0410f872c3c tempest-TenantUsagesTestJSON-2007005376 tempest-TenantUsagesTestJSON-2007005376-project] 10.222.0.43 "GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7" status: 404 len: 111 microversion: 2.1 time: 0.068646 Jul 26 04:34:53.640291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1050/2191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:53 2022] GET /compute/v2.1/servers/16c88409-200c-4c78-9aa2-cc1837591bb7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:34:53.647832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f1fdf429-b82c-4c2d-91a3-69f8e5f4977f req-187c894a-8aa4-4641-9180-5533931691fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c88409-200c-4c78-9aa2-cc1837591bb7", "name": "network-vif-deleted", "tag": "74604202-2aba-456d-a065-faca04fd654a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:53.660255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f1fdf429-b82c-4c2d-91a3-69f8e5f4977f req-187c894a-8aa4-4641-9180-5533931691fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.661124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f1fdf429-b82c-4c2d-91a3-69f8e5f4977f req-187c894a-8aa4-4641-9180-5533931691fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.675540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f1fdf429-b82c-4c2d-91a3-69f8e5f4977f req-187c894a-8aa4-4641-9180-5533931691fc service nova] Creating event network-vif-deleted:74604202-2aba-456d-a065-faca04fd654a for instance 16c88409-200c-4c78-9aa2-cc1837591bb7 on n-h2-848886-16 Jul 26 04:34:53.682709 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f1fdf429-b82c-4c2d-91a3-69f8e5f4977f req-187c894a-8aa4-4641-9180-5533931691fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040681 Jul 26 04:34:53.684127 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1051/2192] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:53.919747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:53.922115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] [instance: 1a4b7f22-356d-4e06-a0a1-9474c1dfd765] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:53.949017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.951511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:53.952734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:53.955162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.000026 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] HTTP exception thrown: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Request method failure captured: Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 HTTP/1.1 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3251KP0TEHCs0UW6Ah9SXluBXSOpezHMvvc1pzvFCi5sN49ut1EfO49kGNR7a6QIxNqUmY6fP15smN9dxgWKOR3ZGdrJ1EoC71r8mXIQ_wni5VHWxrtyI7AkQP8njeNRm-7kms4UPJWnwF-eI1jguNTCRR2b3D-141XtEKngSWxVlL8 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:34:54.001691 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2259161ad29b4d7ea739ac0762516c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 2259161ad29b4d7ea739ac0762516c77 Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-470756396 Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c2873cad521441a89fb4139e6b33147c Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesOneServerTestJSON-470756396-project Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. Jul 26 04:34:54.003502 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1a4b7f22-356d-4e06-a0a1-9474c1dfd765'} Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:54.004900 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. Jul 26 04:34:54.008029 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:34:54.015310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] Returning 404 to user: Instance 1a4b7f22-356d-4e06-a0a1-9474c1dfd765 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:54.018983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bfc64f49-930e-4331-a30d-f885dd8b9000 tempest-ImagesOneServerTestJSON-470756396 tempest-ImagesOneServerTestJSON-470756396-project] 10.222.0.43 "GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765" status: 404 len: 111 microversion: 2.1 time: 0.109547 Jul 26 04:34:54.028672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1052/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:53 2022] GET /compute/v2.1/servers/1a4b7f22-356d-4e06-a0a1-9474c1dfd765 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:34:54.477156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:54.477743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:54.489879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:54.491475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.493593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:54.494288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.502775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:54.512050 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d5264f8-aef9-4806-ae3e-fbb9f2c9b0f3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 1.052729 Jul 26 04:34:54.515778 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1142/2194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:53 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:54.535943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a52a723-a5a9-4cda-829c-ba8efa5868bc req-cbaf9b07-770f-48ba-ac4e-f50a244f0a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "name": "network-vif-unplugged", "status": "completed", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:54.559457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a52a723-a5a9-4cda-829c-ba8efa5868bc req-cbaf9b07-770f-48ba-ac4e-f50a244f0a52 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:54.560172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a52a723-a5a9-4cda-829c-ba8efa5868bc req-cbaf9b07-770f-48ba-ac4e-f50a244f0a52 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.579965 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a52a723-a5a9-4cda-829c-ba8efa5868bc req-cbaf9b07-770f-48ba-ac4e-f50a244f0a52 service nova] Creating event network-vif-unplugged:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h1-848886-16 Jul 26 04:34:54.586420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a52a723-a5a9-4cda-829c-ba8efa5868bc req-cbaf9b07-770f-48ba-ac4e-f50a244f0a52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054385 Jul 26 04:34:54.587709 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1143/2195] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:34:54.594239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:54.595219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:54.602986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:54.603711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.605144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:54.605759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:54.933213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:54.946073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdd5621a-9c79-4527-8dac-954cccbda264 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1529 microversion: 2.1 time: 0.355850 Jul 26 04:34:54.965182 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1144/2196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:54 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1529 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:55.095884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:55.109885 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-133463ed-66ae-4aa4-a43f-f64efe33940f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.633645 Jul 26 04:34:55.110523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1053/2197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:54 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:55.533242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:55.534043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:55.572944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:55.573507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:55.578832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:55.579543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:55.983560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:55.984434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:56.006853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:56.007816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:56.008863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:56.009651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:56.071310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:56.086608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-760cd222-473c-4fde-a216-95a04131e8bf tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.557482 Jul 26 04:34:56.097932 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1145/2198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:55 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:56.133368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:56.136654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:56.157025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:56.161995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:56.164953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:56.167255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:56.346520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:56.557467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:56.572981 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-961a8b58-7188-459e-95ce-0652a7849dfe tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1529 microversion: 2.1 time: 0.593097 Jul 26 04:34:56.573595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1054/2199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:55 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1529 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:56.629981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:56.650208 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1219e37b-5c23-453d-b746-c24b97a3e1d1 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.521216 Jul 26 04:34:56.651306 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1146/2200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:56 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:56.672108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-83abd47f-b1e1-4756-bac9-6c99fb7f6a49 req-90d12154-b538-4470-adf4-760b79868765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:56.699684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:56.713133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-83abd47f-b1e1-4756-bac9-6c99fb7f6a49 req-90d12154-b538-4470-adf4-760b79868765 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:56.717558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-83abd47f-b1e1-4756-bac9-6c99fb7f6a49 req-90d12154-b538-4470-adf4-760b79868765 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:56.778640 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-83abd47f-b1e1-4756-bac9-6c99fb7f6a49 req-90d12154-b538-4470-adf4-760b79868765 service nova] Creating event network-changed:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h1-848886-16 Jul 26 04:34:56.795116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-83abd47f-b1e1-4756-bac9-6c99fb7f6a49 req-90d12154-b538-4470-adf4-760b79868765 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125548 Jul 26 04:34:56.807666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1055/2201] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:34:57.110241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:57.110859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:57.120880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.121333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.122120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.122580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.209830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:57.212308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f249832f-3dd9-40c0-93bf-11e3434bdfa7 req-36e8720b-8bb5-4fea-8248-44873bd31cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a586bd-f45a-4c30-bedc-e775853c3909", "name": "network-vif-deleted", "tag": "46059e43-773a-48db-835e-a84b55e229ff"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:34:57.265749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f249832f-3dd9-40c0-93bf-11e3434bdfa7 req-36e8720b-8bb5-4fea-8248-44873bd31cc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.268017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f249832f-3dd9-40c0-93bf-11e3434bdfa7 req-36e8720b-8bb5-4fea-8248-44873bd31cc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.316560 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f249832f-3dd9-40c0-93bf-11e3434bdfa7 req-36e8720b-8bb5-4fea-8248-44873bd31cc8 service nova] Creating event network-vif-deleted:46059e43-773a-48db-835e-a84b55e229ff for instance 10a586bd-f45a-4c30-bedc-e775853c3909 on n-h1-848886-16 Jul 26 04:34:57.336795 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f249832f-3dd9-40c0-93bf-11e3434bdfa7 req-36e8720b-8bb5-4fea-8248-44873bd31cc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131440 Jul 26 04:34:57.344505 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1056/2202] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:34:57.599829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:57.600603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:57.640026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.641870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.642750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.646842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.778983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:57.779460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:57.779940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lazy-loading 'fault' on Instance uuid 10a586bd-f45a-4c30-bedc-e775853c3909 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:34:57.967394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe13602ed3b40088f0dbd2d04ab2dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009a5725ed22412da5eecc8967b16fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:57.980919 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-358c5113-d49d-462e-ba1a-73c771fa6cbb tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 200 len: 1315 microversion: 2.1 time: 0.383467 Jul 26 04:34:57.999811 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1057/2203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:57 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:34:58.034706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:58.036414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:58.050451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:58.051609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:58.053144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:58.053835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:58.379386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:58.395932 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-009248fb-75b3-481d-99ca-6e9ff6069a27 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 1.287854 Jul 26 04:34:58.399568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1147/2204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:57 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:58.449253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:34:58.458987 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5cc3d344-9d06-43ae-9437-055b800d110e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.439838 Jul 26 04:34:58.459565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1058/2205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:58 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:34:59.006366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:59.007013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] [instance: 10a586bd-f45a-4c30-bedc-e775853c3909] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:59.030846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.032967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:59.048577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.048577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:59.106016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] HTTP exception thrown: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Request method failure captured: Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 HTTP/1.1 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi327YDDJ4_waGypXBlq_QcTz0prmlkhawHKi5xIT3K_TtrIHlMT_NOHWF2r4VGqWgsPx-fvS6Z4obEyEtuQjZ6IPp-VXlE3HItN6BYEsiG7sDXSoP_V_58FxEyMPuml7Ns96vVF8trMaH2RXUtnG1v-8nr7qxHilCEsKzz6SiepL9Uxc Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:34:59.107789 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_009a5725ed22412da5eecc8967b16fd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 009a5725ed22412da5eecc8967b16fd6 Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-629811026 Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe13602ed3b40088f0dbd2d04ab2dfe Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-629811026-project Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. Jul 26 04:34:59.109424 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '10a586bd-f45a-4c30-bedc-e775853c3909'} Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:34:59.111199 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. Jul 26 04:34:59.112850 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:34:59.115650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] Returning 404 to user: Instance 10a586bd-f45a-4c30-bedc-e775853c3909 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:34:59.117254 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79c0028b-c226-4c57-ab07-9cdb217826f2 tempest-ServerAddressesNegativeTestJSON-629811026 tempest-ServerAddressesNegativeTestJSON-629811026-project] 10.222.0.43 "GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909" status: 404 len: 111 microversion: 2.1 time: 0.115641 Jul 26 04:34:59.118546 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1148/2206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:58 2022] GET /compute/v2.1/servers/10a586bd-f45a-4c30-bedc-e775853c3909 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:34:59.423293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:59.424032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:59.441365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:34:59.450246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.450700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:59.459343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.460829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:59.485628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:34:59.486295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:34:59.513282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.535805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:34:59.536684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:34:59.537138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:00.374907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:00.416150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38414113-ee52-4c75-b69f-3ba103321ad4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.972842 Jul 26 04:35:00.426292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1059/2207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:59 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:00.537396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:00.562269 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bc4a55d-6260-4450-84e8-c94003f957ae tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 1.078524 Jul 26 04:35:00.568228 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1149/2208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:34:59 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:00.827895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1db3da5a-91aa-4df9-9f8c-a791c26ebf88 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] Calling method '.version_select at 0x7f38b54408b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:00.924749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1db3da5a-91aa-4df9-9f8c-a791c26ebf88 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] 10.222.0.43 "GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b" status: 200 len: 784 microversion: 2.1 time: 0.324180 Jul 26 04:35:00.929668 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1060/2209] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:35:00 2022] GET /compute/v2.1/images/33ab09be-5eb6-45a4-ae6c-563cf5c54e5b => generated 784 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:00.943579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f2efdd1-ca8f-4769-baa1-a50d895e3719 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] Calling method '.version_select at 0x7f38baccf040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:01.136263 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f2efdd1-ca8f-4769-baa1-a50d895e3719 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] 10.222.0.43 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.197205 Jul 26 04:35:01.138457 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1150/2210] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Jul 26 04:35:00 2022] GET /compute/v2.1/images => generated 445 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:01.155775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21d8d068-67e3-41de-95a1-6edac017f7c6 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] Calling method '.version_select at 0x7f38b5440ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:01.251293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21d8d068-67e3-41de-95a1-6edac017f7c6 tempest-ListImagesTestJSON-1721659687 tempest-ListImagesTestJSON-1721659687-project] 10.222.0.43 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.099667 Jul 26 04:35:01.252524 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1061/2211] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:35:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:01.442099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:01.442851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:01.464716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:01.465727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:01.466777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:01.467388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:01.594291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:01.595242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:01.610082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:01.611132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:01.613087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:01.614103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:02.122748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:02.133367 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c81be85-3010-4c77-8098-907c070a1b34 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.696250 Jul 26 04:35:02.133953 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1151/2212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:01 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:02.264898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-76e20226-c6d4-491e-a52a-7b5e3fcda539 req-cddcb2a0-8e23-458b-ba5a-22d0db2625ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "name": "network-vif-unplugged", "status": "completed", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:02.283242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-76e20226-c6d4-491e-a52a-7b5e3fcda539 req-cddcb2a0-8e23-458b-ba5a-22d0db2625ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:02.286376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-76e20226-c6d4-491e-a52a-7b5e3fcda539 req-cddcb2a0-8e23-458b-ba5a-22d0db2625ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:02.297768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:02.314664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9c08993-9658-4973-a4d6-f33bdc73b695 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.718220 Jul 26 04:35:02.323192 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1062/2213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:01 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:02.325004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-76e20226-c6d4-491e-a52a-7b5e3fcda539 req-cddcb2a0-8e23-458b-ba5a-22d0db2625ce service nova] Creating event network-vif-unplugged:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h1-848886-16 Jul 26 04:35:02.330864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-76e20226-c6d4-491e-a52a-7b5e3fcda539 req-cddcb2a0-8e23-458b-ba5a-22d0db2625ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070978 Jul 26 04:35:02.331693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1152/2214] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:02.820729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-691466141", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "51a40eaa-2e16-4215-a05d-f07113eb19d1"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:02.937860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] validate_networks() for [('51a40eaa-2e16-4215-a05d-f07113eb19d1', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:35:03.161289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:03.162430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:03.172826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:03.173615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:03.174760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:03.175390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:03.535489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:03.557083 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67b109a9-3976-4d7e-9b57-f4f50dd577ae tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.401524 Jul 26 04:35:03.557710 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1153/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:03 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:03.575055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:03.578557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:03.596650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:03.599526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:03.604254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:03.607730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:04.219388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:04.232436 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71d8316c-d4c4-48d3-b7a2-b610bb6b5e33 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.669365 Jul 26 04:35:04.233030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1154/2216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:03 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:04.303510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:35:04.305703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:35:04.306888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:35:04.307558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:35:04.308326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:35:04.331719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:04.332609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:04.334460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:04.337229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:04.388823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Getting quotas for project 75fa67c1eafd4beba28bbbfbc4036e6d. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:04.394705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Getting quotas for user 902edc7397ad4b6d8db46cc67841751f and project 75fa67c1eafd4beba28bbbfbc4036e6d. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:04.413109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:35:04.415878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:35:04.506229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4d659584-09e6-414e-8b5d-b8a914740968 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917254 Jul 26 04:35:04.508665 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1063/2217] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:35:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:35:04.524733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b54d59e7-30f6-42e5-bc69-305aeb574167 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:04.526682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b54d59e7-30f6-42e5-bc69-305aeb574167 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:04.580267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:04.580828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:04.594881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:04.595425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:04.598573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:04.599403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:04.771481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b54d59e7-30f6-42e5-bc69-305aeb574167 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:04.783635 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b54d59e7-30f6-42e5-bc69-305aeb574167 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1215 microversion: 2.1 time: 0.264664 Jul 26 04:35:04.801390 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1155/2218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:04 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:05.254240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:05.255513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:05.270923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:05.271323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:05.272557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:05.273122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:05.685307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:05.695636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78c29013-ecfb-4681-b56d-ee3c7c286c1a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 1.120400 Jul 26 04:35:05.696213 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1064/2219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:04 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:05.810666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:05.811117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:05.825695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:05.847195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:05.854182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:05.856591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:06.110523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:06.121846 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e7f2990-491e-45de-ada5-c9d48371fe39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1267 microversion: 2.1 time: 0.315261 Jul 26 04:35:06.140495 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1065/2220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:05 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:06.717874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:06.719131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:06.733334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:06.738336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:06.739358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:06.741299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:07.412037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:07.421689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2de2dcd7-4f32-49b9-8f75-e7ad64f07a49 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.707868 Jul 26 04:35:07.435288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1066/2221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:06 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:07.435288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:07.443120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:07.463072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:07.463798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:07.464873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:07.465478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:07.718927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:07.728043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a327836-42b6-4f3f-85db-55ee9f925a77 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1273 microversion: 2.1 time: 0.297549 Jul 26 04:35:07.728796 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1067/2222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:07 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:08.235460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:08.244174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c101831f-ecd0-448c-950e-10fd0dad228a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 2.993786 Jul 26 04:35:08.248648 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1156/2223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:05 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:08.442453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:08.443075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:08.458618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:08.459076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:08.459958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:08.460404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:08.755619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:08.758850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:08.802455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:08.805399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:08.808818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:08.812559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:09.287902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:09.309315 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f7743fa-869f-4579-8cc4-10519ce4ccd0 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.869738 Jul 26 04:35:09.312092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1068/2224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:08 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:09.345575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:09.351127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:09.383448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:09.383998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:09.384840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:09.385298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:09.876926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:09.889760 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c7b4553-33c4-4b38-a9dd-82f914624557 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.572613 Jul 26 04:35:09.890526 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1069/2225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:09 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:10.200956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:10.215023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d4eb712-f8e1-4bf5-876f-6e15349c1fbe tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 1.467470 Jul 26 04:35:10.217591 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1157/2226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:08 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:10.241596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a775539-2996-4b07-a373-03978c387802 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b537f160>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnju7lqGGO1OmYOLmr09kWJ9PaCQdPY7kDIsjzdFSs4UfYhc6a7gcug+FjPkjsADKyRl7cmQ0O+awUOTk9h06fKiuNTXzA/jVvOrY3TGI9O70RNc11ZSZn/UOOdozyBTg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:10.255789 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4a775539-2996-4b07-a373-03978c387802 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a775539-2996-4b07-a373-03978c387802 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 257 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:10.271267 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnju7lqGGO1OmYOLmr09kWJ9PaCQdPY7kDIsjzdFSs4UfYhc6a7gcug+FjPkjsADKyRl7cmQ0O+awUOTk9h06fKiuNTXzA/jVvOrY3TGI9O70RNc11ZSZn/UOOdozyBTg=="}} Jul 26 04:35:10.273986 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnju7lqGGO1OmYOLmr09kWJ9PaCQdPY7kDIsjzdFSs4UfYhc6a7gcug+FjPkjsADKyRl7cmQ0O+awUOTk9h06fKiuNTXzA/jVvOrY3TGI9O70RNc11ZSZn/UOOdozyBTg=='}}} Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 26 04:35:10.274946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 04:35:10.277151 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a775539-2996-4b07-a373-03978c387802 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:10.280119 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a775539-2996-4b07-a373-03978c387802 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.303769 Jul 26 04:35:10.281979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1070/2227] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:35:10.288808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5eca670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1706651535", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:10.333021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:10.333660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:10.347534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:10.348012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:10.348857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:10.352020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:10.353705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:10.369895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for user 05f42df03ecf4e3faa7d2527a3bc5d51 and project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:10.425641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 2167 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1706651535", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:35:10.446831 n-d-848886-16 devstack@n-api.service[119488]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1706651535', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:10.449417 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:10.457690 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.464279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:10.471435 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd65afe0-5cf0-47d4-af82-06aaf8563f1b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.187734 Jul 26 04:35:10.472819 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1158/2228] 10.222.0.43 () {60 vars in 1160 bytes} [Tue Jul 26 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:35:10.486538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51baeadb-37ac-412f-84a5-e6772f4aac47 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5264ee0>, body: {"keypair": {"name": "tempest-keypair-794723293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0kBcBtWlfItGymV0F0TQbmLyk6QJ/OMuo6vMoNYZcEqzgUaf8t0VZHG1eaK3r4vuK9RVilGPzapnZf7OzWamhq8Xisze2RlrGCby6biIjavfWe5hoSOFxiCcNGhCbqYA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:10.564129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-51baeadb-37ac-412f-84a5-e6772f4aac47 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:10.580734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-51baeadb-37ac-412f-84a5-e6772f4aac47 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for user 05f42df03ecf4e3faa7d2527a3bc5d51 and project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:10.671942 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51baeadb-37ac-412f-84a5-e6772f4aac47 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178217 Jul 26 04:35:10.688838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1159/2229] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:10.703393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b58bd940>, body: {"keypair": {"name": "tempest-keypair-794723293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeHpE2hhPZRwNaHsrj8gb/dbQgxflk1LAo+cB+NENjKgFp1Be4XUUXqAYm5KF8YkKg+YEPSzb9L/i3LQQYa23CuCEMniqn9b98rjngHfxnhvbJ2V/i/3dHuVNwBDQitaA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:10.770045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:10.791420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for user 05f42df03ecf4e3faa7d2527a3bc5d51 and project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:10.831498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:10.835021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:10.852724 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cbff0d67-8c78-4d38-80d9-b6edc4f9d53a tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1524 microversion: 2.1 time: 0.523580 Jul 26 04:35:10.853958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1071/2230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:10 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1524 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:10.868479 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Key pair 'tempest-keypair-794723293' already exists. Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 272 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: {"keypair": {"name": "tempest-keypair-794723293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeHpE2hhPZRwNaHsrj8gb/dbQgxflk1LAo+cB+NENjKgFp1Be4XUUXqAYm5KF8YkKg+YEPSzb9L/i3LQQYa23CuCEMniqn9b98rjngHfxnhvbJ2V/i/3dHuVNwBDQitaA=="}} Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: exception: Key pair 'tempest-keypair-794723293' already exists. Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-794723293', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeHpE2hhPZRwNaHsrj8gb/dbQgxflk1LAo+cB+NENjKgFp1Be4XUUXqAYm5KF8YkKg+YEPSzb9L/i3LQQYa23CuCEMniqn9b98rjngHfxnhvbJ2V/i/3dHuVNwBDQitaA=='}}} Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '05f42df03ecf4e3faa7d2527a3bc5d51-tempest-keypair-794723293' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 04:35:10.877284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result.read() Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 04:35:10.882710 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '05f42df03ecf4e3faa7d2527a3bc5d51-tempest-keypair-794723293' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 4, 35, 10, 856066), 'updated_at': None, 'name': 'tempest-keypair-794723293', 'user_id': '05f42df03ecf4e3faa7d2527a3bc5d51', 'fingerprint': 'e6:9f:ae:65:bc:1d:56:61:c6:73:5c:b5:29:74:b9:02', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeHpE2hhPZRwNaHsrj8gb/dbQgxflk1LAo+cB+NENjKgFp1Be4XUUXqAYm5KF8YkKg+YEPSzb9L/i3LQQYa23CuCEMniqn9b98rjngHfxnhvbJ2V/i/3dHuVNwBDQitaA==', 'type': 'ssh'}] Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi keypair.create() Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._create() Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-794723293' already exists. Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 26 04:35:10.887441 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-794723293' already exists. Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-794723293' already exists. Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 409 to user: Key pair 'tempest-keypair-794723293' already exists. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:10.895916 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4435cabf-7e1a-44ea-b4f7-e6481e0935b3 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.193075 Jul 26 04:35:10.898795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1160/2231] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:35:10.905066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cea98406-507f-491a-8e13-0c30ff8ca30b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Calling method '.version_select at 0x7f38b537f700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:10.917016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:10.917536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:10.932489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:10.932852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:10.934555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:10.935007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:10.938204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cea98406-507f-491a-8e13-0c30ff8ca30b tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794723293" status: 202 len: 0 microversion: 2.1 time: 0.038681 Jul 26 04:35:10.939514 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1072/2232] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794723293 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:10.954022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df2c214a-89f4-4dd9-8c1d-94b260322a06 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5447700>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTzK+ziDVGwueaChgATKqSYBgLLBEXBjuXnPCFBM3XMQO4J6ZVElSaBjVncdexaskmeG53XB0iX7oPJZcqb49YIb3GE518nL/chmKR4RdIm4W5njeykY/oSOe8OI7Bjdw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df2c214a-89f4-4dd9-8c1d-94b260322a06 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 247 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTzK+ziDVGwueaChgATKqSYBgLLBEXBjuXnPCFBM3XMQO4J6ZVElSaBjVncdexaskmeG53XB0iX7oPJZcqb49YIb3GE518nL/chmKR4RdIm4W5njeykY/oSOe8OI7Bjdw=="}} Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTzK+ziDVGwueaChgATKqSYBgLLBEXBjuXnPCFBM3XMQO4J6ZVElSaBjVncdexaskmeG53XB0iX7oPJZcqb49YIb3GE518nL/chmKR4RdIm4W5njeykY/oSOe8OI7Bjdw=='}}} Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:35:10.958577 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:35:10.965026 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:10.968301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df2c214a-89f4-4dd9-8c1d-94b260322a06 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:10.969652 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df2c214a-89f4-4dd9-8c1d-94b260322a06 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021390 Jul 26 04:35:10.970525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1073/2233] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:35:10.982196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5384c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1632606078", "public_key": " "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:11.001505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:11.006963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for user 05f42df03ecf4e3faa7d2527a3bc5d51 and project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:11.033411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 95 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1632606078", "public_key": " "}} Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1632606078', 'public_key': ' '}}} Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.038767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:11.044634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18b917ec-c2da-4381-8b92-f95a2ce4cd5f tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065683 Jul 26 04:35:11.047221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1074/2234] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jul 26 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 26 04:35:11.057955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-499af2cc-2cab-4f58-967f-24dd06c46603 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5401160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE2gPUC00ZFWR3z6hsqjEUGYXNCa/vU7ImeG1gQ+IioaiBsdregBnhFrbYxrfSRKE0FOaz9nxBJ+hLSnxDNsImn0xWd3DrwhjYlo5XK2VxUe12AtbgBWeUqwGgDuiHCqQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-499af2cc-2cab-4f58-967f-24dd06c46603 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 507 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE2gPUC00ZFWR3z6hsqjEUGYXNCa/vU7ImeG1gQ+IioaiBsdregBnhFrbYxrfSRKE0FOaz9nxBJ+hLSnxDNsImn0xWd3DrwhjYlo5XK2VxUe12AtbgBWeUqwGgDuiHCqQ=="}} Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE2gPUC00ZFWR3z6hsqjEUGYXNCa/vU7ImeG1gQ+IioaiBsdregBnhFrbYxrfSRKE0FOaz9nxBJ+hLSnxDNsImn0xWd3DrwhjYlo5XK2VxUe12AtbgBWeUqwGgDuiHCqQ=='}}} Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 26 04:35:11.073082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-499af2cc-2cab-4f58-967f-24dd06c46603 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:11.077461 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-499af2cc-2cab-4f58-967f-24dd06c46603 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024109 Jul 26 04:35:11.080202 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1075/2235] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:11 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:35:11.106635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-64f22a4f-03ef-443b-a2fa-52f1fa4cab6f req-bfe089b7-7039-4902-9709-9bcca7641377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f552e5-0e8f-4282-b638-401ce68b8619", "tag": "d5e7f0b4-8ca8-463d-9eab-bf64ed636567"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:11.145442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-64f22a4f-03ef-443b-a2fa-52f1fa4cab6f req-bfe089b7-7039-4902-9709-9bcca7641377 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:11.155796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-64f22a4f-03ef-443b-a2fa-52f1fa4cab6f req-bfe089b7-7039-4902-9709-9bcca7641377 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:11.174453 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-64f22a4f-03ef-443b-a2fa-52f1fa4cab6f req-bfe089b7-7039-4902-9709-9bcca7641377 service nova] Creating event network-changed:d5e7f0b4-8ca8-463d-9eab-bf64ed636567 for instance 73f552e5-0e8f-4282-b638-401ce68b8619 on n-h1-848886-16 Jul 26 04:35:11.188878 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-64f22a4f-03ef-443b-a2fa-52f1fa4cab6f req-bfe089b7-7039-4902-9709-9bcca7641377 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105085 Jul 26 04:35:11.189855 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1076/2236] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:11.195757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Action: 'create', calling method: .version_select at 0x7f38b5401160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1248765855", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:11.230870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:11.239950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Getting quotas for user 05f42df03ecf4e3faa7d2527a3bc5d51 and project a2ac0acd7fe3445d83db90383df73d0e. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:11.270186 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 118 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1248765855", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1248765855', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 04:35:11.273316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 04:35:11.278819 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.284575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:11.285674 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f93e78f6-8afb-415f-a0bc-fe56b9e918bf tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.094679 Jul 26 04:35:11.286502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1077/2237] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:35:11.291588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:11.294193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:11.309326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:11.310306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:11.311323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:11.312882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:11.622291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:11.631916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-87d3dd74-6be4-418c-9121-ab4374eaec2e tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 0.343611 Jul 26 04:35:11.642926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1078/2238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:11 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:11.655509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d0b45d4-90e0-46fd-b2b3-626508171ec9 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Calling method '.version_select at 0x7f38b53c9820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:11.670827 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6d0b45d4-90e0-46fd-b2b3-626508171ec9 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d0b45d4-90e0-46fd-b2b3-626508171ec9 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Request method failure captured: Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1235477926 HTTP/1.1 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3279pxmnvMoUgRx0BhOISeul7dPKes8hpHKAIBRvhWI2RjhR36qayNj7CStABevwHeZkqNhrSeIhJPQz0kwFqPVo2opefHlvoy8qUfPuFhjLjd2hjz82VkGhWAv9B3roPiTLKnDrC2v7B_Xw5wJ7fq8gqxWk26ttZoHPy0FKOFOs1Q0 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2ac0acd7fe3445d83db90383df73d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a2ac0acd7fe3445d83db90383df73d0e Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1338986661 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1338986661-project Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: exception: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'tempest-keypair-non-existent-1235477926'} Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.672846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d0b45d4-90e0-46fd-b2b3-626508171ec9 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1235477926 not found for user 05f42df03ecf4e3faa7d2527a3bc5d51 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:11.681639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d0b45d4-90e0-46fd-b2b3-626508171ec9 tempest-KeyPairsNegativeTestJSON-1338986661 tempest-KeyPairsNegativeTestJSON-1338986661-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1235477926" status: 404 len: 145 microversion: 2.1 time: 0.022720 Jul 26 04:35:11.696518 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1079/2239] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1235477926 => generated 145 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:11.812658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:11.825085 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4eaf56c0-f1f0-4190-88cf-9d8b48dc297f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1392 microversion: 2.1 time: 0.914695 Jul 26 04:35:11.838183 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1161/2240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:10 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1392 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:11.874907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:11.875646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:11.885580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:11.886382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:11.887343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:11.887949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:12.057963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:12.073405 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f5fe81e2-cb1e-4640-a4f2-12e81165f6e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1504 microversion: 2.1 time: 0.197867 Jul 26 04:35:12.074930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1080/2241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:11 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:12.096362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-afa51bd4-9578-420a-86e5-0dde35aad44c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'create', calling method: .version_select at 0x7f38bad291f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1960588720", "description": "tempest-description-2077183117"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:12.236436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-525009152", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2d760d79-b14f-4ca6-9b14-f01b88e128f9"}], "security_groups": [{"name": "tempest-securitygroup--622579232"}], "key_name": "tempest-keypair-1798883101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "dc9782e0-0ffa-4bbf-a60b-e2d176553312", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:12.437507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] validate_networks() for [('2d760d79-b14f-4ca6-9b14-f01b88e128f9', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:35:12.989265 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-afa51bd4-9578-420a-86e5-0dde35aad44c tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.897608 Jul 26 04:35:12.991250 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1162/2242] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:35:12 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:35:13.004724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:13.005679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:13.025333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.029135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:13.030515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.031898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:13.361754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for project 06968033322f4c8ca753d79f1c8f0ea7. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:13.373023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for user 8251b1935184447cb3b2425c4f3981fd and project 06968033322f4c8ca753d79f1c8f0ea7. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:13.400345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:35:13.401098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:35:13.401737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:35:13.402372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:35:13.402941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:35:13.413890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.414540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:13.415515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.416136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:13.442604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for project 06968033322f4c8ca753d79f1c8f0ea7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:13.448757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Getting quotas for user 8251b1935184447cb3b2425c4f3981fd and project 06968033322f4c8ca753d79f1c8f0ea7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:13.581065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:35:13.584832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc9782e0-0ffa-4bbf-a60b-e2d176553312',volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:35:13.889239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-08e20ce7-d1af-41c6-9f36-5547a4b32338 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.658183 Jul 26 04:35:13.899236 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1081/2243] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:35:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:35:13.904911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:13.905822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:13.915028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.915821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:13.930543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:13.931313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.245872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:14.254375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-938c5e0e-79ba-49d3-8a81-46d5a8e3d035 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1382 microversion: 2.1 time: 0.353792 Jul 26 04:35:14.255701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1082/2244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:13 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1382 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:14.261598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1960588720"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:14.262408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:14.274134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:14.274680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.275561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:14.282943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.330099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:14.338308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01ea538b-65e8-4eb4-9630-52d2fc464c39 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 1.345529 Jul 26 04:35:14.338783 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1163/2245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:12 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:14.353187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0b3ea46-7570-4844-94a3-d4c5d3b91b69 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:14.353187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f0b3ea46-7570-4844-94a3-d4c5d3b91b69 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:14.536145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f0b3ea46-7570-4844-94a3-d4c5d3b91b69 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:14.544105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0b3ea46-7570-4844-94a3-d4c5d3b91b69 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1121 microversion: 2.1 time: 0.204252 Jul 26 04:35:14.559051 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1164/2246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:14 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1121 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:14.572408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cbb3819-8406-48c7-a7c7-b6cb08f5da13 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '.version_select at 0x7f38b522c5e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:14.581335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cbb3819-8406-48c7-a7c7-b6cb08f5da13 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:14.582137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cbb3819-8406-48c7-a7c7-b6cb08f5da13 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.596480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5cbb3819-8406-48c7-a7c7-b6cb08f5da13 tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.036204 Jul 26 04:35:14.599365 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1165/2247] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:35:14 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:14.613126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:14.615198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:14.624663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:14.625427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.626627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:14.627419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:14.660999 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Adding security group c1148993-44c9-410a-b251-76d160747e7f to port 57b6ab2e-2451-4f52-8463-5fa683017fc1 Jul 26 04:35:15.315602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10b32efa-231a-410e-91fe-0b315c6ad3cd tempest-LiveMigrationTest-1697912033 tempest-LiveMigrationTest-1697912033-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1535 microversion: 2.1 time: 0.707947 Jul 26 04:35:15.318043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1166/2248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:14 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1535 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:15.353321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:15.354956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:15.367958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6447e508-7d1c-49dd-bd33-b68adcadc71f tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action" status: 202 len: 0 microversion: 2.1 time: 1.110102 Jul 26 04:35:15.368861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1083/2249] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:35:14 2022] POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:15.375752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:15.376724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:15.384527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.385818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.388503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.390418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.395935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.397529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.399190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.403518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.427321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:15.669016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fca8027b-88d0-4751-b035-af171b97860b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 204 len: 0 microversion: 2.1 time: 0.324339 Jul 26 04:35:15.669678 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1167/2250] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:15 2022] DELETE /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:15.676430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1960588720"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:15.677351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:15.685685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.686531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.687723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.688431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.741961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:15.753359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6a75ee33-1673-4880-9a14-51eb88e50125 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 0.381810 Jul 26 04:35:15.754084 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1084/2251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:15 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:15.773148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-76a548f3-b9f6-4499-bddf-2b8dc2fc6c80 req-97fffbef-00b5-43b0-977e-28e673a138a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:15.808900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-76a548f3-b9f6-4499-bddf-2b8dc2fc6c80 req-97fffbef-00b5-43b0-977e-28e673a138a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.809816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-76a548f3-b9f6-4499-bddf-2b8dc2fc6c80 req-97fffbef-00b5-43b0-977e-28e673a138a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.833229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-76a548f3-b9f6-4499-bddf-2b8dc2fc6c80 req-97fffbef-00b5-43b0-977e-28e673a138a2 service nova] Creating event network-changed:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:35:15.854871 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-76a548f3-b9f6-4499-bddf-2b8dc2fc6c80 req-97fffbef-00b5-43b0-977e-28e673a138a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098247 Jul 26 04:35:15.858450 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1085/2252] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:15.871297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:15.875309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:15.888649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:15.893679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.897869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:15.898894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:15.900095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:16.125440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:16.140164 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d843ff21-da17-4442-9440-fc1fa019411d tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1227 microversion: 2.1 time: 0.278518 Jul 26 04:35:16.141347 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1086/2253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:15 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:16.150830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:16.159466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:16.172908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:16.174499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:16.175563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:16.176431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:16.556927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:16.570255 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ff184b5-2482-4515-ad5d-a7a42da45f32 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1388 microversion: 2.1 time: 0.426320 Jul 26 04:35:16.572402 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1087/2254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:16 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1388 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:16.776552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:16.777181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:16.788675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:16.789137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:16.789937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:16.790409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:17.151687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.network.security_group_api [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Removing security group c1148993-44c9-410a-b251-76d160747e7f from port 57b6ab2e-2451-4f52-8463-5fa683017fc1 Jul 26 04:35:17.238602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:17.254870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6bb0c0c9-5af5-4c98-9a79-454512cd2a8f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 0.482608 Jul 26 04:35:17.270196 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1088/2255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:16 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:17.282766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:17.284815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:17.300829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:17.301355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:17.302288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:17.303358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:18.404062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:18.433958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36099542-5e72-4e6f-b6c7-ba792f4835dc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1237 microversion: 2.1 time: 1.171496 Jul 26 04:35:18.435816 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1089/2256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:17 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1237 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:18.460029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:18.461643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:18.469361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:18.470186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:18.471811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:18.472459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.202832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:19.234521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0e381ba-58ba-4264-b434-ac7df3ccf8bb tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1388 microversion: 2.1 time: 0.785413 Jul 26 04:35:19.248169 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1090/2257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:18 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1388 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:19.265923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1d6d3c91-96b1-452a-8de1-65ff45c2f8fd req-a361f998-82a2-40aa-89da-5801ecf4b243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f552e5-0e8f-4282-b638-401ce68b8619", "name": "network-vif-plugged", "status": "completed", "tag": "d5e7f0b4-8ca8-463d-9eab-bf64ed636567"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:19.298056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d6d3c91-96b1-452a-8de1-65ff45c2f8fd req-a361f998-82a2-40aa-89da-5801ecf4b243 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.298768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d6d3c91-96b1-452a-8de1-65ff45c2f8fd req-a361f998-82a2-40aa-89da-5801ecf4b243 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.331147 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1d6d3c91-96b1-452a-8de1-65ff45c2f8fd req-a361f998-82a2-40aa-89da-5801ecf4b243 service nova] Creating event network-vif-plugged:d5e7f0b4-8ca8-463d-9eab-bf64ed636567 for instance 73f552e5-0e8f-4282-b638-401ce68b8619 on n-h1-848886-16 Jul 26 04:35:19.336708 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1d6d3c91-96b1-452a-8de1-65ff45c2f8fd req-a361f998-82a2-40aa-89da-5801ecf4b243 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084782 Jul 26 04:35:19.337919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1091/2258] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:19.346253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:19.353663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:19.367138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.367909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.368886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.373422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.780151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:19.800739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef8da846-bc30-4d92-acf4-289e4e3b180a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 0.461167 Jul 26 04:35:19.801992 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1092/2259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:19 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:19.810221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-97d868d4-c033-4039-8109-ff0e1eb3b796 req-1fab06b7-018a-464e-b4e7-56b0fbf46fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3477d-0f5c-4825-9455-bfd7a1c0a354", "name": "network-vif-deleted", "tag": "f41a6243-24f2-45ba-bddc-a62adeaa3f04"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:19.823752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97d868d4-c033-4039-8109-ff0e1eb3b796 req-1fab06b7-018a-464e-b4e7-56b0fbf46fe5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.824614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97d868d4-c033-4039-8109-ff0e1eb3b796 req-1fab06b7-018a-464e-b4e7-56b0fbf46fe5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.839502 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-97d868d4-c033-4039-8109-ff0e1eb3b796 req-1fab06b7-018a-464e-b4e7-56b0fbf46fe5 service nova] Creating event network-vif-deleted:f41a6243-24f2-45ba-bddc-a62adeaa3f04 for instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 on n-h2-848886-16 Jul 26 04:35:19.845472 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-97d868d4-c033-4039-8109-ff0e1eb3b796 req-1fab06b7-018a-464e-b4e7-56b0fbf46fe5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041876 Jul 26 04:35:19.846077 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1093/2260] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:19.852867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:19.853267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:19.859831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.860283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.861060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:19.861494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:19.970197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:19.983690 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e884c4a-cb1b-4562-9edb-c58ae62c73b2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1237 microversion: 2.1 time: 0.133609 Jul 26 04:35:19.984685 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1094/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:19 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1237 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:20.259545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:20.260150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:20.286003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:20.287358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:20.288379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:20.289048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:20.414910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:20.425779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21613f37-c94c-4a27-a092-cbb4bf98c7ed tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1184 microversion: 2.1 time: 0.170814 Jul 26 04:35:20.426995 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1095/2262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:20 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:20.822437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:20.823228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:20.836451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:20.836930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:20.837753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:20.838225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:21.072813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb63c5c4-e998-412c-afbe-959bff1aa5ea tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action" status: 202 len: 0 microversion: 2.1 time: 5.401445 Jul 26 04:35:21.075280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1168/2263] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:35:15 2022] POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action => generated 0 bytes in 5405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:21.081470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:21.082403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:21.100121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:21.101910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:21.103330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:21.106359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:21.206762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:21.215633 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bfb60c5-7b7c-4827-bd1c-6f3b7d7e07ff tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1315 microversion: 2.1 time: 0.397060 Jul 26 04:35:21.216217 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1096/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:20 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:21.241709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dab48bc-c5f2-4508-b01e-ca85a899adab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'create', calling method: .version_select at 0x7f38b5433160>, body: {"pool": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:22.255097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:22.276389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-baa9141d-7c63-455a-b631-28e3f83ec37e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 1.198309 Jul 26 04:35:22.277652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1169/2265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:21 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:22.292091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-81f72656-ea43-42be-8e64-66293d973118 req-557e71ee-53f9-4a4b-9733-0867a9fd70a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:22.328154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-81f72656-ea43-42be-8e64-66293d973118 req-557e71ee-53f9-4a4b-9733-0867a9fd70a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:22.331485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-81f72656-ea43-42be-8e64-66293d973118 req-557e71ee-53f9-4a4b-9733-0867a9fd70a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:22.359301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-81f72656-ea43-42be-8e64-66293d973118 req-557e71ee-53f9-4a4b-9733-0867a9fd70a4 service nova] Creating event network-changed:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:35:22.365501 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-81f72656-ea43-42be-8e64-66293d973118 req-557e71ee-53f9-4a4b-9733-0867a9fd70a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083802 Jul 26 04:35:22.366383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1170/2266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:22.372807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:22.373877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:22.384655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:22.385483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:22.386687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:22.387408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:22.702144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:22.731798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2771a83-a972-4280-92f0-e058a87a23ca tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1184 microversion: 2.1 time: 0.361663 Jul 26 04:35:22.733139 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1171/2267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:22 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1184 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:22.745273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:22.749008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:22.779905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:22.791562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:22.794526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:22.796684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:22.803038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:22.884226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:23.427865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:23.457467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=24 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:23.579467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:23.588418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7be95104-c82d-441f-af86-dc30bca0ead6 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1503 microversion: 2.1 time: 0.854008 Jul 26 04:35:23.591810 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1172/2268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:22 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1503 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:23.606262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:23.607072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:23.621791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:23.622476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:23.623495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:23.624084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:24.434112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:24.450756 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed754e94-b0e3-49f9-83bf-537737f3adcc tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 0.856925 Jul 26 04:35:24.454350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1173/2269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:23 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:24.464277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:24.467686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:24.487033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:24.487932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:24.489010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:24.490229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:24.545060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:24.564393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:24.778307 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-da2325af-3d45-4655-b3d6-e720b34860ca tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 204 len: 0 microversion: 2.1 time: 0.322370 Jul 26 04:35:24.779536 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1174/2270] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:24 2022] DELETE /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:24.796573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:24.801948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:24.817116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:24.821365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:24.828469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:24.829363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:25.030253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:25.040301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27701236-04d5-4440-94b7-4bf32f4cfc7b tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1184 microversion: 2.1 time: 0.259242 Jul 26 04:35:25.052197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1175/2271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:24 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1184 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:25.066847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:25.071862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:25.092908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:25.098909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:25.101900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:25.104262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:25.998195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902edc7397ad4b6d8db46cc67841751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fa67c1eafd4beba28bbbfbc4036e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:26.010140 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40e100ce-9152-435a-98e2-e82236fab719 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 200 len: 1509 microversion: 2.1 time: 0.956288 Jul 26 04:35:26.018249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1176/2272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:25 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 1509 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:26.319340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-13552618", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "4074a51c-d75d-4437-b489-0a22ca553d3f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:26.426179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] validate_networks() for [('4074a51c-d75d-4437-b489-0a22ca553d3f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:35:27.012289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9dab48bc-c5f2-4508-b01e-ca85a899adab tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.776425 Jul 26 04:35:27.012754 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1097/2273] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:35:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:27.026403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-10da0097-4bfa-4b8f-9fb2-c70d744a8af1 req-d7dcd823-6b6a-4d4c-921b-c24b2d473058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7553b65-8f16-4489-b77f-3f1120a3c9da", "tag": "777b8730-49f4-4ce7-8a91-78f3bdc8daa4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:27.074016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-10da0097-4bfa-4b8f-9fb2-c70d744a8af1 req-d7dcd823-6b6a-4d4c-921b-c24b2d473058 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:27.074527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-10da0097-4bfa-4b8f-9fb2-c70d744a8af1 req-d7dcd823-6b6a-4d4c-921b-c24b2d473058 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:27.119386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-10da0097-4bfa-4b8f-9fb2-c70d744a8af1 req-d7dcd823-6b6a-4d4c-921b-c24b2d473058 service nova] Creating event network-changed:777b8730-49f4-4ce7-8a91-78f3bdc8daa4 for instance e7553b65-8f16-4489-b77f-3f1120a3c9da on n-h2-848886-16 Jul 26 04:35:27.132063 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-10da0097-4bfa-4b8f-9fb2-c70d744a8af1 req-d7dcd823-6b6a-4d4c-921b-c24b2d473058 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109741 Jul 26 04:35:27.133261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1098/2274] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:27.144932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:27.149687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:27.160256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:27.164021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:27.166329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:27.167007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:27.633503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:27.638051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:27.659334 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c94b95b-7796-4bbe-a830-7626ade66c7b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 0.524574 Jul 26 04:35:27.670185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1099/2275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:27 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:27.682984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:27.686017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:27.724865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:27.725328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:27.736199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:27.738717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:28.106906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:28.118583 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80af52c4-599b-475d-8561-d084f4389fac tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1184 microversion: 2.1 time: 0.455462 Jul 26 04:35:28.119167 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1100/2276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:27 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1184 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:28.135564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'action', calling method: .version_select at 0x7f38b866bca0>, body: {"addFloatingIp": {"address": "172.25.7.139"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:28.138376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:28.164980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:28.167354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:28.170813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:28.171494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:28.390820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Acquired lock "refresh_cache-b50dc221-caaa-424c-904a-40570389f5cc" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:35:28.707147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:35:28.707647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:35:28.708132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:35:28.708685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:35:28.709211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:35:28.729679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:28.734454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:28.735761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:28.737051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:28.765358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:28.791842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for user 06dd8c749d2f4662a54a04f77ebf20cb and project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:28.846558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:35:28.855191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:35:29.021496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f8ce0af-a9b4-4067-8c31-245555c17413 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.992687 Jul 26 04:35:29.027553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1177/2277] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:35:29.050381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:29.051421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:29.077118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:29.077598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:29.080548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:29.081102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:29.109951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 HTTP/1.1 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '73f552e5-0e8f-4282-b638-401ce68b8619'} Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:29.121482 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:29.124750 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:29.126991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:29.128059 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d3b1cb10-f144-4879-aa06-5e58be2c1a49 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 404 len: 111 microversion: 2.1 time: 0.098122 Jul 26 04:35:29.128818 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1178/2278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:29 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:29.142844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-987700bb-4e8e-46cd-b71b-39c9421991aa req-bcdec7d8-9d70-4866-ae7a-ff10a80e81d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f552e5-0e8f-4282-b638-401ce68b8619", "name": "network-vif-deleted", "tag": "d5e7f0b4-8ca8-463d-9eab-bf64ed636567"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:29.155623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-987700bb-4e8e-46cd-b71b-39c9421991aa req-bcdec7d8-9d70-4866-ae7a-ff10a80e81d1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:29.158763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-987700bb-4e8e-46cd-b71b-39c9421991aa req-bcdec7d8-9d70-4866-ae7a-ff10a80e81d1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:29.175979 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-987700bb-4e8e-46cd-b71b-39c9421991aa req-bcdec7d8-9d70-4866-ae7a-ff10a80e81d1 service nova] Creating event network-vif-deleted:d5e7f0b4-8ca8-463d-9eab-bf64ed636567 for instance 73f552e5-0e8f-4282-b638-401ce68b8619 on n-h1-848886-16 Jul 26 04:35:29.183828 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-987700bb-4e8e-46cd-b71b-39c9421991aa req-bcdec7d8-9d70-4866-ae7a-ff10a80e81d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051280 Jul 26 04:35:29.185125 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1179/2279] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:29.193091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:29.194279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:29.203248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:29.203985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:29.204975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:29.206429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:29.683457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:29.698669 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8603608c-b790-497a-b254-a13da76d2b7e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 0.511813 Jul 26 04:35:29.699276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1180/2280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:29 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:29.725158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b18cf3a-56e6-48bf-9dda-23fbaca69096 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:29.728961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b18cf3a-56e6-48bf-9dda-23fbaca69096 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:30.000456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2b18cf3a-56e6-48bf-9dda-23fbaca69096 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:30.009804 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b18cf3a-56e6-48bf-9dda-23fbaca69096 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1223 microversion: 2.1 time: 0.290838 Jul 26 04:35:30.011880 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1181/2281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:29 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1223 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:30.028811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1618137244", "metadata": {"image_type": "test"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:30.044954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:30.066030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:30.066521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:30.067378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:30.079077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:30.114942 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619/action HTTP/1.1 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 112 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1618137244", "metadata": {"image_type": "test"}}} Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '73f552e5-0e8f-4282-b638-401ce68b8619', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1618137244', 'metadata': {'image_type': 'test'}}}} Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:35:30.117514 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:30.123316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:30.126819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-23ee0781-12ce-4d4f-93e1-ba79e0a3854f tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "POST /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619/action" status: 404 len: 111 microversion: 2.1 time: 0.112143 Jul 26 04:35:30.127694 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1182/2282] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jul 26 04:35:30 2022] POST /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:30.137395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:30.140340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:30.170140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:30.172070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:30.174886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:30.179210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:30.346704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:30.382017 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-925ab68d-dda2-4d00-b146-b6fe833ca35f tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 200 len: 1184 microversion: 2.1 time: 0.253020 Jul 26 04:35:30.383161 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1183/2283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:30 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 1184 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:31.025511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18047529-b2d0-4ce0-959c-5d8852064817 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Action: 'create', calling method: .version_select at 0x7f38b6097670>, body: {"keypair": {"name": "tempest-keypair-1692052328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLTV7/chVHDkkh4Wl+pqODxiYU7HRz65iyyLwdrk8V2pnIWQWmlUtaTKPhBSEegp39GzMc2VP7h+AxFTgnBPbvws4FlBDzE286hksN/3xmf/X7/OT2apU3+d1yRnEBmxg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:31.063606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-18047529-b2d0-4ce0-959c-5d8852064817 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for project b3ddb8081dfd4d248cd435e39e5af58c. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:31.078306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-18047529-b2d0-4ce0-959c-5d8852064817 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for user 1b1fd7a0f1814df19b9c9133965988a1 and project b3ddb8081dfd4d248cd435e39e5af58c. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:31.139879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18047529-b2d0-4ce0-959c-5d8852064817 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.755291 Jul 26 04:35:31.140736 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1184/2284] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:35:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:31.151234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-838703215", "metadata": {"image_type": "test"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:31.154773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Failed to fetch instance by id tempest-invalid-2080079143 {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:35:31.158908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance tempest-invalid-2080079143 could not be found. Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/tempest-invalid-2080079143/action HTTP/1.1 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 111 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-838703215", "metadata": {"image_type": "test"}}} Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance tempest-invalid-2080079143 could not be found. Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'tempest-invalid-2080079143', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-838703215', 'metadata': {'image_type': 'test'}}}} Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2080079143 could not be found. Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:31.160691 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2080079143 could not be found. Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2080079143 could not be found. Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.164148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance tempest-invalid-2080079143 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:31.167774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-096266a2-938b-46d4-abb0-c5438325110a tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "POST /compute/v2.1/servers/tempest-invalid-2080079143/action" status: 404 len: 101 microversion: 2.1 time: 0.025861 Jul 26 04:35:31.168372 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1185/2285] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Jul 26 04:35:31 2022] POST /compute/v2.1/servers/tempest-invalid-2080079143/action => generated 101 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:31.184530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:31.185144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:31.201976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.202627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.203437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.203865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.474513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:31.484126 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa56d8c9-06c8-4a4a-b956-8188dc2fc455 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 0.314695 Jul 26 04:35:31.487166 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1186/2286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:31 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:31.493781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:31.495857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:31.507168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.507620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.508683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.518303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.683642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:31.698456 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94b1ab00-2023-4f61-95ea-9dcd961aad88 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1281 microversion: 2.1 time: 0.209973 Jul 26 04:35:31.710940 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1187/2287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:31 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:31.727052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1384218453"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:31.729763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:35:31.730482 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 57 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-test-snap-1384218453"}} Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1384218453'}}} Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.732181 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.735387 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.739023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:31.740879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ecd447d-ed75-48fa-a582-a6821787f3b8 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028725 Jul 26 04:35:31.747411 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1188/2288] 10.222.0.43 () {60 vars in 1275 bytes} [Tue Jul 26 04:35:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:31.754190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:31.757406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: c6f3477d-0f5c-4825-9455-bfd7a1c0a354] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:31.777861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.778530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.779660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.780871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.819724 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] HTTP exception thrown: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Request method failure captured: Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 HTTP/1.1 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321WNyO7anOOajK8W4mmZOYDIlI83E1TRr_5Oia0zB9e_vJrMXjG5Ljxo41WY53n9tLo7iHFfcCtENCS1axA0C6OUPHU792ZYed8WrpDbXKgEAIE-6PJc6RtwUQnDEM50nKUZUdTHHKeYv9H349S3AzQXurnGt5WWNqUnSoKHlrp4fk Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4bb20f8c8174308901ace320bb16903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 97734a3da7ef4a809b0edd23ac216dfb Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c6f3477d-0f5c-4825-9455-bfd7a1c0a354'} Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.822281 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. Jul 26 04:35:31.825674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.830587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Returning 404 to user: Instance c6f3477d-0f5c-4825-9455-bfd7a1c0a354 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:31.832341 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63c9d03d-14ba-4adc-bf15-9c74061a9f7e tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354" status: 404 len: 111 microversion: 2.1 time: 0.083662 Jul 26 04:35:31.844911 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1189/2289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:31 2022] GET /compute/v2.1/servers/c6f3477d-0f5c-4825-9455-bfd7a1c0a354 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:31.861223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2135662701"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:31.872705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:35:31.877455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 57 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-test-snap-2135662701"}} Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2135662701'}}} Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.881058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 04:35:31.884426 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:31.886824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:31.889183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89e05033-63ea-47b2-80a5-9c81b55f8b6d tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.041213 Jul 26 04:35:31.891157 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1190/2290] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Jul 26 04:35:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:31.916654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:31.919928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:31.952286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.957872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:31.961792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:31.964595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 HTTP/1.1 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '73f552e5-0e8f-4282-b638-401ce68b8619'} Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:32.047217 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:32.051225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57099943-d361-42f4-84bd-b0a0bc5d54f7 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 404 len: 111 microversion: 2.1 time: 0.152124 Jul 26 04:35:32.055763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1191/2291] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:31 2022] DELETE /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:35:32.076679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:32.077206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] [instance: 73f552e5-0e8f-4282-b638-401ce68b8619] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:32.096786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:32.100323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:32.102219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:32.102683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] HTTP exception thrown: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Request method failure captured: Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 HTTP/1.1 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3272QCXo2Mc5xpZXFpxqSN5z2XjZRnyFivpTBQLlRoPLjmbDtQsW707c7CoRodyfWk8xZw1R5R1rTbU4FJhVBPMfm7JRfzhXQKnQW1k_SIt3XXnDeky4dCih7CznFCoRn7zppgN9ZW9ovzKxECikw66fKLynZnh8Y4WXZm6_eEBYRkA Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_75fa67c1eafd4beba28bbbfbc4036e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 75fa67c1eafd4beba28bbbfbc4036e6d Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-982869420 Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 902edc7397ad4b6d8db46cc67841751f Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesNegativeTestJSON-982869420-project Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '73f552e5-0e8f-4282-b638-401ce68b8619'} Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:32.154757 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:32.157718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] Returning 404 to user: Instance 73f552e5-0e8f-4282-b638-401ce68b8619 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:32.166137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5696ce7c-c8db-484f-bc07-9f98e52355d1 tempest-ImagesNegativeTestJSON-982869420 tempest-ImagesNegativeTestJSON-982869420-project] 10.222.0.43 "GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619" status: 404 len: 111 microversion: 2.1 time: 0.109179 Jul 26 04:35:32.166760 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1192/2292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:32 2022] GET /compute/v2.1/servers/73f552e5-0e8f-4282-b638-401ce68b8619 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:32.508391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:32.509165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:32.528231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:32.532439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:32.533374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:32.536834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:32.826224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:35:33.410505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:33.419098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d746ab0a-316d-4b4e-9eb9-49081872f1ce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1304 microversion: 2.1 time: 0.915670 Jul 26 04:35:33.424028 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1193/2293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:32 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1304 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:33.449563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:33.454559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:33.469863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:33.470433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:33.471449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:33.472075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:34.443233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Updating instance_info_cache with network_info: [{"id": "57b6ab2e-2451-4f52-8463-5fa683017fc1", "address": "fa:16:3e:62:c2:fa", "network": {"id": "d4403894-9602-4e0c-83c5-7390139a6f7d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1434220813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e26beaaf35174cbfbbf3c3ae1b82aaf9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57b6ab2e-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:35:34.472390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Releasing lock "refresh_cache-b50dc221-caaa-424c-904a-40570389f5cc" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:35:34.474098 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89b4aba7-1d99-49bd-9b8b-4a30aeee9cf4 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action" status: 202 len: 0 microversion: 2.1 time: 6.348517 Jul 26 04:35:34.474779 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1101/2294] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:35:28 2022] POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action => generated 0 bytes in 6350 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:35:34.497304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1d4e6e8d-43bd-4066-b417-a8a1fee1c30c req-958615b7-3d62-4bab-9bfd-a93ef86fbbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:34.522293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d4e6e8d-43bd-4066-b417-a8a1fee1c30c req-958615b7-3d62-4bab-9bfd-a93ef86fbbc4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:34.522748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d4e6e8d-43bd-4066-b417-a8a1fee1c30c req-958615b7-3d62-4bab-9bfd-a93ef86fbbc4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:34.546642 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1d4e6e8d-43bd-4066-b417-a8a1fee1c30c req-958615b7-3d62-4bab-9bfd-a93ef86fbbc4 service nova] Creating event network-changed:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:35:34.564018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1d4e6e8d-43bd-4066-b417-a8a1fee1c30c req-958615b7-3d62-4bab-9bfd-a93ef86fbbc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084879 Jul 26 04:35:34.564623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1102/2295] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:34.571159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:34.572076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:34.578798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:34.579795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:34.580770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:34.581398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:34.667456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:34.685832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba257dc2-a11e-41c5-8b2d-a2870ba45e94 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 1.247369 Jul 26 04:35:34.702506 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1194/2296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:33 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:34.709682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Action: 'action', calling method: .version_select at 0x7f38b9053dc0>, body: {"removeFloatingIp": {"address": "172.25.7.139"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:35.156847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:35.165956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:35.166684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:35.168592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:35.169285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:35.179675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:35.191717 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f370818e-0f01-4c06-b89a-497a5839a9d8 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 0.623468 Jul 26 04:35:35.194805 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1103/2297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:34 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:35.710298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:35.711670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:35.723318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:35.724372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:35.725405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:35.728336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:36.330584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:36.345746 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2256b535-83e1-46f0-9b0e-311f39687319 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.640537 Jul 26 04:35:36.360051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1104/2298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:35 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:36.368546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:36.369431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:36.379754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:36.381302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:36.382702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:36.384047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:37.881401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:37.894358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-371d1a3b-dfc1-4408-90e5-c30b2133ea75 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 1.532897 Jul 26 04:35:37.897907 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1105/2299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:36 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:37.912444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-13644bcb-4a7a-4c0d-83b8-9eb52eea41fa req-57015057-c7c2-4121-a952-de379ab16668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d6d4e5-05d3-4626-9b14-31e236450316", "tag": "c3e2ecce-7f77-4420-af33-df0e85e75b1a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:37.936165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-13644bcb-4a7a-4c0d-83b8-9eb52eea41fa req-57015057-c7c2-4121-a952-de379ab16668 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:37.938785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-13644bcb-4a7a-4c0d-83b8-9eb52eea41fa req-57015057-c7c2-4121-a952-de379ab16668 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:37.974374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-13644bcb-4a7a-4c0d-83b8-9eb52eea41fa req-57015057-c7c2-4121-a952-de379ab16668 service nova] Creating event network-changed:c3e2ecce-7f77-4420-af33-df0e85e75b1a for instance 45d6d4e5-05d3-4626-9b14-31e236450316 on n-h1-848886-16 Jul 26 04:35:37.985795 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-13644bcb-4a7a-4c0d-83b8-9eb52eea41fa req-57015057-c7c2-4121-a952-de379ab16668 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086304 Jul 26 04:35:37.991252 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1106/2300] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:37.998215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:38.003158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:38.026526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:38.027401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:38.028480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:38.029141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:38.504931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:38.539437 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19da95ef-cc91-4d9a-929b-394f856e63c1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.546550 Jul 26 04:35:38.542546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1107/2301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:37 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:38.712291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Acquired lock "refresh_cache-b50dc221-caaa-424c-904a-40570389f5cc" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:35:38.754872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:38.921032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:38.921650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:38.939869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:38.940505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:38.943027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:38.943713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:40.117377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:40.125218 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b3df9269-0c2b-4876-a671-794f2b353aba tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 1.208038 Jul 26 04:35:40.126114 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1108/2302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:38 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:40.131156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:40.139020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:40.163598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:40.168729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:40.169872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:40.170364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:40.916889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:40.929132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52510429-28e9-478a-b25a-18ef6a7d7415 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.801679 Jul 26 04:35:40.930076 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1109/2303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:40 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:40.940565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:40.941064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:40.959282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:40.959282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:40.959282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:40.959282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:41.039371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:41.096644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:41.250084 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6c38ca0e-7c1a-4a0e-80d6-fe236b70e832 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 204 len: 0 microversion: 2.1 time: 0.318515 Jul 26 04:35:41.250694 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1110/2304] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:40 2022] DELETE /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:41.256516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-375375482", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e3ebb030-ef82-475f-98f2-ebd0b11124a8"}], "security_groups": [{"name": "tempest-securitygroup--2031672333"}], "key_name": "tempest-keypair-1692052328", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:41.620409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Building network info cache for instance {{(pid=119488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:35:42.475801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] validate_networks() for [('e3ebb030-ef82-475f-98f2-ebd0b11124a8', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:35:42.786462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Updating instance_info_cache with network_info: [{"id": "57b6ab2e-2451-4f52-8463-5fa683017fc1", "address": "fa:16:3e:62:c2:fa", "network": {"id": "d4403894-9602-4e0c-83c5-7390139a6f7d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1434220813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e26beaaf35174cbfbbf3c3ae1b82aaf9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57b6ab2e-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:35:42.845476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Releasing lock "refresh_cache-b50dc221-caaa-424c-904a-40570389f5cc" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:35:42.851433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b8b7819-2a4b-49f5-aa28-8f6839908cec tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action" status: 202 len: 0 microversion: 2.1 time: 8.158232 Jul 26 04:35:42.856816 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1195/2305] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:35:34 2022] POST /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc/action => generated 0 bytes in 8167 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:35:42.885841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:42.890849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:42.911293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:42.911760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:42.917830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:42.918530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:42.996858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:43.414451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:43.443477 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e699a4c-1801-4d2e-b8fe-b5e1f615738c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 0.583390 Jul 26 04:35:43.444403 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1196/2306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:42 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:43.456294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:43.458286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:43.470582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:43.477591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:43.478759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:43.481354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:43.804155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:43.814502 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85c780d0-c163-4dc8-8fa8-dadac08d2f25 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1668 microversion: 2.1 time: 0.366924 Jul 26 04:35:43.815283 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1197/2307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:43 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:43.822474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-beeabb80-b6ce-47d3-bd13-98d5c67b4e16 req-741989ea-c0eb-4117-b53b-3796a25a864f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:43.835346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-beeabb80-b6ce-47d3-bd13-98d5c67b4e16 req-741989ea-c0eb-4117-b53b-3796a25a864f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:43.836291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-beeabb80-b6ce-47d3-bd13-98d5c67b4e16 req-741989ea-c0eb-4117-b53b-3796a25a864f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:43.850884 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-beeabb80-b6ce-47d3-bd13-98d5c67b4e16 req-741989ea-c0eb-4117-b53b-3796a25a864f service nova] Creating event network-changed:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:35:43.857321 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-beeabb80-b6ce-47d3-bd13-98d5c67b4e16 req-741989ea-c0eb-4117-b53b-3796a25a864f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040437 Jul 26 04:35:43.858479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1198/2308] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:43.880858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:43.881814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:43.892718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:43.893533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:43.894977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:43.895602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:44.164896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:44.175686 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bcde7c4c-c750-452d-852c-8720fe7b28de tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.315002 Jul 26 04:35:44.176531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1199/2309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:43 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:44.196929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dac395d2-d46e-4442-8b4d-76df3cca3909 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '.version_select at 0x7f38b5a923a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:44.652815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for project b3ddb8081dfd4d248cd435e39e5af58c. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:44.659088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for user 1b1fd7a0f1814df19b9c9133965988a1 and project b3ddb8081dfd4d248cd435e39e5af58c. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:44.675290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:35:44.676792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:35:44.677554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:35:44.678133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:35:44.678716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:35:44.695028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:44.695986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:44.696987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:44.697540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:44.717367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for project b3ddb8081dfd4d248cd435e39e5af58c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:44.722295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Getting quotas for user 1b1fd7a0f1814df19b9c9133965988a1 and project b3ddb8081dfd4d248cd435e39e5af58c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:44.742423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:35:44.745174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:35:44.803297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5300529c-037d-4d3d-acbd-dd1478392f29 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.551369 Jul 26 04:35:44.804187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1111/2310] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:35:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 3553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:35:44.810198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:44.811696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:44.820756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:44.822077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:44.823184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:44.823848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.387002 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dac395d2-d46e-4442-8b4d-76df3cca3909 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/802452e2-788e-46a9-860f-f6948573c4cb" status: 202 len: 0 microversion: 2.1 time: 1.209162 Jul 26 04:35:45.387702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1200/2311] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:35:44 2022] DELETE /compute/v2.1/os-floating-ips/802452e2-788e-46a9-860f-f6948573c4cb => generated 0 bytes in 1211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:45.396350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:45.397151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:45.408671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.409861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.413492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.413970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.523333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:45.541065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-084ddd62-b0c8-4bb5-bab8-2f4214e750ca tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1281 microversion: 2.1 time: 0.151592 Jul 26 04:35:45.542406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1201/2312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:45 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:45.547085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:45.548517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:45.556468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.558120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.559435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.560136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.677389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:45.689399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6b46547-1af4-4079-a5ec-cd0180be0541 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1600 microversion: 2.1 time: 0.145795 Jul 26 04:35:45.690055 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1202/2313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:45 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:45.707452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:45.707997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:45.708870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:45.719439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.722349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.724143 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22623111-190b-4df3-b578-549283689e3e tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 0.918299 Jul 26 04:35:45.725104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1112/2314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:44 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:45.726850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:45.727648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:45.744164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e259d3d-815e-448b-8459-db124eecc51d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '.version_select at 0x7f38b5433940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:45.910815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:45.921013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ddf8799-4494-4e9f-8954-b1cf31fd56c3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.220319 Jul 26 04:35:45.921947 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1203/2315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:45 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:46.191720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7fc8e8f4-d3f9-49cd-9e98-d8a76262fa3a req-da0db569-f324-452e-9583-9aa534673fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7553b65-8f16-4489-b77f-3f1120a3c9da", "name": "network-vif-plugged", "status": "completed", "tag": "777b8730-49f4-4ce7-8a91-78f3bdc8daa4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:46.212661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7fc8e8f4-d3f9-49cd-9e98-d8a76262fa3a req-da0db569-f324-452e-9583-9aa534673fe5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.215965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7fc8e8f4-d3f9-49cd-9e98-d8a76262fa3a req-da0db569-f324-452e-9583-9aa534673fe5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.248525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7fc8e8f4-d3f9-49cd-9e98-d8a76262fa3a req-da0db569-f324-452e-9583-9aa534673fe5 service nova] Creating event network-vif-plugged:777b8730-49f4-4ce7-8a91-78f3bdc8daa4 for instance e7553b65-8f16-4489-b77f-3f1120a3c9da on n-h2-848886-16 Jul 26 04:35:46.264196 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7fc8e8f4-d3f9-49cd-9e98-d8a76262fa3a req-da0db569-f324-452e-9583-9aa534673fe5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072228 Jul 26 04:35:46.265168 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1204/2316] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:35:46.567837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:46.569195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:46.582602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.583379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.584327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.584920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.799387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:46.813963 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c298b219-5e53-4b96-b2b8-d843424c5a26 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1335 microversion: 2.1 time: 0.250115 Jul 26 04:35:46.828008 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1205/2317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:46 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1335 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:46.833776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:46.839941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:46.855291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.855954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.856932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.858887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.963751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e259d3d-815e-448b-8459-db124eecc51d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c1148993-44c9-410a-b251-76d160747e7f" status: 202 len: 0 microversion: 2.1 time: 1.237391 Jul 26 04:35:46.964936 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1113/2318] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:35:45 2022] DELETE /compute/v2.1/os-security-groups/c1148993-44c9-410a-b251-76d160747e7f => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:46.967876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:46.967876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:46.967876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lazy-loading 'fault' on Instance uuid 5a9c8e7c-643b-4e11-ba67-181651b63baf {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:35:46.975690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:46.976532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:46.989095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:46.997705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.002099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.005711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.006314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.498019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:47.510088 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf1973fc-ba9b-486b-8d3b-2b5ab836a1d8 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 200 len: 1323 microversion: 2.1 time: 0.677645 Jul 26 04:35:47.526668 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1206/2319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:46 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:47.533813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ed301dea-423c-4a79-af60-947d7fd369b9 req-21d8ff58-d4be-494e-a591-f862b9a809ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9c8e7c-643b-4e11-ba67-181651b63baf", "name": "network-vif-deleted", "tag": "02da4639-e8e2-4e19-ada9-0194e2b3f1fa"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:47.535613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:47.544342 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88c3d656-28c8-4d9a-933d-aa4a458cedc2 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 0.575059 Jul 26 04:35:47.551587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ed301dea-423c-4a79-af60-947d7fd369b9 req-21d8ff58-d4be-494e-a591-f862b9a809ff service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.553308 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1114/2320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:46 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:47.556689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ed301dea-423c-4a79-af60-947d7fd369b9 req-21d8ff58-d4be-494e-a591-f862b9a809ff service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.574385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:47.578072 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ed301dea-423c-4a79-af60-947d7fd369b9 req-21d8ff58-d4be-494e-a591-f862b9a809ff service nova] Creating event network-vif-deleted:02da4639-e8e2-4e19-ada9-0194e2b3f1fa for instance 5a9c8e7c-643b-4e11-ba67-181651b63baf on n-h1-848886-16 Jul 26 04:35:47.581242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:47.587493 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ed301dea-423c-4a79-af60-947d7fd369b9 req-21d8ff58-d4be-494e-a591-f862b9a809ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058855 Jul 26 04:35:47.588538 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1207/2321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:47.596039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:47.598140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:47.606315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.608856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.610064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.611047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.612172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.615124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.616226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.616966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.650861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:47.757779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:47.780004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b258fb8-ba0c-44e5-ad2d-75400d4a6595 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 204 len: 0 microversion: 2.1 time: 0.189600 Jul 26 04:35:47.781480 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1208/2322] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:47 2022] DELETE /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:47.792951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:47.793965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:47.802373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.803454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:47.807083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:47.807775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.011221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:48.022972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fae64c5-971c-4e24-a1b4-a0b35be0b6ac tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 0.468394 Jul 26 04:35:48.038559 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1115/2323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:47 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:48.045233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:48.046058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:48.053215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.053872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.054820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.056019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.134289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:48.138286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:48.144220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b48efe9f-2a84-4dac-b1b0-52639ba5c8ed tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1335 microversion: 2.1 time: 0.104150 Jul 26 04:35:48.149939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1116/2324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:48 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:48.430553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-320233678", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:48.508138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] validate_networks() for [('a75a427f-663c-4626-8831-f7eac0ebbcc7', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:35:48.516040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:48.531607 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b515684a-7416-45c8-9c46-d10114917f82 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1510 microversion: 2.1 time: 0.744332 Jul 26 04:35:48.532209 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1209/2325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:47 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1510 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:48.544575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a9071d29-8d39-4d8b-9275-a6744c153f4b req-2a54d3a8-22db-4d20-a2b5-82cc7ccd217f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d6d4e5-05d3-4626-9b14-31e236450316", "name": "network-vif-plugged", "status": "completed", "tag": "c3e2ecce-7f77-4420-af33-df0e85e75b1a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:48.574564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a9071d29-8d39-4d8b-9275-a6744c153f4b req-2a54d3a8-22db-4d20-a2b5-82cc7ccd217f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.575577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a9071d29-8d39-4d8b-9275-a6744c153f4b req-2a54d3a8-22db-4d20-a2b5-82cc7ccd217f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.607490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a9071d29-8d39-4d8b-9275-a6744c153f4b req-2a54d3a8-22db-4d20-a2b5-82cc7ccd217f service nova] Creating event network-vif-plugged:c3e2ecce-7f77-4420-af33-df0e85e75b1a for instance 45d6d4e5-05d3-4626-9b14-31e236450316 on n-h1-848886-16 Jul 26 04:35:48.614645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a9071d29-8d39-4d8b-9275-a6744c153f4b req-2a54d3a8-22db-4d20-a2b5-82cc7ccd217f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079436 Jul 26 04:35:48.615866 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1210/2326] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:48.635154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:48.635154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: 5a9c8e7c-643b-4e11-ba67-181651b63baf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:48.659119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.660512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.661729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.662339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.704326 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] HTTP exception thrown: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Request method failure captured: Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf HTTP/1.1 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321WNyO7anOOajK8W4mmZOYDIlI83E1TRr_5Oia0zB9e_vJrMXjG5Ljxo41WY53n9tLo7iHFfcCtENCS1axA0C6OUPHU792ZYed8WrpDbXKgEAIE-6PJc6RtwUQnDEM50nKUZUdTHHKeYv9H349S3AzQXurnGt5WWNqUnSoKHlrp4fk Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4bb20f8c8174308901ace320bb16903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 97734a3da7ef4a809b0edd23ac216dfb Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '5a9c8e7c-643b-4e11-ba67-181651b63baf'} Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:48.706371 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:48.711592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Returning 404 to user: Instance 5a9c8e7c-643b-4e11-ba67-181651b63baf could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:48.713437 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cde6310f-906e-4b48-b0b1-e91bbe450620 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf" status: 404 len: 111 microversion: 2.1 time: 0.095594 Jul 26 04:35:48.714457 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1211/2327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:48 2022] GET /compute/v2.1/servers/5a9c8e7c-643b-4e11-ba67-181651b63baf => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:48.721716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:48.726402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:48.743084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.743710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:48.744621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:48.745303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.453309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:35:49.453776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:35:49.454217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:35:49.454634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:35:49.455046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:35:49.475976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.476539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.477373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.477820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.507400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Getting quotas for project 6c78e1a85b9342b394b5528fcd158a04. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:35:49.526220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Getting quotas for user 6745e2a70916439cb278be0fc606d295 and project 6c78e1a85b9342b394b5528fcd158a04. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:35:49.566953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:35:49.571470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:35:49.661003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:49.672222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8411bd24-06d9-4e81-b238-e7eda0ba5dce tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1292 microversion: 2.1 time: 0.956504 Jul 26 04:35:49.673613 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1212/2328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:48 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1292 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:49.683140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64147bfe-d6f5-4ed9-b70e-d7e9435e6cd9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '.version_select at 0x7f38b61894c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:49.726541 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64147bfe-d6f5-4ed9-b70e-d7e9435e6cd9 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208329623" status: 202 len: 0 microversion: 2.1 time: 0.051787 Jul 26 04:35:49.727138 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1213/2329] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208329623 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:35:49.728097 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9299139f-f20e-4468-8b20-2ec4918c78ca tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.575999 Jul 26 04:35:49.735093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1117/2330] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:35:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:35:49.740521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:49.741319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:49.749871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:49.750799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:49.765721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.766195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.771912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.777189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.779949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.783208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:49.784323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:49.785331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:50.487031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:50.509894 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b8e14159-86c3-489e-a2f7-82458282a24f tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.772406 Jul 26 04:35:50.516530 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1118/2331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:49 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:50.527625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:50.528435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:50.545351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:50.545822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:50.546657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:50.547109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:50.718765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:50.739110 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5fb993c3-49f0-4699-aaed-1bd7620af312 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1323 microversion: 2.1 time: 1.007663 Jul 26 04:35:50.739738 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1214/2332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:49 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1323 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:50.745582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:50.750330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:50.784184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:50.787130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:50.790352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:50.790973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:50.992199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:51.003085 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5db7dca-ab69-4412-bf24-6c438e2ff9e3 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1510 microversion: 2.1 time: 0.484771 Jul 26 04:35:51.004237 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1119/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:50 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:51.034389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:51.035133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:51.050023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.054520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:51.055931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.056583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:51.164256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:51.175570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26b1eae2-d7bd-4335-addd-353eaa743d5e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1217 microversion: 2.1 time: 0.434075 Jul 26 04:35:51.187981 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1215/2334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:50 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:51.537646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:51.538533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:51.547047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.552214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:51.553879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.554634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:51.590719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:51.859331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:51.875691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4dd41951-19ca-4997-acf7-86b3465912cb tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1482 microversion: 2.1 time: 0.849941 Jul 26 04:35:51.883520 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1120/2335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:51 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1482 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:51.903440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:51.904285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:51.914199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.917109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:51.919100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:51.919833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.202443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:52.215798 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-489f8689-a052-49e5-aa4f-404ec3be164a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.328831 Jul 26 04:35:52.216669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1121/2336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:51 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:52.225303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.225825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.242489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.243097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.243912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.244450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.346062 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9ec1e7b-78f8-4a57-93f0-4242baa6a8e7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127320 Jul 26 04:35:52.348108 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1122/2337] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:35:52 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:52.354067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.355449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.373901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.376304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.377914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.381202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.490565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:52.499525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb4851a9-2de3-4745-854a-7dfec8ac8140 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.966497 Jul 26 04:35:52.500729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1216/2338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:51 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:52.510834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:52.523976 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff3c0108-943d-4d37-83ce-879f0eeee692 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1468 microversion: 2.1 time: 0.174506 Jul 26 04:35:52.526227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.526997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.534218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1123/2339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:52 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1468 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:52.541350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.541517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.542437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.543162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.543549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.544168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.561421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.561877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.562714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.563154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.593666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:52.745883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:52.758403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7406b672-87ed-4db5-9a8d-32f6b0acd346 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1271 microversion: 2.1 time: 0.224408 Jul 26 04:35:52.767467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7703030d-d4ad-4cfc-861a-4fde4b4bc242 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 204 len: 0 microversion: 2.1 time: 0.249889 Jul 26 04:35:52.773039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1217/2340] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:52 2022] DELETE /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:52.774889 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1124/2341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:52 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:52.781236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.782121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.801976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.802797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.803833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.804869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:52.806483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.808128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:52.823783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.824248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:52.825096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:52.831161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.122022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:53.133473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-466b1a23-473f-4f82-a1ff-daa62ce7d170 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1485 microversion: 2.1 time: 0.357234 Jul 26 04:35:53.134200 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1125/2342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:52 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1485 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:53.283895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-237f03b7-c022-41e4-963c-10e9b189152d req-7e6b82e8-28f3-48bc-aa7a-fd6914a9d908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50dc221-caaa-424c-904a-40570389f5cc", "name": "network-vif-deleted", "tag": "57b6ab2e-2451-4f52-8463-5fa683017fc1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:53.302687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-237f03b7-c022-41e4-963c-10e9b189152d req-7e6b82e8-28f3-48bc-aa7a-fd6914a9d908 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.303402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-237f03b7-c022-41e4-963c-10e9b189152d req-7e6b82e8-28f3-48bc-aa7a-fd6914a9d908 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.327991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-237f03b7-c022-41e4-963c-10e9b189152d req-7e6b82e8-28f3-48bc-aa7a-fd6914a9d908 service nova] Creating event network-vif-deleted:57b6ab2e-2451-4f52-8463-5fa683017fc1 for instance b50dc221-caaa-424c-904a-40570389f5cc on n-h2-848886-16 Jul 26 04:35:53.341180 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-237f03b7-c022-41e4-963c-10e9b189152d req-7e6b82e8-28f3-48bc-aa7a-fd6914a9d908 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060151 Jul 26 04:35:53.343312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1126/2343] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:53.524578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:53.525539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:53.532807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.533567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.535162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.536103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.713413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:53.741405 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd62ebf1-9052-4944-8639-0e103897e7b9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.965163 Jul 26 04:35:53.744193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1218/2344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:52 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:53.751041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:53.751931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:53.773854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.774642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.776460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.777224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.849912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:53.850645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:53.853861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lazy-loading 'fault' on Instance uuid b50dc221-caaa-424c-904a-40570389f5cc {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:35:53.998800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ecbf62a4cb478887ab8ef6b56cd78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26beaaf35174cbfbbf3c3ae1b82aaf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:54.008013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20b5a08a-2198-4240-80c9-4cfec5f1f68d tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 200 len: 1313 microversion: 2.1 time: 0.261969 Jul 26 04:35:54.008616 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1219/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:53 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:54.027535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-653d4fa4-c0b0-4eb4-8cb0-5f4c431a4a98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1211926690", "metadata": {"": ""}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-653d4fa4-c0b0-4eb4-8cb0-5f4c431a4a98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action HTTP/1.1 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 107 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1211926690", "metadata": {"": ""}}} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1211926690', 'metadata': {'': ''}}}} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'': ''} Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:54.033322 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:54.037188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:54.040041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-653d4fa4-c0b0-4eb4-8cb0-5f4c431a4a98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:54.041343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-653d4fa4-c0b0-4eb4-8cb0-5f4c431a4a98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action" status: 400 len: 170 microversion: 2.1 time: 0.027236 Jul 26 04:35:54.045696 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1220/2346] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jul 26 04:35:54 2022] POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:35:54.062944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:54.063604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:54.090336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.090831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.091807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.092431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.129001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:54.139408 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f2485cb-f9f7-46be-b11e-d47eaca3f4e0 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.621895 Jul 26 04:35:54.157870 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1127/2347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:53 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:54.164430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:54.165328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:54.172259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.172941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.173892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.175016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.204344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:54.213859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a983fe85-1dc0-481c-8a83-c479a16b672b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1271 microversion: 2.1 time: 0.166846 Jul 26 04:35:54.216308 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1221/2348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:54 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:54.225332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:54.231396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:54.245784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.246272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.247065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.247514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.590253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:54.599876 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0863839-da09-4e0e-bc0d-c9fd0800922d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1485 microversion: 2.1 time: 0.380590 Jul 26 04:35:54.606216 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1222/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:54 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1485 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:54.685434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:54.698395 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f3e5f81-a95b-4338-ac9f-f6676a6c43d8 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.538936 Jul 26 04:35:54.698983 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1128/2350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:54 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:54.720163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:54.721347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:54.737431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.738562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.739553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:54.740151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:54.992009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c11eff6d-24cb-426f-a394-106b7d4451ab req-6c705403-63b9-4c0c-9490-90eb2c0807c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead7e696-c94a-4516-8282-5dc1cbd829d1", "name": "network-vif-deleted", "tag": "dfaf511d-dea4-46a1-b673-83ba18efa390"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:55.011246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c11eff6d-24cb-426f-a394-106b7d4451ab req-6c705403-63b9-4c0c-9490-90eb2c0807c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.011701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c11eff6d-24cb-426f-a394-106b7d4451ab req-6c705403-63b9-4c0c-9490-90eb2c0807c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.038868 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c11eff6d-24cb-426f-a394-106b7d4451ab req-6c705403-63b9-4c0c-9490-90eb2c0807c1 service nova] Creating event network-vif-deleted:dfaf511d-dea4-46a1-b673-83ba18efa390 for instance ead7e696-c94a-4516-8282-5dc1cbd829d1 on n-h1-848886-16 Jul 26 04:35:55.049055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c11eff6d-24cb-426f-a394-106b7d4451ab req-6c705403-63b9-4c0c-9490-90eb2c0807c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061320 Jul 26 04:35:55.053357 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1129/2351] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:55.058847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:55.073596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] [instance: b50dc221-caaa-424c-904a-40570389f5cc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:55.090429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.091149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.093072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.094695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.131233 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] HTTP exception thrown: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Request method failure captured: Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc HTTP/1.1 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3265-zhAgQFYjHCZJcVf6ZuCFKv4dsenrGefheJ9eRDfFxefgzv0pPnFiw3qmoOIp4pIdAsxTphLnLvtLHI4Mgir1JEmpLwX8k2ufv9Xl6U8DpQSGwFI34YPMAe8dcwKY4QRwctPQu2eTPhLFquCS_DYrWJsz6bXyXo_Yhm2yw2BNzY Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e26beaaf35174cbfbbf3c3ae1b82aaf9 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-655115739 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e26beaaf35174cbfbbf3c3ae1b82aaf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e26beaaf35174cbfbbf3c3ae1b82aaf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e26beaaf35174cbfbbf3c3ae1b82aaf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e26beaaf35174cbfbbf3c3ae1b82aaf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-655115739 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e26beaaf35174cbfbbf3c3ae1b82aaf9 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-655115739 Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueTestJSONUnderV235-655115739-project Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 64ecbf62a4cb478887ab8ef6b56cd78f Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-655115739-project Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b50dc221-caaa-424c-904a-40570389f5cc'} Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:55.132926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:55.136270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] Returning 404 to user: Instance b50dc221-caaa-424c-904a-40570389f5cc could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:55.144911 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84f59b67-6d1b-4853-8bcd-cd3cfaeca679 tempest-ServerRescueTestJSONUnderV235-655115739 tempest-ServerRescueTestJSONUnderV235-655115739-project] 10.222.0.43 "GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc" status: 404 len: 111 microversion: 2.1 time: 0.079790 Jul 26 04:35:55.145899 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1130/2352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:55 2022] GET /compute/v2.1/servers/b50dc221-caaa-424c-904a-40570389f5cc => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:55.165589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:55.166208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:55.190117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.190649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.197320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.201795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.428713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:55.440408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe550ae6-b118-408e-bf1b-3b4a9cc4706a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.723884 Jul 26 04:35:55.457628 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1223/2353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:54 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:55.467104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:55.468271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:55.478671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.479964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.481676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.482384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.796749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:55.805411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-72f26c44-a5fc-416d-92ad-67352130de86 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.346083 Jul 26 04:35:55.808690 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1224/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:55 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:55.813741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:55.815267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:55.832752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.835993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:55.839504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:55.840265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.082299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:56.090937 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3b1dee2-076e-43d4-9d92-13cbeff9fdea tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1482 microversion: 2.1 time: 0.280916 Jul 26 04:35:56.091533 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1225/2355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:55 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1482 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:56.101277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-790c3133-96ac-4b20-b87c-fd7fab67385c req-681e8990-103f-41bb-9e1a-3efd0fd12c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6410eed-6433-4a63-8e36-bc44ea43c87d", "tag": "beece54d-d442-426a-809e-af3a98d3782a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:56.139145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-790c3133-96ac-4b20-b87c-fd7fab67385c req-681e8990-103f-41bb-9e1a-3efd0fd12c57 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.140384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-790c3133-96ac-4b20-b87c-fd7fab67385c req-681e8990-103f-41bb-9e1a-3efd0fd12c57 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.161464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-790c3133-96ac-4b20-b87c-fd7fab67385c req-681e8990-103f-41bb-9e1a-3efd0fd12c57 service nova] Creating event network-changed:beece54d-d442-426a-809e-af3a98d3782a for instance f6410eed-6433-4a63-8e36-bc44ea43c87d on n-h1-848886-16 Jul 26 04:35:56.173030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-790c3133-96ac-4b20-b87c-fd7fab67385c req-681e8990-103f-41bb-9e1a-3efd0fd12c57 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075968 Jul 26 04:35:56.175923 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1226/2356] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:56.196130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfe419ac-368f-4fdb-8942-8dfc714b39ae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1000461798", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfe419ac-368f-4fdb-8942-8dfc714b39ae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action HTTP/1.1 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 619 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1000461798", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1000461798', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:35:56.204209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:35:56.207288 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:35:56.210976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfe419ac-368f-4fdb-8942-8dfc714b39ae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:56.212939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfe419ac-368f-4fdb-8942-8dfc714b39ae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action" status: 400 len: 938 microversion: 2.1 time: 0.035283 Jul 26 04:35:56.217550 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1227/2357] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jul 26 04:35:56 2022] POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action => generated 938 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:35:56.223415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:56.224231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:56.232280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.233238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.234524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.235294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.321927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:56.337993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.338548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.339012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lazy-loading 'fault' on Instance uuid ead7e696-c94a-4516-8282-5dc1cbd829d1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:35:56.339996 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c0e2c29-a012-41fb-bc40-e5921a904e31 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 1.178280 Jul 26 04:35:56.346625 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1131/2358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:55 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:56.352569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:56.359494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:56.366576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.368484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.373135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.373883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.578775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:56.596580 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be4c6563-8d6b-4db8-9c52-d82e3459e37a tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 200 len: 1301 microversion: 2.1 time: 0.377636 Jul 26 04:35:56.598197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1228/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:56 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 1301 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:56.830679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:56.831874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:56.842588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.844480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:56.844480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:56.848285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.070679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:57.091774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8da824ab-72d1-4a3d-af1b-4f2e5c141e85 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.742984 Jul 26 04:35:57.095976 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1132/2360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:56 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:57.102445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ab523415-8862-433a-b065-be964f91d64d req-9c4cc72e-ee4f-4f24-b61e-e3225645c3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7553b65-8f16-4489-b77f-3f1120a3c9da", "tag": "777b8730-49f4-4ce7-8a91-78f3bdc8daa4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:57.125846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab523415-8862-433a-b065-be964f91d64d req-9c4cc72e-ee4f-4f24-b61e-e3225645c3aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.129588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab523415-8862-433a-b065-be964f91d64d req-9c4cc72e-ee4f-4f24-b61e-e3225645c3aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.168069 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ab523415-8862-433a-b065-be964f91d64d req-9c4cc72e-ee4f-4f24-b61e-e3225645c3aa service nova] Creating event network-changed:777b8730-49f4-4ce7-8a91-78f3bdc8daa4 for instance e7553b65-8f16-4489-b77f-3f1120a3c9da on n-h2-848886-16 Jul 26 04:35:57.179911 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ab523415-8862-433a-b065-be964f91d64d req-9c4cc72e-ee4f-4f24-b61e-e3225645c3aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081352 Jul 26 04:35:57.184615 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1133/2361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:57.210068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:57.211286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:57.220265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.221043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.222885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.223558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.492311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:57.504827 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96478d59-e1e8-4554-a8db-bb89d1399bec tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.678221 Jul 26 04:35:57.507813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1229/2362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:56 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:35:57.520548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:57.520548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:57.536442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.536901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.537793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.538136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.917187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:57.929771 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2aa3502f-ff6f-4a13-a044-cfefabd41fd0 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.740869 Jul 26 04:35:57.931730 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1134/2363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:57 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:57.945188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:57.946429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: ead7e696-c94a-4516-8282-5dc1cbd829d1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:57.955391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.956928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.957731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:57.958205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:57.984346 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] HTTP exception thrown: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Request method failure captured: Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 HTTP/1.1 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi321WNyO7anOOajK8W4mmZOYDIlI83E1TRr_5Oia0zB9e_vJrMXjG5Ljxo41WY53n9tLo7iHFfcCtENCS1axA0C6OUPHU792ZYed8WrpDbXKgEAIE-6PJc6RtwUQnDEM50nKUZUdTHHKeYv9H349S3AzQXurnGt5WWNqUnSoKHlrp4fk Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4bb20f8c8174308901ace320bb16903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 97734a3da7ef4a809b0edd23ac216dfb Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-LiveMigrationTest-1299629746-project Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ead7e696-c94a-4516-8282-5dc1cbd829d1'} Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:57.988459 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:57.992126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Returning 404 to user: Instance ead7e696-c94a-4516-8282-5dc1cbd829d1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:57.993799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-300eae72-86fc-497e-885a-1da8fbd4f59c tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1" status: 404 len: 111 microversion: 2.1 time: 0.060891 Jul 26 04:35:57.996850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1135/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:57 2022] GET /compute/v2.1/servers/ead7e696-c94a-4516-8282-5dc1cbd829d1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:35:58.005490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-393a6ac0-484e-4f1a-b82d-46ee6798767b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-393a6ac0-484e-4f1a-b82d-46ee6798767b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action HTTP/1.1 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 285 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.010518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:35:58.013847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:35:58.016790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-393a6ac0-484e-4f1a-b82d-46ee6798767b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:35:58.018001 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-393a6ac0-484e-4f1a-b82d-46ee6798767b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action" status: 400 len: 619 microversion: 2.1 time: 0.020032 Jul 26 04:35:58.020888 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1136/2365] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jul 26 04:35:57 2022] POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:35:58.027715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:58.028871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:58.037324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.038123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.039387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.040058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.071036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:35:58.142545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:58.251769 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c4df8dc-cc65-48ea-a3ef-e20137d72667 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 204 len: 0 microversion: 2.1 time: 0.229284 Jul 26 04:35:58.255592 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1137/2366] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:35:58 2022] DELETE /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:35:58.260178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:58.260938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:58.283528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.283998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.285759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.286232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.629229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:58.639267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f3cd39a-74f1-4c4c-88fb-7db1c72e1bba tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.385214 Jul 26 04:35:58.640228 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1138/2367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:58 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:58.646397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:58.647293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:58.662007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.663057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.664211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.664665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.837110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:58.846451 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13bb81ba-64a7-4a83-be32-1e5d24782770 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 1.337477 Jul 26 04:35:58.847728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1230/2368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:57 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:58.852747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-31e4f610-98fb-4e9c-a86d-0351325df097 req-71e81da9-fba1-4095-8bfe-6a9f1026e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566ad57d-f13d-4aa4-96c9-6d813121e2d3", "tag": "55c039a0-155b-4b61-8ae4-8d30268abbbc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:35:58.863790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-31e4f610-98fb-4e9c-a86d-0351325df097 req-71e81da9-fba1-4095-8bfe-6a9f1026e37b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.864268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-31e4f610-98fb-4e9c-a86d-0351325df097 req-71e81da9-fba1-4095-8bfe-6a9f1026e37b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.876351 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-31e4f610-98fb-4e9c-a86d-0351325df097 req-71e81da9-fba1-4095-8bfe-6a9f1026e37b service nova] Creating event network-changed:55c039a0-155b-4b61-8ae4-8d30268abbbc for instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 on n-h2-848886-16 Jul 26 04:35:58.881880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-31e4f610-98fb-4e9c-a86d-0351325df097 req-71e81da9-fba1-4095-8bfe-6a9f1026e37b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032523 Jul 26 04:35:58.882895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1231/2369] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:35:58.896242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:58.897213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:58.904829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.905937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:58.907849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:58.908522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:59.340412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:59.351554 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b01b4cd7-c916-4761-b894-e2f5648cd31d tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1501 microversion: 2.1 time: 0.709821 Jul 26 04:35:59.355772 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1139/2370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:58 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1501 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:59.374532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:59.375130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:59.387144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:59.388602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:59.391243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:59.394090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:59.419740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:35:59.437508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f992eabd-5f04-4f0e-8882-e3ae3a91c1ea tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.549525 Jul 26 04:35:59.438832 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1232/2371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:58 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:35:59.493857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:59.556454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:35:59.867969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:35:59.868578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:35:59.876033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:59.876589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:35:59.877474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:35:59.878596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.025376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:00.034636 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d782b42-e4f6-4474-9561-a0e4b0dac3c2 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.169764 Jul 26 04:36:00.036015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1233/2372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:59 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:00.379752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:00.380453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:00.388014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.389209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.389997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.390518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.396856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:00.426816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:00.439235 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8637c9b-bbb0-4d53-a03d-e8266a5caf98 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 1.082161 Jul 26 04:36:00.450633 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1140/2373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:35:59 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:00.463882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:00.464897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:00.472316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.473285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.475136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.476033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.557832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:00.568976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de0ffbf9-7e6e-4439-9b00-96626d74a320 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1501 microversion: 2.1 time: 0.195481 Jul 26 04:36:00.570220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1234/2374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:00 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:00.580478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1478219887"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:00.580478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:00.592226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.592642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.593537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.594019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.878279 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6a57ced-45da-4e83-a0e7-29a720889a91 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action" status: 202 len: 0 microversion: 2.1 time: 0.306011 Jul 26 04:36:00.887987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1235/2375] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:00 2022] POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:36:00.895539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-308367373"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:00.906314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:00.918013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.919372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.920477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:00.920934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:00.963780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Cannot 'createImage' instance 45d6d4e5-05d3-4626-9b14-31e236450316 while it is in task_state image_snapshot_pending Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action HTTP/1.1 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 84 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-308367373"}} Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'createImage' instance 45d6d4e5-05d3-4626-9b14-31e236450316 while it is in task_state image_snapshot_pending Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-308367373'}}} Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:36:00.966007 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 45d6d4e5-05d3-4626-9b14-31e236450316 while it is in task_state image_snapshot_pending Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 45d6d4e5-05d3-4626-9b14-31e236450316 while it is in task_state image_snapshot_pending Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 409 to user: Cannot 'createImage' instance 45d6d4e5-05d3-4626-9b14-31e236450316 while it is in task_state image_snapshot_pending {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:00.969971 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02cb4c87-35bf-45dc-b168-e001155d768a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action" status: 409 len: 167 microversion: 2.1 time: 0.077955 Jul 26 04:36:00.972338 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1236/2376] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:00 2022] POST /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316/action => generated 167 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:36:00.984517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9ac2bed-83ca-4afb-b466-efda8a343eae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b59368b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:01.134078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9ac2bed-83ca-4afb-b466-efda8a343eae tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/images/c59811c8-eb3c-4eec-8237-4220b033c341" status: 204 len: 0 microversion: 2.1 time: 0.160431 Jul 26 04:36:01.135026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1237/2377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:00 2022] DELETE /compute/v2.1/images/c59811c8-eb3c-4eec-8237-4220b033c341 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:36:01.141026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:01.141918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:01.151934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.152910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.153964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.154674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.299104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:01.307835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b68574de-3ae4-4ba5-9279-d2dfceb09c41 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.849900 Jul 26 04:36:01.312769 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1141/2378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:00 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:01.319217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:01.320141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:01.328252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.329008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.330054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.330539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.353526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:01.363254 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9bbdcb0d-5d37-4119-a658-7819d1632e21 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.225920 Jul 26 04:36:01.370204 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1238/2379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:01 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:01.593077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:01.593981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:01.606031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.606720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.607538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.607992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.678346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97734a3da7ef4a809b0edd23ac216dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb20f8c8174308901ace320bb16903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:01.686711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3255a617-4a8b-41b2-ae9e-8010b30a2594 tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 200 len: 1459 microversion: 2.1 time: 0.097659 Jul 26 04:36:01.687555 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1239/2380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:01 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 1459 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:01.737942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2bc8d750-c45c-4bb8-a13b-b77872d1ba71 req-3077bd8c-8716-4326-b6c4-bf6ae40433b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd6f2ab-34eb-477c-919c-3013ef2ac190", "name": "network-vif-deleted", "tag": "a717e781-60a8-4a96-ba15-f846b2ec4481"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:01.755352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2bc8d750-c45c-4bb8-a13b-b77872d1ba71 req-3077bd8c-8716-4326-b6c4-bf6ae40433b0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:01.756207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2bc8d750-c45c-4bb8-a13b-b77872d1ba71 req-3077bd8c-8716-4326-b6c4-bf6ae40433b0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:01.775780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2bc8d750-c45c-4bb8-a13b-b77872d1ba71 req-3077bd8c-8716-4326-b6c4-bf6ae40433b0 service nova] Creating event network-vif-deleted:a717e781-60a8-4a96-ba15-f846b2ec4481 for instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 on n-h1-848886-16 Jul 26 04:36:01.782532 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2bc8d750-c45c-4bb8-a13b-b77872d1ba71 req-3077bd8c-8716-4326-b6c4-bf6ae40433b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051237 Jul 26 04:36:01.784526 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1240/2381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:01.983622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ad758722-863e-46f7-9a7f-e9c2f2c8987b req-14846464-4cc3-4029-b89f-e911c6161b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6410eed-6433-4a63-8e36-bc44ea43c87d", "name": "network-vif-plugged", "status": "completed", "tag": "beece54d-d442-426a-809e-af3a98d3782a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:02.016123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:02.030740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ad758722-863e-46f7-9a7f-e9c2f2c8987b req-14846464-4cc3-4029-b89f-e911c6161b34 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.031785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ad758722-863e-46f7-9a7f-e9c2f2c8987b req-14846464-4cc3-4029-b89f-e911c6161b34 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.040041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53663e4c-e2bd-4ad2-b079-617aca076927 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1532 microversion: 2.1 time: 0.726070 Jul 26 04:36:02.069075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1142/2382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:01 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1532 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:02.090737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ad758722-863e-46f7-9a7f-e9c2f2c8987b req-14846464-4cc3-4029-b89f-e911c6161b34 service nova] Creating event network-vif-plugged:beece54d-d442-426a-809e-af3a98d3782a for instance f6410eed-6433-4a63-8e36-bc44ea43c87d on n-h1-848886-16 Jul 26 04:36:02.109472 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ad758722-863e-46f7-9a7f-e9c2f2c8987b req-14846464-4cc3-4029-b89f-e911c6161b34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131215 Jul 26 04:36:02.113477 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1241/2383] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:02.328335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:02.328961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:02.355617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.358567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.360134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.360748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.386062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:02.386821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:02.398891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.399350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.400145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.405779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.651796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:02.664204 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d7b9dd53-90c5-4da4-88c7-e498526ed8c9 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.282667 Jul 26 04:36:02.679441 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1242/2384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:02 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:02.717063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:02.717946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] [instance: bdd6f2ab-34eb-477c-919c-3013ef2ac190] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:02.727616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.727995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.728797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:02.729242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:02.749947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] HTTP exception thrown: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Request method failure captured: Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 HTTP/1.1 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi321WNyO7anOOajK8W4mmZOYDIlI83E1TRr_5Oia0zB9e_vJrMXjG5Ljxo41WY53n9tLo7iHFfcCtENCS1axA0C6OUPHU792ZYed8WrpDbXKgEAIE-6PJc6RtwUQnDEM50nKUZUdTHHKeYv9H349S3AzQXurnGt5WWNqUnSoKHlrp4fk Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4bb20f8c8174308901ace320bb16903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4bb20f8c8174308901ace320bb16903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-LiveMigrationTest-1299629746 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f4bb20f8c8174308901ace320bb16903 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-LiveMigrationTest-1299629746 Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-LiveMigrationTest-1299629746-project Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 97734a3da7ef4a809b0edd23ac216dfb Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-LiveMigrationTest-1299629746-project Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'bdd6f2ab-34eb-477c-919c-3013ef2ac190'} Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:02.751903 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] Returning 404 to user: Instance bdd6f2ab-34eb-477c-919c-3013ef2ac190 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:02.755813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09f240da-62aa-4cee-9154-b81d053879ff tempest-LiveMigrationTest-1299629746 tempest-LiveMigrationTest-1299629746-project] 10.222.0.43 "GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190" status: 404 len: 111 microversion: 2.1 time: 0.049296 Jul 26 04:36:02.759534 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1243/2385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:02 2022] GET /compute/v2.1/servers/bdd6f2ab-34eb-477c-919c-3013ef2ac190 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:36:03.075672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:03.077657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:03.092690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:03.094012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:03.101007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:03.102355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:03.338668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:03.353087 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51253827-0f5c-4c69-957e-1da52329b16b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 1.028531 Jul 26 04:36:03.359268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1143/2386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:02 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:03.493589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:03.522889 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-190e9ae0-6c09-4295-a020-51763205fb8f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1538 microversion: 2.1 time: 0.464982 Jul 26 04:36:03.541196 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1244/2387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:03 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1538 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:03.686323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:03.687048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:03.698466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:03.699050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:03.700862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:03.710895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:04.096341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:04.106460 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0c645b3-22b1-4614-bf49-5a16d07c44ac tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1403 microversion: 2.1 time: 0.424140 Jul 26 04:36:04.113261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1144/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:03 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1403 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:04.372985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:04.373618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:04.386823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:04.388722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:04.392576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:04.394493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:04.551443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:04.562274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:04.587296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:04.588967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:04.596742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:04.604759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:04.640457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:04.657632 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-621921a7-66de-47a2-bfe1-b284d2d87c14 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.287921 Jul 26 04:36:04.658386 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1245/2389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:04 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:05.026550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:05.036714 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ded7e30c-113e-4942-ace4-723f2507c5f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1533 microversion: 2.1 time: 0.492635 Jul 26 04:36:05.037296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1145/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:04 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1533 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:05.135357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:05.136590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:05.145541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:05.146034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:05.147006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:05.147563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:05.680215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:05.680839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:05.688400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:05.697950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:05.698832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:05.704478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.061600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:06.088654 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0019d73a-cf68-421c-bbff-48bcf9c00b1e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.406168 Jul 26 04:36:06.090928 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1146/2391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:05 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:06.098438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:06.104356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:06.119617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:06.119866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.120660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:06.121102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.297276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:06.311322 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccb018e8-6359-4402-9db2-723b1ca00173 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1590 microversion: 2.1 time: 1.180484 Jul 26 04:36:06.311925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1246/2392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:05 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1590 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:06.333717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:06.334498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:06.344231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:06.358980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.359867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:06.360316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.700288 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69166f69-57cc-408a-aca6-7f542990982d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.370583 Jul 26 04:36:06.708752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1247/2393] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:36:06 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d/os-interface => generated 285 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:06.764852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-50a34b93-1ca2-4126-8aa5-d6a9285f29de req-4fc28390-fd03-4943-a799-33c6d1f7cb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566ad57d-f13d-4aa4-96c9-6d813121e2d3", "name": "network-vif-plugged", "status": "completed", "tag": "55c039a0-155b-4b61-8ae4-8d30268abbbc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:06.778251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-50a34b93-1ca2-4126-8aa5-d6a9285f29de req-4fc28390-fd03-4943-a799-33c6d1f7cb53 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:06.778681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-50a34b93-1ca2-4126-8aa5-d6a9285f29de req-4fc28390-fd03-4943-a799-33c6d1f7cb53 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:06.796243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-50a34b93-1ca2-4126-8aa5-d6a9285f29de req-4fc28390-fd03-4943-a799-33c6d1f7cb53 service nova] Creating event network-vif-plugged:55c039a0-155b-4b61-8ae4-8d30268abbbc for instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 on n-h2-848886-16 Jul 26 04:36:06.802278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-50a34b93-1ca2-4126-8aa5-d6a9285f29de req-4fc28390-fd03-4943-a799-33c6d1f7cb53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056027 Jul 26 04:36:06.803551 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1248/2394] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:07.000326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:07.012679 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52e00a92-6155-4c97-a098-4449b6accf8b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1520 microversion: 2.1 time: 0.920245 Jul 26 04:36:07.015905 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1147/2395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:06 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1520 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:07.039528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:07.040589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:07.048404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.050532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.052630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.053435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.087115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:36:07.115070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:07.115704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:07.150115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.153614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.155270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.159232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.288550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bd28485b-9f89-49a4-aa8b-314517d86b67 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 204 len: 0 microversion: 2.1 time: 0.253385 Jul 26 04:36:07.289561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1249/2396] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:36:07 2022] DELETE /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:36:07.303145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:07.305571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:07.318993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:07.320600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.326383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.329100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:07.329580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:07.511106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:07.536023 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3af8040b-bcaa-4af3-b0e5-4200b7054871 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.426327 Jul 26 04:36:07.537910 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1148/2397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:07 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:08.433854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:08.445768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f66d778-ffa2-421e-ade2-2541c0745e83 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1526 microversion: 2.1 time: 1.151443 Jul 26 04:36:08.446982 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1250/2398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:07 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1526 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:08.557698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:08.558508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:08.566556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:08.567382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:08.568323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:08.569038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:08.787206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:08.822249 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7a20a5e-1f4f-436c-80b7-2547e65cf8e6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.268683 Jul 26 04:36:08.823733 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1149/2399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:08 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:09.468256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:09.469631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:09.477740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:09.478437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:09.479559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:09.480292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:09.844301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:09.844948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:09.857824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:09.859843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:09.866877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:09.868881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:09.948232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:09.968749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:09.990672 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d72fe2e-3c29-44de-bda7-762edb929da4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 200 len: 1484 microversion: 2.1 time: 0.518789 Jul 26 04:36:09.998405 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1251/2400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:09 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 1484 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:10.019367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4766b267-5dab-4b72-8435-2b90ce7b5442 req-b8c19b62-c2b5-4746-8e51-7e87646ff27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d6d4e5-05d3-4626-9b14-31e236450316", "name": "network-vif-deleted", "tag": "c3e2ecce-7f77-4420-af33-df0e85e75b1a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:10.081943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4766b267-5dab-4b72-8435-2b90ce7b5442 req-b8c19b62-c2b5-4746-8e51-7e87646ff27f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:10.082555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4766b267-5dab-4b72-8435-2b90ce7b5442 req-b8c19b62-c2b5-4746-8e51-7e87646ff27f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:10.170624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4766b267-5dab-4b72-8435-2b90ce7b5442 req-b8c19b62-c2b5-4746-8e51-7e87646ff27f service nova] Creating event network-vif-deleted:c3e2ecce-7f77-4420-af33-df0e85e75b1a for instance 45d6d4e5-05d3-4626-9b14-31e236450316 on n-h1-848886-16 Jul 26 04:36:10.177329 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4766b267-5dab-4b72-8435-2b90ce7b5442 req-b8c19b62-c2b5-4746-8e51-7e87646ff27f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177367 Jul 26 04:36:10.178183 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1252/2401] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:10.358107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:10.368552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a663d4d8-c3f7-4773-8f63-d6490f8a59b8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1313 microversion: 2.1 time: 0.528038 Jul 26 04:36:10.381974 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1150/2402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:09 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:11.024952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:11.028982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:11.052643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.053294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.054914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.055488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.093609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 HTTP/1.1 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316'} Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:11.095477 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:36:11.100003 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:11.112834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:11.115174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d02644d6-fe6a-43dd-a25d-f83d59422a32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 404 len: 111 microversion: 2.1 time: 0.096008 Jul 26 04:36:11.116298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1253/2403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:11 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:11.133556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9224a62-e77e-45e3-9998-6c72fb875b84 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'create', calling method: .version_select at 0x7f38b638edc0>, body: {"keypair": {"name": "tempest-keypair-198224278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMA6EQy9RPzjJCy4nF6N4jINl5XOcZa0LJuETvW2L3xwXQrOK1ujrz8kYI2Vn1RzBQcTn31FhgB6GHSEQ2kcfpdJpgAKKYwgXL1tmQsnKE3Zi1B6ZpJVZN4mWjfX6zN3Q=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:11.182356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a9224a62-e77e-45e3-9998-6c72fb875b84 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for project 27b358735df742409a285172544cc056. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:11.192374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a9224a62-e77e-45e3-9998-6c72fb875b84 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for user 06dd8c749d2f4662a54a04f77ebf20cb and project 27b358735df742409a285172544cc056. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:11.243659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:11.282659 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9224a62-e77e-45e3-9998-6c72fb875b84 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157271 Jul 26 04:36:11.283561 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1151/2404] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:36:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:11.390413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:11.391362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:11.398775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.399470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.400465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.401144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.582532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:11.583163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:11.601346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.601812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.606492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:11.607348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:11.956708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:11.971191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-284f9bed-9643-4524-930e-8340f11cab4a tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1590 microversion: 2.1 time: 0.391172 Jul 26 04:36:11.973178 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1152/2405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:11 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1590 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:11.990465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d83623aa-b843-4f94-969d-a85361da8755 req-24dc3c5c-c0a9-4644-ac28-23c2f630b380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6410eed-6433-4a63-8e36-bc44ea43c87d", "tag": "beece54d-d442-426a-809e-af3a98d3782a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:12.004906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d83623aa-b843-4f94-969d-a85361da8755 req-24dc3c5c-c0a9-4644-ac28-23c2f630b380 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:12.007886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d83623aa-b843-4f94-969d-a85361da8755 req-24dc3c5c-c0a9-4644-ac28-23c2f630b380 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:12.041838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d83623aa-b843-4f94-969d-a85361da8755 req-24dc3c5c-c0a9-4644-ac28-23c2f630b380 service nova] Creating event network-changed:beece54d-d442-426a-809e-af3a98d3782a for instance f6410eed-6433-4a63-8e36-bc44ea43c87d on n-h1-848886-16 Jul 26 04:36:12.057103 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d83623aa-b843-4f94-969d-a85361da8755 req-24dc3c5c-c0a9-4644-ac28-23c2f630b380 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079861 Jul 26 04:36:12.058460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1153/2406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:12.468038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2dd84abd-b798-47e8-9ffc-0309bd33dbc5 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38bab38040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-791068712", "description": "tempest-description-201250192"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:12.780516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:12.793158 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c85bb79b-dc78-4852-b818-c8acc96376a2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1498 microversion: 2.1 time: 1.407337 Jul 26 04:36:12.804615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1254/2407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:11 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1498 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:12.818859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:12.821699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:12.829391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:12.831272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:12.832759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:12.833605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:12.872170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lazy-loading 'flavor' on Instance uuid 566ad57d-f13d-4aa4-96c9-6d813121e2d3 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:36:13.058464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75b40e78-219c-40a8-9ba8-18261e82ee1b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "POST /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3/action" status: 200 len: 32 microversion: 2.1 time: 0.245207 Jul 26 04:36:13.060925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1255/2408] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:12 2022] POST /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:36:13.075285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:13.076288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:13.086507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:13.087748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:13.089298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:13.090027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:13.409622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2dd84abd-b798-47e8-9ffc-0309bd33dbc5 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.169477 Jul 26 04:36:13.410265 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1154/2409] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:36:12 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:13.425353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e15ab84-b7a0-4103-814b-ecdc36b4073b tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b608f3a0>, body: {"security_group_rule": {"parent_group_id": "770cdca4-f3b8-4435-bd25-6d394467f875", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:13.996233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:14.026022 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bd14ab2b-95c0-410f-a6e8-1da6356ed951 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.956680 Jul 26 04:36:14.044687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1256/2410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:13 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:15.052495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:15.053316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:15.073249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:15.073822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:15.074764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:15.075354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:15.248089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e15ab84-b7a0-4103-814b-ecdc36b4073b tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.828888 Jul 26 04:36:15.249090 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1155/2411] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:15.263504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da33f085-27c2-46e4-87b7-5c629ed55fbf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b5a42ee0>, body: {"security_group_rule": {"parent_group_id": "770cdca4-f3b8-4435-bd25-6d394467f875", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:15.499428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-da33f085-27c2-46e4-87b7-5c629ed55fbf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da33f085-27c2-46e4-87b7-5c629ed55fbf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 138 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: {"security_group_rule": {"parent_group_id": "770cdca4-f3b8-4435-bd25-6d394467f875", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: exception: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'security_group_rule': {'parent_group_id': '770cdca4-f3b8-4435-bd25-6d394467f875', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:15.504274 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:15.508405 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:15.508405 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:15.508405 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 Jul 26 04:36:15.508405 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:15.512970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da33f085-27c2-46e4-87b7-5c629ed55fbf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: This rule already exists in group 770cdca4-f3b8-4435-bd25-6d394467f875 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:15.515634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da33f085-27c2-46e4-87b7-5c629ed55fbf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.258543 Jul 26 04:36:15.516444 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1156/2412] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:15 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:36:15.525768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d172d88-62f4-4919-ad3f-a99d04880194 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38b654db80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:15.791499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:15.802377 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7054ad09-a8e4-4412-a781-23b3d078e64e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.754663 Jul 26 04:36:15.803623 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1257/2413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:15 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:16.282345 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d172d88-62f4-4919-ad3f-a99d04880194 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/cb5a850c-18dc-450c-85b1-e128b1a50b33" status: 202 len: 0 microversion: 2.1 time: 0.760810 Jul 26 04:36:16.285299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1157/2414] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Jul 26 04:36:15 2022] DELETE /compute/v2.1/os-security-group-rules/cb5a850c-18dc-450c-85b1-e128b1a50b33 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:36:16.297947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b62782b-f6f7-413c-afd1-6e43b11ac01c tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b5851a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-958530709", "description": "tempest-description-58012821"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:16.826889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:16.828454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:16.845116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:16.846350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:16.847654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:16.848356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:17.037510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b62782b-f6f7-413c-afd1-6e43b11ac01c tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.745603 Jul 26 04:36:17.038377 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1258/2415] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:36:16 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:17.055883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f3a40da-ea80-4375-a0fb-ab70bc34ce39 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b59af4c0>, body: {"security_group_rule": {"parent_group_id": "7c8225c8-1c0c-471d-a99c-ad2f96f0f92a", "ip_protocol": "tcp", "from_port": 1003048345, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:17.346063 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3f3a40da-ea80-4375-a0fb-ab70bc34ce39 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Invalid port range 1003048345:22. Former value cannot be greater than the later Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f3a40da-ea80-4375-a0fb-ab70bc34ce39 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 146 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "7c8225c8-1c0c-471d-a99c-ad2f96f0f92a", "ip_protocol": "tcp", "from_port": 1003048345, "to_port": 22}} Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid port range 1003048345:22. Former value cannot be greater than the later Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7c8225c8-1c0c-471d-a99c-ad2f96f0f92a', 'ip_protocol': 'tcp', 'from_port': 1003048345, 'to_port': 22}}} Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1003048345:22. Former value cannot be greater than the later Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1003048345:22. Former value cannot be greater than the later Jul 26 04:36:17.354599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1003048345:22. Former value cannot be greater than the later Jul 26 04:36:17.359261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.362030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f3a40da-ea80-4375-a0fb-ab70bc34ce39 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: Invalid port range 1003048345:22. Former value cannot be greater than the later {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:17.364570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f3a40da-ea80-4375-a0fb-ab70bc34ce39 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.316200 Jul 26 04:36:17.366407 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1259/2416] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:17 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:36:17.398576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50f97d6a-2ac4-4d01-89a2-2053710e3406 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b6377820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1273523239", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:17.411895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-50f97d6a-2ac4-4d01-89a2-2053710e3406 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Security group id should be uuid Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50f97d6a-2ac4-4d01-89a2-2053710e3406 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 131 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1273523239", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group id should be uuid Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1273523239', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:17.423303 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:17.427901 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 26 04:36:17.427901 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:17.429852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50f97d6a-2ac4-4d01-89a2-2053710e3406 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: Security group id should be uuid {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:17.435231 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50f97d6a-2ac4-4d01-89a2-2053710e3406 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.061773 Jul 26 04:36:17.437003 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1260/2417] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:17 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:36:17.453169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aaa822b8-2b5b-4292-8696-dce47047f105 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b57f71f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-797332483", "description": "tempest-description-885101685"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:17.513408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:17.528418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3cec0a56-4d90-48b1-90f5-cce577c3760b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.708912 Jul 26 04:36:17.533617 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1158/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:16 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:17.565601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-582444405", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:17.674936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] validate_networks() for [('4074a51c-d75d-4437-b489-0a22ca553d3f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:18.342054 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aaa822b8-2b5b-4292-8696-dce47047f105 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.897425 Jul 26 04:36:18.344586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1261/2419] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:36:17 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:18.358863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a27d6d6-9884-4c7f-9d8e-c91a8e8a9636 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b893af70>, body: {"security_group_rule": {"parent_group_id": "12c0adda-a378-430d-9c12-b483164877f9", "ip_protocol": "tempest-999-1091910547", "from_port": 22, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:18.673363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8a27d6d6-9884-4c7f-9d8e-c91a8e8a9636 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Invalid IP protocol tempest-999-1091910547. Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a27d6d6-9884-4c7f-9d8e-c91a8e8a9636 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 157 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "12c0adda-a378-430d-9c12-b483164877f9", "ip_protocol": "tempest-999-1091910547", "from_port": 22, "to_port": 22}} Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid IP protocol tempest-999-1091910547. Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': '12c0adda-a378-430d-9c12-b483164877f9', 'ip_protocol': 'tempest-999-1091910547', 'from_port': 22, 'to_port': 22}}} Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1091910547. Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1091910547. Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:18.675735 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1091910547. Jul 26 04:36:18.679721 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:18.690289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a27d6d6-9884-4c7f-9d8e-c91a8e8a9636 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: Invalid IP protocol tempest-999-1091910547. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:18.692181 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a27d6d6-9884-4c7f-9d8e-c91a8e8a9636 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.338789 Jul 26 04:36:18.693568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1262/2420] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:18 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:36:18.709336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:18.711070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:18.734043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:18.735325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:18.739624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:18.741022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:19.296290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:19.316102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81a17dd8-b7a6-46f9-a1b0-51323dae4663 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.620362 Jul 26 04:36:19.317347 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1263/2421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:18 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:19.323490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d45762c-0260-4836-b560-54d7928423ef tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b5eca670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2096997621", "description": "tempest-description-258092573"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:19.382985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:36:19.384046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:36:19.384670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:36:19.385284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:36:19.385894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:36:19.404436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:19.405131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:19.406120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:19.406803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:19.445349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:19.458139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for user 06dd8c749d2f4662a54a04f77ebf20cb and project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:19.494476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:36:19.499925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:36:19.594183 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-25d6833b-eecb-4b6b-9eb9-6221eefaa706 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.033168 Jul 26 04:36:19.596188 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1159/2422] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:36:19.625775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d16a71dd-d513-4464-b93f-77e22eebf9e2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:19.626571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d16a71dd-d513-4464-b93f-77e22eebf9e2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:19.903275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d16a71dd-d513-4464-b93f-77e22eebf9e2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:19.914942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d16a71dd-d513-4464-b93f-77e22eebf9e2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1224 microversion: 2.1 time: 0.305235 Jul 26 04:36:19.917758 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1160/2423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:19 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1224 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:20.346883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:20.348152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:20.361298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:20.362199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:20.363760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:20.364390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:20.371290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:20.509570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d45762c-0260-4836-b560-54d7928423ef tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.190550 Jul 26 04:36:20.510707 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1264/2424] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:36:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:20.524503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70f85a1f-6c17-43d7-bbbc-3d162f0ab6d6 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b5a47700>, body: {"security_group_rule": {"parent_group_id": "4ba318f7-e556-469d-a154-c088325dc854", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:21.105160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-70f85a1f-6c17-43d7-bbbc-3d162f0ab6d6 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70f85a1f-6c17-43d7-bbbc-3d162f0ab6d6 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 138 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "4ba318f7-e556-469d-a154-c088325dc854", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ba318f7-e556-469d-a154-c088325dc854', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 04:36:21.107442 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 04:36:21.110657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:21.116751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-70f85a1f-6c17-43d7-bbbc-3d162f0ab6d6 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:21.118029 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-70f85a1f-6c17-43d7-bbbc-3d162f0ab6d6 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.598521 Jul 26 04:36:21.119445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1265/2425] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:20 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 600 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:36:21.135871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:21.136660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:21.151241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:21.152028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:21.153041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:21.153625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:21.306434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:21.329346 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d635846-d663-450f-870a-68d646baf23b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.992023 Jul 26 04:36:21.334773 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1161/2426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:20 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:21.358346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f7cfda6-e4f8-4271-b427-43b6aa9b3248 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38bad5d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-429596093", "description": "tempest-description-921531135"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:21.531565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:21.545148 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a8b5218-2361-4a6e-b9bc-d8e93570f61d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1276 microversion: 2.1 time: 0.424265 Jul 26 04:36:21.550446 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1266/2427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:21 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1276 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:21.791049 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f7cfda6-e4f8-4271-b427-43b6aa9b3248 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.453782 Jul 26 04:36:21.792067 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1162/2428] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:36:21 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:21.806105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73c772bb-8f8e-4d42-9bf4-67bc9312b559 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b8266940>, body: {"security_group_rule": {"parent_group_id": "581061e4-dedc-4242-8d3f-6a9a546071e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 590760702}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:22.003422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2054106904", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:22.072109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] validate_networks() for [('2bb5e808-d793-40d4-b818-b8f206b33bc2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:22.171090 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-73c772bb-8f8e-4d42-9bf4-67bc9312b559 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73c772bb-8f8e-4d42-9bf4-67bc9312b559 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 145 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "581061e4-dedc-4242-8d3f-6a9a546071e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 590760702}} Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': '581061e4-dedc-4242-8d3f-6a9a546071e2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 590760702}}} Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 Jul 26 04:36:22.172756 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.178406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73c772bb-8f8e-4d42-9bf4-67bc9312b559 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 400 to user: Invalid port range 22:590760702. Valid TCP ports should be between 1-65535 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:22.180646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73c772bb-8f8e-4d42-9bf4-67bc9312b559 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.378388 Jul 26 04:36:22.181409 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1267/2429] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:21 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:36:22.201322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Action: 'create', calling method: .version_select at 0x7f38b59afc10>, body: {"security_group_rule": {"parent_group_id": "e43ef6cf-4e76-411d-9d55-826f6ac76b84", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:22.266198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:36:22.266636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Neutron security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:36:22.267823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.267823 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 138 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: {"security_group_rule": {"parent_group_id": "e43ef6cf-4e76-411d-9d55-826f6ac76b84", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e43ef6cf-4e76-411d-9d55-826f6ac76b84', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:36:22.270785 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 404 to user: Security group e43ef6cf-4e76-411d-9d55-826f6ac76b84 does not exist Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-66b3dc2d-517b-4ad4-b2ea-2490f4fb73b4'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:22.274146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b06ddb18-19d7-4562-b5c1-e3d003c15bcf tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.083444 Jul 26 04:36:22.280897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1268/2430] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Jul 26 04:36:22 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:22.286067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38b592c670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:22.420634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:36:22.421851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Neutron security group rule e6693302-f69f-443f-838d-01b714e4e0b5 not found {{(pid=119488) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 26 04:36:22.421851 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] HTTP exception thrown: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.421851 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Request method failure captured: Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-security-group-rules/e6693302-f69f-443f-838d-01b714e4e0b5 HTTP/1.1 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3288OWPB7GbL6EmznMfAVY6gRjhMejSkf42fY0CqQxygwhuYn5y4lOqs36ksLcDG7SNjW4n6TTVWrJHHp_-WTuikUahOxSGzFCaFBcSjtwG62FPk7N_L8NJGoa4KjEe41vLsMZRPWPYmySOSR-Ul9SnyzZCKUfKnsEyFRWW31FM_A84 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ab6a0ba87904f4995fa24e49e565042"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5ab6a0ba87904f4995fa24e49e565042 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 67089b2cdce041c5b472141e258eab1b Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'e6693302-f69f-443f-838d-01b714e4e0b5'} Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:36:22.425041 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Returning 404 to user: Security group rule e6693302-f69f-443f-838d-01b714e4e0b5 does not exist Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-c053e0b5-5315-4141-9133-cfd9ef14759d'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f579010c-93ed-4119-859e-dfa06a6676f9 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/e6693302-f69f-443f-838d-01b714e4e0b5" status: 404 len: 199 microversion: 2.1 time: 0.147540 Jul 26 04:36:22.428727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1269/2431] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Jul 26 04:36:22 2022] DELETE /compute/v2.1/os-security-group-rules/e6693302-f69f-443f-838d-01b714e4e0b5 => generated 199 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:22.445232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:22.446201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:22.474090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.474669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:22.475727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.476320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:22.644577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:36:22.645242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:36:22.645437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:36:22.646189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:36:22.646843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:36:22.658560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.659283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:22.660093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.660710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:22.681055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:22.691817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for user 338a0f0319d34f9f955e930ef03f3bdf and project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:22.706788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:36:22.708954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:36:22.759258 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffc7fb0d-70cf-4013-acf1-61ee6dc0d742 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.826185 Jul 26 04:36:22.760547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1163/2432] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:36:22.765590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a782c5c-f6e9-4579-961c-e34a75ca641e tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38b60745e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:22.855545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:22.891304 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a326c536-01b2-4a84-8703-8bd9aa595e9b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.459131 Jul 26 04:36:22.894477 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1270/2433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:22 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:22.912351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:22.915743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:22.944537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.945111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:22.951465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:22.953595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:23.118910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a782c5c-f6e9-4579-961c-e34a75ca641e tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/581061e4-dedc-4242-8d3f-6a9a546071e2" status: 202 len: 0 microversion: 2.1 time: 0.357080 Jul 26 04:36:23.120094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1164/2434] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:36:22 2022] DELETE /compute/v2.1/os-security-groups/581061e4-dedc-4242-8d3f-6a9a546071e2 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:23.126831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20a93650-8858-4534-822a-8edbd2fcbdd2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:23.127562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20a93650-8858-4534-822a-8edbd2fcbdd2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:23.133368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:23.156891 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1fefd3af-79a4-42cc-b6a1-0bc71a3df491 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1282 microversion: 2.1 time: 0.260889 Jul 26 04:36:23.157979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1271/2435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:22 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:23.180860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d39ea13f-bc34-4be8-bf54-773b63104d26 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38bab28670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:23.268831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20a93650-8858-4534-822a-8edbd2fcbdd2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:23.276155 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20a93650-8858-4534-822a-8edbd2fcbdd2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1222 microversion: 2.1 time: 0.154847 Jul 26 04:36:23.277062 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1165/2436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:23 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:23.349875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-629175822", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:23.429594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] validate_networks() for [('2bb5e808-d793-40d4-b818-b8f206b33bc2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:24.118906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d39ea13f-bc34-4be8-bf54-773b63104d26 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4ba318f7-e556-469d-a154-c088325dc854" status: 202 len: 0 microversion: 2.1 time: 0.958996 Jul 26 04:36:24.120350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1272/2437] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:36:23 2022] DELETE /compute/v2.1/os-security-groups/4ba318f7-e556-469d-a154-c088325dc854 => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:24.125131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:24.125910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:24.137399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.142787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:24.143644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.145648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:24.176403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:36:24.178558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:36:24.179217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:36:24.179821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:36:24.180400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:36:24.196229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.196935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:24.198268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.201371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:24.286684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:24.308880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for user 338a0f0319d34f9f955e930ef03f3bdf and project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:24.330060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:36:24.334887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:36:24.425751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d044b64-463d-4c86-a2bd-42419f0587ca tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.082887 Jul 26 04:36:24.427060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1166/2438] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:36:24.450951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8459e095-944a-44b2-acb8-71c09c0fb670 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38bad5d9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:24.583530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:24.595225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-376b2eab-75ac-4289-92de-22e9f4efb131 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.473630 Jul 26 04:36:24.599039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1273/2439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:24 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:24.620262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:24.621717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:24.630043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.630942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:24.634167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:24.634167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:25.163961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:25.175818 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ef78e41-5b97-44d3-9979-f5616e734dd9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.561710 Jul 26 04:36:25.204834 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1274/2440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:24 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:25.210190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-892b7cee-ce87-4115-b91d-9cdca37651a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:25.210887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-892b7cee-ce87-4115-b91d-9cdca37651a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:25.340059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8459e095-944a-44b2-acb8-71c09c0fb670 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/12c0adda-a378-430d-9c12-b483164877f9" status: 202 len: 0 microversion: 2.1 time: 0.911585 Jul 26 04:36:25.342247 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1167/2441] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:36:24 2022] DELETE /compute/v2.1/os-security-groups/12c0adda-a378-430d-9c12-b483164877f9 => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:25.350940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffc5f3b9-f0c6-4ffb-b01d-5343586be721 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38b61d2280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:25.411222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-892b7cee-ce87-4115-b91d-9cdca37651a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:25.424520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-892b7cee-ce87-4115-b91d-9cdca37651a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1221 microversion: 2.1 time: 0.212474 Jul 26 04:36:25.439352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1275/2442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:25 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:25.628056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:25.628747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:25.654957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:25.656047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:25.657107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:25.658358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:26.279468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffc5f3b9-f0c6-4ffb-b01d-5343586be721 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/7c8225c8-1c0c-471d-a99c-ad2f96f0f92a" status: 202 len: 0 microversion: 2.1 time: 0.932432 Jul 26 04:36:26.281302 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1168/2443] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:36:25 2022] DELETE /compute/v2.1/os-security-groups/7c8225c8-1c0c-471d-a99c-ad2f96f0f92a => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:26.286426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:26.287199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:26.300761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:26.302730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:26.306751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:26.307360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:26.436099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:26.451303 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0384b38e-a007-48a0-b3d8-006c57f99e9c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.835124 Jul 26 04:36:26.462964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1276/2444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:25 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:26.478490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7c988b9-0c21-42ad-ab5b-c42549cd4970 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] Calling method '.version_select at 0x7f38b51ae670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:26.691221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:26.702235 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8dad67e0-f241-4a7b-ba28-086eea49e965 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.418791 Jul 26 04:36:26.703819 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1169/2445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:26 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:26.713395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:26.714353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:26.724356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:26.725795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:26.727190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:26.728425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:26.847751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:26.863565 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-599f59ee-e9c2-4622-a103-ca876d0195f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1279 microversion: 2.1 time: 0.154071 Jul 26 04:36:26.865715 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1170/2446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:26 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:27.169979 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7c988b9-0c21-42ad-ab5b-c42549cd4970 tempest-SecurityGroupRulesNegativeTestJSON-1697279494 tempest-SecurityGroupRulesNegativeTestJSON-1697279494-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/770cdca4-f3b8-4435-bd25-6d394467f875" status: 202 len: 0 microversion: 2.1 time: 0.700963 Jul 26 04:36:27.172770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1277/2447] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:36:26 2022] DELETE /compute/v2.1/os-security-groups/770cdca4-f3b8-4435-bd25-6d394467f875 => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:27.410310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2b4f231e-9bc7-49c9-a909-9518839e51dc req-beb7abc2-14ad-4426-b074-bb6d66a3ff39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5bb002-9b50-4e69-a2e1-1cd7cb082161", "tag": "19331205-ec56-45c8-9fcd-77b84b74f493"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:27.435324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2b4f231e-9bc7-49c9-a909-9518839e51dc req-beb7abc2-14ad-4426-b074-bb6d66a3ff39 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:27.435773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2b4f231e-9bc7-49c9-a909-9518839e51dc req-beb7abc2-14ad-4426-b074-bb6d66a3ff39 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:27.462849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2b4f231e-9bc7-49c9-a909-9518839e51dc req-beb7abc2-14ad-4426-b074-bb6d66a3ff39 service nova] Creating event network-changed:19331205-ec56-45c8-9fcd-77b84b74f493 for instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 on n-h2-848886-16 Jul 26 04:36:27.484936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:27.486355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:27.492422 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2b4f231e-9bc7-49c9-a909-9518839e51dc req-beb7abc2-14ad-4426-b074-bb6d66a3ff39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086519 Jul 26 04:36:27.504827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1171/2448] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:27.507300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:27.507696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:27.508622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:27.508959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:27.729815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:27.731058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:27.754427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:27.760431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:27.761341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:27.761787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:28.061187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:28.091838 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39113e70-885a-4662-ba25-20f516dfd77f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.612521 Jul 26 04:36:28.095219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1278/2449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:27 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:28.134798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:28.135683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:28.156703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:28.157236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:28.169343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:28.170277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:28.459063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:28.463497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:28.473552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d9fd9252-77bf-45aa-8a93-bcac851efc92 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1279 microversion: 2.1 time: 0.357704 Jul 26 04:36:28.485739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c643ef62-a523-4818-85c0-b229304b92eb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.748798 Jul 26 04:36:28.486163 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1279/2450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:28 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:28.498939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1172/2451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:27 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:29.121078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:29.122098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:29.135036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.135774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.136735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.138060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.469863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:29.477319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:29.488928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28ac0e41-e730-4f4d-b0fc-44034b541136 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.372167 Jul 26 04:36:29.510391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:29.511034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:29.511540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1280/2452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:29 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:29.522862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.524207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.531888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.533010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.535610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:29.537209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:29.558556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.559201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.560142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:29.560968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:29.836288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:29.847103 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-195f6f33-e83f-44b0-9788-2df3afafba47 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.319122 Jul 26 04:36:29.848214 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1281/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:29 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:30.050006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:30.058780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2769e441-baf9-4cee-ba96-7f79b71c0e60 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.553118 Jul 26 04:36:30.060275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1173/2454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:29 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:30.113779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:30.134254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:30.139600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Searching by: {'deleted': False, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:36:30.148548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.149010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.149904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.150519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.210002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:36:30.345602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-91125450-7680-431a-80ac-4aef1c09f22f tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.237356 Jul 26 04:36:30.347827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1282/2455] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:36:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:30.376138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:30.384734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:30.388224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Searching by: {'deleted': False, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:36:30.398907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.399596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.400862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.401476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.445707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:36:30.518455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:30.519612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:30.534743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.538531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.539642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.545917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.561455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:30.579412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.580594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.924966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9dd1d6bb-f08a-4067-ab96-44492bed2a8c tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.568354 Jul 26 04:36:30.930733 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1174/2456] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:36:30 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:30.943433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-89619025-1cb9-452c-bcb2-92cae4382505 req-834b846d-8a84-4f07-8384-18717ae00f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6", "tag": "a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:30.956545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-89619025-1cb9-452c-bcb2-92cae4382505 req-834b846d-8a84-4f07-8384-18717ae00f02 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.956938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-89619025-1cb9-452c-bcb2-92cae4382505 req-834b846d-8a84-4f07-8384-18717ae00f02 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.977231 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-89619025-1cb9-452c-bcb2-92cae4382505 req-834b846d-8a84-4f07-8384-18717ae00f02 service nova] Creating event network-changed:a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35 for instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 on n-h1-848886-16 Jul 26 04:36:30.982615 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-89619025-1cb9-452c-bcb2-92cae4382505 req-834b846d-8a84-4f07-8384-18717ae00f02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050213 Jul 26 04:36:30.983549 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1175/2457] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:30.989655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:30.990747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:30.997608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.998328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:30.999118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:30.999721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.279853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:31.290948 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-065d3cdb-73b9-4d4c-8bb2-41199125de65 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.777709 Jul 26 04:36:31.304887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1283/2458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:30 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:31.312892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2248d682-9fa4-469a-bbdf-4f0e742eb96b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:31.329328 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2248d682-9fa4-469a-bbdf-4f0e742eb96b tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023097 Jul 26 04:36:31.330252 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1284/2459] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:36:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:31.338094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:31.338948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:31.348049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.348910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.349850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.350653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.360808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:31.371974 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f80cd7eb-fc56-432c-b44b-f65c0a6854f1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.386792 Jul 26 04:36:31.373128 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1176/2460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:30 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:31.687422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:31.688137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:31.695480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.696316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.697440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.697886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.730921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:36:31.843731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51f84776-9722-445f-bc72-8bbcf471c718 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 204 len: 0 microversion: 2.1 time: 0.160501 Jul 26 04:36:31.849694 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1177/2461] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:36:31 2022] DELETE /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:36:31.856617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:31.857793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:31.866544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.867424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:31.868706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:31.869318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:32.019728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:32.031417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4110ab73-1df4-49e2-9a1f-0fcf45c8ca6c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.699797 Jul 26 04:36:32.040817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:32.041828 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1285/2462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:31 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:32.053189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32753088-c9c2-4ccc-9432-957a8b67ddb7 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1607 microversion: 2.1 time: 0.201646 Jul 26 04:36:32.054814 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1178/2463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:31 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1607 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:32.317425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:32.318037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:32.325441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:32.326084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:32.327059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:32.327655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:32.396143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:32.396766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:32.402947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:32.403452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:32.404185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:32.404921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:32.658632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:32.674293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bd40b0f-14de-440e-a605-aad83639bd27 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.361155 Jul 26 04:36:32.687811 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1286/2464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:32 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:33.009974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:33.021740 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95d903f7-3293-4387-a5a4-c919a7a5f3d4 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.629951 Jul 26 04:36:33.027599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1179/2465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:32 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:33.066140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:33.066984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:33.078450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:33.079332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:33.079591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.081220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.084029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.084912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.095161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.095836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.096746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.097122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.715954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:33.749033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b2da6cc-419e-407a-83c5-a0e763b2a9f7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.686297 Jul 26 04:36:33.749684 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1287/2466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:33 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:33.770147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b3929749-736c-4c2e-8247-c27bd555fd24 req-25da3390-9b3e-4f56-95ef-72a96d3bb67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae1e975-620a-4b90-ac0a-39e6ca7c185e", "tag": "384606ae-4f32-48f9-817b-5d1e652be3bc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:33.790540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b3929749-736c-4c2e-8247-c27bd555fd24 req-25da3390-9b3e-4f56-95ef-72a96d3bb67d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.790994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b3929749-736c-4c2e-8247-c27bd555fd24 req-25da3390-9b3e-4f56-95ef-72a96d3bb67d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.858092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b3929749-736c-4c2e-8247-c27bd555fd24 req-25da3390-9b3e-4f56-95ef-72a96d3bb67d service nova] Creating event network-changed:384606ae-4f32-48f9-817b-5d1e652be3bc for instance eae1e975-620a-4b90-ac0a-39e6ca7c185e on n-h2-848886-16 Jul 26 04:36:33.867581 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b3929749-736c-4c2e-8247-c27bd555fd24 req-25da3390-9b3e-4f56-95ef-72a96d3bb67d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109423 Jul 26 04:36:33.875057 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1288/2467] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:33.890939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:33.892355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:33.901008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.902825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:33.904021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:33.904698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:34.030786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:34.048541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7eb42504-e5af-495c-a8db-f9635211e860 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1607 microversion: 2.1 time: 0.972011 Jul 26 04:36:34.064920 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1180/2468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:33 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1607 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:34.076206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:34.077404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:34.084223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:34.093550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:34.094416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:34.095825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:34.096499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:34.424868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:34.433046 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8fc923a-107c-44bb-9227-799079d3a39b tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.556529 Jul 26 04:36:34.447887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1289/2469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:33 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:34.487008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:34.510896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d26ae300-2aeb-4987-87be-fb1315e1ddcb tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.443701 Jul 26 04:36:34.512882 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1181/2470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:34 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:34.676782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a321bb8-0d08-4d5f-9b29-5738ee038975 tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] Calling method '.version_select at 0x7f38b5936790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:34.677703 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:36:34.677703 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:36:34.702446 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a321bb8-0d08-4d5f-9b29-5738ee038975 tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.248798 Jul 26 04:36:34.703480 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1290/2471] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:36:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:34.718457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8c469ae-e1e1-4907-9559-0ce3789cf264 tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5bb13a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:34.744775 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:36:34.744775 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:36:34.771000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:34.771628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:34.780072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:34.780540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:34.781341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:34.782347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.140277 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8c469ae-e1e1-4907-9559-0ce3789cf264 tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.428892 Jul 26 04:36:35.141222 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1182/2472] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Jul 26 04:36:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:35.146268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:35.147470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:35.154026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.154531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.155297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.155730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.300354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:35.308323 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-024e032a-bc81-4e30-a0a3-3fb70e0e8f81 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.542088 Jul 26 04:36:35.323200 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1291/2473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:34 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:35.329597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e4a1acd-12e9-4556-9dd6-521ce82ac0ed tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] Calling method '.version_select at 0x7f38b6189430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:35.330678 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:36:35.330678 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:36:35.342662 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e4a1acd-12e9-4556-9dd6-521ce82ac0ed tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018038 Jul 26 04:36:35.343833 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1292/2474] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 04:36:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:35.356454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fcc9a57-eb31-4d3f-8910-7e884c0f70db tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] Action: 'update', calling method: .version_select at 0x7f38b63750d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:35.360721 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:36:35.360721 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:36:35.503885 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fcc9a57-eb31-4d3f-8910-7e884c0f70db tempest-QuotaClassesAdminTestJSON-1112893071 tempest-QuotaClassesAdminTestJSON-1112893071-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.151399 Jul 26 04:36:35.510341 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1293/2475] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Jul 26 04:36:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:35.510341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:35.510526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:35.517697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.518297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.519385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.520034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.535918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:35.546730 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-592131ca-121b-406d-a15c-c56c8a7fb692 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1607 microversion: 2.1 time: 0.404382 Jul 26 04:36:35.547389 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1183/2476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:35 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1607 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:35.556736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:35.557352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:35.570734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.571309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.572200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:35.572747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:35.579803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:36.145567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:36.160816 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11df7c47-4a89-4ea2-bc79-b1bd5d892d41 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.612017 Jul 26 04:36:36.164432 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1184/2477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:35 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:36.179748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9fd8f0b6-f0ce-42d3-872d-1ff3d2cdb83e req-74e755b4-a782-4f76-83df-85ff4716951c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5bb002-9b50-4e69-a2e1-1cd7cb082161", "name": "network-vif-plugged", "status": "completed", "tag": "19331205-ec56-45c8-9fcd-77b84b74f493"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:36.210511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:36.224127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9fd8f0b6-f0ce-42d3-872d-1ff3d2cdb83e req-74e755b4-a782-4f76-83df-85ff4716951c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:36.224703 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b27f6388-af74-4436-8c08-0763ab779dd0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1504 microversion: 2.1 time: 0.715523 Jul 26 04:36:36.226586 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1294/2478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:35 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:36.229613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9fd8f0b6-f0ce-42d3-872d-1ff3d2cdb83e req-74e755b4-a782-4f76-83df-85ff4716951c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:36.264213 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9fd8f0b6-f0ce-42d3-872d-1ff3d2cdb83e req-74e755b4-a782-4f76-83df-85ff4716951c service nova] Creating event network-vif-plugged:19331205-ec56-45c8-9fcd-77b84b74f493 for instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 on n-h2-848886-16 Jul 26 04:36:36.271626 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9fd8f0b6-f0ce-42d3-872d-1ff3d2cdb83e req-74e755b4-a782-4f76-83df-85ff4716951c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105893 Jul 26 04:36:36.272579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1185/2479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:36.335917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:36.337305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:36.351692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:36.355144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:36.360531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:36.361285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:36.579038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:36.580288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:36.588465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:36.589235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:36.590312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:36.591007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:36.798913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:36.809157 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2787a49d-62db-4172-9596-adaa7e9a7003 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1540 microversion: 2.1 time: 0.240721 Jul 26 04:36:36.822920 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1186/2480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:36 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1540 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:36.989358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9d0a929f-7c30-453b-b220-5411fe42df7d req-71f306d6-caa0-4569-a0f9-0cb1f1423df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7553b65-8f16-4489-b77f-3f1120a3c9da", "name": "network-vif-deleted", "tag": "777b8730-49f4-4ce7-8a91-78f3bdc8daa4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:36.994192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:37.016281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9d0a929f-7c30-453b-b220-5411fe42df7d req-71f306d6-caa0-4569-a0f9-0cb1f1423df7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.016691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9d0a929f-7c30-453b-b220-5411fe42df7d req-71f306d6-caa0-4569-a0f9-0cb1f1423df7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.043292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a07e23bf-ede3-4f35-aa89-f2699915e7b5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.711465 Jul 26 04:36:37.046888 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1295/2481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:36 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:37.053497 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9d0a929f-7c30-453b-b220-5411fe42df7d req-71f306d6-caa0-4569-a0f9-0cb1f1423df7 service nova] Creating event network-vif-deleted:777b8730-49f4-4ce7-8a91-78f3bdc8daa4 for instance e7553b65-8f16-4489-b77f-3f1120a3c9da on n-h2-848886-16 Jul 26 04:36:37.063206 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9d0a929f-7c30-453b-b220-5411fe42df7d req-71f306d6-caa0-4569-a0f9-0cb1f1423df7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078929 Jul 26 04:36:37.063826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1187/2482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:37.185892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:37.186744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:37.199058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.200314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.201686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.204108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.250193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:37.251588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:37.260914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.264763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.265594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.266083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.461534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:37.471332 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2882d6de-2dd8-4354-8c11-c3676736b924 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1484 microversion: 2.1 time: 0.225570 Jul 26 04:36:37.490189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1188/2483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:37 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1484 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:37.627453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:37.639160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a9be235-8311-4893-afcb-cc73f7faf279 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1324 microversion: 2.1 time: 0.457811 Jul 26 04:36:37.639715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1618943472", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:37.648346 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1296/2484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:37 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:37.778677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] validate_networks() for [('a75a427f-663c-4626-8831-f7eac0ebbcc7', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:37.832955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:37.833900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:37.836638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:37.848889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.849685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:37.851410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:37.853221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.099727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:38.113684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05c19048-f2c7-426c-8717-10b4357b4502 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1252 microversion: 2.1 time: 0.284057 Jul 26 04:36:38.118809 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1297/2485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:37 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1252 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:38.125922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:38.126861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:38.142493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.143155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.144208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.144833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.620429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:36:38.620941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:36:38.621533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:36:38.622049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:36:38.622627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:36:38.642527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.642987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.647148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.648095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.675774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Getting quotas for project 6c78e1a85b9342b394b5528fcd158a04. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:38.682065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Getting quotas for user 6745e2a70916439cb278be0fc606d295 and project 6c78e1a85b9342b394b5528fcd158a04. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:38.698399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:36:38.701198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:36:38.816041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-703296fe-0087-4cbc-831b-02d1345426a6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.179571 Jul 26 04:36:38.825337 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1189/2486] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:36:38.850195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f1948ecb-cc92-4a96-9923-12ad0f1f9691 req-63e8b05f-3ebc-4b25-bf9e-44a5a68a6849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6", "name": "network-vif-plugged", "status": "completed", "tag": "a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:38.882040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f1948ecb-cc92-4a96-9923-12ad0f1f9691 req-63e8b05f-3ebc-4b25-bf9e-44a5a68a6849 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.882525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f1948ecb-cc92-4a96-9923-12ad0f1f9691 req-63e8b05f-3ebc-4b25-bf9e-44a5a68a6849 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.906940 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f1948ecb-cc92-4a96-9923-12ad0f1f9691 req-63e8b05f-3ebc-4b25-bf9e-44a5a68a6849 service nova] Creating event network-vif-plugged:a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35 for instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 on n-h1-848886-16 Jul 26 04:36:38.916562 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f1948ecb-cc92-4a96-9923-12ad0f1f9691 req-63e8b05f-3ebc-4b25-bf9e-44a5a68a6849 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088515 Jul 26 04:36:38.918007 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1190/2487] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:38.926992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:38.928017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:38.937267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.938555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:38.944929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:38.945663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.185188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:39.217745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4aceaaa-af39-4e44-9df2-f132aa98841b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 1.097683 Jul 26 04:36:39.229218 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1298/2488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:38 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:39.246765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eeaf96e0-2763-4b55-a8aa-654e96ae49d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:39.251751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eeaf96e0-2763-4b55-a8aa-654e96ae49d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:39.381857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:39.399442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2de16e8-b67b-4ec3-bb8f-b77c746b3f32 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1520 microversion: 2.1 time: 0.479892 Jul 26 04:36:39.400026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1191/2489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:38 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:39.418646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:39.421156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:39.438982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.439509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.440328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.440827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.452408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eeaf96e0-2763-4b55-a8aa-654e96ae49d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:39.463927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eeaf96e0-2763-4b55-a8aa-654e96ae49d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1214 microversion: 2.1 time: 0.228453 Jul 26 04:36:39.466042 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1299/2490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:39 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:39.478757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:39.479483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:39.499545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.501099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.507650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.508912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.576705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:39.592589 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68466481-5fe0-40ca-8a12-48ee981cbe32 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1252 microversion: 2.1 time: 0.185799 Jul 26 04:36:39.594580 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1192/2491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:39 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1252 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:39.793464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:39.801416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b5cbc84-daaa-4d1c-be87-b0102b5ff329 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1520 microversion: 2.1 time: 0.333533 Jul 26 04:36:39.807935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1300/2492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:39 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:39.822217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1069251539"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:39.824649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:39.839779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.840552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:39.841484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:39.842282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.172416 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d123e090-2649-4a70-beb4-a7154a10f2e9 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161/action" status: 202 len: 0 microversion: 2.1 time: 0.353906 Jul 26 04:36:40.177280 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1193/2493] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:39 2022] POST /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:36:40.188823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24752148-392c-46fe-8e66-8b4adb4e4017 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b5a498b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.197018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:40.252951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.253653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:40.267552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.268000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.268786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.279204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.445328 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24752148-392c-46fe-8e66-8b4adb4e4017 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e" status: 204 len: 0 microversion: 2.1 time: 0.261776 Jul 26 04:36:40.449646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1301/2494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:40 2022] DELETE /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:36:40.457114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dcec047-3c4c-47be-82ba-507289a2750a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b58bd3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.497609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0dcec047-3c4c-47be-82ba-507289a2750a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Image not found. Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dcec047-3c4c-47be-82ba-507289a2750a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e HTTP/1.1 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'fd297e38-5311-4e80-8b83-29ad9d7acb4e'} Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fd297e38-5311-4e80-8b83-29ad9d7acb4e Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:36:40.501002 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd297e38-5311-4e80-8b83-29ad9d7acb4e could not be found. Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:40.504764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dcec047-3c4c-47be-82ba-507289a2750a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:40.507327 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0dcec047-3c4c-47be-82ba-507289a2750a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e" status: 404 len: 62 microversion: 2.1 time: 0.054321 Jul 26 04:36:40.511325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1302/2495] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:36:40 2022] GET /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:36:40.523015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.526071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:40.543727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.546306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.549113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.549689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.723354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:40.742622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a739b534-be58-4d8a-840c-89e1bb820987 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.494397 Jul 26 04:36:40.743932 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1194/2496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:40 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:40.753239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.767364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:40.777925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.779673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.780790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.783412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.921609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:40.941053 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5755246f-aeff-41ec-9d31-5956bb9e3451 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1210 microversion: 2.1 time: 0.428508 Jul 26 04:36:40.943223 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1303/2497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:40 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1210 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:40.960879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:40.962051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:40.979429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.982262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:40.987323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:40.989160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:41.149925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:41.165387 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d88a13b2-cd7f-4aed-8707-b92914085f05 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1532 microversion: 2.1 time: 0.420027 Jul 26 04:36:41.165980 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1195/2498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:40 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1532 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:41.282114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:41.284544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:41.297169 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a594581-1103-4f22-b23a-33ae9f5654dd tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1252 microversion: 2.1 time: 0.348338 Jul 26 04:36:41.299124 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1304/2499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:40 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1252 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:41.770496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:41.771368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:41.779197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:41.780263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:41.781831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:41.782813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:41.964137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:41.964635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:41.975371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:41.975832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:41.976628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:41.994374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:42.106792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:42.122042 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-828a883e-29a7-42de-a0d0-3cdf6ad5594d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1272 microversion: 2.1 time: 0.161560 Jul 26 04:36:42.123009 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1305/2500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:41 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:42.186848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:42.188460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:42.202035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:42.202766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:42.203787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:42.205140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:42.559107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:42.571852 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ab5a0d6-5ab4-4298-99ac-39ac758daa47 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.806005 Jul 26 04:36:42.573784 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1196/2501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:41 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:42.585970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:42.586904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:42.591707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:42.601058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26e252f4-051f-41e5-8a8c-3f03be6c08bc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1532 microversion: 2.1 time: 0.418040 Jul 26 04:36:42.602592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:42.604694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:42.606769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:42.607903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:42.614578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1306/2502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:42 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1532 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:42.727623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:42.762468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d28e7d84-4f34-4219-86d4-c32970395200 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1252 microversion: 2.1 time: 0.185470 Jul 26 04:36:42.779509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1197/2503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:42 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1252 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:43.172272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:43.172921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:43.211095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:43.211555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:43.212343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:43.228513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:43.596323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:43.596962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:43.611507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:43.612253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:43.613605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:43.614860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.022084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.038253 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfa0200b-3402-4f29-9c06-f8c382fde5f2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 0.889459 Jul 26 04:36:44.039354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1307/2504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:43 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:44.044273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:44.055038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:44.063450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.064461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.065411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.065957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.130882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.143181 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-148f5795-a88a-496c-813b-e351f0b3c281 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.551463 Jul 26 04:36:44.161470 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1198/2505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:43 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:44.167696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:44.173237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:44.186637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.187659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.188430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.193833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.377891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8251b1935184447cb3b2425c4f3981fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06968033322f4c8ca753d79f1c8f0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.386312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13c6d7d0-7a3d-44be-aa20-e7cf7bc417a5 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 200 len: 1252 microversion: 2.1 time: 0.223347 Jul 26 04:36:44.388076 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1199/2506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:44 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 1252 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:44.394106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:44.399921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.401188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Searching by: {'deleted': False, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:36:44.409286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.409975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.411012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.411780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.427499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=11 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:44.448209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:36:44.489237 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f926227-e62b-4f52-833e-58c2001b66fa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.099887 Jul 26 04:36:44.491525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1200/2507] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:36:44 2022] GET /compute/v2.1/servers => generated 339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:44.507455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:44.517339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.522483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Searching by: {'deleted': False, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:36:44.536530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:44.542891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.545174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.547855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.548600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.676608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:36:44.708849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:44.718228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.729864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7bb861f-8a65-468b-892c-4a1eb5272cef tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1538 microversion: 2.1 time: 0.689352 Jul 26 04:36:44.730487 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1308/2508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:44 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1538 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:44.774588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bcce8bb5-1a38-4754-b03f-6b2f7c249a92 req-b4eb0de5-7a26-430d-87e1-009f5008f6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0218ec5-8ad9-473e-b819-853209360f03", "tag": "9781a1b5-128a-41fc-881c-b0f36346cc2a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:44.821227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bcce8bb5-1a38-4754-b03f-6b2f7c249a92 req-b4eb0de5-7a26-430d-87e1-009f5008f6d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.821586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bcce8bb5-1a38-4754-b03f-6b2f7c249a92 req-b4eb0de5-7a26-430d-87e1-009f5008f6d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:44.840786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=7 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:44.851105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bcce8bb5-1a38-4754-b03f-6b2f7c249a92 req-b4eb0de5-7a26-430d-87e1-009f5008f6d7 service nova] Creating event network-changed:9781a1b5-128a-41fc-881c-b0f36346cc2a for instance c0218ec5-8ad9-473e-b819-853209360f03 on n-h1-848886-16 Jul 26 04:36:44.857728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bcce8bb5-1a38-4754-b03f-6b2f7c249a92 req-b4eb0de5-7a26-430d-87e1-009f5008f6d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102394 Jul 26 04:36:44.858249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:44.859719 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1309/2509] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:44.875999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:44.876410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.074457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:45.075336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:45.095860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.098958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.100467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.101382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.431270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-596d5131-6f25-4449-817b-56ae648154b6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.932260 Jul 26 04:36:45.431909 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1201/2510] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:36:44 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:45.454921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:45.455547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:45.483131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.483604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.485271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.485741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.892361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:45.906500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71ecdc32-f097-4668-a867-e261cd558957 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 0.457780 Jul 26 04:36:45.909106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1202/2511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:45 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:45.932341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:45.939087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] [instance: e7553b65-8f16-4489-b77f-3f1120a3c9da] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:45.952050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.953383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.954727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:45.955443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:45.975237 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] HTTP exception thrown: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Request method failure captured: Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da HTTP/1.1 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi327RFFgPNXHEYBQpWepPGx_LMihAQ0W8Oiao-n8U62YpP8g_DDgqKv550o9Q3wbQQPbvjx8ieqsaYl4318UiJyTim23YyH25K3JPshDrPEgTtxvwN4zmJiXlB6Nubm8YV9O13jwUvb7-gvDKKUD5oYpXWxkcfGa1376XKt5T5uQISFk Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 06968033322f4c8ca753d79f1c8f0ea7 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestBootFromVolume-521871874 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06968033322f4c8ca753d79f1c8f0ea7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06968033322f4c8ca753d79f1c8f0ea7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06968033322f4c8ca753d79f1c8f0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06968033322f4c8ca753d79f1c8f0ea7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestBootFromVolume-521871874 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 06968033322f4c8ca753d79f1c8f0ea7 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestBootFromVolume-521871874 Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestBootFromVolume-521871874-project Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8251b1935184447cb3b2425c4f3981fd Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestBootFromVolume-521871874-project Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e7553b65-8f16-4489-b77f-3f1120a3c9da'} Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:45.977404 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Returning 404 to user: Instance e7553b65-8f16-4489-b77f-3f1120a3c9da could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-015578af-b9f9-4239-8e71-a6c37680dba9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da" status: 404 len: 111 microversion: 2.1 time: 0.068717 Jul 26 04:36:45.982099 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1203/2512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:45 2022] GET /compute/v2.1/servers/e7553b65-8f16-4489-b77f-3f1120a3c9da => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:45.987339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8e47ecf-fc6e-4ddc-b5d3-d6c89342f00d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:46.003079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8e47ecf-fc6e-4ddc-b5d3-d6c89342f00d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021209 Jul 26 04:36:46.003778 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1204/2513] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:36:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:46.010445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:46.011239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:46.019919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.020629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:46.021809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.022427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:46.216024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:46.225647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1e5e68c-9dc9-4c53-b291-05deba651ed5 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 1.166955 Jul 26 04:36:46.230093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1310/2514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:45 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:46.235655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-242b1123-7b0d-4d11-997b-c848288417b9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] Calling method '.version_select at 0x7f38b50c6430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:46.335589 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-242b1123-7b0d-4d11-997b-c848288417b9 tempest-ServersTestBootFromVolume-521871874 tempest-ServersTestBootFromVolume-521871874-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798883101" status: 202 len: 0 microversion: 2.1 time: 0.104087 Jul 26 04:36:46.345906 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1311/2515] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798883101 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:46.360187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:46.369890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:46.386027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.390939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:46.396127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.403629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:46.478584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:36:46.533533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:46.543660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ff683ce-d29a-42c4-8407-5b5505353781 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1538 microversion: 2.1 time: 0.538375 Jul 26 04:36:46.549310 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1205/2516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:46 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1538 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:46.725779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-753eebc7-015a-4e33-9722-91cc9ff98533 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 204 len: 0 microversion: 2.1 time: 0.378131 Jul 26 04:36:46.738037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:46.738908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:46.742278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1312/2517] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:36:46 2022] DELETE /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:36:46.751121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.752637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:46.753919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:46.754562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.227977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-707e391b-3da6-49ae-bf4a-e1e9ce5aa2b7 req-f31021e0-26b3-48ce-8843-2163049120da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae1e975-620a-4b90-ac0a-39e6ca7c185e", "name": "network-vif-plugged", "status": "completed", "tag": "384606ae-4f32-48f9-817b-5d1e652be3bc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:47.250309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-707e391b-3da6-49ae-bf4a-e1e9ce5aa2b7 req-f31021e0-26b3-48ce-8843-2163049120da service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.250809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-707e391b-3da6-49ae-bf4a-e1e9ce5aa2b7 req-f31021e0-26b3-48ce-8843-2163049120da service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.261217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:47.276867 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b1025555-2a95-4715-8e77-f5b8f1e16ed1 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1713 microversion: 2.1 time: 0.543626 Jul 26 04:36:47.277196 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-707e391b-3da6-49ae-bf4a-e1e9ce5aa2b7 req-f31021e0-26b3-48ce-8843-2163049120da service nova] Creating event network-vif-plugged:384606ae-4f32-48f9-817b-5d1e652be3bc for instance eae1e975-620a-4b90-ac0a-39e6ca7c185e on n-h2-848886-16 Jul 26 04:36:47.289577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-707e391b-3da6-49ae-bf4a-e1e9ce5aa2b7 req-f31021e0-26b3-48ce-8843-2163049120da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.513233 Jul 26 04:36:47.292666 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1313/2518] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:47.293957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1206/2519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:46 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1713 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:47.315548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:47.319527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:47.323672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:47.325799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:47.347582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.349249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.351584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.352260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.362691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.371394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.377334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.377931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.692597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:47.704302 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2e667fd-5a44-47bb-8277-70930bd1e93a tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 0.409119 Jul 26 04:36:47.716706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1207/2520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:47 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:47.741312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:47.741942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:47.758346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.759100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:47.761184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:47.763367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.145267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:48.153585 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55d25a3f-a7c4-4861-801d-18f6305b28b2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1520 microversion: 2.1 time: 0.435456 Jul 26 04:36:48.176193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1208/2521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:47 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:48.192708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:48.195244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:48.208057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.208512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.209639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.210286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.245408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:36:48.363317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a326958-6dff-48e3-a2de-e4ffe1a59c9d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 204 len: 0 microversion: 2.1 time: 0.181411 Jul 26 04:36:48.365081 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1209/2522] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:36:48 2022] DELETE /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:36:48.465368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:48.476491 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-48382bdd-12a2-4972-a753-d8637d71ad3f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 1.181088 Jul 26 04:36:48.477456 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1314/2523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:47 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:48.495660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:48.496615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:48.504895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.507478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.508445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.510018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.661289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55952dac-fc1b-4895-ac44-261ce3019717 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b54e21f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:48.774618 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55952dac-fc1b-4895-ac44-261ce3019717 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6" status: 200 len: 371 microversion: 2.1 time: 0.403802 Jul 26 04:36:48.775416 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1210/2524] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:36:48 2022] GET /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6 => generated 371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:48.781738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:48.782841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:48.790034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.791246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.792268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:48.792928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:48.991752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:49.011231 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6a2acbd-79a0-41f9-9429-aa3fd942c82e tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1526 microversion: 2.1 time: 0.233348 Jul 26 04:36:49.028645 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1211/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:48 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1526 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:49.028645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:49.028645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:49.050100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.051062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.052306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.052418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.277628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:49.307656 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6610355-4469-4412-862d-5ff28fb2ffc0 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 0.279589 Jul 26 04:36:49.309766 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1212/2526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:49 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:49.330366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5c115e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:49.365303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:49.376823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b01094c7-3d65-44fa-a246-f1c5a6ed74e6 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1713 microversion: 2.1 time: 0.897444 Jul 26 04:36:49.392489 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1315/2527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:48 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1713 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:49.477742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.478887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.480477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.481142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.503196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:49.507208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:49.510879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:49.524827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.526733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.529953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:49.531033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:49.604177 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-56cfa083-a985-4ef1-beaf-2b369936bd70 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6" status: 200 len: 328 microversion: 2.1 time: 0.292856 Jul 26 04:36:49.606349 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1213/2528] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:36:49 2022] PUT /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6 => generated 328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:49.623513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d891c01b-9718-44f5-814f-b4774df67f01 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:49.644545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d891c01b-9718-44f5-814f-b4774df67f01 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6" status: 202 len: 0 microversion: 2.1 time: 0.030204 Jul 26 04:36:49.645664 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1214/2529] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:36:49 2022] DELETE /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:49.656334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa0bd1d0-c114-436f-8ea2-ce762f9562d3 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b60dadc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:49.763322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa0bd1d0-c114-436f-8ea2-ce762f9562d3 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6" status: 200 len: 371 microversion: 2.1 time: 0.111429 Jul 26 04:36:49.764418 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1215/2530] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:36:49 2022] GET /compute/v2.1/os-quota-sets/2e45828d105d40a9bef14c9d191aa1a6 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:49.988477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1961903-7a72-43ff-a9a4-96a943ed8afc tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b5bbd160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:50.252972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1961903-7a72-43ff-a9a4-96a943ed8afc tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.268224 Jul 26 04:36:50.273043 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1216/2531] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:36:49 2022] GET /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6/defaults => generated 371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:50.291082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:50.292065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:50.309304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.311565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.315038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.315382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.619887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:50.632346 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3daefa3-843b-4993-9998-6c7bb393a050 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1526 microversion: 2.1 time: 0.357502 Jul 26 04:36:50.632938 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1217/2532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:50 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:50.638628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:50.639244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:50.649003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.650487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.650945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.651686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.823585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:50.838144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af5a91a8-0298-47b7-8234-4edc4b9f0450 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 0.203651 Jul 26 04:36:50.851457 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1218/2533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:50 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:50.851457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:50.851457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:50.860252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.860726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.861677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:50.862185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:50.884613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:50.893903 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fc2023c-9d56-4dfb-b599-685a6bc47ebe tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1321 microversion: 2.1 time: 1.395439 Jul 26 04:36:50.903679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1316/2534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:49 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1321 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:50.909061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5080ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:51.076975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:51.085689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f385bfc0-b7de-4ddf-bbf5-c53bbad5fa38 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1713 microversion: 2.1 time: 0.244977 Jul 26 04:36:51.086540 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1219/2535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:50 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1713 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:51.134477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.135191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.136175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.136773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.202465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3d98b85-7fbe-4566-a00c-5e5abae73fe8 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064" status: 200 len: 328 microversion: 2.1 time: 0.297503 Jul 26 04:36:51.209943 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1317/2536] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:36:50 2022] PUT /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064 => generated 328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:51.217281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b5e748b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:51.342006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.342756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.343925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.344702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.415810 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a27c7c10-70dc-467a-8e02-cb38e71a6925 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064/detail" status: 200 len: 916 microversion: 2.1 time: 0.204721 Jul 26 04:36:51.417942 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1220/2537] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:36:51 2022] GET /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064/detail => generated 916 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:51.629561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5a8f5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:51.662053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:51.662732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:51.682597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.683105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.684737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.684737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.792288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.793248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.794735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.795456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.851699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.853978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.855286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.855865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.948282 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36394041-29c9-4403-aa2c-b2c0879b92a9 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064?user_id=4b3ff7ae9b7b47d9a3d14d127e256e48" status: 200 len: 328 microversion: 2.1 time: 0.330989 Jul 26 04:36:51.954191 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1318/2538] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:36:51 2022] PUT /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064?user_id=4b3ff7ae9b7b47d9a3d14d127e256e48 => generated 328 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:51.960607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:51.961635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:51.972835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.973651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:51.975031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:51.975583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.012541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:52.022931 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-946e0881-d4c8-4568-893e-1c8f79fcc3ca tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1526 microversion: 2.1 time: 0.368076 Jul 26 04:36:52.024163 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1221/2539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:51 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1526 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:52.035265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:52.036670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:52.053364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.054212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.055812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.056571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.239988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:52.249218 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cca0a142-3d21-4c59-bbca-5197d0211e27 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1515 microversion: 2.1 time: 0.223689 Jul 26 04:36:52.250063 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1222/2540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:52 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:52.268901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a7083aab-3cdb-4402-9809-e2cdd982520e tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b5f6b5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:52.364935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a7083aab-3cdb-4402-9809-e2cdd982520e tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064?user_id=4b3ff7ae9b7b47d9a3d14d127e256e48" status: 200 len: 370 microversion: 2.1 time: 0.113376 Jul 26 04:36:52.367293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1223/2541] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Jul 26 04:36:52 2022] GET /compute/v2.1/os-quota-sets/05e3852c5d7e4a58a80da3e2acdb9064?user_id=4b3ff7ae9b7b47d9a3d14d127e256e48 => generated 370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:52.377832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:52.378525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:52.401151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.402800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.404859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.404859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.418188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:52.540195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:52.551697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-954fe6ed-a3dd-4518-8d60-d203226639aa tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1645 microversion: 2.1 time: 0.183082 Jul 26 04:36:52.569752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1224/2542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:52 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1645 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:52.575766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:52.579225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:52.587051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.587786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.588666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.589210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.643482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'flavor' on Instance uuid eae1e975-620a-4b90-ac0a-39e6ca7c185e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:36:52.788627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5e67659-f965-45c6-9625-e23e245b6eb9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action" status: 200 len: 32 microversion: 2.1 time: 0.217286 Jul 26 04:36:52.790057 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1225/2543] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:52 2022] POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:36:52.805817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bba153ad-bb6d-41e4-aadd-e63bc6f84572 req-9b4ee86f-8c7d-4389-84c6-1009671b1a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0218ec5-8ad9-473e-b819-853209360f03", "name": "network-vif-plugged", "status": "completed", "tag": "9781a1b5-128a-41fc-881c-b0f36346cc2a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:52.820577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bba153ad-bb6d-41e4-aadd-e63bc6f84572 req-9b4ee86f-8c7d-4389-84c6-1009671b1a55 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.821244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bba153ad-bb6d-41e4-aadd-e63bc6f84572 req-9b4ee86f-8c7d-4389-84c6-1009671b1a55 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.836147 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bba153ad-bb6d-41e4-aadd-e63bc6f84572 req-9b4ee86f-8c7d-4389-84c6-1009671b1a55 service nova] Creating event network-vif-plugged:9781a1b5-128a-41fc-881c-b0f36346cc2a for instance c0218ec5-8ad9-473e-b819-853209360f03 on n-h1-848886-16 Jul 26 04:36:52.842436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bba153ad-bb6d-41e4-aadd-e63bc6f84572 req-9b4ee86f-8c7d-4389-84c6-1009671b1a55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050590 Jul 26 04:36:52.843335 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1226/2544] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:52.851657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:52.852947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:52.860898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.861414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:52.862243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:52.863156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.081282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:53.089857 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9eb41e5-0ff1-41e3-9591-3f9bbec4a814 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.242264 Jul 26 04:36:53.090576 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1227/2545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:52 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:53.095946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e81699f-c5ec-44e3-828a-95430b2e4401 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Calling method '.version_select at 0x7f38b60874c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:53.308200 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e81699f-c5ec-44e3-828a-95430b2e4401 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.216743 Jul 26 04:36:53.309106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1228/2546] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:36:53 2022] GET /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6/defaults => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:53.317249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:53.318087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:53.325135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.325594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.327307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.327856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.392292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:53.402558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b937fc0-5440-4de6-a7ce-402c8079514c tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1314 microversion: 2.1 time: 1.446474 Jul 26 04:36:53.417497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1319/2547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:51 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1314 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:53.424171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Action: 'update', calling method: .version_select at 0x7f38b50d6af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:53.529292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:53.539982 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c454d15-3b85-4cd4-859d-301a31b19f29 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1526 microversion: 2.1 time: 0.229521 Jul 26 04:36:53.541053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1229/2548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:53 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1526 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:53.565324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.565784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.566619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.567254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.578973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:53.579653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:53.590043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.590529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.591371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:53.591885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:53.672258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:53.692117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:53.709007 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a15c39c6-4b70-4f00-8408-92f6640ab888 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1645 microversion: 2.1 time: 0.134643 Jul 26 04:36:53.711887 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1230/2549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:53 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1645 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:53.940976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27869f00-cfe2-4f84-a113-9066ded545b2 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6" status: 200 len: 329 microversion: 2.1 time: 0.520215 Jul 26 04:36:53.942499 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1320/2550] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Jul 26 04:36:53 2022] PUT /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6 => generated 329 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:53.954932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5b7a700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:54.049501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.050407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.051625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.052279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.113006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:54.113533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:54.113716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:54.129023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.141158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.143400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.143970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.664905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7226b553-89d9-4eb0-98ed-87688ed2fd81 tempest-QuotasAdminTestJSON-672735029 tempest-QuotasAdminTestJSON-672735029-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6" status: 200 len: 329 microversion: 2.1 time: 0.714407 Jul 26 04:36:54.665852 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1231/2551] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Jul 26 04:36:53 2022] PUT /compute/v2.1/os-quota-sets/ab6e6ea5d53e4e76b4cf25d35b0a45f6 => generated 329 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:54.829686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-700476a0-73e8-4600-840f-20a8b7f9d8da req-bacc6a66-f9b0-42cc-93d3-54f26754a6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5bb002-9b50-4e69-a2e1-1cd7cb082161", "name": "network-vif-deleted", "tag": "19331205-ec56-45c8-9fcd-77b84b74f493"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:54.871384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-700476a0-73e8-4600-840f-20a8b7f9d8da req-bacc6a66-f9b0-42cc-93d3-54f26754a6b1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.871852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-700476a0-73e8-4600-840f-20a8b7f9d8da req-bacc6a66-f9b0-42cc-93d3-54f26754a6b1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.916832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-700476a0-73e8-4600-840f-20a8b7f9d8da req-bacc6a66-f9b0-42cc-93d3-54f26754a6b1 service nova] Creating event network-vif-deleted:19331205-ec56-45c8-9fcd-77b84b74f493 for instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 on n-h2-848886-16 Jul 26 04:36:54.929753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-700476a0-73e8-4600-840f-20a8b7f9d8da req-bacc6a66-f9b0-42cc-93d3-54f26754a6b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261471 Jul 26 04:36:54.931078 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1232/2552] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:36:54.938980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:54.950013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:54.968078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.969685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.970541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:54.971897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:54.975115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:54.983859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28daf456-3add-49d9-a4e8-847925c325fc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.874029 Jul 26 04:36:54.998305 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1321/2553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:54 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:55.005049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:55.005813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:55.015819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.016784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.017644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.018176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.066865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.067329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.067793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lazy-loading 'fault' on Instance uuid 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:36:55.366088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:55.375424 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f50fd27-cbd4-43f0-8cd0-0bec7386ee95 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1499 microversion: 2.1 time: 0.441958 Jul 26 04:36:55.377014 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1233/2554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:54 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1499 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:55.382092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:55.383059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:55.389448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.390643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.391813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.392269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.442183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.442978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.443619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lazy-loading 'fault' on Instance uuid f6410eed-6433-4a63-8e36-bc44ea43c87d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:36:55.503285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1fd7a0f1814df19b9c9133965988a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ddb8081dfd4d248cd435e39e5af58c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:55.525237 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4e35763-5be3-4e98-b194-a9f74af3a98d tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 200 len: 1367 microversion: 2.1 time: 0.146940 Jul 26 04:36:55.534292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1234/2555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:55 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:55.537456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:55.539832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:55.546288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.546750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.547838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.548285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.580425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lazy-loading 'flavor' on Instance uuid c0218ec5-8ad9-473e-b819-853209360f03 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:36:55.604922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:55.616240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f3e4d76-ad55-4710-a931-9f5691459924 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 200 len: 1314 microversion: 2.1 time: 0.616164 Jul 26 04:36:55.616827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1322/2556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:54 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:55.818858 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dac98c29-d22f-42c0-a1dd-7d372f4586c2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "POST /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03/action" status: 200 len: 32 microversion: 2.1 time: 0.287637 Jul 26 04:36:55.820665 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1235/2557] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:36:55 2022] POST /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:36:55.832697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:55.833522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:55.854520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.864387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.866276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:55.866949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:55.884658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:56.007111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:56.007905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:56.030848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.031466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.036186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.038034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.323354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:56.334986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-585edb83-50cd-4ac3-a775-161f3fcfad6a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.332386 Jul 26 04:36:56.335801 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1236/2558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:56 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:56.467276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:56.485745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1f73a83-00bd-43ae-9d94-0f7e9d3962c7 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.656866 Jul 26 04:36:56.498221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1323/2559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:55 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:56.564633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:56.565248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] [instance: f6410eed-6433-4a63-8e36-bc44ea43c87d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:56.575730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.576192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.577078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.577536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.614713 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] HTTP exception thrown: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Request method failure captured: Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d HTTP/1.1 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi328R0ZHucMWgmVoEjE_H1SiXclsbXiGackibIolbnT0xOTKmmzQQN1vv1c4AjXSnoJVVdgNG-Ldzm5B4EgOF9Lyzc3O2hE0F6Tx9nkz22XVoGIER6FBzS9qW4E2D2Ojbp4Sp_sfExmoGvcmDAICByh25B2c41B6YjCjYTTCRkqRbpyo Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b3ddb8081dfd4d248cd435e39e5af58c Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestManualDisk-1507648944 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b3ddb8081dfd4d248cd435e39e5af58c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3ddb8081dfd4d248cd435e39e5af58c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3ddb8081dfd4d248cd435e39e5af58c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b3ddb8081dfd4d248cd435e39e5af58c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestManualDisk-1507648944 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b3ddb8081dfd4d248cd435e39e5af58c Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestManualDisk-1507648944 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestManualDisk-1507648944-project Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1b1fd7a0f1814df19b9c9133965988a1 Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestManualDisk-1507648944-project Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'f6410eed-6433-4a63-8e36-bc44ea43c87d'} Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:56.616425 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Returning 404 to user: Instance f6410eed-6433-4a63-8e36-bc44ea43c87d could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:56.629604 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9f29536-687c-464e-a1c5-10f437294d74 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d" status: 404 len: 111 microversion: 2.1 time: 0.061439 Jul 26 04:36:56.638786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:56.639940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:56.656957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.657483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.658050 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1237/2560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:56 2022] GET /compute/v2.1/servers/f6410eed-6433-4a63-8e36-bc44ea43c87d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:56.664471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3c03a26-0552-4245-b4ca-81b98b9dfd25 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] Calling method '.version_select at 0x7f38b5a47a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:56.674438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:56.675183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:56.703915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 HTTP/1.1 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7e5bb002-9b50-4e69-a2e1-1cd7cb082161'} Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.705616 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:36:56.710047 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:36:56.712065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:36:56.713219 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e7b9846-efef-4902-b894-8bce35883ffd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 404 len: 111 microversion: 2.1 time: 0.078358 Jul 26 04:36:56.734641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f3c03a26-0552-4245-b4ca-81b98b9dfd25 tempest-ServersTestManualDisk-1507648944 tempest-ServersTestManualDisk-1507648944-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692052328" status: 202 len: 0 microversion: 2.1 time: 0.075023 Jul 26 04:36:56.734979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1324/2561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:56 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:36:56.735726 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1238/2562] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692052328 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:36:56.861489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-895819568", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:56.947014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] validate_networks() for [('4074a51c-d75d-4437-b489-0a22ca553d3f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:57.002273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1e1f6921-80c3-49e4-8ad9-924b8ad213a0 req-c1a781f6-4ae3-40e2-a9ed-752ea15ade7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6410eed-6433-4a63-8e36-bc44ea43c87d", "name": "network-vif-deleted", "tag": "beece54d-d442-426a-809e-af3a98d3782a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:57.027633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1e1f6921-80c3-49e4-8ad9-924b8ad213a0 req-c1a781f6-4ae3-40e2-a9ed-752ea15ade7c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:57.028869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1e1f6921-80c3-49e4-8ad9-924b8ad213a0 req-c1a781f6-4ae3-40e2-a9ed-752ea15ade7c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:57.044096 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1e1f6921-80c3-49e4-8ad9-924b8ad213a0 req-c1a781f6-4ae3-40e2-a9ed-752ea15ade7c service nova] Creating event network-vif-deleted:beece54d-d442-426a-809e-af3a98d3782a for instance f6410eed-6433-4a63-8e36-bc44ea43c87d on n-h1-848886-16 Jul 26 04:36:57.050452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1e1f6921-80c3-49e4-8ad9-924b8ad213a0 req-c1a781f6-4ae3-40e2-a9ed-752ea15ade7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054584 Jul 26 04:36:57.052115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1239/2563] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:36:57.357521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:57.359144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:57.375254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:57.375717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:57.376623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:57.376967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:57.923402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:57.954891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-047ac648-a4b1-4299-a808-9496d7133eab tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.601576 Jul 26 04:36:57.958439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1240/2564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:57 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:36:57.974821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:57.976560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:57.987042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:57.987633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:57.989088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:57.989645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:58.376291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:58.383347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:36:58.385753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e09f22f-8305-47f5-ab63-783017250b80 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.425228 Jul 26 04:36:58.386667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1241/2565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:57 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:59.056651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:36:59.058493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:36:59.059338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:36:59.060011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:36:59.060589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:36:59.091055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.092497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:59.094046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.101402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1431001084", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "badc6835-8985-4e41-9bfd-7a8a2cc9011d"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:36:59.107028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:59.163345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:36:59.170465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Getting quotas for user 06dd8c749d2f4662a54a04f77ebf20cb and project 27b358735df742409a285172544cc056. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:36:59.189703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:36:59.193478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:36:59.229896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] validate_networks() for [('badc6835-8985-4e41-9bfd-7a8a2cc9011d', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:36:59.304917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b38655f4-efb2-4eaa-8895-7452b45da63a tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.448506 Jul 26 04:36:59.311704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1325/2566] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:36:59.346609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:59.347453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:59.364511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.366248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:59.367237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.367838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:59.707511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:59.717821 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7edef158-25b7-4f06-92de-79f01a34588c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.401846 Jul 26 04:36:59.736221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1326/2567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:59 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:59.744767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d585f64-8ee5-4074-9126-3862e82ecbdd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:59.746086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0d585f64-8ee5-4074-9126-3862e82ecbdd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:59.829307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0d585f64-8ee5-4074-9126-3862e82ecbdd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:36:59.846712 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d585f64-8ee5-4074-9126-3862e82ecbdd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1224 microversion: 2.1 time: 0.109225 Jul 26 04:36:59.862607 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1327/2568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:59 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:36:59.869954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:36:59.876211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:36:59.887587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.888040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:36:59.889898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:36:59.892716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:00.110626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:00.128661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-894a9786-4d12-40e6-a5ae-5bed093c2d00 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.263945 Jul 26 04:37:00.131902 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1328/2569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:36:59 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:00.603088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1691167229", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e87915cc-ddd2-453e-8c20-7f29643f4c05"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:00.699042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] validate_networks() for [('e87915cc-ddd2-453e-8c20-7f29643f4c05', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:37:02.159963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:37:02.161101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:37:02.161847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:37:02.162396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:37:02.163061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:37:02.181458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.183124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.184402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.186782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.253629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Getting quotas for project 089663829e2c41dd874402e71641dea0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:02.260106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:37:02.261418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:37:02.262701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:37:02.263411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:37:02.265182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:37:02.278280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Getting quotas for user 2b6f9a033a73449f911d11dad259e1f6 and project 089663829e2c41dd874402e71641dea0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:02.287375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.290496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.291787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.292428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.334966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Going to run 3 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:37:02.339278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:02.398083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Getting quotas for project c76aa4a586f5424ca48c062b9ddfd38e. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:02.419332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=c7231416-6b0b-4c0d-bbad-4f2524c8a5bf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:02.422464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Getting quotas for user b6ea16ef8d824a86933233f7ff944c26 and project c76aa4a586f5424ca48c062b9ddfd38e. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:02.482289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:37:02.495160 n-d-848886-16 devstack@n-api.service[119487]: WARNING nova.utils [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1431001084 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-143100108 Jul 26 04:37:02.497366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=2260cefb-9a96-4605-a65e-941a9ce5e018,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:02.499476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:02.629349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b48c12b7-01b1-4e41-90b7-3bf2098343e4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.495883 Jul 26 04:37:02.631774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1329/2570] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:37:02.639863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:02.641614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:02.653568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24dfbe3b-2b9e-4dae-ae6b-8fdac73db334 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.771991 Jul 26 04:37:02.660939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1242/2571] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:37:02.667214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:02.667843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:02.670081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=17,nova_api:SELECT=68,nova_api:UPDATE=14,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:02.673935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.675244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.679115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.687953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.689060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.689715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:02.690733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:02.691925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:03.242757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:03.251892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40ed2b49-f061-4046-97eb-3ca65f2d9f1b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1282 microversion: 2.1 time: 0.595924 Jul 26 04:37:03.256568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1243/2572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:02 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1282 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:03.269351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:03.270033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:03.287665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:03.288132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:03.299108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:03.299612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:03.443429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:03.457656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-552dfcf4-d12f-4ddd-b9f3-574d01588938 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.823933 Jul 26 04:37:03.474952 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1330/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:02 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:03.486397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:03.495014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:03.497150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:03.566626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:03.567137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:03.572830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:03.573591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:03.634473 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af3c4d41-01cc-4316-a72b-6abdaf6d04a0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.157909 Jul 26 04:37:03.659169 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1331/2574] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:37:03 2022] GET /compute/v2.1/servers => generated 1018 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:03.664990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5dced048-7c19-40af-82c2-6fc47e7778d1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:03.674357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5dced048-7c19-40af-82c2-6fc47e7778d1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:03.867359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5dced048-7c19-40af-82c2-6fc47e7778d1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:03.876027 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5dced048-7c19-40af-82c2-6fc47e7778d1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1232 microversion: 2.1 time: 0.214752 Jul 26 04:37:03.876618 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1332/2575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:03 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1232 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:03.895979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-566e08be-5aa7-41e4-b3e7-6360fef00242 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:03.897175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-566e08be-5aa7-41e4-b3e7-6360fef00242 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:03.971478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:03.978448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f12f2ce-e22f-4cf0-9afb-fa289b9cdb8e tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.717976 Jul 26 04:37:03.979364 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1244/2576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:03 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:04.085536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-566e08be-5aa7-41e4-b3e7-6360fef00242 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:04.101312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-566e08be-5aa7-41e4-b3e7-6360fef00242 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1223 microversion: 2.1 time: 0.219247 Jul 26 04:37:04.102350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1333/2577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:03 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1223 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:04.287497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:04.288744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:04.297325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:04.298063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:04.301644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:04.302297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:04.480438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:04.481248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:04.494356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:04.495430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:04.503843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:04.504567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:04.930229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:04.958207 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a9948fc-8cad-49fa-9cf1-637064108bec tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.675028 Jul 26 04:37:04.959231 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1245/2578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:04 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:04.971010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:04.973679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:04.993984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:04.999734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:05.002982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:05.003618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:05.055083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:05.066100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-396d4a5b-3cbd-4063-9b85-9aab65e07c35 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.590049 Jul 26 04:37:05.067265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1334/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:04 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:05.076223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:05.078693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:05.094700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:05.095437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:05.097538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:05.098663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:05.364554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:05.380222 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf84fe35-e09e-4d93-a4aa-6e9477e45118 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1302 microversion: 2.1 time: 0.419564 Jul 26 04:37:05.385978 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1246/2580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:04 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1302 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:05.400061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de65f788-056c-468f-bfd5-22a5bfcfb351 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:05.403618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de65f788-056c-468f-bfd5-22a5bfcfb351 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:05.643447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:05.678602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-056dd54f-6d36-42da-bf98-68a3ba936499 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.608112 Jul 26 04:37:05.679993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1335/2581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:05 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:05.712743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de65f788-056c-468f-bfd5-22a5bfcfb351 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:05.723646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de65f788-056c-468f-bfd5-22a5bfcfb351 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1223 microversion: 2.1 time: 0.335124 Jul 26 04:37:05.724699 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1247/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:05 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1223 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:05.984425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:05.985060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:05.995154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=22 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:06.005538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.006352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.008671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.009323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.093806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:06.094733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:06.123137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.123799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.127385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.130481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.639169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:06.650497 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10b3a89a-1d03-41ac-96d9-9f7f02a0371d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.671995 Jul 26 04:37:06.654130 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1336/2583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:05 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:06.672100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:06.672967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:06.688260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.689174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.690209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:06.690910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:06.998446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:07.010053 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3502619e-81af-4134-9908-72e12a97f464 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.925507 Jul 26 04:37:07.016511 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1248/2584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:06 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:07.021814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:07.035210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:07.042856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.043159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.044124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.044720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.434826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:07.448290 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e44c3597-75fc-43ff-8ba3-a760f546c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1290 microversion: 2.1 time: 0.791746 Jul 26 04:37:07.449476 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1337/2585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:06 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1290 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:07.455232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e236e40a-8062-4ffb-b5e8-5da1ed8e56b4 req-83662888-c7e8-4ffd-984a-03f6a168d2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7394af32-20c8-460a-bf32-40912d13ccfe", "tag": "a943729c-2d9c-4c6b-b296-02738612d962"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:07.483360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e236e40a-8062-4ffb-b5e8-5da1ed8e56b4 req-83662888-c7e8-4ffd-984a-03f6a168d2af service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.484142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e236e40a-8062-4ffb-b5e8-5da1ed8e56b4 req-83662888-c7e8-4ffd-984a-03f6a168d2af service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.507843 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e236e40a-8062-4ffb-b5e8-5da1ed8e56b4 req-83662888-c7e8-4ffd-984a-03f6a168d2af service nova] Creating event network-changed:a943729c-2d9c-4c6b-b296-02738612d962 for instance 7394af32-20c8-460a-bf32-40912d13ccfe on n-h2-848886-16 Jul 26 04:37:07.522397 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e236e40a-8062-4ffb-b5e8-5da1ed8e56b4 req-83662888-c7e8-4ffd-984a-03f6a168d2af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071046 Jul 26 04:37:07.523306 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1338/2586] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:07.533454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:07.534443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:07.541788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.542653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.543645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.544243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.798780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:07.807854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8a13555-06cb-4c17-a002-449d4d6be123 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1293 microversion: 2.1 time: 0.283148 Jul 26 04:37:07.808553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1339/2587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:07 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1293 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:07.831368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:07.832154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:07.838792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.839448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:07.840368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:07.840984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.132823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:08.142187 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-83d5d61e-e4a7-4653-b96c-90db499153ac tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 1.124115 Jul 26 04:37:08.142792 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1249/2588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:07 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:08.158474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:08.159258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:08.179087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.179551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.180339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.180966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.383916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:08.398923 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec74b470-6f23-447a-9a20-df99de145e5f tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.571253 Jul 26 04:37:08.399954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1340/2589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:07 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:08.474956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:08.475571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:08.487546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.488358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.489361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.490069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.883659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:08.899321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cda8d237-1e47-4e22-8889-580585b034e3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.755074 Jul 26 04:37:08.900914 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1250/2590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:08 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:08.922818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:08.923855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:08.935054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.937351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:08.942023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:08.943533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.122063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:09.146364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca5c51bb-afd4-484c-9250-ddf24a30ff82 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1281 microversion: 2.1 time: 0.235975 Jul 26 04:37:09.149225 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1251/2591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:08 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:09.174738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:09.177611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:09.187812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.188881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.189909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.191246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.270625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:09.283883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f86b5f9f-a0e5-4f4d-b775-b27908978068 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.812944 Jul 26 04:37:09.287149 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1341/2592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:08 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:09.429331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:09.430124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:09.444974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.446991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.447940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.449263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.859112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:09.861814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:09.875967 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9d531f9-47bc-4d90-bd08-a4e46d661d59 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.716324 Jul 26 04:37:09.876265 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e1709670-5d72-4e80-9dbd-baf44dc339db tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.456891 Jul 26 04:37:09.876942 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1252/2593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:09 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:09.890561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1342/2594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:09 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:09.933144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:09.934480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:09.944503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.945678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:09.946788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:09.947501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.174786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:10.177952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:10.234758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.238461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.239976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.241313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.432412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:10.441042 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0affb430-6400-4e78-a19c-c1736be7fc74 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.517594 Jul 26 04:37:10.460582 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1253/2595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:09 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:10.478882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:10.479510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:10.493698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.494192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.494997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.495442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.583813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:10.597891 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0877814f-c990-4eb4-b305-bd1cb1c257c1 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.432891 Jul 26 04:37:10.601086 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1343/2596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:10 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:10.911071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:10.911793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:10.922619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.924412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:10.929138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:10.929778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:11.270476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:11.271403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:11.282871 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb770d2f-f1ed-43a0-a4e3-d704bfe54e50 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.820614 Jul 26 04:37:11.284577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1254/2597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:10 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:11.291012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:11.291957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:11.300430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-997a303f-28ba-4479-b08c-13ceafc9d435 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.395230 Jul 26 04:37:11.301312 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1344/2598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:10 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:11.318618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:11.319352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:11.320377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:11.321009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:11.504368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-632641448", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:11.605392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:37:11.711208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:11.750917 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1583a4d4-3a4c-4b30-a00d-abdd910fefcc tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.441333 Jul 26 04:37:11.751613 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1255/2599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:11 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:11.768776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:11.769397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:11.816748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:11.817271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:11.818072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:11.822326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.366495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=11 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:12.590907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:12.599663 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4987db26-0e9d-48db-a271-c94bd61cc369 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.835437 Jul 26 04:37:12.620258 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1256/2600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:11 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:12.627866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-09234807-8f6c-4d3c-a45c-6ae19113b927 req-d25702d8-a2f7-41bc-a68d-63983d97e3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da07cc22-6450-4853-8020-51392989bba6", "tag": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:12.642068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-09234807-8f6c-4d3c-a45c-6ae19113b927 req-d25702d8-a2f7-41bc-a68d-63983d97e3d5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:12.642865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-09234807-8f6c-4d3c-a45c-6ae19113b927 req-d25702d8-a2f7-41bc-a68d-63983d97e3d5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.668066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-09234807-8f6c-4d3c-a45c-6ae19113b927 req-d25702d8-a2f7-41bc-a68d-63983d97e3d5 service nova] Creating event network-changed:62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 for instance da07cc22-6450-4853-8020-51392989bba6 on n-h1-848886-16 Jul 26 04:37:12.677823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-09234807-8f6c-4d3c-a45c-6ae19113b927 req-d25702d8-a2f7-41bc-a68d-63983d97e3d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053180 Jul 26 04:37:12.679554 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1257/2601] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:12.685813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:12.686930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:12.693876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:12.694675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.695678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:12.696326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.878466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:37:12.879249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:37:12.879801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:37:12.880382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:37:12.880802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:37:12.918546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:12.920287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.921345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:12.921802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:12.961839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:12.975160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:12.992740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:37:12.996325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:13.078065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21a7558c-2959-4f03-b013-7081050ec103 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775241 Jul 26 04:37:13.081727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1345/2602] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:37:13.103968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:13.105905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:13.116907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:13.121944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:13.124359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:13.125003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:13.217757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:13.235721 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed72a33b-16f8-4527-b9d1-4bfb59072cbf tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.554523 Jul 26 04:37:13.237284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1258/2603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:12 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:13.242442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:13.243251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:13.260299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:13.261127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:13.262872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:13.267231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.004490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:14.022204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de07524d-b9d4-4a93-bbc6-f36056c799fd tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.782817 Jul 26 04:37:14.024466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1259/2604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:13 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:14.038412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:14.040836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:14.064171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.064673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.068357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.068823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.470056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:14.496493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:14.501315 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f3a3edc-ed62-41e4-beb2-fead6fed3182 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 1.418211 Jul 26 04:37:14.502636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:14.504014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1346/2605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:13 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:14.522848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:14.523423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:14.525053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:14.526549 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8dae2954-c7ee-4e89-b8d5-1079e9c8ecd2 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.499785 Jul 26 04:37:14.527682 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1260/2606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:14 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:14.535494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.537286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.538344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.538941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.544445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:14.545078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:14.552294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.553000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.554165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.555009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.712019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:14.721171 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22504e02-0e6f-4a36-8464-6499c5b04d0b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1268 microversion: 2.1 time: 0.215844 Jul 26 04:37:14.722344 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1347/2607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:14 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:14.741885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:14.742853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:14.752856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.753623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:14.754680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:14.755286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.113185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:15.126484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7a3c62e0-4f53-4886-866a-2a6c90b181a8 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.402301 Jul 26 04:37:15.128720 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1348/2608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:14 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:15.133907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:15.134893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:15.141890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.142817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.143902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.144763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.475902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:15.488998 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d21a82b-bab1-457b-b00e-9c0b21b677ab tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.358788 Jul 26 04:37:15.489605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1349/2609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:15 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:15.498361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ecc0be1d-27d7-47fb-9e51-3558a5000da9 req-2a83e21f-726d-4e13-82d2-8bb42128a9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac71e1a7-d446-42ae-8f14-475f08721ccd", "tag": "8bbe6467-ff6f-40a5-8ced-6f9c307d98df"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:15.523513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ecc0be1d-27d7-47fb-9e51-3558a5000da9 req-2a83e21f-726d-4e13-82d2-8bb42128a9ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.534989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ecc0be1d-27d7-47fb-9e51-3558a5000da9 req-2a83e21f-726d-4e13-82d2-8bb42128a9ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.561811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ecc0be1d-27d7-47fb-9e51-3558a5000da9 req-2a83e21f-726d-4e13-82d2-8bb42128a9ce service nova] Creating event network-changed:8bbe6467-ff6f-40a5-8ced-6f9c307d98df for instance ac71e1a7-d446-42ae-8f14-475f08721ccd on n-h1-848886-16 Jul 26 04:37:15.567186 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ecc0be1d-27d7-47fb-9e51-3558a5000da9 req-2a83e21f-726d-4e13-82d2-8bb42128a9ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076193 Jul 26 04:37:15.568053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1350/2610] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:15.578964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:15.579733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:15.592513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.593294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.594318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.594996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.733735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=61 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:15.819479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:15.832976 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-383c8fd0-fc66-4dc3-a077-5c0a66d98ba3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 1.300106 Jul 26 04:37:15.833949 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1261/2611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:14 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:15.844992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:15.845557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:15.856619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.857784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:15.860970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:15.861640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.011061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:16.020795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc76256c-1d93-4a64-a31c-d656e97332b3 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.450998 Jul 26 04:37:16.026704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1351/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:15 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:16.058704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:16.059594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:16.072109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.076160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.077531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.078408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.357012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:16.367114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:16.368154 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e131099-ef50-4c1b-b03d-ae49892309ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1274 microversion: 2.1 time: 0.321556 Jul 26 04:37:16.369415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1352/2613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:16 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1274 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:16.376450 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1afc18e2-f362-45d0-9c88-0a52e2ae7e77 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.541081 Jul 26 04:37:16.377194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:16.378818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:16.381120 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1262/2614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:15 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:16.386992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.387676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.389216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.390065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.394931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b9144a29-7ef8-41e8-b4fa-333cedf7b1cc req-1eb82678-1e86-49d9-94fa-c7af87480af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7394af32-20c8-460a-bf32-40912d13ccfe", "name": "network-vif-plugged", "status": "completed", "tag": "a943729c-2d9c-4c6b-b296-02738612d962"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:16.419926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b9144a29-7ef8-41e8-b4fa-333cedf7b1cc req-1eb82678-1e86-49d9-94fa-c7af87480af0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.426504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b9144a29-7ef8-41e8-b4fa-333cedf7b1cc req-1eb82678-1e86-49d9-94fa-c7af87480af0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.446938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b9144a29-7ef8-41e8-b4fa-333cedf7b1cc req-1eb82678-1e86-49d9-94fa-c7af87480af0 service nova] Creating event network-vif-plugged:a943729c-2d9c-4c6b-b296-02738612d962 for instance 7394af32-20c8-460a-bf32-40912d13ccfe on n-h2-848886-16 Jul 26 04:37:16.461397 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b9144a29-7ef8-41e8-b4fa-333cedf7b1cc req-1eb82678-1e86-49d9-94fa-c7af87480af0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078913 Jul 26 04:37:16.462196 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1263/2615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:16.516514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:16.517246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:16.526928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.527393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.528182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.528672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.911218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:16.925693 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cd4b7bbc-61d1-45bd-9d45-62099aa628d2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.415934 Jul 26 04:37:16.926399 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1264/2616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:16 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:16.943418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:16.944714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:16.958963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.960803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.962848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:16.965844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:16.985999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:17.000714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-630fbaca-ff71-41c6-9b38-3135c1794b49 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.629738 Jul 26 04:37:17.002775 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1353/2617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:16 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:17.067789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:17.070376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:17.096257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.096988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.098821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.101258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.267690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:17.280141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22d36ca0-5eb0-4f7e-b45e-e51bae2623bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.347881 Jul 26 04:37:17.296517 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1265/2618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:16 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:17.395928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:17.397074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:17.412963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.414685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.415658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.416258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.506689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:17.516619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b369b61b-b9ea-4a0b-bcd3-addc75cb5e4c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1274 microversion: 2.1 time: 0.124450 Jul 26 04:37:17.517886 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1266/2619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:17 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:17.524347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:17.525205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:17.533344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.534743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.535747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.536387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.792099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:17.805416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4956453-6d14-4a42-9173-f78cd70c9fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.752706 Jul 26 04:37:17.806304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1354/2620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:17 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:17.915795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:17.930931 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a6fcce5-9c8e-466a-803c-f918c1bb8bbe tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1324 microversion: 2.1 time: 0.406149 Jul 26 04:37:17.931751 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1267/2621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:17 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:17.955047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:17.955665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:17.973776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.974259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:17.975047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:17.975488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:18.307615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-882b934e-147c-466e-b48d-6475f6ef2864 req-7e861073-a726-4c8f-a329-5175066c253b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7231416-6b0b-4c0d-bbad-4f2524c8a5bf", "tag": "3031e075-e286-44fc-bff4-bf56d7df72a7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:18.328255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-882b934e-147c-466e-b48d-6475f6ef2864 req-7e861073-a726-4c8f-a329-5175066c253b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:18.328705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-882b934e-147c-466e-b48d-6475f6ef2864 req-7e861073-a726-4c8f-a329-5175066c253b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:18.390115 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-882b934e-147c-466e-b48d-6475f6ef2864 req-7e861073-a726-4c8f-a329-5175066c253b service nova] Creating event network-changed:3031e075-e286-44fc-bff4-bf56d7df72a7 for instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf on n-h1-848886-16 Jul 26 04:37:18.405097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-882b934e-147c-466e-b48d-6475f6ef2864 req-7e861073-a726-4c8f-a329-5175066c253b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.597137 Jul 26 04:37:18.411100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1355/2622] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:18.432185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:18.433394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:18.448469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:18.455570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:18.458100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:18.462779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:18.882245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:18.893687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd4bf75b-5c3f-4b91-84b6-d6b7695d0465 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.480505 Jul 26 04:37:18.915712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1356/2623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:18 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:18.921599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f706dd3f-6cb2-46a2-9f07-59e402df32c8 req-bb8e1900-6e48-44bb-8614-4b04f6e997a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2260cefb-9a96-4605-a65e-941a9ce5e018", "tag": "b0b56259-34cb-4773-b177-e5278ac4b61f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:18.938272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f706dd3f-6cb2-46a2-9f07-59e402df32c8 req-bb8e1900-6e48-44bb-8614-4b04f6e997a9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:18.938914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f706dd3f-6cb2-46a2-9f07-59e402df32c8 req-bb8e1900-6e48-44bb-8614-4b04f6e997a9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:18.960078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f706dd3f-6cb2-46a2-9f07-59e402df32c8 req-bb8e1900-6e48-44bb-8614-4b04f6e997a9 service nova] Creating event network-changed:b0b56259-34cb-4773-b177-e5278ac4b61f for instance 2260cefb-9a96-4605-a65e-941a9ce5e018 on n-h2-848886-16 Jul 26 04:37:18.982110 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f706dd3f-6cb2-46a2-9f07-59e402df32c8 req-bb8e1900-6e48-44bb-8614-4b04f6e997a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055409 Jul 26 04:37:18.984130 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1357/2624] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:18.994401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:18.995350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:19.029406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.030131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.031242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.031842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.128126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:19.137528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6fbf017a-be66-4b6f-892b-0119590df033 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 1.187232 Jul 26 04:37:19.139401 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1268/2625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:17 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:19.145275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:19.146079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:19.158286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.161426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.164378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.165159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.385394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:19.407775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-547cb7a9-c5de-428b-a763-41b44fd0a7bc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.420845 Jul 26 04:37:19.408813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1358/2626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:18 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:19.417032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:19.418039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:19.428981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.430054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.431456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.433189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.714443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:19.730857 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f9a47f79-9acf-4542-854d-e17d02507fd1 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.318875 Jul 26 04:37:19.732811 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1359/2627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:19 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:19.738349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:19.739302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:19.748026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.748555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.749372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.751957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.909948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:19.919914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4d5422a7-57d5-451b-bd19-9f98a6459e63 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1520 microversion: 2.1 time: 0.184945 Jul 26 04:37:19.920647 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1360/2628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:19 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:19.927551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:19.928452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:19.940520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.941198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.942178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:19.942729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:19.989881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:20.001041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-841940f7-cff6-4afc-bfac-63df0ac98fdc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.859922 Jul 26 04:37:20.001948 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1269/2629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:19 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:20.007439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:20.008184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:20.015783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.016669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.017653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.019021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.051658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:20.096333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:20.105867 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-227618ec-2ebd-427d-94ab-e5f460a7203d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.183943 Jul 26 04:37:20.109517 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1361/2630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:19 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:20.160222 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-293752cc-93fe-4dfc-83d9-c311ebbe3843 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 204 len: 0 microversion: 2.1 time: 0.156337 Jul 26 04:37:20.161376 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1270/2631] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:20 2022] DELETE /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:20.166287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:20.167652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:20.174760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:20.176498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:20.179493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.180513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.182130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.183150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.186143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.187414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.189461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.190037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.348890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:20.358616 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89642235-bc2d-4be6-8ac7-a678fa32f74f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.200488 Jul 26 04:37:20.359600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1362/2632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:20 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:20.429806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:20.431071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:20.442855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.443738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.444754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.445407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.631872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:20.647394 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4aa5de87-fd22-47ed-9a47-eea6e1bb0da5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.221918 Jul 26 04:37:20.649301 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1363/2633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:20 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:20.656652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ea885192-27f7-49ff-acf2-5422dc561649 req-d1e0268d-1aac-43e8-93f7-683fb31e5b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da07cc22-6450-4853-8020-51392989bba6", "name": "network-vif-plugged", "status": "completed", "tag": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:20.680687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ea885192-27f7-49ff-acf2-5422dc561649 req-d1e0268d-1aac-43e8-93f7-683fb31e5b6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.681498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ea885192-27f7-49ff-acf2-5422dc561649 req-d1e0268d-1aac-43e8-93f7-683fb31e5b6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.699800 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ea885192-27f7-49ff-acf2-5422dc561649 req-d1e0268d-1aac-43e8-93f7-683fb31e5b6b service nova] Creating event network-vif-plugged:62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 for instance da07cc22-6450-4853-8020-51392989bba6 on n-h1-848886-16 Jul 26 04:37:20.702433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:20.708205 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ea885192-27f7-49ff-acf2-5422dc561649 req-d1e0268d-1aac-43e8-93f7-683fb31e5b6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056772 Jul 26 04:37:20.710739 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1364/2634] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:20.715246 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a547f43b-6e8e-4736-8cb2-d1586cf4b291 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1526 microversion: 2.1 time: 0.547140 Jul 26 04:37:20.716372 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1271/2635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:20 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1526 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:20.754066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:20.754832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:20.774107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.774596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:20.775390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:20.775836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.024955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:21.025573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:21.044810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.045523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.046506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.047129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.186584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:21.198861 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35a8a034-96e0-469e-a61c-6edd73889e5b tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.448947 Jul 26 04:37:21.199872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1365/2636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:20 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:21.205937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:21.206621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:21.223167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.223691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.224672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.225142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.232096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:21.688349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:21.694033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:21.703818 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9eadf826-aa43-4d31-a8f3-03d9fc41bb04 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.682648 Jul 26 04:37:21.705081 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1272/2637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:21 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:21.705190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0fde31b-8b33-4df0-ac44-ea3e3f904b43 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.503298 Jul 26 04:37:21.710118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:21.711002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1366/2638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:21 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:21.711304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:21.719854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:21.720400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:21.732053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.733391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.734484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.735027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.744166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.747396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:21.748261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:21.752223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.087915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:22.100818 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-763999e8-04df-4d71-a310-54efcf87d057 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.388737 Jul 26 04:37:22.101995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1367/2639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:21 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:22.113463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:22.114100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:22.120381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.120733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.122219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.122956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.147635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:22.158742 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd896156-44ec-4424-84d8-03f707aaa28d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.449713 Jul 26 04:37:22.159637 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1273/2640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:21 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:22.224616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:22.225506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:22.235359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.236133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.237163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.237821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.485693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:22.503635 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79f04fb9-f1ce-4efe-a0d6-0950c8e7967b tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1526 microversion: 2.1 time: 0.400199 Jul 26 04:37:22.504256 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1368/2641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:22 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1526 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:22.530271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5d733a6f-17d0-420a-99d0-e6e0e2d37c61 req-fb2b9b23-99b0-49a6-aaf8-969a9d1fbdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f46604-10b1-44f0-9e50-56a9f36f6f8e", "tag": "ed81efa3-388c-46d5-a6ea-de855a9706fb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:22.547901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5d733a6f-17d0-420a-99d0-e6e0e2d37c61 req-fb2b9b23-99b0-49a6-aaf8-969a9d1fbdca service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.548598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5d733a6f-17d0-420a-99d0-e6e0e2d37c61 req-fb2b9b23-99b0-49a6-aaf8-969a9d1fbdca service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.587125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5d733a6f-17d0-420a-99d0-e6e0e2d37c61 req-fb2b9b23-99b0-49a6-aaf8-969a9d1fbdca service nova] Creating event network-changed:ed81efa3-388c-46d5-a6ea-de855a9706fb for instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e on n-h2-848886-16 Jul 26 04:37:22.600157 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5d733a6f-17d0-420a-99d0-e6e0e2d37c61 req-fb2b9b23-99b0-49a6-aaf8-969a9d1fbdca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073482 Jul 26 04:37:22.600806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1369/2642] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:37:22.700393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:22.715385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4313cb3-8715-4415-beb8-b88a961b7e3a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1332 microversion: 2.1 time: 0.495046 Jul 26 04:37:22.728975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:22.729597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:22.730966 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1274/2643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:22 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1332 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:22.742534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:22.743335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:22.743693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.744159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.751173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.751618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.765116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.766311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.767285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:22.768603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:22.947929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=17 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:22.986826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=78 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:23.010504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:23.022325 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81c6d548-65b2-40f3-9aea-19e3d27c233f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 0.284539 Jul 26 04:37:23.023164 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1275/2644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:22 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:23.028763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dadcd6a3-9aaa-4d16-89c0-a564db620b3d req-79cfda03-f320-466e-bcc4-95be0bdb0402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac71e1a7-d446-42ae-8f14-475f08721ccd", "name": "network-vif-plugged", "status": "completed", "tag": "8bbe6467-ff6f-40a5-8ced-6f9c307d98df"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:23.039092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dadcd6a3-9aaa-4d16-89c0-a564db620b3d req-79cfda03-f320-466e-bcc4-95be0bdb0402 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.039941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dadcd6a3-9aaa-4d16-89c0-a564db620b3d req-79cfda03-f320-466e-bcc4-95be0bdb0402 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.053262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dadcd6a3-9aaa-4d16-89c0-a564db620b3d req-79cfda03-f320-466e-bcc4-95be0bdb0402 service nova] Creating event network-vif-plugged:8bbe6467-ff6f-40a5-8ced-6f9c307d98df for instance ac71e1a7-d446-42ae-8f14-475f08721ccd on n-h1-848886-16 Jul 26 04:37:23.058504 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dadcd6a3-9aaa-4d16-89c0-a564db620b3d req-79cfda03-f320-466e-bcc4-95be0bdb0402 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Jul 26 04:37:23.059114 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1276/2645] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:23.128620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:23.129712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:23.139285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.140144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.142270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.143454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.154700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:23.190948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:23.201215 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c3b2e5b-e3fe-4b69-8ce0-3d32dbe8750f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.477452 Jul 26 04:37:23.202683 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1370/2646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:22 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:23.218753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:23.219573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:23.227560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.228226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.229171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.229812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.568826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:23.579026 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fbed2ca4-98ad-4937-9b10-860be16b04e1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.456267 Jul 26 04:37:23.580392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1277/2647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:23 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:23.585821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:23.586889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:23.597521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.601379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.604810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.605471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.684236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:23.696901 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-234ebe94-9f52-4fd0-976c-884cfce16e33 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.492846 Jul 26 04:37:23.699242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1371/2648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:23 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:23.740907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:23.743086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:23.754597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.760917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:23.775569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:23.777564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:24.156350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:24.164603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3a2b5c6-fb28-4c9c-8786-ef7016a71533 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1536 microversion: 2.1 time: 0.431957 Jul 26 04:37:24.182352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1372/2649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:23 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1536 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:24.196070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:24.196837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:24.213533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:24.214252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:24.215187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:24.215812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:24.317861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:24.331884 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-256a7af0-d44f-4dfd-8dc9-5bdf316917bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1526 microversion: 2.1 time: 0.749816 Jul 26 04:37:24.346183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1278/2650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:23 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1526 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:24.346183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0d1d1e1-f548-44e9-bdb6-392b2d4f6048 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'create', calling method: .version_select at 0x7f38b6466c10>, body: {"pool": "75c51b10-d4e1-485c-a436-7f097bc72177"} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:25.344061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:25.358497 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f3ac660-de5c-46d5-99f1-32f0be821b1f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1323 microversion: 2.1 time: 1.171880 Jul 26 04:37:25.360296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1373/2651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:24 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1323 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:25.389253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:25.395432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:25.425710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:25.426719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:25.430747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:25.431759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:26.026730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:26.036172 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cba0798e-983d-414b-9b73-c4ce19aa46ce tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.671659 Jul 26 04:37:26.043073 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1374/2652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:25 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:26.048428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:26.051169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:26.069108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:26.070087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:26.071172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:26.074188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:26.651372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:26.683194 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4d8438d-4f4b-46c9-aa5e-3deb6f51bfde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1521 microversion: 2.1 time: 0.638618 Jul 26 04:37:26.683813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1375/2653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:26 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1521 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:26.698044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:26.698929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:26.740663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:26.741301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:26.742368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:26.745035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:27.525431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:27.553132 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eaab1273-df38-457a-a313-9c71ac5b568d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.866692 Jul 26 04:37:27.554019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1376/2654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:26 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:27.562292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:27.563506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:27.574304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:27.575417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:27.578449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:27.579219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:27.629348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:27.630978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:27.631696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lazy-loading 'fault' on Instance uuid 7394af32-20c8-460a-bf32-40912d13ccfe {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:27.708106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06dd8c749d2f4662a54a04f77ebf20cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b358735df742409a285172544cc056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:27.723591 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-792be75f-db26-40dc-94c3-314a1ca3c007 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 200 len: 1314 microversion: 2.1 time: 0.166807 Jul 26 04:37:27.724561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1377/2655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:27 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:27.729846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:27.739112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:27.747256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:27.765957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:27.767290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:27.768253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:27.768844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.053172 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0d1d1e1-f548-44e9-bdb6-392b2d4f6048 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.718271 Jul 26 04:37:28.053811 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1279/2656] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:37:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:28.060543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:28.061827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:28.083145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.083614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.084413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.084847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.127048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:28.141771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4344bc3-b767-43e0-aada-69bb721a5065 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 200 len: 1517 microversion: 2.1 time: 0.409587 Jul 26 04:37:28.148283 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1378/2657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:27 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:28.154893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-03735017-add3-4f10-8983-0d9b3c7e9b84 req-a4c09556-a57d-43ef-84d5-3a247d071bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7394af32-20c8-460a-bf32-40912d13ccfe", "name": "network-vif-deleted", "tag": "a943729c-2d9c-4c6b-b296-02738612d962"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:28.168486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-03735017-add3-4f10-8983-0d9b3c7e9b84 req-a4c09556-a57d-43ef-84d5-3a247d071bea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.169145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-03735017-add3-4f10-8983-0d9b3c7e9b84 req-a4c09556-a57d-43ef-84d5-3a247d071bea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.189517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-03735017-add3-4f10-8983-0d9b3c7e9b84 req-a4c09556-a57d-43ef-84d5-3a247d071bea service nova] Creating event network-vif-deleted:a943729c-2d9c-4c6b-b296-02738612d962 for instance 7394af32-20c8-460a-bf32-40912d13ccfe on n-h2-848886-16 Jul 26 04:37:28.208495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-03735017-add3-4f10-8983-0d9b3c7e9b84 req-a4c09556-a57d-43ef-84d5-3a247d071bea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057446 Jul 26 04:37:28.210277 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1379/2658] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:28.222841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:28.226513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:28.236724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.237638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.239714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.240612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.327049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:28.337479 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d247447-e8f1-4e42-83dc-91d93634edef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.282029 Jul 26 04:37:28.343551 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1280/2659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:28 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:28.348704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.62"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:28.354814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:28.366984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.374434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.375552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.376159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.439866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Acquired lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:37:28.916682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:28.926990 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5801e08-cf7d-4c56-be21-6dc7113e4988 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1501 microversion: 2.1 time: 0.713757 Jul 26 04:37:28.928099 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1380/2660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:28 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1501 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:28.938887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:28.939674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:28.950509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.951471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:28.952363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:28.952907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.186831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:29.195525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-56d4af31-e85f-47cd-9b93-e29ec56bcb16 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1323 microversion: 2.1 time: 0.266276 Jul 26 04:37:29.196356 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1381/2661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:28 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:29.202767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:29.203776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:29.209859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.210529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.211487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.212096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.481217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:29.497997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17ae765b-f856-46c1-9037-5c211607c163 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.299301 Jul 26 04:37:29.499151 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1382/2662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:29 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:29.514014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:29.514901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7394af32-20c8-460a-bf32-40912d13ccfe] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:29.534524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.535268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.536255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.538492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.560661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe HTTP/1.1 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7394af32-20c8-460a-bf32-40912d13ccfe'} Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:29.571197 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. Jul 26 04:37:29.576513 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:29.579968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 7394af32-20c8-460a-bf32-40912d13ccfe could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:29.581176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7848fc4b-0c89-44ea-8876-9576ed7a63bd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe" status: 404 len: 111 microversion: 2.1 time: 0.080571 Jul 26 04:37:29.586115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1383/2663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:29 2022] GET /compute/v2.1/servers/7394af32-20c8-460a-bf32-40912d13ccfe => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:29.595931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:29.597905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:29.610030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.610580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.611385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:29.611823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:29.635554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:30.037466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:30.052648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b4a1177-b1e6-46cc-b5ba-a1d0c0c0cceb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1516 microversion: 2.1 time: 0.465290 Jul 26 04:37:30.054381 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1384/2664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:29 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1516 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:30.060994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:30.062513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:30.069905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:30.071103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:30.072125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:30.072804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:30.369871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:30.379730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4f5c1924-c53a-45e2-9976-aba953513517 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.322644 Jul 26 04:37:30.382817 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1385/2665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:30 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:30.405832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a8532dd1-6802-4f4f-b1e3-287cc4aa62e0 req-dcf8362e-66ec-416e-aa2b-70b033640693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2260cefb-9a96-4605-a65e-941a9ce5e018", "name": "network-vif-plugged", "status": "completed", "tag": "b0b56259-34cb-4773-b177-e5278ac4b61f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:30.420681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a8532dd1-6802-4f4f-b1e3-287cc4aa62e0 req-dcf8362e-66ec-416e-aa2b-70b033640693 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:30.421407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a8532dd1-6802-4f4f-b1e3-287cc4aa62e0 req-dcf8362e-66ec-416e-aa2b-70b033640693 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:30.447906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a8532dd1-6802-4f4f-b1e3-287cc4aa62e0 req-dcf8362e-66ec-416e-aa2b-70b033640693 service nova] Creating event network-vif-plugged:b0b56259-34cb-4773-b177-e5278ac4b61f for instance 2260cefb-9a96-4605-a65e-941a9ce5e018 on n-h2-848886-16 Jul 26 04:37:30.461892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a8532dd1-6802-4f4f-b1e3-287cc4aa62e0 req-dcf8362e-66ec-416e-aa2b-70b033640693 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076323 Jul 26 04:37:30.463535 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1386/2666] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:30.471511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-deb5afa6-c3c1-4a3f-8d93-a75c839a5587 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b5936ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:30.556797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-deb5afa6-c3c1-4a3f-8d93-a75c839a5587 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Image not found. Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-deb5afa6-c3c1-4a3f-8d93-a75c839a5587 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e HTTP/1.1 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'fd297e38-5311-4e80-8b83-29ad9d7acb4e'} Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fd297e38-5311-4e80-8b83-29ad9d7acb4e to delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd297e38-5311-4e80-8b83-29ad9d7acb4e could not be found. Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:30.559058 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-deb5afa6-c3c1-4a3f-8d93-a75c839a5587 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-deb5afa6-c3c1-4a3f-8d93-a75c839a5587 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e" status: 404 len: 62 microversion: 2.1 time: 0.095650 Jul 26 04:37:30.562875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1387/2667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:30 2022] DELETE /compute/v2.1/images/fd297e38-5311-4e80-8b83-29ad9d7acb4e => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:37:30.572738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-288256618", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "2dbbebc4-9f8a-4dea-a5bd-a6171f0392e8"}, {"uuid": "c2dcf33d-0af0-47a0-82ef-0fcb27ef6666"}, {"uuid": "2dbbebc4-9f8a-4dea-a5bd-a6171f0392e8"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:30.628889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:37:30.678924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] validate_networks() for [('2dbbebc4-9f8a-4dea-a5bd-a6171f0392e8', None, None, None, None, None), ('c2dcf33d-0af0-47a0-82ef-0fcb27ef6666', None, None, None, None, None), ('2dbbebc4-9f8a-4dea-a5bd-a6171f0392e8', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:37:31.790888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Updating instance_info_cache with network_info: [{"id": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84", "address": "fa:16:3e:8c:bc:b8", "network": {"id": "badc6835-8985-4e41-9bfd-7a8a2cc9011d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-402722676-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c76aa4a586f5424ca48c062b9ddfd38e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62ba8d03-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:37:31.813518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Releasing lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:37:31.814865 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-590a9f7d-8338-4fe1-a155-b6fa6953260f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 202 len: 0 microversion: 2.1 time: 3.470058 Jul 26 04:37:31.816010 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1281/2668] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:28 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 0 bytes in 3472 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:37:31.828151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:31.834858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 87c8f6a5-9d8c-41ca-9aff-992f09260753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:31.847228 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/87c8f6a5-9d8c-41ca-9aff-992f09260753/action HTTP/1.1 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: {"rescue": {}} Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '87c8f6a5-9d8c-41ca-9aff-992f09260753', 'body': {'rescue': {}}} Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:31.860208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. Jul 26 04:37:31.864595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:31.865770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 404 to user: Instance 87c8f6a5-9d8c-41ca-9aff-992f09260753 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:31.867070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5a04714-dcf4-45ce-9789-9f21c31c22c8 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/87c8f6a5-9d8c-41ca-9aff-992f09260753/action" status: 404 len: 111 microversion: 2.1 time: 0.049941 Jul 26 04:37:31.867798 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1282/2669] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:31 2022] POST /compute/v2.1/servers/87c8f6a5-9d8c-41ca-9aff-992f09260753/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:31.875675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:31.883464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:31.893001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:31.893849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:31.894916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:31.895512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.124159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:32.144169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2612e3c-1440-4901-925b-5f43b9f94fe0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1323 microversion: 2.1 time: 0.269353 Jul 26 04:37:32.158619 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1283/2670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:31 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:32.165809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:32.168893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:32.179582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.180324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.181316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.181783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.483380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:32.495294 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f4d50ae-d093-421a-8822-777ffc4feec2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1485 microversion: 2.1 time: 0.336690 Jul 26 04:37:32.501174 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1284/2671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:32 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1485 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:32.506828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:32.507442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:32.516834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.517301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.518099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.518578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.542948 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 HTTP/1.1 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7e5bb002-9b50-4e69-a2e1-1cd7cb082161'} Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:32.544813 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:32.549082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:32.550643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:32.552045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a80a7d42-cec6-48b0-8226-a906c1179ad1 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 404 len: 111 microversion: 2.1 time: 0.049825 Jul 26 04:37:32.553065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1285/2672] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:32 2022] DELETE /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:32.560684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1d1e7039-7390-4b58-a1fd-88e0672d9fd3 req-415e123e-c1e0-46fd-8c4a-a947b0a9507e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da07cc22-6450-4853-8020-51392989bba6", "tag": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:32.572831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d1e7039-7390-4b58-a1fd-88e0672d9fd3 req-415e123e-c1e0-46fd-8c4a-a947b0a9507e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.573314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1d1e7039-7390-4b58-a1fd-88e0672d9fd3 req-415e123e-c1e0-46fd-8c4a-a947b0a9507e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.587425 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1d1e7039-7390-4b58-a1fd-88e0672d9fd3 req-415e123e-c1e0-46fd-8c4a-a947b0a9507e service nova] Creating event network-changed:62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 for instance da07cc22-6450-4853-8020-51392989bba6 on n-h1-848886-16 Jul 26 04:37:32.595376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1d1e7039-7390-4b58-a1fd-88e0672d9fd3 req-415e123e-c1e0-46fd-8c4a-a947b0a9507e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040916 Jul 26 04:37:32.599053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1286/2673] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:32.608252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:32.609323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:32.616711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.617361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.618204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.618800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.705265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:37:32.705730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:37:32.706351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:37:32.707172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:37:32.708183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:37:32.723519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.724332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.726840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.728494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:32.760260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Getting quotas for project 9e51945c9cb04fa5ab1ac0d8ebdf83c4. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:32.770056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Getting quotas for user 113f2b415ddf44519f9908d643958bab and project 9e51945c9cb04fa5ab1ac0d8ebdf83c4. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:32.788663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:37:32.792750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:32.895521 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a53d2d6e-aa28-49d3-973f-435c64fc527a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332837 Jul 26 04:37:32.897158 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1388/2674] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:37:32.905381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:32.911570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47e7d5cc-ad0e-451f-bb51-4c763f93c267 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'create', calling method: .version_select at 0x7f38b5032ee0>, body: {"pool": "75c51b10-d4e1-485c-a436-7f097bc72177"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:32.926894 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c01704e-2fa7-4e81-abe8-fac16ce7e2c8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.326198 Jul 26 04:37:32.931428 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1287/2675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:32 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:32.943100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:32.943658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:32.991918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:32.998322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:32.998792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.009855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.011380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.173159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86158153-b43b-4f8a-b3d6-83c8bbcc265f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action" status: 202 len: 0 microversion: 2.1 time: 0.238917 Jul 26 04:37:33.177688 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1288/2676] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:32 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:33.187345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:33.188319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:33.196818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.197383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.198457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.199007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.316568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14f93be5-36d3-4ba4-832f-d0ecd2e41c21 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "POST /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03/action" status: 202 len: 0 microversion: 2.1 time: 0.140567 Jul 26 04:37:33.318716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1289/2677] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:33 2022] POST /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:33.338058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:33.338843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 7e5bb002-9b50-4e69-a2e1-1cd7cb082161] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:33.382083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.383656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.384690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.385301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.419237 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 HTTP/1.1 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7e5bb002-9b50-4e69-a2e1-1cd7cb082161'} Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:33.422817 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. Jul 26 04:37:33.426976 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:33.429900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 7e5bb002-9b50-4e69-a2e1-1cd7cb082161 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:33.430993 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-caf1b605-488a-4cc8-94dd-4df12a29e768 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161" status: 404 len: 111 microversion: 2.1 time: 0.110113 Jul 26 04:37:33.442234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1290/2678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:33 2022] GET /compute/v2.1/servers/7e5bb002-9b50-4e69-a2e1-1cd7cb082161 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:33.447771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-321e7cd0-03f2-416d-b82a-9afa0281404d req-e761f615-2fde-48dd-9d69-7b628ac584f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7231416-6b0b-4c0d-bbad-4f2524c8a5bf", "name": "network-vif-plugged", "status": "completed", "tag": "3031e075-e286-44fc-bff4-bf56d7df72a7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:33.482497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-321e7cd0-03f2-416d-b82a-9afa0281404d req-e761f615-2fde-48dd-9d69-7b628ac584f3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.484753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-321e7cd0-03f2-416d-b82a-9afa0281404d req-e761f615-2fde-48dd-9d69-7b628ac584f3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.518426 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-321e7cd0-03f2-416d-b82a-9afa0281404d req-e761f615-2fde-48dd-9d69-7b628ac584f3 service nova] Creating event network-vif-plugged:3031e075-e286-44fc-bff4-bf56d7df72a7 for instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf on n-h1-848886-16 Jul 26 04:37:33.530144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-321e7cd0-03f2-416d-b82a-9afa0281404d req-e761f615-2fde-48dd-9d69-7b628ac584f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086101 Jul 26 04:37:33.531147 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1291/2679] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:33.553493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10f2234d-4279-4fe1-996f-5ba6105d2a4e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:33.555193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10f2234d-4279-4fe1-996f-5ba6105d2a4e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:33.799931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10f2234d-4279-4fe1-996f-5ba6105d2a4e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:33.813267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10f2234d-4279-4fe1-996f-5ba6105d2a4e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1212 microversion: 2.1 time: 0.280572 Jul 26 04:37:33.814345 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1292/2680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:33 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1212 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:33.823897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:33.826934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:33.840110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.844178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:33.847649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:33.850040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:34.447611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:34.462909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4d38c32-b01a-4f5e-a1e3-c1bd4ce43840 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1516 microversion: 2.1 time: 0.647122 Jul 26 04:37:34.463829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1293/2681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:33 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1516 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:34.470140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:34.470784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:34.492557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:34.493028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:34.493836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:34.494322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:34.856655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:34.867983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f0987a9-e513-4f1c-943e-7ed3fa989063 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1501 microversion: 2.1 time: 0.403083 Jul 26 04:37:34.868585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1294/2682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:34 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1501 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:34.881584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:34.882119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:34.891131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:34.891598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:34.892359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:34.892792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:35.184230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:35.204527 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7da0edc2-e321-4e57-8f18-ec61a230bbde tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1493 microversion: 2.1 time: 0.334823 Jul 26 04:37:35.205191 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1295/2683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:34 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1493 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:35.228494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec07188c-ed39-4b71-ac68-9bffa4b41b0d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b54a25e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:35.254386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec07188c-ed39-4b71-ac68-9bffa4b41b0d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198224278" status: 202 len: 0 microversion: 2.1 time: 0.046948 Jul 26 04:37:35.255706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1296/2684] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198224278 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:35.263332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:35.264191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:35.276350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:35.277179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:35.278765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:35.279388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:35.614771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:35.625054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:35.630204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-833b991d-5702-46c3-89b9-1f97663ec26a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.373193 Jul 26 04:37:35.631766 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1297/2685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:35 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:35.662579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:35.663637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:35.682965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:35.684364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:35.685568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:35.687160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:36.507292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:36.530129 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb890038-dbbe-4694-b1cf-76bec94b66bb tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 200 len: 1517 microversion: 2.1 time: 0.875073 Jul 26 04:37:36.532762 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1298/2686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:35 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 1517 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:36.549252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:36.551079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:36.565576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:36.568738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:36.570221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:36.571979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.182732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:37.195223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-176e9f56-1f08-4415-b2c8-0278cc877cfe tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1312 microversion: 2.1 time: 0.657507 Jul 26 04:37:37.198036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1299/2687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:36 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1312 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:37.214514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:37.217797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:37.227955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.235770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.236883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.237468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.296981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'flavor' on Instance uuid 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:37.311676 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Cannot 'rescue' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state paused Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action HTTP/1.1 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: {"rescue": {}} Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'rescue' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state paused Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6', 'body': {'rescue': {}}} Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 in vm_state paused. Cannot rescue while the instance is in this state. Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state paused Jul 26 04:37:37.313830 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state paused Jul 26 04:37:37.319295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:37.321780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 409 to user: Cannot 'rescue' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state paused {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:37.323925 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e4a9ea7-072f-4539-ad88-6473aa9c550b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action" status: 409 len: 144 microversion: 2.1 time: 0.123848 Jul 26 04:37:37.325175 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1300/2688] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:37 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action => generated 144 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:37:37.331165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:37.332080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:37.340307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.341041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.342080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.342792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.769525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47e7d5cc-ad0e-451f-bb51-4c763f93c267 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.870271 Jul 26 04:37:37.770604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1389/2689] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:37:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:37.775509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:37.776021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:37.786935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.787396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.788181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.788625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.871453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:37.875018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:37.886398 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cbef5025-916e-41ec-985e-8c1a3ff2aab2 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1493 microversion: 2.1 time: 0.553537 Jul 26 04:37:37.888156 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1301/2690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:37 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1493 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:37.910047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:37.912123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:37.939017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.939513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:37.940499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:37.945473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.016870 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-236bd190-615e-4770-9f75-1aa3af375c0f tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 204 len: 0 microversion: 2.1 time: 0.242308 Jul 26 04:37:38.017907 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1390/2691] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:37 2022] DELETE /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:38.032692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-54bafdee-f6e4-45fb-86df-5fdb4835de70 req-28d95974-7e55-4373-a51c-ec349b24d381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f46604-10b1-44f0-9e50-56a9f36f6f8e", "name": "network-vif-plugged", "status": "completed", "tag": "ed81efa3-388c-46d5-a6ea-de855a9706fb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:38.049616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54bafdee-f6e4-45fb-86df-5fdb4835de70 req-28d95974-7e55-4373-a51c-ec349b24d381 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.050243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54bafdee-f6e4-45fb-86df-5fdb4835de70 req-28d95974-7e55-4373-a51c-ec349b24d381 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.079086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-54bafdee-f6e4-45fb-86df-5fdb4835de70 req-28d95974-7e55-4373-a51c-ec349b24d381 service nova] Creating event network-vif-plugged:ed81efa3-388c-46d5-a6ea-de855a9706fb for instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e on n-h2-848886-16 Jul 26 04:37:38.085003 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-54bafdee-f6e4-45fb-86df-5fdb4835de70 req-28d95974-7e55-4373-a51c-ec349b24d381 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060257 Jul 26 04:37:38.090748 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1391/2692] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:38.096990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:38.098284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:38.112661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.114754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.115722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.116318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.257296 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35f2be74-9fc4-4952-8e03-2fefd756119c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action" status: 202 len: 0 microversion: 2.1 time: 0.163834 Jul 26 04:37:38.262029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1392/2693] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:38 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:38.276523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: .version_select at 0x7f38b86339d0>, body: {"addFloatingIp": {"address": "172.25.7.186"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:38.288041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:38.309113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.309598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.310449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.313255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.364830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:38.369999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Acquired lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:37:38.382214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dcbad128-e21a-4db1-829a-533ae7cb5d23 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.492019 Jul 26 04:37:38.396613 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1302/2694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:37 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:38.403299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:38.403917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:38.413944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.414990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.416030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.416719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.687397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:38.699718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18b3f425-9ab7-401b-a729-50ae942e4e1d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 200 len: 1523 microversion: 2.1 time: 0.298673 Jul 26 04:37:38.700394 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1303/2695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:38 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:38.706605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:38.711542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:38.724372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.726729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:38.730873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:38.731718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:39.212719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:39.227433 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ce65178-37e6-4855-8812-d273be183139 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1333 microversion: 2.1 time: 0.525381 Jul 26 04:37:39.243532 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1304/2696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:38 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1333 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:39.249763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:39.250760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:39.262078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:39.262717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:39.264095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:39.264862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:39.644787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177.", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:37:39.645394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Releasing lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:37:39.645962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.645962 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Request method failure captured: Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action HTTP/1.1 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 46 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329qfllG3ahkGHklG1H6C0wFA9niTt9Cms6ZtPc6rNrE7ctPcedHJH4J0A83m3hIsJBHEeOQbFENZ31N5aKPVtmfExIuqzqSoa7iJ0IdcoCJilPoV66FO7FFDCgdPmnWW34fzzkK-kd4Hv5y3PJkGrWanciwbuhL3-6ZyyXXVMmVbVc Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: b6ea16ef8d824a86933233f7ff944c26 Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: {"addFloatingIp": {"address": "172.25.7.186"}} Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'da07cc22-6450-4853-8020-51392989bba6', 'body': {'addFloatingIp': {'address': '172.25.7.186'}}} Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:37:39.648069 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] Jul 26 04:37:39.655632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Returning 400 to user: Cannot associate floating IP 172.25.7.186 (171c0dc4-4ae2-49de-ad8d-023c97237efb) with port 62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 75c51b10-d4e1-485c-a436-7f097bc72177. Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5210341b-a58f-435d-bf69-1241a8457860'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-057bc6fe-790a-484e-a6f1-c813238bf310 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 400 len: 382 microversion: 2.1 time: 1.386243 Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1393/2697] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:38 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 382 bytes in 1391 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:39.660344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:39.696574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:39.697441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:39.698499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:39.699693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.082999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:40.093405 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-616c2393-9edb-4bf8-919a-cd20de34fcbc tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1508 microversion: 2.1 time: 0.848507 Jul 26 04:37:40.093802 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1305/2698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:39 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1508 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:40.099707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88ca73ea-6c5d-4797-8713-2c9061d361a3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '.version_select at 0x7f38b5a91b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.125500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:40.134897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-88ca73ea-6c5d-4797-8713-2c9061d361a3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Image not found. Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88ca73ea-6c5d-4797-8713-2c9061d361a3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/c59811c8-eb3c-4eec-8237-4220b033c341 HTTP/1.1 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c59811c8-eb3c-4eec-8237-4220b033c341'} Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c59811c8-eb3c-4eec-8237-4220b033c341 to delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c59811c8-eb3c-4eec-8237-4220b033c341 could not be found. Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:40.137926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:37:40.141796 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.145410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39adfd59-4df0-4728-a6b4-fb501ec469d1 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1499 microversion: 2.1 time: 0.490223 Jul 26 04:37:40.159339 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1394/2699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:39 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:40.165580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.165911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88ca73ea-6c5d-4797-8713-2c9061d361a3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:40.166232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:40.171023 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88ca73ea-6c5d-4797-8713-2c9061d361a3 tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/images/c59811c8-eb3c-4eec-8237-4220b033c341" status: 404 len: 62 microversion: 2.1 time: 0.074794 Jul 26 04:37:40.172141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1306/2700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:40 2022] DELETE /compute/v2.1/images/c59811c8-eb3c-4eec-8237-4220b033c341 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:37:40.177642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee61ee16-444e-46bb-a083-604d44aed52a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '.version_select at 0x7f38b5b95940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.194560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.195042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.195832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.196268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.489041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:40.497869 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5d3e37e-6a01-4e1a-b520-c836f0afeba8 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1316 microversion: 2.1 time: 0.345958 Jul 26 04:37:40.499053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1395/2701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:40 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:40.503988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.504615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:40.510711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.511693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.512594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.512903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.772478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:40.783297 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa4de832-a509-4e66-a07f-c7da5c499109 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 200 len: 1523 microversion: 2.1 time: 0.282821 Jul 26 04:37:40.784121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1396/2702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:40 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:40.789345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.790111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:40.797156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.797890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.799323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.800141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.828773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:40.943694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9958757a-bc2d-441f-864c-4a0d6d7c993f tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 204 len: 0 microversion: 2.1 time: 0.157815 Jul 26 04:37:40.945331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1397/2703] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:40 2022] DELETE /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:40.953064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:40.953970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:40.961341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.962089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.963286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:40.963960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:40.989922 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 HTTP/1.1 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316'} Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:40.992403 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:40.996630 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.000054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:41.001180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3202566f-705c-4ece-8b35-bac65f927f8d tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 404 len: 111 microversion: 2.1 time: 0.054197 Jul 26 04:37:41.002576 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1398/2704] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:40 2022] DELETE /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:41.008867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:41.010409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:41.023370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.023834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.024882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.025654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.278838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:41.289774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ee8098d-3096-40b7-845c-32a0279f3990 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.284694 Jul 26 04:37:41.304059 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1399/2705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:41 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:41.306863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:41.307707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:41.320422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.321637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.322498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.323404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.625994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:41.636347 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-276fca38-1819-4151-beb3-7bb782e87bc8 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.334689 Jul 26 04:37:41.638882 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1400/2706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:41 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:41.650584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:41.651653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] [instance: 45d6d4e5-05d3-4626-9b14-31e236450316] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:41.670246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.670834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.673680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.674348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.712635 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] HTTP exception thrown: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Request method failure captured: Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 HTTP/1.1 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328M8jnI5lRoOXSEtGLs985fTfEEZfIHOcjEUDRtHgqwPCFoyZIRKRcA2B7hp1q-0pkXwE20A-CBsszkhz4hEljiiFWnRtFW_ldsBRrKCxrzX_nM3CdCpyU7IEpeupLW69MEg43UouYtAp8X1V5vfjyR6A5bM5oHqNDgV-bBn8ftItM Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27b358735df742409a285172544cc056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27b358735df742409a285172544cc056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27b358735df742409a285172544cc056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 27b358735df742409a285172544cc056 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456 Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 06dd8c749d2f4662a54a04f77ebf20cb Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1851989456-project Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '45d6d4e5-05d3-4626-9b14-31e236450316'} Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.717556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. Jul 26 04:37:41.721548 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:41.724445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] Returning 404 to user: Instance 45d6d4e5-05d3-4626-9b14-31e236450316 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:41.727256 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af52709f-121a-4c93-b330-710dc7df8bfd tempest-ImagesOneServerNegativeTestJSON-1851989456 tempest-ImagesOneServerNegativeTestJSON-1851989456-project] 10.222.0.43 "GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316" status: 404 len: 111 microversion: 2.1 time: 0.086976 Jul 26 04:37:41.732606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1401/2707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:41 2022] GET /compute/v2.1/servers/45d6d4e5-05d3-4626-9b14-31e236450316 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:41.741325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:41.742579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:41.764952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.766044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.767089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:41.768214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:41.795419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:42.249453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:42.263833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8a138cd-ace5-4daa-a808-440201d5502e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1516 microversion: 2.1 time: 0.529717 Jul 26 04:37:42.274579 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1402/2708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:41 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1516 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:42.287535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:42.288404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:42.296985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.297449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.302670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.303505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.695416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:42.705563 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d784a9f8-6cda-486b-8fd2-4bd01c01c83a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1465 microversion: 2.1 time: 0.429528 Jul 26 04:37:42.706976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1403/2709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:42 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1465 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:42.712833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bf8d854a-6542-4f0c-970e-b48ce682ebde req-bf4fd80f-5284-4e1a-826e-2bcb2398a1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7231416-6b0b-4c0d-bbad-4f2524c8a5bf", "name": "network-vif-deleted", "tag": "3031e075-e286-44fc-bff4-bf56d7df72a7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:42.725862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bf8d854a-6542-4f0c-970e-b48ce682ebde req-bf4fd80f-5284-4e1a-826e-2bcb2398a1c5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.727154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bf8d854a-6542-4f0c-970e-b48ce682ebde req-bf4fd80f-5284-4e1a-826e-2bcb2398a1c5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.772341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:42.780892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bf8d854a-6542-4f0c-970e-b48ce682ebde req-bf4fd80f-5284-4e1a-826e-2bcb2398a1c5 service nova] Creating event network-vif-deleted:3031e075-e286-44fc-bff4-bf56d7df72a7 for instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf on n-h1-848886-16 Jul 26 04:37:42.793639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bf8d854a-6542-4f0c-970e-b48ce682ebde req-bf4fd80f-5284-4e1a-826e-2bcb2398a1c5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084188 Jul 26 04:37:42.795262 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1404/2710] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:42.802617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:42.803407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:42.809499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:42.814706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.815424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.816608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.817318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.903817 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee61ee16-444e-46bb-a083-604d44aed52a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/171c0dc4-4ae2-49de-ad8d-023c97237efb" status: 202 len: 0 microversion: 2.1 time: 2.730269 Jul 26 04:37:42.904619 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1307/2711] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:37:40 2022] DELETE /compute/v2.1/os-floating-ips/171c0dc4-4ae2-49de-ad8d-023c97237efb => generated 0 bytes in 2732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:42.913975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:42.914626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:42.934022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.935027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.935301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.935745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.951036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:42.960178 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58445b38-d358-4876-afc7-3962cff93ee0 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 200 len: 1481 microversion: 2.1 time: 0.163475 Jul 26 04:37:42.960770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1405/2712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:42 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 1481 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:42.975659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:42.976529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:42.993787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.994497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:42.995243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:42.996113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:43.333421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:43.341955 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ecb1f74-dbff-4584-a401-4907d819e759 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.380136 Jul 26 04:37:43.343153 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1406/2713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:42 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:43.484602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:43.522248 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b41fedb4-33dc-4a5e-8d10-644180b73b71 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.612102 Jul 26 04:37:43.524121 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1308/2714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:42 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:43.534770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: .version_select at 0x7f38b8857a60>, body: {"removeFloatingIp": {"address": "172.25.7.62"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:43.806453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:44.143681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:44.146487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:44.168426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.169454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.170564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.171266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.223650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:44.231639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.232103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.232912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.233365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.641324 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-786358e3-9526-4aa8-a3a9-41989de29d99 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1618 microversion: 2.1 time: 1.296823 Jul 26 04:37:44.646546 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1407/2715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:43 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1618 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:44.651786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:44.659313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:44.669910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.670503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.671302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.672119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.733510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.734258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.734913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lazy-loading 'fault' on Instance uuid c7231416-6b0b-4c0d-bbad-4f2524c8a5bf {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:44.824940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:44.834599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-386cd001-ce3e-4ab3-b677-822f2d13c8de tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 200 len: 1313 microversion: 2.1 time: 0.186184 Jul 26 04:37:44.836418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1408/2716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:44 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:44.844912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:44.845663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:44.852026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.852491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:44.853324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:44.853785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.024049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:45.035212 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ecb7fbf-d80e-4591-8de0-fcf0f31678fc tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 200 len: 1505 microversion: 2.1 time: 0.196334 Jul 26 04:37:45.036763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1409/2717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:44 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:45.044081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:45.044696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:45.053670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:45.054134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.054950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:45.055394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.100884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Acquired lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:37:45.253263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:45.262345 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f10a4618-34a7-4abf-a043-ecc4dc120309 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.224459 Jul 26 04:37:45.263233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1410/2718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:45 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:45.268743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: .version_select at 0x7f38b5014ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1064509133", "policies": ["affinity"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:45.287618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:45.294433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:45.319968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:45.377350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:45.383904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:45.399100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2235a700-b787-4b48-b207-03fd4c6945aa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.134362 Jul 26 04:37:45.407378 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1411/2719] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Jul 26 04:37:45 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:45.422870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-99124704-9b3d-4607-9d2c-98eb1e4325ad req-06e2d02f-e8ff-405e-ad54-c0489d4243e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "tag": "276d7529-2021-49de-8c08-fdd5d2f0cdc7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:45.439832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-99124704-9b3d-4607-9d2c-98eb1e4325ad req-06e2d02f-e8ff-405e-ad54-c0489d4243e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:45.440525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-99124704-9b3d-4607-9d2c-98eb1e4325ad req-06e2d02f-e8ff-405e-ad54-c0489d4243e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.453751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-99124704-9b3d-4607-9d2c-98eb1e4325ad req-06e2d02f-e8ff-405e-ad54-c0489d4243e0 service nova] Creating event network-changed:276d7529-2021-49de-8c08-fdd5d2f0cdc7 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:37:45.460102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-99124704-9b3d-4607-9d2c-98eb1e4325ad req-06e2d02f-e8ff-405e-ad54-c0489d4243e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050930 Jul 26 04:37:45.460979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1412/2720] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:45.466937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:45.470043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:45.493989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:45.494471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.495799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:45.496232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:45.534239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'flavor' on Instance uuid 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:45.679742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e5fd0e4-e0d2-4e52-bf41-b2a16f834a89 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action" status: 200 len: 32 microversion: 2.1 time: 0.217350 Jul 26 04:37:45.682251 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1413/2721] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:45 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:45.695287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2051276858", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8b069c89-60d3-43e6-8197-6e1588d56a96"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:45.834060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:37:46.695502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:37:46.696575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:37:46.697057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:37:46.697895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:37:46.701072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:37:46.751769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:46.752933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:46.753960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:46.754660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:46.821376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:46.844756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:46.867534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 2 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:37:46.872908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:46.976326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119488) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 04:37:47.038911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:47.053670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:47.111976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:47.119747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:47.139622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=8903bf4f-431a-45e1-8284-16a0550064d6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:37:47.213447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:47.221303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:47.283450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:47.290711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:47.340513 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c7ef2113-46e2-425f-8934-1ad726120733 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.656084 Jul 26 04:37:47.342324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1414/2722] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:37:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1659 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:37:47.354203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:47.357275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:47.364504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.365094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.366112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.366945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.728965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:47.763945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bde67c68-5217-42d5-9ba7-4870700c9f75 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.419888 Jul 26 04:37:47.770106 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1415/2723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:47 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:47.780631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:47.781262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:47.814630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.815884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.816318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.816955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.861568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] HTTP exception thrown: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf HTTP/1.1 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c7231416-6b0b-4c0d-bbad-4f2524c8a5bf'} Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:47.863261 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.867714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 404 to user: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:47.868669 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45bc6bd1-2a88-4e1f-929e-8ec7cc222c7d tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 404 len: 111 microversion: 2.1 time: 0.093531 Jul 26 04:37:47.878408 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1416/2724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:47 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:47.884287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:47.885099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: c0218ec5-8ad9-473e-b819-853209360f03] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:47.902824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.914919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.916034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.916649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.940245 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] HTTP exception thrown: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Request method failure captured: Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 HTTP/1.1 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328jG4MH_9ojNVA9Zg81qrxa-CGSZF8ESWfGCFK9OjdoTtyeFYwGmFUEvbcP-HmxH_HVK5kgLGb5f_132oxiLaVtLge6IE2pt8esqamSEFXSdfNOlP2j4BnxNRo_3IdFdgp6ay9NV6r0uIkV1QLIleeScG4jbJ9wRNffVwuduYBZzno Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6c78e1a85b9342b394b5528fcd158a04 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6c78e1a85b9342b394b5528fcd158a04 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerRescueTestJSON-1754581508-project Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6745e2a70916439cb278be0fc606d295 Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerRescueTestJSON-1754581508-project Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c0218ec5-8ad9-473e-b819-853209360f03'} Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:47.944802 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. Jul 26 04:37:47.949593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:47.952508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Returning 404 to user: Instance c0218ec5-8ad9-473e-b819-853209360f03 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:47.953638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12a961cb-74ae-4844-ac94-5be3169a6efa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03" status: 404 len: 111 microversion: 2.1 time: 0.074072 Jul 26 04:37:47.954784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1417/2725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:47 2022] GET /compute/v2.1/servers/c0218ec5-8ad9-473e-b819-853209360f03 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:47.963629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:47.964893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:47.971815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.972340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:47.973204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:47.973863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:48.631228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:48.643946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5effd52b-3411-46e5-a7db-72c7194db710 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.687734 Jul 26 04:37:48.645543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1418/2726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:47 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:48.652886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:48.661573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:48.663508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Searching by: {'deleted': False, 'project_id': 'b021402842234f30a0c3464f83ef416c'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:48.666580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:48.685787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:48.686298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:48.687133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:48.687623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:48.727768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:37:48.830682 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1bc02173-ca54-431e-b199-cf087a21c148 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.183262 Jul 26 04:37:48.831846 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1419/2727] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:37:48 2022] GET /compute/v2.1/servers => generated 1003 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:48.851459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-df247bc8-2716-444b-81f7-a7b26f1e7a7d req-70383cc9-04be-423f-ba7c-ab1ecfec99dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0218ec5-8ad9-473e-b819-853209360f03", "name": "network-vif-deleted", "tag": "9781a1b5-128a-41fc-881c-b0f36346cc2a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:48.886655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-df247bc8-2716-444b-81f7-a7b26f1e7a7d req-70383cc9-04be-423f-ba7c-ab1ecfec99dd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:48.887394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-df247bc8-2716-444b-81f7-a7b26f1e7a7d req-70383cc9-04be-423f-ba7c-ab1ecfec99dd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:48.913429 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-df247bc8-2716-444b-81f7-a7b26f1e7a7d req-70383cc9-04be-423f-ba7c-ab1ecfec99dd service nova] Creating event network-vif-deleted:9781a1b5-128a-41fc-881c-b0f36346cc2a for instance c0218ec5-8ad9-473e-b819-853209360f03 on n-h1-848886-16 Jul 26 04:37:48.939583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-df247bc8-2716-444b-81f7-a7b26f1e7a7d req-70383cc9-04be-423f-ba7c-ab1ecfec99dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105060 Jul 26 04:37:48.945891 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1420/2728] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:48.955068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:48.975684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:48.976879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:48.998273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:48.998600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:48.999395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:48.999830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.237221 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-07c4640d-e935-4384-b71b-cd0441dad291 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.286361 Jul 26 04:37:49.246912 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1421/2729] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Jul 26 04:37:48 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:49.249351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:49.250290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:49.265041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.265546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.266424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.266865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.273829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:49.306528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:37:49.345150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:49.504588 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e55b5a58-8c7c-4b8f-96d3-970163737677 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 204 len: 0 microversion: 2.1 time: 0.263382 Jul 26 04:37:49.505383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1422/2730] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:49 2022] DELETE /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:49.518444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:49.518444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:49.527164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.527621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.528408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.528846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.860128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:49.871784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3151e22e-12db-4dc2-aa2a-6b856f2e9a63 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.360745 Jul 26 04:37:49.872791 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1423/2731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:49 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:49.877445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:49.880057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:49.898260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.901343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:49.903915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:49.908365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:50.901686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:50.923806 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3b82bb7-9070-4e72-83c7-1c3667aa4939 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1271 microversion: 2.1 time: 1.049644 Jul 26 04:37:50.925377 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1424/2732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:49 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1271 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:50.953387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb0f7361-af1f-40df-be47-c0de63a7c9cd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb0f7361-af1f-40df-be47-c0de63a7c9cd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 04:37:50.959006 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb0f7361-af1f-40df-be47-c0de63a7c9cd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb0f7361-af1f-40df-be47-c0de63a7c9cd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.013985 Jul 26 04:37:50.964508 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1425/2733] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Jul 26 04:37:50 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:37:50.968130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:50.972843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:50.998510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:50.998967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:51.004765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:51.006106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:51.522285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:51.535428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cda26e07-d027-4fd0-baf9-acbd1e21cf31 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1490 microversion: 2.1 time: 0.572976 Jul 26 04:37:51.549156 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1426/2734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:50 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1490 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:51.549156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:51.550486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:51.566072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:51.566569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:51.567362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:51.567810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:51.696357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Updating instance_info_cache with network_info: [{"id": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84", "address": "fa:16:3e:8c:bc:b8", "network": {"id": "badc6835-8985-4e41-9bfd-7a8a2cc9011d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-402722676-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c76aa4a586f5424ca48c062b9ddfd38e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62ba8d03-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:37:51.729642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Releasing lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:37:51.731297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20f09c8d-248e-4fbb-838c-eb621b89ae4a tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 202 len: 0 microversion: 2.1 time: 8.205160 Jul 26 04:37:51.746104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1309/2735] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:43 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 0 bytes in 8221 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:37:51.765630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:51.767583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:51.796208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:51.796599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:51.800728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:51.803728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.005031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:52.015857 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aed347fa-f39b-4bc0-ae00-3bc5a69cd94c tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.478292 Jul 26 04:37:52.016439 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1427/2736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:51 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:52.028167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:52.053392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:52.054261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:52.078720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.082334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.090185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.094215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.166178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:37:52.222411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00d1f0de-ebc8-4caf-ba8b-69df40831fcd tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.204847 Jul 26 04:37:52.223005 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1428/2737] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:37:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:52.231481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "tag": "89a9506c-c140-422a-a94d-deb073c119d9"}, {"name": "network-changed", "server_uuid": "da07cc22-6450-4853-8020-51392989bba6", "tag": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:52.267856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.268313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.295256 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] Creating event network-changed:89a9506c-c140-422a-a94d-deb073c119d9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:37:52.299431 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] Creating event network-changed:62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 for instance da07cc22-6450-4853-8020-51392989bba6 on n-h1-848886-16 Jul 26 04:37:52.324744 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fa638f2b-78e4-4c29-a252-b427045de79d req-6aa8f1be-cb24-411f-bdcf-944206bce249 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097720 Jul 26 04:37:52.326588 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1429/2738] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:52.338531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ce96f55-73f9-484a-8ed3-3f6c6e574b10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '.version_select at 0x7f38b50364c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:52.367445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:52.398170 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88550859-0db2-449d-a407-f91e7db0aa0d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.647482 Jul 26 04:37:52.403956 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1310/2739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:51 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:52.411784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:52.412630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:52.441896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.442521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.443428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.443882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.626531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:52.639745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a47bda4-2481-4f97-990e-8e60fdf2de78 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1277 microversion: 2.1 time: 0.233293 Jul 26 04:37:52.660135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1311/2740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:52 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:52.669906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:52.682083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:52.686837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.servers [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Removing options 'limit' from query {{(pid=119487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 04:37:52.687838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:52.698440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.699940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.701074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.701847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.737274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:37:52.780045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8087308-5733-4aba-8fe6-809e7c398f1b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.117966 Jul 26 04:37:52.780673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1312/2741] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Jul 26 04:37:52 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:52.785611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:52.786723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:52.794066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.794959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:52.795925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:52.796969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:53.051804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:53.060455 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18a9dcad-1b89-41e1-9628-a327e6673a73 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1490 microversion: 2.1 time: 0.278672 Jul 26 04:37:53.061389 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1313/2742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:52 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1490 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:53.066369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0c49c2f-456f-493b-b79a-ea2061268dee tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0c49c2f-456f-493b-b79a-ea2061268dee tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '-1' Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 04:37:53.070388 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0c49c2f-456f-493b-b79a-ea2061268dee tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:53.075000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0c49c2f-456f-493b-b79a-ea2061268dee tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009164 Jul 26 04:37:53.078116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1314/2743] 10.222.0.43 () {58 vars in 1142 bytes} [Tue Jul 26 04:37:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:37:53.083235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:53.084052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:53.095241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:53.095703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:53.096479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:53.097084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:53.812798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:53.825677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7c3cb21-90e3-41b7-a8f0-929219a81ae3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.746084 Jul 26 04:37:53.826886 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1315/2744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:53 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:53.836471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3be9d341-9019-4b4b-85b3-2fc21df80ab3 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3be9d341-9019-4b4b-85b3-2fc21df80ab3 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: action_args: {} Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'testing' Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 04:37:53.847983 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3be9d341-9019-4b4b-85b3-2fc21df80ab3 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:53.853441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3be9d341-9019-4b4b-85b3-2fc21df80ab3 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023166 Jul 26 04:37:53.854516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1316/2745] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:37:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:37:53.869013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:53.871217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:53.880639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:53.881118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:53.882282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:53.882826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:53.888939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:54.229451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:54.236455 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-973a807c-aac5-47f8-b95c-b47e3473d615 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.380756 Jul 26 04:37:54.251338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1317/2746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:53 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:54.256374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:54.257975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:54.266906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:54.267747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:54.268756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:54.269416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:54.561306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:54.572795 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffff51c8-c877-4149-a4ba-4714a2b66243 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.319937 Jul 26 04:37:54.574219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1318/2747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:54 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:54.581578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33d3e6a6-691b-4e38-9b04-7b174544e2d4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:54.593765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d3e6a6-691b-4e38-9b04-7b174544e2d4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:54.596621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33d3e6a6-691b-4e38-9b04-7b174544e2d4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:54.611302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.servers [None req-33d3e6a6-691b-4e38-9b04-7b174544e2d4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Flavor 'non_existing_flavor' could not be found {{(pid=119487) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 26 04:37:54.612571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33d3e6a6-691b-4e38-9b04-7b174544e2d4 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.034965 Jul 26 04:37:54.613548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1319/2748] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Jul 26 04:37:54 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:54.618102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:54.620403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:54.626773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:54.627228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:54.628035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:54.629115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:54.916389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:54.938502 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86a85487-9246-40e7-9211-545bb457f74d tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1448 microversion: 2.1 time: 0.318674 Jul 26 04:37:54.939932 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1320/2749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:54 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1448 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:54.945024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5984c2d0-b460-43d6-80e1-a0fa92113bfb req-5b7ede4c-7448-4759-b0ac-841396e6ff56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "tag": "2d783bc3-2a14-454d-99ac-2403769ca7b9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:54.966051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5984c2d0-b460-43d6-80e1-a0fa92113bfb req-5b7ede4c-7448-4759-b0ac-841396e6ff56 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:54.968714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5984c2d0-b460-43d6-80e1-a0fa92113bfb req-5b7ede4c-7448-4759-b0ac-841396e6ff56 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.005252 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5984c2d0-b460-43d6-80e1-a0fa92113bfb req-5b7ede4c-7448-4759-b0ac-841396e6ff56 service nova] Creating event network-changed:2d783bc3-2a14-454d-99ac-2403769ca7b9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:37:55.012348 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5984c2d0-b460-43d6-80e1-a0fa92113bfb req-5b7ede4c-7448-4759-b0ac-841396e6ff56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070654 Jul 26 04:37:55.013761 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1321/2750] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:55.021903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:55.031131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:55.033308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:55.045530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.046383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.047695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.048506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.232013 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20c13f4c-36ff-4848-a5ac-ed7613a4eebe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.216199 Jul 26 04:37:55.235680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1322/2751] 10.222.0.43 () {58 vars in 1174 bytes} [Tue Jul 26 04:37:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:55.246439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e03ced3a-57df-4f1c-81c5-0c2776041555 req-d6f5f5aa-8e80-4dcf-8c5e-1b7b737e7dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566ad57d-f13d-4aa4-96c9-6d813121e2d3", "name": "network-vif-deleted", "tag": "55c039a0-155b-4b61-8ae4-8d30268abbbc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:55.287669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e03ced3a-57df-4f1c-81c5-0c2776041555 req-d6f5f5aa-8e80-4dcf-8c5e-1b7b737e7dda service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.290045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e03ced3a-57df-4f1c-81c5-0c2776041555 req-d6f5f5aa-8e80-4dcf-8c5e-1b7b737e7dda service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.321588 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e03ced3a-57df-4f1c-81c5-0c2776041555 req-d6f5f5aa-8e80-4dcf-8c5e-1b7b737e7dda service nova] Creating event network-vif-deleted:55c039a0-155b-4b61-8ae4-8d30268abbbc for instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 on n-h2-848886-16 Jul 26 04:37:55.328705 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e03ced3a-57df-4f1c-81c5-0c2776041555 req-d6f5f5aa-8e80-4dcf-8c5e-1b7b737e7dda service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090245 Jul 26 04:37:55.330123 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1323/2752] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:55.337446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:55.339891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:55.351381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.352949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.355644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.356385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.418691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ce96f55-73f9-484a-8ed3-3f6c6e574b10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/03f362ab-e03b-4093-931e-0f7f5ff51997" status: 202 len: 0 microversion: 2.1 time: 3.089418 Jul 26 04:37:55.419772 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1430/2753] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:37:52 2022] DELETE /compute/v2.1/os-floating-ips/03f362ab-e03b-4093-931e-0f7f5ff51997 => generated 0 bytes in 3092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:37:55.425068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:55.439577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:55.441983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:55.452081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.452729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.453710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.454377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.612310 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c48e9941-d4e7-40fe-b9ec-0b4bac912936 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.191006 Jul 26 04:37:55.613322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1431/2754] 10.222.0.43 () {58 vars in 1184 bytes} [Tue Jul 26 04:37:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:55.621616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:55.623099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:55.632979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.633568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.634505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.635609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.861894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:55.878222 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-467916a2-4819-4627-a334-ccd4683bb834 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.546305 Jul 26 04:37:55.880548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1324/2755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:55 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:55.890690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-788833ee-a8a4-4b93-972c-c706294a052e tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-788833ee-a8a4-4b93-972c-c706294a052e tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Request method failure captured: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action HTTP/1.1 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 34 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329qfllG3ahkGHklG1H6C0wFA9niTt9Cms6ZtPc6rNrE7ctPcedHJH4J0A83m3hIsJBHEeOQbFENZ31N5aKPVtmfExIuqzqSoa7iJ0IdcoCJilPoV66FO7FFDCgdPmnWW34fzzkK-kd4Hv5y3PJkGrWanciwbuhL3-6ZyyXXVMmVbVc Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b6ea16ef8d824a86933233f7ff944c26 Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: {"addFloatingIp": {"address": ""}} Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'da07cc22-6450-4853-8020-51392989bba6', 'body': {'addFloatingIp': {'address': ''}}} Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:37:55.897415 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 04:37:55.902187 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:55.905624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-788833ee-a8a4-4b93-972c-c706294a052e tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:55.906862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-788833ee-a8a4-4b93-972c-c706294a052e tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 400 len: 142 microversion: 2.1 time: 0.024733 Jul 26 04:37:55.908257 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1325/2756] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:55 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:37:55.913343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:55.918057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:55.926606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.927206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:55.928398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:55.928950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.029817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.046770 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b399f0bc-c479-4453-ade2-6110b7f83207 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.432143 Jul 26 04:37:56.048977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1432/2757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:55 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:56.054740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:56.061080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.067380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:56.086985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.089704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.090957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.092512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.236570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:37:56.322045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.341252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.344413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.601551 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2a9e8db-2e5c-412f-b989-702dc4ef2608 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.551048 Jul 26 04:37:56.602942 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1433/2758] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:37:56 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:56.608371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:56.610934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:56.625608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.626068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.627616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.628226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.691352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Acquired lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:37:56.704951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.716220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32393c98-bf1c-4fa6-9200-c8d8de548594 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.806599 Jul 26 04:37:56.725207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1326/2759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:55 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:56.741838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:56.742744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:56.752462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.753947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.753947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.754366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.799638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.800430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.800959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lazy-loading 'fault' on Instance uuid 566ad57d-f13d-4aa4-96c9-6d813121e2d3 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:56.872122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.872503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Releasing lock "refresh_cache-da07cc22-6450-4853-8020-51392989bba6" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:37:56.873067 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] HTTP exception thrown: floating IP not found Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Request method failure captured: Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action HTTP/1.1 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 41 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329qfllG3ahkGHklG1H6C0wFA9niTt9Cms6ZtPc6rNrE7ctPcedHJH4J0A83m3hIsJBHEeOQbFENZ31N5aKPVtmfExIuqzqSoa7iJ0IdcoCJilPoV66FO7FFDCgdPmnWW34fzzkK-kd4Hv5y3PJkGrWanciwbuhL3-6ZyyXXVMmVbVc Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: b6ea16ef8d824a86933233f7ff944c26 Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: exception: floating IP not found Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'da07cc22-6450-4853-8020-51392989bba6', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 26 04:37:56.874970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 26 04:37:56.878994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:56.881013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Returning 404 to user: floating IP not found {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:56.883164 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe85cd1b-febc-469e-bac2-5dcb2b25a55d tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 404 len: 67 microversion: 2.1 time: 0.278532 Jul 26 04:37:56.883924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1434/2760] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:56 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 67 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:37:56.894697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f925ca23-86ee-410e-914f-7b68639d6e48 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:56.907177 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3eb26d0-8478-4f94-beb7-47ec9bd8d7aa tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1303 microversion: 2.1 time: 0.180195 Jul 26 04:37:56.908090 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1327/2761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:56 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:56.915067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f925ca23-86ee-410e-914f-7b68639d6e48 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:56.921961 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f925ca23-86ee-410e-914f-7b68639d6e48 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.031792 Jul 26 04:37:56.922535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a59dd0d7-68f9-48c5-a565-780b014b3f10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:56.935332 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1435/2762] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Jul 26 04:37:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:37:56.946881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:56.948473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:56.975002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.975794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:56.977340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:56.978463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.018666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a59dd0d7-68f9-48c5-a565-780b014b3f10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a59dd0d7-68f9-48c5-a565-780b014b3f10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Request method failure captured: Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action HTTP/1.1 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 44 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329qfllG3ahkGHklG1H6C0wFA9niTt9Cms6ZtPc6rNrE7ctPcedHJH4J0A83m3hIsJBHEeOQbFENZ31N5aKPVtmfExIuqzqSoa7iJ0IdcoCJilPoV66FO7FFDCgdPmnWW34fzzkK-kd4Hv5y3PJkGrWanciwbuhL3-6ZyyXXVMmVbVc Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b6ea16ef8d824a86933233f7ff944c26 Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: exception: Floating IP not found for address 0.0.0.0. Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'da07cc22-6450-4853-8020-51392989bba6', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 26 04:37:57.023070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 26 04:37:57.028892 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.034095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a59dd0d7-68f9-48c5-a565-780b014b3f10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:57.036066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a59dd0d7-68f9-48c5-a565-780b014b3f10 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action" status: 404 len: 88 microversion: 2.1 time: 0.127204 Jul 26 04:37:57.037211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1328/2763] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:37:56 2022] POST /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6/action => generated 88 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:37:57.050090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.059762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:57.060924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Searching by: {'deleted': False, 'project_id': '089663829e2c41dd874402e71641dea0'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:37:57.071113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.071626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.073600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.074256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.123011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:37:57.161005 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea334794-0757-44eb-af05-df0f24355646 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.122057 Jul 26 04:37:57.174840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1329/2764] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:37:57 2022] GET /compute/v2.1/servers => generated 683 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:57.180887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.181607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.190994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.191655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.192625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.193649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.224058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:57.357522 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c3a7dec-4ec3-406a-ae5f-9ef8ae67b214 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 204 len: 0 microversion: 2.1 time: 0.180903 Jul 26 04:37:57.359995 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1330/2765] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:57 2022] DELETE /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:57.376204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-064982b1-1e2e-4238-b276-522e67edc4c1 req-02a34620-8713-406b-81cf-8ad329f1bca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138a22ae-b68f-4262-9183-ae3202881194", "tag": "e41b8a17-2a92-4fa5-ba91-a98872327e8a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:57.397104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-064982b1-1e2e-4238-b276-522e67edc4c1 req-02a34620-8713-406b-81cf-8ad329f1bca8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.398254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-064982b1-1e2e-4238-b276-522e67edc4c1 req-02a34620-8713-406b-81cf-8ad329f1bca8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.412315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:57.426830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-064982b1-1e2e-4238-b276-522e67edc4c1 req-02a34620-8713-406b-81cf-8ad329f1bca8 service nova] Creating event network-changed:e41b8a17-2a92-4fa5-ba91-a98872327e8a for instance 138a22ae-b68f-4262-9183-ae3202881194 on n-h1-848886-16 Jul 26 04:37:57.427123 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd6c108b-2e08-4d93-b8f2-ce94a1d07aeb tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.487528 Jul 26 04:37:57.438900 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1436/2766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:56 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:57.438900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.438900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.445403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-064982b1-1e2e-4238-b276-522e67edc4c1 req-02a34620-8713-406b-81cf-8ad329f1bca8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080341 Jul 26 04:37:57.445830 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1331/2767] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:57.451716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.452164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.452957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.453397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.462187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.463228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.482645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.485004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.490945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.492606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.515986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] HTTP exception thrown: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf HTTP/1.1 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c7231416-6b0b-4c0d-bbad-4f2524c8a5bf'} Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:57.517725 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 404 to user: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad8bbf79-20e6-4aeb-b126-21e41c73b8db tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 404 len: 111 microversion: 2.1 time: 0.070165 Jul 26 04:37:57.521293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1332/2768] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:57 2022] DELETE /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:57.527263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.527881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.537022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.537701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.538517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.538958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.709251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:57.718078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-515c8524-94af-40c3-a337-5012901f3308 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.288329 Jul 26 04:37:57.719604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1437/2769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:57 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:57.727643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c5205724-cfd0-4431-89a8-77840e10e3ae req-dcc0d567-6601-48f0-b771-b8a73742054c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8903bf4f-431a-45e1-8284-16a0550064d6", "tag": "fc53b2dd-3497-4981-90a1-902aaf8d699a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:57.747537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c5205724-cfd0-4431-89a8-77840e10e3ae req-dcc0d567-6601-48f0-b771-b8a73742054c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.747985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c5205724-cfd0-4431-89a8-77840e10e3ae req-dcc0d567-6601-48f0-b771-b8a73742054c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.759417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c5205724-cfd0-4431-89a8-77840e10e3ae req-dcc0d567-6601-48f0-b771-b8a73742054c service nova] Creating event network-changed:fc53b2dd-3497-4981-90a1-902aaf8d699a for instance 8903bf4f-431a-45e1-8284-16a0550064d6 on n-h1-848886-16 Jul 26 04:37:57.765560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c5205724-cfd0-4431-89a8-77840e10e3ae req-dcc0d567-6601-48f0-b771-b8a73742054c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042121 Jul 26 04:37:57.766262 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1438/2770] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:57.772201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.772787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.780461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.781931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.782970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.783882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.822132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:57.834621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:57.847550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c62efaf9-baf0-4135-8f53-cf78936de439 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1542 microversion: 2.1 time: 0.325325 Jul 26 04:37:57.861797 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1333/2771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:57 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1542 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:57.861797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.861797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.863448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.864076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.864947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.865455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.893339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:57.958877 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-104c57e2-69b1-4325-ba5b-8c4538c4c2fe tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 204 len: 0 microversion: 2.1 time: 0.186855 Jul 26 04:37:57.960045 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1439/2772] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:57 2022] DELETE /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:57.965574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:57.966301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:57.973301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.973932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:57.974780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:57.975471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.017706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.018493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.019133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lazy-loading 'fault' on Instance uuid 566ad57d-f13d-4aa4-96c9-6d813121e2d3 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:37:58.031750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:58.050606 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50b4e12e-98d6-4342-9a78-50069ffbc7d1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.197110 Jul 26 04:37:58.053570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1334/2773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:57 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:58.075956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.076469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.083669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.084135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.084919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.085600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.086094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6745e2a70916439cb278be0fc606d295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c78e1a85b9342b394b5528fcd158a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:58.098520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fc2d922d-2f57-410b-8d62-534ec5fb4d94 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 200 len: 1303 microversion: 2.1 time: 0.137199 Jul 26 04:37:58.099770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1440/2774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:57 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:58.131249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:37:58.276635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:58.286519 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-173db52d-1a6c-420b-9276-26294ba93d03 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 204 len: 0 microversion: 2.1 time: 0.231431 Jul 26 04:37:58.287037 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1335/2775] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:37:58 2022] DELETE /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:58.296496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.297106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: c7231416-6b0b-4c0d-bbad-4f2524c8a5bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.304543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.304997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.305934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.306414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.321728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] HTTP exception thrown: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf HTTP/1.1 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c7231416-6b0b-4c0d-bbad-4f2524c8a5bf'} Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:58.323840 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 404 to user: Instance c7231416-6b0b-4c0d-bbad-4f2524c8a5bf could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a15689e0-eef0-47a8-9395-e12c8deabb7e tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf" status: 404 len: 111 microversion: 2.1 time: 0.033304 Jul 26 04:37:58.328843 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1441/2776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:58 2022] GET /compute/v2.1/servers/c7231416-6b0b-4c0d-bbad-4f2524c8a5bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:58.335081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.335835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.344589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.345196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.345985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.346479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.351857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:37:58.453521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.454130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.461823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.462521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.463884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.464472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.512201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:58.521349 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc47ca21-6620-4e82-850f-6dc940a3bde7 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1522 microversion: 2.1 time: 0.190956 Jul 26 04:37:58.535698 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1336/2777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:58 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:58.717352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:58.730275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e639b86-0805-43e8-bfb2-01e37ca81334 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.281027 Jul 26 04:37:58.731067 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1442/2778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:58 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:58.744287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.745094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.751740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.752196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.752973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.753415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.868884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:58.870313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:58.878265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.879022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.880691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:58.881456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:58.915828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:58.926147 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4d864350-4232-41a8-b6dd-63666c89d47e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.187378 Jul 26 04:37:58.926754 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1337/2779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:58 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:59.042091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:59.053933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18f2891f-0e0f-4383-ae29-15b7dde4ffaa tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1542 microversion: 2.1 time: 0.188851 Jul 26 04:37:59.058236 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1443/2780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:58 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1542 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:37:59.081469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.082076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:59.089528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.089991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.091605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.091781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.124693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.125636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] [instance: 566ad57d-f13d-4aa4-96c9-6d813121e2d3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:59.132726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.133437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.134496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.135915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.155791 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] HTTP exception thrown: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Request method failure captured: Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 HTTP/1.1 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi328jG4MH_9ojNVA9Zg81qrxa-CGSZF8ESWfGCFK9OjdoTtyeFYwGmFUEvbcP-HmxH_HVK5kgLGb5f_132oxiLaVtLge6IE2pt8esqamSEFXSdfNOlP2j4BnxNRo_3IdFdgp6ay9NV6r0uIkV1QLIleeScG4jbJ9wRNffVwuduYBZzno Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 6c78e1a85b9342b394b5528fcd158a04 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c78e1a85b9342b394b5528fcd158a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 6c78e1a85b9342b394b5528fcd158a04 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerRescueTestJSON-1754581508 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerRescueTestJSON-1754581508-project Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6745e2a70916439cb278be0fc606d295 Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerRescueTestJSON-1754581508-project Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '566ad57d-f13d-4aa4-96c9-6d813121e2d3'} Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:37:59.157345 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. Jul 26 04:37:59.161939 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:37:59.164058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] Returning 404 to user: Instance 566ad57d-f13d-4aa4-96c9-6d813121e2d3 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:37:59.165165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2fcfe411-535f-4f7c-8950-12672f025eb6 tempest-ServerRescueTestJSON-1754581508 tempest-ServerRescueTestJSON-1754581508-project] 10.222.0.43 "GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3" status: 404 len: 111 microversion: 2.1 time: 0.044975 Jul 26 04:37:59.171212 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1444/2781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:59 2022] GET /compute/v2.1/servers/566ad57d-f13d-4aa4-96c9-6d813121e2d3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:37:59.273040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:37:59.283200 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-837e9b6b-ba38-4f95-bbfd-77b301b9d879 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.206158 Jul 26 04:37:59.284309 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1338/2782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:59 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:37:59.387989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb49620a-7683-4885-82b1-8b95b40610f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b509d550>, body: {"keypair": {"name": "tempest-keypair-1795212347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD1y4GtgDzunJVZ2NKBi03uhVQJ8XPtv6haVjhsGGaAOxrhl6aKqhCKtRnDw4ZlkWpARzuDbRpaZNlATgaxt7vtzf7XANJZgh42vqJaLmGmQlc+KQckRYSZAgcCTyGmmA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:59.404442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bb49620a-7683-4885-82b1-8b95b40610f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:59.411210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bb49620a-7683-4885-82b1-8b95b40610f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:59.438625 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb49620a-7683-4885-82b1-8b95b40610f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.247038 Jul 26 04:37:59.439542 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1445/2783] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:37:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:37:59.450813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ba70abf-8ec6-4b62-b858-8c331f5e73f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b529ea60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.459858 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ba70abf-8ec6-4b62-b858-8c331f5e73f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1795212347" status: 200 len: 513 microversion: 2.2 time: 0.013575 Jul 26 04:37:59.460420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1339/2784] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 26 04:37:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1795212347 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:37:59.473617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-82805b3c-584d-4607-9a2d-47747c5569e4 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b4f59af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.495684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-82805b3c-584d-4607-9a2d-47747c5569e4 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795212347" status: 204 len: 0 microversion: 2.2 time: 0.026712 Jul 26 04:37:59.504329 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1446/2785] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Jul 26 04:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795212347 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:59.509397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca76ace3-0497-414a-8465-6422d37bf4c8 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5386c10>, body: {"keypair": {"name": "tempest-keypair-345830068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlb6M0lIA4Be7CYIh8Wi3msepbDsqlyt0red13IcuVp/fiJMSZ7gYE//HgJDQ9U8+dc5PHoelouCeE9J5auhIoDgL/+cYWvVvixvy6i/Y8y4USJ6w15l7LS8kLIHozUdg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:59.530427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ca76ace3-0497-414a-8465-6422d37bf4c8 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:59.544359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.545460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:59.554765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.558789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.559651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.560102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.561447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ca76ace3-0497-414a-8465-6422d37bf4c8 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:59.624515 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca76ace3-0497-414a-8465-6422d37bf4c8 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.119469 Jul 26 04:37:59.625785 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1340/2786] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:37:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:37:59.636992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b754441-6f03-411e-bca1-8964759107c0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5a73dc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.662704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b754441-6f03-411e-bca1-8964759107c0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345830068" status: 204 len: 0 microversion: 2.2 time: 0.029509 Jul 26 04:37:59.663583 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1341/2787] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 26 04:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345830068 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:59.675040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-318da4e3-21d8-4773-885a-5cd1ce4062f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5c11280>, body: {"keypair": {"name": "tempest-keypair-673959195", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:37:59.693300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-318da4e3-21d8-4773-885a-5cd1ce4062f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:37:59.698911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-318da4e3-21d8-4773-885a-5cd1ce4062f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:37:59.727876 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-318da4e3-21d8-4773-885a-5cd1ce4062f1 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.056427 Jul 26 04:37:59.734347 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1342/2788] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:37:59 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:37:59.739781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ff2afe2-dfd5-404c-883d-e04a2bedd8d0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5b95d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.779168 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ff2afe2-dfd5-404c-883d-e04a2bedd8d0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673959195" status: 204 len: 0 microversion: 2.2 time: 0.043327 Jul 26 04:37:59.786741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1343/2789] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 26 04:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673959195 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:37:59.795112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:37:59.796025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:37:59.804901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.805570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:37:59.806548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:37:59.808359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.198816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:00.209791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9260c6f-c086-459f-870c-1efcffbd40b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.425174 Jul 26 04:38:00.214986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1344/2790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:59 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:00.220937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d25e60c-714e-4716-beab-e4e8f0a13040 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b6087700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-597867815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBufE0X469RzKf0KMWp2GtmY0NYGCyGw68bk140uWzUrW+2V7ErbMK0NrxulUe0UzzCB8AIYbyG5r77GJ1eNJ3XxIctWfjNNlgNrfk4PKjZZlszEvTVBC6rTlh9nsJ/d8A=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:00.253739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-3d25e60c-714e-4716-beab-e4e8f0a13040 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:00.262703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-3d25e60c-714e-4716-beab-e4e8f0a13040 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:00.290393 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d25e60c-714e-4716-beab-e4e8f0a13040 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.073943 Jul 26 04:38:00.295154 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1345/2791] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:38:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:38:00.303299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:00.303922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:00.320779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.321244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.323920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.324373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.334288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:00.343615 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6279792f-afca-42fb-aaab-b2aa3e68b368 tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1522 microversion: 2.1 time: 0.803797 Jul 26 04:38:00.344195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1447/2792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:37:59 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1522 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:00.360931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:00.361544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:00.369503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.377445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.378867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.379652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.682592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:00.711872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5ba696f-afa1-4d86-b4d4-f342cf904ad1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.415252 Jul 26 04:38:00.714775 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1346/2793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:00 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:00.723850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:00.725479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:00.764714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.765392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.768358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:00.769242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:00.787330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:00.796433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2b26d94-d157-4903-aaf7-ced1a8e3153f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1542 microversion: 2.1 time: 0.450549 Jul 26 04:38:00.796433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1448/2794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:00 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1542 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:00.800929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f8c9b0f-26a2-4a0d-8798-dc708fa2de7f tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5080dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1777041568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJcLrpsRX/kTfFBh/q4tTH22eGD2qgedd+E8MlKoBmbwggQb8zU7v/T/lslVP9/CYQ8ddE8rBtM+0nfAdYxX9+yO0R+xi8mEJHH47NoJsyZI97FfitxA1yhHrS32t1o6Q=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:00.843925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8f8c9b0f-26a2-4a0d-8798-dc708fa2de7f tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:00.852522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8f8c9b0f-26a2-4a0d-8798-dc708fa2de7f tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:00.929452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f8c9b0f-26a2-4a0d-8798-dc708fa2de7f tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.123818 Jul 26 04:38:00.929452 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1449/2795] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:38:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:38:00.936747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-695d4214-1eac-4158-bb23-8b992c673703 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5851d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-509669155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCebYRdw9Fm+RhazC7k4G7RefWwYyV52doCAeQc0u/eRGnf81Rd8JQXkyNaDLFsx9ya162UDrUCv5wRynRNsBmoYSwJbA4QYa36nJiMgqDQ7BupD2/Nvw+rR4uAIz+YEgw=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:00.985142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-695d4214-1eac-4158-bb23-8b992c673703 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:00.999761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-695d4214-1eac-4158-bb23-8b992c673703 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:01.001616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:01.069209 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-695d4214-1eac-4158-bb23-8b992c673703 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.136352 Jul 26 04:38:01.075995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1450/2796] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:38:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:38:01.081552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-501c6214-f865-4258-b3bd-027d6fe4f224 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5851af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.098678 n-d-848886-16 devstack@n-api.service[119488]: WARNING oslo_db.sqlalchemy.utils [None req-501c6214-f865-4258-b3bd-027d6fe4f224 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:38:01.111206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-501c6214-f865-4258-b3bd-027d6fe4f224 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.033444 Jul 26 04:38:01.121534 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1451/2797] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Jul 26 04:38:01 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:01.129121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8edf88c2-a280-4873-9dca-25b1fac1ffbb tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5085790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.175669 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8edf88c2-a280-4873-9dca-25b1fac1ffbb tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-509669155" status: 204 len: 0 microversion: 2.2 time: 0.052468 Jul 26 04:38:01.176907 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1452/2798] 10.222.0.43 () {60 vars in 1318 bytes} [Tue Jul 26 04:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-509669155 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:01.203894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fad987d-41ac-47b4-a366-4e7cef55edc5 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b50dcdc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.247322 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fad987d-41ac-47b4-a366-4e7cef55edc5 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1777041568" status: 204 len: 0 microversion: 2.2 time: 0.061123 Jul 26 04:38:01.248232 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1453/2799] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Jul 26 04:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1777041568 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:01.253884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.259287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:01.275296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.282430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:01.289329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.294115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:01.651243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:01.665491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec24e069-c8bc-48db-82b5-5f06f37eb1ab tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.947098 Jul 26 04:38:01.668365 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1347/2800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:00 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:01.679857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9747e19e-bda8-4d1c-b642-bc04ccd6581d tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5386940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.755388 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9747e19e-bda8-4d1c-b642-bc04ccd6581d tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-597867815" status: 204 len: 0 microversion: 2.2 time: 0.084447 Jul 26 04:38:01.756343 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1348/2801] 10.222.0.43 () {60 vars in 1318 bytes} [Tue Jul 26 04:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-597867815 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:01.773288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.774128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:01.786355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.788013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:01.792297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.793657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:01.801833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:01.813441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6fa4954-05c2-4036-a8e6-b5283e158994 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.563874 Jul 26 04:38:01.820087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1454/2802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:01 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:01.825547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:01.829851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:01.848361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.850508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:01.856924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:01.859827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.032278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6f9a033a73449f911d11dad259e1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089663829e2c41dd874402e71641dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:02.049290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1371843-eaca-4e0d-84ac-237fdcb852ea tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 200 len: 1480 microversion: 2.1 time: 0.289758 Jul 26 04:38:02.062360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1349/2803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:01 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 1480 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:02.074265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2a24781-1d03-4971-9826-cd6d551e659e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5ff8c10>, body: {"keypair": {"name": "tempest-keypair-518633918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr4JLD3ucSMPv2RluZGUxaRIE3ROWHGEfA0WucNVU3AkiSCCY93mkVw4Yfo18/yjd0na+LrserIlvRjYBfNlU8P/g7dKvP2xgVYnmaslAdS1YzH+Y7TkGxlKGTowNkLqg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:02.111083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a2a24781-1d03-4971-9826-cd6d551e659e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:02.120031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a2a24781-1d03-4971-9826-cd6d551e659e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:02.159084 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2a24781-1d03-4971-9826-cd6d551e659e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.105824 Jul 26 04:38:02.160218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1350/2804] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jul 26 04:38:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:38:02.165025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:02.168061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:02.175373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.175832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.176899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.178239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.549885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:02.562401 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35965b96-42df-44d9-8f4a-e30c52c76860 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.741007 Jul 26 04:38:02.565183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ea16ef8d824a86933233f7ff944c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76aa4a586f5424ca48c062b9ddfd38e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:02.574615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1455/2805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:01 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:02.576542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-658cfafc-d8e1-485d-b067-e26b67d47d8f tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 200 len: 1542 microversion: 2.1 time: 0.412582 Jul 26 04:38:02.590257 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1351/2806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:02 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 1542 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:02.590257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4f97de2-fff6-4ecd-95b0-a36f0e373a5e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5447670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:02.596147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6ba7854b-da0c-409c-a9e0-b6ed82035d66 req-1a053766-7815-4225-820a-6b950f2d01f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2260cefb-9a96-4605-a65e-941a9ce5e018", "name": "network-vif-deleted", "tag": "b0b56259-34cb-4773-b177-e5278ac4b61f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:02.596370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4f97de2-fff6-4ecd-95b0-a36f0e373a5e tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-518633918" status: 200 len: 512 microversion: 2.2 time: 0.017779 Jul 26 04:38:02.597404 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1352/2807] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Jul 26 04:38:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-518633918 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:02.604061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0cb70f8a-5f97-4cdd-9bd9-5cf986aa284a req-b4c8f1b3-0369-4e4d-b793-2e9c49bdb9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac71e1a7-d446-42ae-8f14-475f08721ccd", "name": "network-vif-deleted", "tag": "8bbe6467-ff6f-40a5-8ced-6f9c307d98df"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:02.608694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6ba7854b-da0c-409c-a9e0-b6ed82035d66 req-1a053766-7815-4225-820a-6b950f2d01f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.611787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6ba7854b-da0c-409c-a9e0-b6ed82035d66 req-1a053766-7815-4225-820a-6b950f2d01f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.615852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0cb70f8a-5f97-4cdd-9bd9-5cf986aa284a req-b4c8f1b3-0369-4e4d-b793-2e9c49bdb9b7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.616247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0cb70f8a-5f97-4cdd-9bd9-5cf986aa284a req-b4c8f1b3-0369-4e4d-b793-2e9c49bdb9b7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.633330 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0cb70f8a-5f97-4cdd-9bd9-5cf986aa284a req-b4c8f1b3-0369-4e4d-b793-2e9c49bdb9b7 service nova] Creating event network-vif-deleted:8bbe6467-ff6f-40a5-8ced-6f9c307d98df for instance ac71e1a7-d446-42ae-8f14-475f08721ccd on n-h1-848886-16 Jul 26 04:38:02.640027 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0cb70f8a-5f97-4cdd-9bd9-5cf986aa284a req-b4c8f1b3-0369-4e4d-b793-2e9c49bdb9b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041205 Jul 26 04:38:02.641364 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6ba7854b-da0c-409c-a9e0-b6ed82035d66 req-1a053766-7815-4225-820a-6b950f2d01f1 service nova] Creating event network-vif-deleted:b0b56259-34cb-4773-b177-e5278ac4b61f for instance 2260cefb-9a96-4605-a65e-941a9ce5e018 on n-h2-848886-16 Jul 26 04:38:02.647849 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1353/2808] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:02.654279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e45ef403-4c44-4c81-83a9-4c8ca24e97b0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b52968b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:02.659101 n-d-848886-16 devstack@n-api.service[119487]: WARNING oslo_db.sqlalchemy.utils [None req-e45ef403-4c44-4c81-83a9-4c8ca24e97b0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:38:02.665215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e45ef403-4c44-4c81-83a9-4c8ca24e97b0 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015775 Jul 26 04:38:02.665434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6ba7854b-da0c-409c-a9e0-b6ed82035d66 req-1a053766-7815-4225-820a-6b950f2d01f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088061 Jul 26 04:38:02.666293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1354/2809] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Jul 26 04:38:02 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:02.674604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1456/2810] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:02.679021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-847aa70f-18c7-4ff5-942f-674ed0138d32 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b529eb80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:02.692113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:02.692754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:02.702523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.712018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-847aa70f-18c7-4ff5-942f-674ed0138d32 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518633918" status: 204 len: 0 microversion: 2.2 time: 0.038464 Jul 26 04:38:02.720675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.721241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:02.721700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:02.743726 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1355/2811] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 26 04:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518633918 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:02.758547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Action: 'create', calling method: .version_select at 0x7f38b5245790>, body: {"keypair": {"name": "tempest-keypair-1255900951", "type": "x509"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:02.841512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:02.867590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:02.965006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.processutils [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpheu7_p6b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpheu7_p6b/temp.key -subj /CN=77534944dfd24ecfb32a81953e833f19 -extensions v3_req_client {{(pid=119487) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 04:38:03.164547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:03.174195 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84d142d0-1749-4154-b152-e1f3c703c320 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.485987 Jul 26 04:38:03.175392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1457/2812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:02 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:03.183285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:03.184190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:03.192832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.193983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.194967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.195843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.299775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.processutils [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpheu7_p6b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpheu7_p6b/temp.key -subj /CN=77534944dfd24ecfb32a81953e833f19 -extensions v3_req_client" returned: 0 in 0.335s {{(pid=119487) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 04:38:03.301447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.processutils [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpheu7_p6b/temp.key -password pass: {{(pid=119487) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 04:38:03.378711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.processutils [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpheu7_p6b/temp.key -password pass:" returned: 0 in 0.075s {{(pid=119487) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 04:38:03.544251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:03.612164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:03.631838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Getting quotas for user 77534944dfd24ecfb32a81953e833f19 and project d0606be8d3344fa4b396c01f025b9c73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:03.682581 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e30edd6-844c-49b8-8f79-38571f1034f2 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.936426 Jul 26 04:38:03.685382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1356/2813] 10.222.0.43 () {62 vars in 1198 bytes} [Tue Jul 26 04:38:02 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 941 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:03.702356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:03.709308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: 2260cefb-9a96-4605-a65e-941a9ce5e018] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:03.739869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.740480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.741471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.744843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.768248 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] HTTP exception thrown: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 HTTP/1.1 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2260cefb-9a96-4605-a65e-941a9ce5e018'} Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:03.770412 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 404 to user: Instance 2260cefb-9a96-4605-a65e-941a9ce5e018 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:03.775800 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6cd1db07-8c80-4b92-ae7f-d52b0c60359b tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018" status: 404 len: 111 microversion: 2.1 time: 0.083940 Jul 26 04:38:03.776508 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1357/2814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:03 2022] GET /compute/v2.1/servers/2260cefb-9a96-4605-a65e-941a9ce5e018 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:03.784870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:03.785494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:03.792489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.793064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.793868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:03.794344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:03.969708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:03.980429 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe29020f-5eb4-46a3-81a3-201eb602a263 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.202637 Jul 26 04:38:03.996464 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1358/2815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:03 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:04.003212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.004099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] [instance: da07cc22-6450-4853-8020-51392989bba6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:04.015490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.016740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.017666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.018360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.036970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] HTTP exception thrown: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Request method failure captured: Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 HTTP/1.1 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329qfllG3ahkGHklG1H6C0wFA9niTt9Cms6ZtPc6rNrE7ctPcedHJH4J0A83m3hIsJBHEeOQbFENZ31N5aKPVtmfExIuqzqSoa7iJ0IdcoCJilPoV66FO7FFDCgdPmnWW34fzzkK-kd4Hv5y3PJkGrWanciwbuhL3-6ZyyXXVMmVbVc Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c76aa4a586f5424ca48c062b9ddfd38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c76aa4a586f5424ca48c062b9ddfd38e Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: b6ea16ef8d824a86933233f7ff944c26 Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'da07cc22-6450-4853-8020-51392989bba6'} Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. Jul 26 04:38:04.039115 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. Jul 26 04:38:04.043846 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.045435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] Returning 404 to user: Instance da07cc22-6450-4853-8020-51392989bba6 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:04.046887 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c033d32b-a4af-46d0-ba98-f12c779ab858 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299 tempest-FloatingIPsAssociationNegativeTestJSON-1226666299-project] 10.222.0.43 "GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6" status: 404 len: 111 microversion: 2.1 time: 0.048858 Jul 26 04:38:04.051074 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1359/2816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:03 2022] GET /compute/v2.1/servers/da07cc22-6450-4853-8020-51392989bba6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:04.053561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44708500-3dab-4192-9143-c6b1042a6ffc tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38bacd25e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.065411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44708500-3dab-4192-9143-c6b1042a6ffc tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1255900951" status: 200 len: 1534 microversion: 2.2 time: 0.016380 Jul 26 04:38:04.073070 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1360/2817] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 26 04:38:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1255900951 => generated 1534 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:04.073070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.073070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] [instance: ac71e1a7-d446-42ae-8f14-475f08721ccd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:04.080367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.081268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.082221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.082795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.083374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:04.091552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0173e1e6-5dab-42d1-a02f-cd0ac8fb94b0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.914765 Jul 26 04:38:04.092142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1458/2818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:03 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:04.099860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] HTTP exception thrown: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Request method failure captured: Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd HTTP/1.1 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329rnSKDG2X6uijr-m4kT8hpVWPgk53O45ECalJH-UcEZ848GQrr7do27kcGoi02_xfNd7OD1pHIv0roVMJZOACrTkZUeqZlVI3JLYlb_7Fiqm9w-1_3xV1SWpEvqnbSYGm6LA5rNcqe62DatW4Upfpc7-1LLNXwvOotl6hOJooB248 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/089663829e2c41dd874402e71641dea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/089663829e2c41dd874402e71641dea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_089663829e2c41dd874402e71641dea0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 089663829e2c41dd874402e71641dea0 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1955864518 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2b6f9a033a73449f911d11dad259e1f6 Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServersNegativeTestJSON-1955864518-project Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ac71e1a7-d446-42ae-8f14-475f08721ccd'} Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:04.101765 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. Jul 26 04:38:04.106771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:04.109005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] Returning 404 to user: Instance ac71e1a7-d446-42ae-8f14-475f08721ccd could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:04.109996 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e87ab56-226f-4287-a0be-6bcddda2c2df tempest-ListServersNegativeTestJSON-1955864518 tempest-ListServersNegativeTestJSON-1955864518-project] 10.222.0.43 "GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd" status: 404 len: 111 microversion: 2.1 time: 0.042200 Jul 26 04:38:04.111150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f06363b-8a3a-46db-81bb-0bdf4eb5c6b5 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5a47040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.115138 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1361/2819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:04 2022] GET /compute/v2.1/servers/ac71e1a7-d446-42ae-8f14-475f08721ccd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:04.115249 n-d-848886-16 devstack@n-api.service[119488]: WARNING oslo_db.sqlalchemy.utils [None req-5f06363b-8a3a-46db-81bb-0bdf4eb5c6b5 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:38:04.127141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f06363b-8a3a-46db-81bb-0bdf4eb5c6b5 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022264 Jul 26 04:38:04.128556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1459/2820] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Jul 26 04:38:04 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:04.139829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f29647b5-fa1a-4f26-af4f-f79653a57555 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] Calling method '.version_select at 0x7f38b5451f70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.170654 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f29647b5-fa1a-4f26-af4f-f79653a57555 tempest-KeyPairsV22TestJSON-1565853651 tempest-KeyPairsV22TestJSON-1565853651-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255900951" status: 204 len: 0 microversion: 2.2 time: 0.035351 Jul 26 04:38:04.175523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1362/2821] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Jul 26 04:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255900951 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:04.202908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:04.204091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:04.215124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.215584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.216378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.216852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.723906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:04.737183 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94a29fa8-a79c-4fdd-94ba-96f00c8f7c8f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.541563 Jul 26 04:38:04.750582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1460/2822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:04 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:04.827011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c613b4ff-06f6-4b61-902f-42f24ef09403 req-acf299d7-b7ca-4454-bbd1-94b3b7908b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da07cc22-6450-4853-8020-51392989bba6", "name": "network-vif-deleted", "tag": "62ba8d03-0b3b-4633-9ee2-f9d48ea52a84"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:04.848338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c613b4ff-06f6-4b61-902f-42f24ef09403 req-acf299d7-b7ca-4454-bbd1-94b3b7908b4d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:04.852590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c613b4ff-06f6-4b61-902f-42f24ef09403 req-acf299d7-b7ca-4454-bbd1-94b3b7908b4d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:04.878056 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c613b4ff-06f6-4b61-902f-42f24ef09403 req-acf299d7-b7ca-4454-bbd1-94b3b7908b4d service nova] Creating event network-vif-deleted:62ba8d03-0b3b-4633-9ee2-f9d48ea52a84 for instance da07cc22-6450-4853-8020-51392989bba6 on n-h1-848886-16 Jul 26 04:38:04.887915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c613b4ff-06f6-4b61-902f-42f24ef09403 req-acf299d7-b7ca-4454-bbd1-94b3b7908b4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065982 Jul 26 04:38:04.894919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1363/2823] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:05.003521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:05.004456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:05.017215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.027024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:05.028389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.029059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:05.114335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:05.115300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:05.125488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.128880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:05.130051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.131715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:05.526801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:05.549595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ee53cc5-41a8-427d-9038-a5336676b190 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.437021 Jul 26 04:38:05.553086 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1364/2824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:05 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:05.761446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:05.763384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:05.795569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.796591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:05.806408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:05.810338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:06.145636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:06.158729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4563cd09-b22c-43f5-b27a-d01ebc3d96e0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 1.157086 Jul 26 04:38:06.161023 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1461/2825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:04 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:06.176668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c09d32ce-b085-40de-a35d-045ba00f8eb1 req-44d3fe6c-b200-4c0b-9b28-248bf4d7417f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-plugged", "status": "completed", "tag": "276d7529-2021-49de-8c08-fdd5d2f0cdc7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:06.189741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:06.206808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c09d32ce-b085-40de-a35d-045ba00f8eb1 req-44d3fe6c-b200-4c0b-9b28-248bf4d7417f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:06.209411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c09d32ce-b085-40de-a35d-045ba00f8eb1 req-44d3fe6c-b200-4c0b-9b28-248bf4d7417f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:06.235929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c09d32ce-b085-40de-a35d-045ba00f8eb1 req-44d3fe6c-b200-4c0b-9b28-248bf4d7417f service nova] Creating event network-vif-plugged:276d7529-2021-49de-8c08-fdd5d2f0cdc7 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:06.246966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c09d32ce-b085-40de-a35d-045ba00f8eb1 req-44d3fe6c-b200-4c0b-9b28-248bf4d7417f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079563 Jul 26 04:38:06.249856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1462/2826] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:06.447030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:06.458336 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75f47f03-d8ea-4da7-bd12-f0c5aed09206 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.702155 Jul 26 04:38:06.459045 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1365/2827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:05 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:06.576619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:06.579168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:06.589244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:06.590011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:06.591296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:06.591943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:07.182504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:07.184668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:07.187507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:07.205170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:07.210727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:07.211800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:07.212261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:07.215221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:07.228811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12b8aded-d141-4bce-843d-796293bec0cd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.658741 Jul 26 04:38:07.234548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1463/2828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:06 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:07.483997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:07.484682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:07.496780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:07.500759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:07.504619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:07.506334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:07.772073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:07.783504 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-adcc19e6-79b4-47f6-ab9e-4a6ec593d2da tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.605603 Jul 26 04:38:07.784946 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1366/2829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:07 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:07.878131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:07.892626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea6f580a-0c2a-4a9c-8d58-36d73fe3b3d9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.415239 Jul 26 04:38:07.894143 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1464/2830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:07 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:08.266072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:08.267137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:08.268554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-plugged", "status": "completed", "tag": "89a9506c-c140-422a-a94d-deb073c119d9"}, {"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-plugged", "status": "completed", "tag": "2d783bc3-2a14-454d-99ac-2403769ca7b9"}, {"server_uuid": "138a22ae-b68f-4262-9183-ae3202881194", "name": "network-vif-plugged", "status": "completed", "tag": "e41b8a17-2a92-4fa5-ba91-a98872327e8a"}, {"server_uuid": "8903bf4f-431a-45e1-8284-16a0550064d6", "name": "network-vif-plugged", "status": "completed", "tag": "fc53b2dd-3497-4981-90a1-902aaf8d699a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:08.300629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:08.312115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:08.328877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:08.329554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:08.334016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:08.335711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:08.383346 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Creating event network-vif-plugged:89a9506c-c140-422a-a94d-deb073c119d9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:08.383863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Creating event network-vif-plugged:2d783bc3-2a14-454d-99ac-2403769ca7b9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:08.384410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Creating event network-vif-plugged:e41b8a17-2a92-4fa5-ba91-a98872327e8a for instance 138a22ae-b68f-4262-9183-ae3202881194 on n-h1-848886-16 Jul 26 04:38:08.384929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] Creating event network-vif-plugged:fc53b2dd-3497-4981-90a1-902aaf8d699a for instance 8903bf4f-431a-45e1-8284-16a0550064d6 on n-h1-848886-16 Jul 26 04:38:08.437434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e73a3210-e436-4eef-9eb1-001685aa0810 req-75ded8d3-c622-46ba-a8ab-2bfa1f813260 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.154174 Jul 26 04:38:08.444798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1465/2831] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:08.809082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:08.810454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:08.821304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:08.822451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:08.823711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:08.824400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:09.042735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:09.059239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9aa9283e-e73b-4678-975d-160f718ba667 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.802688 Jul 26 04:38:09.060667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1367/2832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:08 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:09.066028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:09.067261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:09.089793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:09.090703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:09.091724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:09.094069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:09.463720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:09.471618 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0efd906b-9899-4b81-8fa8-ca06e28e4a73 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.669304 Jul 26 04:38:09.472949 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1466/2833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:08 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:09.719401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] Calling method '.version_select at 0x7f38b57f74c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:09.747573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:09.751143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:09.752351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:09.753999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:09.768618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:09.777459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c545ada-8881-4c74-bdd6-97ebb89198a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.715495 Jul 26 04:38:09.780722 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1368/2834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:09 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:09.807696 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33601c54-6648-43b5-93ad-f25c9b62a392 tempest-AbsoluteLimitsTestJSON-1074615331 tempest-AbsoluteLimitsTestJSON-1074615331-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.333308 Jul 26 04:38:09.820641 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1467/2835] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Jul 26 04:38:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:10.082615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:10.083810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:10.110120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.111178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.112255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.112969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.358724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:10.398559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfd4bd8a-f3a6-4428-9a4e-cb86aeb29ef3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1354 microversion: 2.1 time: 0.317176 Jul 26 04:38:10.405756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1369/2836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:10 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1354 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:10.497307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:10.498533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:10.521660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.522061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.527249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.527973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.533726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.828442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:10.830531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:10.860618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.862211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.863479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:10.865575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:10.887715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:11.303803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:11.311770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01c9346e-d935-43cc-8248-6be9978834cb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1319 microversion: 2.1 time: 0.513983 Jul 26 04:38:11.326234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1370/2837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:10 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:11.366890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:11.381054 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-773c8143-76f9-4f13-bcf6-2a31c87019ac tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.889162 Jul 26 04:38:11.394191 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1468/2838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:10 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:11.431783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:11.432925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:11.442059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:11.442961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:11.443939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:11.444806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.027908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:12.042492 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6836aebd-17d6-4bbb-8140-307e33fd7f85 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1803 microversion: 2.1 time: 0.612288 Jul 26 04:38:12.043126 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1371/2839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:11 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1803 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:12.063903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.064477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.074638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.075097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.079656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.081271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.156216 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a66d07b8-489c-49bb-bb66-eaf68d9d2175 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0/ips" status: 200 len: 217 microversion: 2.1 time: 0.096114 Jul 26 04:38:12.176003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.176826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.183055 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1469/2840] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:38:12 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0/ips => generated 217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:12.191817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.194072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.197612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.200881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.296780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:38:12.333140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.334002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.347055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.347521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.348597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.350833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.483616 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ee9a685-a5a5-4d06-9d3f-f7ca1f401849 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 204 len: 0 microversion: 2.1 time: 0.312106 Jul 26 04:38:12.484702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1372/2841] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:38:12 2022] DELETE /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:12.491131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.492141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.504713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.505422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.506839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.507301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.640201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:12.651670 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6c8341d-dad3-4b61-97b3-d37cf3cfa43d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1469 microversion: 2.1 time: 0.321980 Jul 26 04:38:12.652639 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1470/2842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:12 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1469 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:12.667766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.669539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.684646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.685573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.686721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.688313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.832513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:12.846376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a000608e-3e0b-4788-8a20-4982e763aa7d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.356100 Jul 26 04:38:12.847392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1373/2843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:12 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:12.855701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:12.861641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:12.871823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.872327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.873043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:12.873500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:12.980784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:12.996165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc56c129-335a-4c02-bac0-5c101254c39b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1809 microversion: 2.1 time: 0.340551 Jul 26 04:38:12.997928 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1471/2844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:12 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:13.129252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:13.139380 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b26bd37e-b9b2-41f6-82e5-10e0fb03d4f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1468 microversion: 2.1 time: 0.290661 Jul 26 04:38:13.141695 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1374/2845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:12 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:13.160784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:13.168653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:13.169779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Searching by: {'reservation_id': 'r-aaempoiu', 'deleted': False, 'project_id': 'b021402842234f30a0c3464f83ef416c'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:38:13.177778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:13.178587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:13.179588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:13.180192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:13.324909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:38:13.448765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=47 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:13.453834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:13.462182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:13.462821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:13.723263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=24 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:13.867187 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa3c9424-d286-434f-83af-f301d22508bf tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-aaempoiu" status: 200 len: 2930 microversion: 2.1 time: 0.710312 Jul 26 04:38:13.867995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1472/2846] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Jul 26 04:38:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-aaempoiu => generated 2930 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:13.873974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:13.875106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:13.896079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:13.896801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:13.897827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:13.898608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.103368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Calling method '.version_select at 0x7f38b5256c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:14.119486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.120384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.121741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.122603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.136911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:14.147531 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61cb50cb-f48d-4716-802f-45567b3f6492 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.276622 Jul 26 04:38:14.147531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1473/2847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:13 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:14.160156 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4103e40b-0493-4549-90fa-f45c56f8171d tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.438132 Jul 26 04:38:14.175776 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1375/2848] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Jul 26 04:38:13 2022] GET /compute/v2.1/limits => generated 511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:14.178874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59ebebdc-8659-4ad2-8f08-4cd08bc840c3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:14.184392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:14.188543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:14.199125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.199957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.201130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.201779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.247681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_groups [None req-59ebebdc-8659-4ad2-8f08-4cd08bc840c3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Querying cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) for 2 instances {{(pid=119488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 04:38:14.248520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59ebebdc-8659-4ad2-8f08-4cd08bc840c3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.248977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59ebebdc-8659-4ad2-8f08-4cd08bc840c3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.325923 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59ebebdc-8659-4ad2-8f08-4cd08bc840c3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/8b069c89-60d3-43e6-8197-6e1588d56a96" status: 200 len: 266 microversion: 2.1 time: 0.176829 Jul 26 04:38:14.331925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1474/2849] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:38:14 2022] GET /compute/v2.1/os-server-groups/8b069c89-60d3-43e6-8197-6e1588d56a96 => generated 266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:14.338100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1453509461", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:14.440462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:14.900630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:14.912933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2377568-1ca9-4662-b969-eb25bce00369 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1809 microversion: 2.1 time: 0.735763 Jul 26 04:38:14.924460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1376/2850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:14 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1809 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:14.935620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:14.936307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:14.947095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.948558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:14.949626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:14.950699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:15.002224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Getting quotas for project 92be917a61be419ea47f55e2c0f02357. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:15.014886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Getting quotas for user daca8bc0aa46480e8f2d0654e0843442 and project 92be917a61be419ea47f55e2c0f02357. Resources: dict_keys(['metadata_items']) {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:15.029954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Request method failure captured: Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 1752 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-1gtMLVTINtqTRLf2_8jQ0OnprnLXiSuAI7Uwd18IPzS9MJh4YM6RCIWzh9pMopbCgP0k1sepoHj33SkhhS0eaZCDmobR_ezkeupdabM3Cw16aYpF-nGUZ8AglxRPv2Z8Ve6RK3Xe-AstM3Mm3UEQRf_A-y598QUBeOiqu_Ln8nEk Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 92be917a61be419ea47f55e2c0f02357 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-186660612 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92be917a61be419ea47f55e2c0f02357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92be917a61be419ea47f55e2c0f02357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92be917a61be419ea47f55e2c0f02357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92be917a61be419ea47f55e2c0f02357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-186660612 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 92be917a61be419ea47f55e2c0f02357 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-186660612 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-186660612-project Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: daca8bc0aa46480e8f2d0654e0843442 Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-186660612-project Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1453509461", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:38:15.033095 n-d-848886-16 devstack@n-api.service[119488]: exception: Maximum number of metadata items exceeds 128 Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1453509461', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:15.035697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:15.038921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47b11cfa-caf2-47d2-ae01-85819ea72f67 tempest-AbsoluteLimitsNegativeTestJSON-186660612 tempest-AbsoluteLimitsNegativeTestJSON-186660612-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.706210 Jul 26 04:38:15.042184 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1475/2851] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 26 04:38:14 2022] POST /compute/v2.1/servers => generated 87 bytes in 714 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:15.252417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22691215-c978-4356-a4dc-242b82ba742d tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Calling method '.version_select at 0x7f38b5a473a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:15.276893 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf324a22-2211-422a-adec-7b6dffa9dd15 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 200 len: 1622 microversion: 2.1 time: 0.351202 Jul 26 04:38:15.280547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1377/2852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:14 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 1622 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:15.285361 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-22691215-c978-4356-a4dc-242b82ba742d tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22691215-c978-4356-a4dc-242b82ba742d tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/a298cf60-f598-4306-bf42-f45c10bf9f1b/metadata/os_distro HTTP/1.1 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'image_id': 'a298cf60-f598-4306-bf42-f45c10bf9f1b', 'id': 'os_distro'} Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a298cf60-f598-4306-bf42-f45c10bf9f1b Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:15.294229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a298cf60-f598-4306-bf42-f45c10bf9f1b could not be found. Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:15.297868 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:15.304756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22691215-c978-4356-a4dc-242b82ba742d tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:15.306860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22691215-c978-4356-a4dc-242b82ba742d tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "DELETE /compute/v2.1/images/a298cf60-f598-4306-bf42-f45c10bf9f1b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.263305 Jul 26 04:38:15.307905 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1476/2853] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Jul 26 04:38:15 2022] DELETE /compute/v2.1/images/a298cf60-f598-4306-bf42-f45c10bf9f1b/metadata/os_distro => generated 62 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:15.314041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:15.314908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:15.325661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:15.326536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:15.328905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:15.329470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:15.545516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6973103f-3c1e-463d-9402-c607651cfbac tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] Calling method '.version_select at 0x7f38b5256ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:15.636155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:15.660858 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-adcc660b-9c3c-4784-8725-04d06f8acc95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.350524 Jul 26 04:38:15.664395 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1477/2854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:15 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:15.675354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:15.676151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:15.690453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:15.692577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:15.697898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:15.699064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:15.953946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8de716bd-4fc5-4540-ac6d-c7836d6447f3 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1621 microversion: 2.1 time: 0.287694 Jul 26 04:38:15.954567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1478/2855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:15 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1621 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:15.971398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2bcb308-37f3-44f5-88f7-e507d4b3c3c8 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Calling method '.version_select at 0x7f38b51ae040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:16.025745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f2bcb308-37f3-44f5-88f7-e507d4b3c3c8 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2bcb308-37f3-44f5-88f7-e507d4b3c3c8 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/images/7a73437d-05a8-415d-995a-da40aaeaf9b0/metadata/os_version HTTP/1.1 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'image_id': '7a73437d-05a8-415d-995a-da40aaeaf9b0', 'id': 'os_version'} Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a73437d-05a8-415d-995a-da40aaeaf9b0 Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:16.033374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a73437d-05a8-415d-995a-da40aaeaf9b0 could not be found. Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2bcb308-37f3-44f5-88f7-e507d4b3c3c8 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f2bcb308-37f3-44f5-88f7-e507d4b3c3c8 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "GET /compute/v2.1/images/7a73437d-05a8-415d-995a-da40aaeaf9b0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.080498 Jul 26 04:38:16.038453 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1479/2856] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Jul 26 04:38:15 2022] GET /compute/v2.1/images/7a73437d-05a8-415d-995a-da40aaeaf9b0/metadata/os_version => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:16.059494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f2a421ce-ead7-43d7-90d1-eea9cc14194d req-eba93f71-eef5-4fd3-9c15-19514580f7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-deleted", "tag": "2d783bc3-2a14-454d-99ac-2403769ca7b9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:16.077487 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6973103f-3c1e-463d-9402-c607651cfbac tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.795097 Jul 26 04:38:16.078040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f2a421ce-ead7-43d7-90d1-eea9cc14194d req-eba93f71-eef5-4fd3-9c15-19514580f7a5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:16.078040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f2a421ce-ead7-43d7-90d1-eea9cc14194d req-eba93f71-eef5-4fd3-9c15-19514580f7a5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:16.079677 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1378/2857] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:38:15 2022] GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3/defaults => generated 371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:16.092888 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f2a421ce-ead7-43d7-90d1-eea9cc14194d req-eba93f71-eef5-4fd3-9c15-19514580f7a5 service nova] Creating event network-vif-deleted:2d783bc3-2a14-454d-99ac-2403769ca7b9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:16.100461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:16.101738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f2a421ce-ead7-43d7-90d1-eea9cc14194d req-eba93f71-eef5-4fd3-9c15-19514580f7a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063637 Jul 26 04:38:16.102041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1480/2858] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:16.104877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:16.123138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: .version_select at 0x7f38b59b8940>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2048894612", "policies": ["anti-affinity"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:16.127646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:16.128550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:16.135551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:16.136081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:16.156855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:16.170275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:16.213805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:16.227002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:16.235308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:16.251124 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e33cb8cd-053f-40d5-877a-ce9fadf452ad tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.147621 Jul 26 04:38:16.251914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1481/2859] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Jul 26 04:38:16 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:16.269869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18d3b577-fd4d-47ac-a75f-bd46ddeb79a3 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Calling method '.version_select at 0x7f38b59afe50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:16.304572 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-18d3b577-fd4d-47ac-a75f-bd46ddeb79a3 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18d3b577-fd4d-47ac-a75f-bd46ddeb79a3 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/images/c75db717-3fda-4a80-b146-21f3424111b4/metadata HTTP/1.1 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'image_id': 'c75db717-3fda-4a80-b146-21f3424111b4'} Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c75db717-3fda-4a80-b146-21f3424111b4 Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:16.307847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c75db717-3fda-4a80-b146-21f3424111b4 could not be found. Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18d3b577-fd4d-47ac-a75f-bd46ddeb79a3 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18d3b577-fd4d-47ac-a75f-bd46ddeb79a3 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "GET /compute/v2.1/images/c75db717-3fda-4a80-b146-21f3424111b4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056306 Jul 26 04:38:16.312072 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1482/2860] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:38:16 2022] GET /compute/v2.1/images/c75db717-3fda-4a80-b146-21f3424111b4/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:16.318820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99fffe2e-1e7c-4763-8cce-6b11b57c32c9 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] Calling method '.version_select at 0x7f38b59b8040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:16.418805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:16.430069 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a086b77-2737-4295-8a8d-35dfdb26acfd tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1788 microversion: 2.1 time: 0.348840 Jul 26 04:38:16.430997 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1379/2861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:16 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1788 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:16.454411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87c49acc-753a-464a-b3e9-fecabbb427f9 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Action: 'update_all', calling method: .version_select at 0x7f38b5296940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:16.501011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-87c49acc-753a-464a-b3e9-fecabbb427f9 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87c49acc-753a-464a-b3e9-fecabbb427f9 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/images/a636c20f-fd55-4f42-87f8-dda76f14175b/metadata HTTP/1.1 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 57 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'image_id': 'a636c20f-fd55-4f42-87f8-dda76f14175b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a636c20f-fd55-4f42-87f8-dda76f14175b Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:16.504418 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a636c20f-fd55-4f42-87f8-dda76f14175b could not be found. Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87c49acc-753a-464a-b3e9-fecabbb427f9 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-87c49acc-753a-464a-b3e9-fecabbb427f9 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "PUT /compute/v2.1/images/a636c20f-fd55-4f42-87f8-dda76f14175b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062586 Jul 26 04:38:16.514393 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1380/2862] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:38:16 2022] PUT /compute/v2.1/images/a636c20f-fd55-4f42-87f8-dda76f14175b/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:16.522315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-31409090", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "939dc1d5-003f-4236-8a35-1a999d752e07"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:16.589911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:16.701323 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99fffe2e-1e7c-4763-8cce-6b11b57c32c9 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3" status: 200 len: 371 microversion: 2.1 time: 0.389476 Jul 26 04:38:16.702423 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1483/2863] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:38:16 2022] GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:16.714027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97d902c2-f10f-4d91-9ba7-d802fb88e496 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Action: 'update', calling method: .version_select at 0x7f38b5936ca0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:16.752492 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-97d902c2-f10f-4d91-9ba7-d802fb88e496 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97d902c2-f10f-4d91-9ba7-d802fb88e496 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/images/b6dcab4e-a0c2-4282-9270-08c63d7b691a/metadata/os_distro HTTP/1.1 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 30 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: {"meta": {"os_distro": "alt"}} Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'image_id': 'b6dcab4e-a0c2-4282-9270-08c63d7b691a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b6dcab4e-a0c2-4282-9270-08c63d7b691a Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:16.756008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6dcab4e-a0c2-4282-9270-08c63d7b691a could not be found. Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:16.759881 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:16.772401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97d902c2-f10f-4d91-9ba7-d802fb88e496 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:16.774584 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97d902c2-f10f-4d91-9ba7-d802fb88e496 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "PUT /compute/v2.1/images/b6dcab4e-a0c2-4282-9270-08c63d7b691a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.068361 Jul 26 04:38:16.776083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1484/2864] 10.222.0.43 () {60 vars in 1310 bytes} [Tue Jul 26 04:38:16 2022] PUT /compute/v2.1/images/b6dcab4e-a0c2-4282-9270-08c63d7b691a/metadata/os_distro => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:16.783305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:16.784386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:16.794603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:16.795991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:16.797166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:16.797724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:17.161384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:17.175761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7472b69b-9bb1-4a68-bb06-009824f0975e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1502 microversion: 2.1 time: 0.398369 Jul 26 04:38:17.197647 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1485/2865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:16 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:17.207406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58137103-24f0-4bf3-b8db-620a7b0830f4 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] Calling method '.version_select at 0x7f38b59b8670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:17.346781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:17.347257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:17.347670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:17.348434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:17.348870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:17.418582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:17.419049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:17.421684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:17.422506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:17.473846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:17.488237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:17.507916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 2 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:17.511474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:17.567196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119487) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 04:38:17.612958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:17.627835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:17.651933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.762641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:17.802212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:17.888951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58137103-24f0-4bf3-b8db-620a7b0830f4 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.688845 Jul 26 04:38:17.890547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1486/2866] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:38:17 2022] GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3/defaults => generated 371 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:17.900218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa4569aa-39c4-42e6-a3c0-f0b381d2c2b7 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Action: 'create', calling method: .version_select at 0x7f38b50a4f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:17.901664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=943fee86-3a28-4987-814c-61be59a28c5a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:17.940707 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fa4569aa-39c4-42e6-a3c0-f0b381d2c2b7 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] HTTP exception thrown: Image not found. Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa4569aa-39c4-42e6-a3c0-f0b381d2c2b7 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Request method failure captured: Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/images/72c97fd8-bd86-423c-9ad3-3e0c0acaec34/metadata HTTP/1.1 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 57 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-2HVd6gu_OtX9UDHKcU_QFiirpmO6rOAKcWfCJCoPIFiIaTOTyBRDeQj7EUOnvkJ40TqaTZnkFaNy13aGBZS_4Y3qareW-EchbOC50eUsjpdCjgPhARedotxh0EsvAeqbjJF2y15C2Y-HRMX8HBTPcu23C2qzPE_rwEELzj9pF5o0 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f50695ebb29461fa73494e02aefb589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f50695ebb29461fa73494e02aefb589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0f50695ebb29461fa73494e02aefb589 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-835550646 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c1f0ff19954a4245a1db4cdacfe4e245 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-835550646-project Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'image_id': '72c97fd8-bd86-423c-9ad3-3e0c0acaec34', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 72c97fd8-bd86-423c-9ad3-3e0c0acaec34 Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:38:17.943075 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 72c97fd8-bd86-423c-9ad3-3e0c0acaec34 could not be found. Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:38:17.948307 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:17.985148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa4569aa-39c4-42e6-a3c0-f0b381d2c2b7 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:17.991010 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa4569aa-39c4-42e6-a3c0-f0b381d2c2b7 tempest-ImagesMetadataNegativeTestJSON-835550646 tempest-ImagesMetadataNegativeTestJSON-835550646-project] 10.222.0.43 "POST /compute/v2.1/images/72c97fd8-bd86-423c-9ad3-3e0c0acaec34/metadata" status: 404 len: 62 microversion: 2.1 time: 0.099115 Jul 26 04:38:17.994721 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1487/2867] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Jul 26 04:38:17 2022] POST /compute/v2.1/images/72c97fd8-bd86-423c-9ad3-3e0c0acaec34/metadata => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:18.015110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2edce57-05a8-404b-8e0f-589832345802"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:18.024430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:18.042248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.043828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.046071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:18.047300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.047947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.062680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:18.103209 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Cannot 'attach_volume' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state rescued Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/os-volume_attachments HTTP/1.1 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 74 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: {"volumeAttachment": {"volumeId": "e2edce57-05a8-404b-8e0f-589832345802"}} Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'attach_volume' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state rescued Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6', 'body': {'volumeAttachment': {'volumeId': 'e2edce57-05a8-404b-8e0f-589832345802'}}} Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 04:38:18.108146 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state rescued Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state rescued Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:18.113478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 409 to user: Cannot 'attach_volume' instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 while it is in vm_state rescued {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:18.114650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:18.117511 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31d6e404-89cc-4943-a006-0c36d2c210ee tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114455 Jul 26 04:38:18.119735 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1488/2868] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:38:17 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:38:18.127677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:18.133255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:18.137685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:18.153506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.154308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.154867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.155324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.207549 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ccbb18d-bdea-4554-84fa-03737737c36d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.697800 Jul 26 04:38:18.211194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.215189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.215537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1381/2869] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1706 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 04:38:18.216708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lazy-loading 'fault' on Instance uuid e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:38:18.219731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69f7c8b5-3863-42d9-9cc9-ee14493d7ed5 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] Calling method '.version_select at 0x7f38b529e700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:18.310067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:18.319603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb146ee3-aa32-49aa-8759-cd4a04d6666b tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 200 len: 1302 microversion: 2.1 time: 0.198613 Jul 26 04:38:18.322322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1489/2870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:18 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 1302 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:18.335550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-deleted", "tag": "276d7529-2021-49de-8c08-fdd5d2f0cdc7"}, {"server_uuid": "e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0", "name": "network-vif-deleted", "tag": "89a9506c-c140-422a-a94d-deb073c119d9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:18.362976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.363429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.385937 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] Creating event network-vif-deleted:276d7529-2021-49de-8c08-fdd5d2f0cdc7 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:18.386478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] Creating event network-vif-deleted:89a9506c-c140-422a-a94d-deb073c119d9 for instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 on n-h2-848886-16 Jul 26 04:38:18.406468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-72548d56-fc06-4e4d-8182-a182bfb0e647 req-637aca24-f66d-4f2c-955a-d0b8b8d827bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081856 Jul 26 04:38:18.407222 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1490/2871] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:18.414254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:18.414988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:18.437506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.441789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.445174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.447093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.641239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-166ad74e-bafd-4bb3-8f1f-0def67f43241 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action" status: 202 len: 0 microversion: 2.1 time: 0.231557 Jul 26 04:38:18.641883 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1491/2872] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:38:18 2022] POST /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:38:18.654968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:18.679439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:18.683927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Searching by: {'deleted': False, 'project_id': 'b021402842234f30a0c3464f83ef416c'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:38:18.762269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.762914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.765511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.766147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.815638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:38:18.864663 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bba392d-b878-4d24-9d72-d09a9b9b4871 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.219243 Jul 26 04:38:18.865727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1492/2873] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:38:18 2022] GET /compute/v2.1/servers => generated 1661 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:18.870825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:18.871758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:18.880770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.881757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:18.883291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:18.886111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:19.130586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:19.137202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:19.156565 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40d8c7a7-0f8d-4107-a3ec-2b877de1c25e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1510 microversion: 2.1 time: 0.288372 Jul 26 04:38:19.161359 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1493/2874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:18 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:19.171867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3a741ae-7fc5-4324-9cf8-f2cc66c696e0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:19.172951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3a741ae-7fc5-4324-9cf8-f2cc66c696e0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:19.174707 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69f7c8b5-3863-42d9-9cc9-ee14493d7ed5 tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3" status: 200 len: 371 microversion: 2.1 time: 0.959586 Jul 26 04:38:19.181565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1382/2875] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 04:38:18 2022] GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3 => generated 371 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:19.194758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-730818ec-0a3f-4590-8d50-774bd1597b5c tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] Calling method '.version_select at 0x7f38b52459d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:19.416128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-730818ec-0a3f-4590-8d50-774bd1597b5c tempest-QuotasTestJSON-1619295495 tempest-QuotasTestJSON-1619295495-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3?user_id=3cb484d7a07a416592a854d380a855ba" status: 200 len: 371 microversion: 2.1 time: 0.225613 Jul 26 04:38:19.416737 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1383/2876] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Jul 26 04:38:19 2022] GET /compute/v2.1/os-quota-sets/b6704e98eb1441d8ac776a2ba3b2baa3?user_id=3cb484d7a07a416592a854d380a855ba => generated 371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:19.432351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:19.434373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:19.449800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3a741ae-7fc5-4324-9cf8-f2cc66c696e0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:19.453596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:19.454089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:19.457105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:19.457953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:19.459682 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3a741ae-7fc5-4324-9cf8-f2cc66c696e0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1217 microversion: 2.1 time: 0.295070 Jul 26 04:38:19.461946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1494/2877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:19 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1217 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:19.538671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 HTTP/1.1 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0'} Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:19.545922 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:38:19.549777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:19.556110 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37dc2784-f610-4863-b8ef-90a1d3db9615 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 404 len: 111 microversion: 2.1 time: 0.126186 Jul 26 04:38:19.557251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1384/2878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:19 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:19.632626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:19.637003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:19.637956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:19.640042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:19.640042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:19.702827 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96ca8921-9133-4207-866b-9a630b69101a tempest-AZV2TestJSON-1054298310 tempest-AZV2TestJSON-1054298310-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.238467 Jul 26 04:38:19.709884 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1495/2879] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Jul 26 04:38:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:38:20.181294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:20.182750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:20.193502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:20.193971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:20.199796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:20.200536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:20.482843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:20.484253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:20.495951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:20.496413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:20.501961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:20.502470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:20.901098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:20.920064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fd1750c-7091-435b-85d2-a01d54c033df tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1277 microversion: 2.1 time: 0.442672 Jul 26 04:38:20.928087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1496/2880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:20 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1277 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:21.286992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:21.301233 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7439120-6de9-4707-b790-bdcbfee4125f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1510 microversion: 2.1 time: 1.123721 Jul 26 04:38:21.303060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1385/2881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:20 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1510 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:21.955418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:21.958349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:21.971398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:21.971971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:21.973104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:21.978855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:22.306961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:22.317219 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-751308fc-8e2c-4630-bf47-904e65844cd0 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1275 microversion: 2.1 time: 0.374564 Jul 26 04:38:22.320168 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1497/2882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:21 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:22.324311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:22.324926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:22.337754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:22.338488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:22.340922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:22.341549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:22.994947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:23.006498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e74a1475-943e-4dde-a35f-bd16c747caf6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1510 microversion: 2.1 time: 0.683414 Jul 26 04:38:23.009233 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1386/2883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:22 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1510 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:23.344579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:23.345184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:23.363538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:23.366104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:23.368101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:23.368816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:24.029769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:24.030410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:24.047090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:24.047572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:24.048369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:24.049002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:24.320548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:24.340649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f984b1d-82d3-4537-97fd-f61488d00ca5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 1.001841 Jul 26 04:38:24.345202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1498/2884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:23 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:24.621664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:24.652885 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f10a0183-de50-404c-94df-949a00a188a0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1516 microversion: 2.1 time: 0.626976 Jul 26 04:38:24.655013 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1387/2885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:24 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1516 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:25.361082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:25.361701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:25.401405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:25.405334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:25.408996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:25.426427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:26.452213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e0132126-594c-4e7b-a7a2-c459d91b9c33 req-cefa60c4-6043-439b-8b92-858afda8afab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943fee86-3a28-4987-814c-61be59a28c5a", "tag": "573774f4-b9bf-49f1-a1db-8608bd32d073"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:26.501621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e0132126-594c-4e7b-a7a2-c459d91b9c33 req-cefa60c4-6043-439b-8b92-858afda8afab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:26.502046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e0132126-594c-4e7b-a7a2-c459d91b9c33 req-cefa60c4-6043-439b-8b92-858afda8afab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:26.528605 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e0132126-594c-4e7b-a7a2-c459d91b9c33 req-cefa60c4-6043-439b-8b92-858afda8afab service nova] Creating event network-changed:573774f4-b9bf-49f1-a1db-8608bd32d073 for instance 943fee86-3a28-4987-814c-61be59a28c5a on n-h2-848886-16 Jul 26 04:38:26.535216 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e0132126-594c-4e7b-a7a2-c459d91b9c33 req-cefa60c4-6043-439b-8b92-858afda8afab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100614 Jul 26 04:38:26.540840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1388/2886] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:26.810590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:26.824742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a146c7e2-f393-4785-9fd5-f2719ff9290a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 1.467138 Jul 26 04:38:26.835499 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1499/2887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:25 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:27.180940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9fa5f6d-4745-4058-8272-4a4cb107ab78 tempest-ComputeTenantNetworksTest-959343058 tempest-ComputeTenantNetworksTest-959343058-project] Calling method '.version_select at 0x7f38b51b25e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:27.423134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17eff33b-fa0c-4ff0-a362-1a08aa90c470 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: .version_select at 0x7f38b5efa1f0>, body: {"keypair": {"name": "tempest-keypair-1415453824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBwr7vHasMzitCiAlk7VdMy+OpbLseiau+wteUCzAhGFIxFKpkZVgnEHaKFlSTmoG/u49IcrJMeZybkRI3/k+vqa+payD5Z2gzCuoy7+3oGAPNmnLZPklZQKr5n9007Eg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:27.441523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:27.445391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-17eff33b-fa0c-4ff0-a362-1a08aa90c470 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:27.465370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-17eff33b-fa0c-4ff0-a362-1a08aa90c470 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for user 338a0f0319d34f9f955e930ef03f3bdf and project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:27.528667 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17eff33b-fa0c-4ff0-a362-1a08aa90c470 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106329 Jul 26 04:38:27.532451 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1500/2888] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:38:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:27.848321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:27.848998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:27.865961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:27.866449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:27.868145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:27.869027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:28.289957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9fa5f6d-4745-4058-8272-4a4cb107ab78 tempest-ComputeTenantNetworksTest-959343058 tempest-ComputeTenantNetworksTest-959343058-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.259990 Jul 26 04:38:28.292704 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1389/2889] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:38:27 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:28.307632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c3d15e9-0dc0-49db-89f7-dbe3e42a696a tempest-ComputeTenantNetworksTest-959343058 tempest-ComputeTenantNetworksTest-959343058-project] Calling method '.version_select at 0x7f38b51b0280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:28.437668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:28.454775 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd29b1fd-3903-4a01-9240-cc00a31f1efb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.610198 Jul 26 04:38:28.466523 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c3d15e9-0dc0-49db-89f7-dbe3e42a696a tempest-ComputeTenantNetworksTest-959343058 tempest-ComputeTenantNetworksTest-959343058-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks/958b2943-8684-459d-a971-58960c58c708" status: 200 len: 139 microversion: 2.1 time: 0.157140 Jul 26 04:38:28.466523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1390/2890] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:38:28 2022] GET /compute/v2.1/os-tenant-networks/958b2943-8684-459d-a971-58960c58c708 => generated 139 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:28.467388 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1501/2891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:27 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:29.226621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d360d79b-22e0-4f1f-89cb-29528e173d9c req-6bb8030c-1d1f-4b58-a98a-a5ce5c58f5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558a8be1-306b-4a75-b21a-183197fdc398", "tag": "e04cd38a-7dcc-4879-9393-8a5e57c5d305"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:29.265785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d360d79b-22e0-4f1f-89cb-29528e173d9c req-6bb8030c-1d1f-4b58-a98a-a5ce5c58f5ae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:29.269254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d360d79b-22e0-4f1f-89cb-29528e173d9c req-6bb8030c-1d1f-4b58-a98a-a5ce5c58f5ae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:29.287660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d360d79b-22e0-4f1f-89cb-29528e173d9c req-6bb8030c-1d1f-4b58-a98a-a5ce5c58f5ae service nova] Creating event network-changed:e04cd38a-7dcc-4879-9393-8a5e57c5d305 for instance 558a8be1-306b-4a75-b21a-183197fdc398 on n-h1-848886-16 Jul 26 04:38:29.293814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d360d79b-22e0-4f1f-89cb-29528e173d9c req-6bb8030c-1d1f-4b58-a98a-a5ce5c58f5ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075191 Jul 26 04:38:29.295909 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1391/2892] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:29.483159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:29.485779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:29.502319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:29.503108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:29.505598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:29.507106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:29.663661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.230285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:30.239990 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8fcdc786-b2d2-43a7-8f92-5d0c2890e4c5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.765087 Jul 26 04:38:30.241984 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1502/2893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:29 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:31.264567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:31.265453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:31.267810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=30 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.286569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:31.287358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:31.288417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:31.290843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:31.934127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:31.952037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80682ed6-abe9-4618-9ffb-fb1789d4d549 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.691962 Jul 26 04:38:31.976392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1392/2894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:31 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:32.989564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:32.990880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:33.012042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:33.013185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:33.015354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:33.017818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:33.247549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7809430-7ed0-4fe9-b207-6265c9d16104 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Action: 'create', calling method: .version_select at 0x7f38b51cb670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1451028766", "metadata": {"Type": "work"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:33.828706 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7809430-7ed0-4fe9-b207-6265c9d16104 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.746761 Jul 26 04:38:33.829337 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1393/2895] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Jul 26 04:38:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 748 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 04:38:33.842546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0fd50e6-2f17-476d-a645-704f61f9f907 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b51b08b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:33.961694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0fd50e6-2f17-476d-a645-704f61f9f907 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 353 microversion: 2.1 time: 0.122977 Jul 26 04:38:33.962755 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1394/2896] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:33 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:34.618963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:34.628331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfa976a3-4f97-42c6-a77d-12a5c99de360 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 1.655111 Jul 26 04:38:34.628908 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1503/2897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:32 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:34.978118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-921d31ec-78d2-4d0a-a0a4-8bbf43308233 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b51cb670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:35.151382 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-921d31ec-78d2-4d0a-a0a4-8bbf43308233 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 353 microversion: 2.1 time: 0.179255 Jul 26 04:38:35.152362 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1395/2898] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:34 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:35.656280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:35.656908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:35.673073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:35.673539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:35.684915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:35.685492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:35.925080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1e09262-abbe-4a20-acda-c3e4d56ef143 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Action: 'create', calling method: .version_select at 0x7f38b51d69d0>, body: {"keypair": {"name": "tempest-keypair-1858168389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfpgsXAq8oObjG+8Lj7t69w7LJCiHVrrtrMDEgjy0P0lK7bB2p8df3b8gLLPkRybDYiQw2RG2L00tawIcEpeX7076I2zN/pz10C4lhjmsBsZ9YVepSVchXyLhYV5xYSyQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:35.965824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d1e09262-abbe-4a20-acda-c3e4d56ef143 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Getting quotas for project 1618901939a44ef2b44d98dbc2a821b7. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:35.983579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d1e09262-abbe-4a20-acda-c3e4d56ef143 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Getting quotas for user 30724f41927d42b78babcf9b382d31e9 and project 1618901939a44ef2b44d98dbc2a821b7. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:36.063951 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1e09262-abbe-4a20-acda-c3e4d56ef143 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.141642 Jul 26 04:38:36.080919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1396/2899] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:38:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:38:36.165071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae26dce1-202a-4a64-8072-688f8c61d9ea tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b51cbaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:36.277697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae26dce1-202a-4a64-8072-688f8c61d9ea tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 354 microversion: 2.1 time: 0.116630 Jul 26 04:38:36.279153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1397/2900] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:36 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:36.388966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: .version_select at 0x7f38b5256790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-669848715", "policies": ["affinity"]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:36.467908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:36.482225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:36.537664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:36.560169 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bba81cc-2b33-49b3-9378-11b69c733965 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.904592 Jul 26 04:38:36.561620 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1504/2901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:35 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:36.587046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-466f4395-aae7-4df7-a29c-09cd47314bb3 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b5a22550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:36.620950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:36.624333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:36.640201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:36.672370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0aa35a7-08fe-4c92-9fc1-c64322c05883 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.391477 Jul 26 04:38:36.673006 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1398/2902] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Jul 26 04:38:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:36.684601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: .version_select at 0x7f38b51d6040>, body: {"server_group": {"name": "tempest-server-group-1718228168", "policies": ["affinity"]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:36.684778 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-466f4395-aae7-4df7-a29c-09cd47314bb3 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 354 microversion: 2.1 time: 0.119099 Jul 26 04:38:36.693897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1505/2903] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:36 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:36.699794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8945ea32-39ed-45b3-9822-8a518651ba14 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b57f7820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:36.723259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:36.773619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:36.864253 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8945ea32-39ed-45b3-9822-8a518651ba14 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 202 len: 0 microversion: 2.1 time: 0.168561 Jul 26 04:38:36.870220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1506/2904] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:38:36 2022] DELETE /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:38:36.880228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7bec1701-1d60-4803-86ae-15fd445ae3d9 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b5a8f3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:36.929733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:36.945990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:37.014136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a7d8262-a739-40fc-bd8e-54125d4047e6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.334012 Jul 26 04:38:37.021576 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1399/2905] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 26 04:38:36 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:37.028199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7bec1701-1d60-4803-86ae-15fd445ae3d9 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 353 microversion: 2.1 time: 0.156177 Jul 26 04:38:37.029163 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1507/2906] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:36 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:37.032255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1482221269", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "31ad927a-3cff-404b-8218-08db9634c6aa"}, {"uuid": "5bb46093-1189-4a55-a4f9-3ef253978a45"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:37.041563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: .version_select at 0x7f38b57f70d0>, body: {"server_group": {"name": "tempest-server-group-1718228168", "policies": ["affinity"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:37.099289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:37.121762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] validate_networks() for [('31ad927a-3cff-404b-8218-08db9634c6aa', None, None, None, None, None), ('5bb46093-1189-4a55-a4f9-3ef253978a45', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:37.125691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:37.225208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:37.240564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:37.273267 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3ebe45a-19ba-4f92-8e3b-8ebe754850dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.237564 Jul 26 04:38:37.282612 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1508/2907] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 26 04:38:37 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:37.293881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6a17f7f-f337-46dd-b32b-5c56e10a8e37 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:37.346714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.370810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6a17f7f-f337-46dd-b32b-5c56e10a8e37 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e876350c-3317-4d36-9696-0c6f79681293" status: 204 len: 0 microversion: 2.1 time: 0.086074 Jul 26 04:38:37.373017 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1509/2908] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:38:37 2022] DELETE /compute/v2.1/os-server-groups/e876350c-3317-4d36-9696-0c6f79681293 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:37.400096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39e50ee2-8726-4ab9-88ed-2b8c96c0ee42 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:37.442812 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39e50ee2-8726-4ab9-88ed-2b8c96c0ee42 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.061733 Jul 26 04:38:37.448857 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1510/2909] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:38:37 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:37.463890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-067b07b7-dde2-4c98-b65e-d28f924de5dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:37.539232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-067b07b7-dde2-4c98-b65e-d28f924de5dd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e83f2877-f587-4226-96e7-c6b01764fbe9" status: 204 len: 0 microversion: 2.1 time: 0.083086 Jul 26 04:38:37.541291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1511/2910] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:38:37 2022] DELETE /compute/v2.1/os-server-groups/e83f2877-f587-4226-96e7-c6b01764fbe9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:37.552427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfca87ee-ef17-465b-816e-c91d79828fdd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:37.587235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfca87ee-ef17-465b-816e-c91d79828fdd tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040687 Jul 26 04:38:37.588365 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1512/2911] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:38:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:37.602308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:37.610827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:37.620010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:37.622536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:37.623629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:37.627692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:38.291716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:38.308265 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2cc844a9-9745-4ee6-9d4a-b9dbe6cf101b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.718109 Jul 26 04:38:38.310805 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1513/2912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:37 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:38.331003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: .version_select at 0x7f38b5a8fc10>, body: {"server_group": {"name": "tempest-server-group-806166868", "policies": ["affinity"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:38.396724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:38.414690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:38.516193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:38.529092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:38.552522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45b091b0-cd83-4010-a980-461f087c876b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.239473 Jul 26 04:38:38.553479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1514/2913] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 26 04:38:38 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:38.562465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d9a8db9-728d-46d6-8918-454edc37f14d tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b6177790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:38.627678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d9a8db9-728d-46d6-8918-454edc37f14d tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 353 microversion: 2.1 time: 0.072120 Jul 26 04:38:38.628813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1515/2914] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:38 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:38.634610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1930707499", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bb5e808-d793-40d4-b818-b8f206b33bc2"}], "security_groups": [{"name": "tempest-securitygroup--990987151"}], "key_name": "tempest-keypair-1415453824", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:38.844634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:38.845103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:38.845528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:38.845941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:38.846383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:38.877583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:38.878043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:38.878884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:38.879329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:38.938334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Getting quotas for project 9e51945c9cb04fa5ab1ac0d8ebdf83c4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:38.954493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Getting quotas for user 113f2b415ddf44519f9908d643958bab and project 9e51945c9cb04fa5ab1ac0d8ebdf83c4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:38.978264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:38.980635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:39.080685 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44aab09f-4839-4805-9a36-7bdb67262048 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057685 Jul 26 04:38:39.088837 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1400/2915] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:39.094107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b7cc61d-b53c-4e2e-a5e8-88e2f6b7134c tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:39.163483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b7cc61d-b53c-4e2e-a5e8-88e2f6b7134c tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/ea176f4f-cc93-4589-a28b-1ce907ea222a" status: 204 len: 0 microversion: 2.1 time: 0.073145 Jul 26 04:38:39.164535 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1401/2916] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:38:39 2022] DELETE /compute/v2.1/os-server-groups/ea176f4f-cc93-4589-a28b-1ce907ea222a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:39.169660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-062d5d63-ce8a-43a9-9c03-bd2981baaaa7 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:39.170509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-062d5d63-ce8a-43a9-9c03-bd2981baaaa7 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:39.315570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-062d5d63-ce8a-43a9-9c03-bd2981baaaa7 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:39.326998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-062d5d63-ce8a-43a9-9c03-bd2981baaaa7 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1213 microversion: 2.1 time: 0.161202 Jul 26 04:38:39.327600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1402/2917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:39 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:39.349544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9f64d112-1e33-4c74-81e5-bd2ee269e9b0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:39.389349 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9f64d112-1e33-4c74-81e5-bd2ee269e9b0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043150 Jul 26 04:38:39.395004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1403/2918] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:38:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:39.401193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:39.407179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:39.417783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] validate_networks() for [('2bb5e808-d793-40d4-b818-b8f206b33bc2', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:39.427256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:39.428292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:39.428455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:39.429916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:39.764528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:39.772155 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c66dce3a-f781-4d83-a04d-15e8c41016cc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.375879 Jul 26 04:38:39.782506 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1404/2919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:39 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:39.790127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: .version_select at 0x7f38b5386ca0>, body: {"server_group": {"name": "tempest-server-group-1250133107", "policies": ["anti-affinity"]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:39.824643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:39.845859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:39.947233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:39.965062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_groups'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:39.987749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d42f15a8-ed37-4b80-be2d-629be3eb3771 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.203926 Jul 26 04:38:39.989489 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1405/2920] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 26 04:38:39 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:40.016181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3b9f055-5163-489c-b641-71d3fa25b1d9 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b529ef70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:40.173040 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3b9f055-5163-489c-b641-71d3fa25b1d9 tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 200 len: 353 microversion: 2.1 time: 0.172692 Jul 26 04:38:40.174004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1406/2921] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:39 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:40.182522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71df8e09-0dc8-4280-b74a-eff61d4a89f0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:40.246061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71df8e09-0dc8-4280-b74a-eff61d4a89f0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f" status: 204 len: 0 microversion: 2.1 time: 0.070586 Jul 26 04:38:40.247424 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1407/2922] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:38:40 2022] DELETE /compute/v2.1/os-server-groups/e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:40.255780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9111d2bd-460f-4df4-940c-0276abaa2bb0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:40.273816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.298624 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9111d2bd-460f-4df4-940c-0276abaa2bb0 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044223 Jul 26 04:38:40.301672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1408/2923] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:38:40 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:38:40.353071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:40.353697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:40.392274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:40.396305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:40.400347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:40.405960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:40.443464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.755001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:40.763814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8af0879f-e672-44d3-89d2-dda9fc3ef119 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1209 microversion: 2.1 time: 0.415324 Jul 26 04:38:40.768074 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1409/2924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:40 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1209 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:40.790782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1923917472", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "35685ce4-3d50-4320-bc37-7bc7b765596a"}]}, "os:scheduler_hints": {"group": "eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:41.013164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] validate_networks() for [('35685ce4-3d50-4320-bc37-7bc7b765596a', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:42.259884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:42.261935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:42.262941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:42.265080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:42.265798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:42.296171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:42.298497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:42.300997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:42.303114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:42.365927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:42.384632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Getting quotas for user 338a0f0319d34f9f955e930ef03f3bdf and project 4b4c000482da4440bb1a1a650eda5b55. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:42.419800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:42.426672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:42.546950 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f78d68f2-3846-468c-a544-54e9a05993a4 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.916551 Jul 26 04:38:42.549235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1516/2925] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 3919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:42.559010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:42.562101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:42.586567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:42.590869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:42.596593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:42.613434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:43.445276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:43.446334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:43.447273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:43.448049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:43.448648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:43.496844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:43.498798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:43.500444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:43.501637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:43.536368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:43.547765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:43.570349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:43.575904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:43.683166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:43.691884 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a23281f-5f8a-4503-85fd-d4aa2339d133 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 1.139671 Jul 26 04:38:43.699238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:43.706576 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1517/2926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:42 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:43.710331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:43.721047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d8dd407c-b653-4c5f-ba2b-c6e876c60eaa req-48fe2345-819d-47d4-b6d7-1228bc4b2a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943fee86-3a28-4987-814c-61be59a28c5a", "name": "network-vif-plugged", "status": "completed", "tag": "573774f4-b9bf-49f1-a1db-8608bd32d073"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:43.759253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d8dd407c-b653-4c5f-ba2b-c6e876c60eaa req-48fe2345-819d-47d4-b6d7-1228bc4b2a35 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:43.763288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d8dd407c-b653-4c5f-ba2b-c6e876c60eaa req-48fe2345-819d-47d4-b6d7-1228bc4b2a35 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:43.802645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d8dd407c-b653-4c5f-ba2b-c6e876c60eaa req-48fe2345-819d-47d4-b6d7-1228bc4b2a35 service nova] Creating event network-vif-plugged:573774f4-b9bf-49f1-a1db-8608bd32d073 for instance 943fee86-3a28-4987-814c-61be59a28c5a on n-h2-848886-16 Jul 26 04:38:43.820199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d8dd407c-b653-4c5f-ba2b-c6e876c60eaa req-48fe2345-819d-47d4-b6d7-1228bc4b2a35 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111426 Jul 26 04:38:43.825039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1518/2927] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:43.832989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:43.843012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02adda4e-07eb-4881-837f-8a5c05acdfef tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Calling method '.version_select at 0x7f38b6190c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:43.866942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Getting quotas for user cffc4a65cd3946b3a7ebc2958f3cd6ef and project ddff673af64c4a53a6ee90b9e8ebf0af. Resources: {'server_group_members'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:43.932115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-890c1cb4-62ad-4b34-a100-cf3faf101d4e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.162345 Jul 26 04:38:43.941874 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1410/2928] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:43.950737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-02adda4e-07eb-4881-837f-8a5c05acdfef tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] HTTP exception thrown: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02adda4e-07eb-4881-837f-8a5c05acdfef tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Request method failure captured: Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 HTTP/1.1 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_ItlYm7y2bAGpeHfI1HIm9-e3gvvmizzDRbLmaxfBNGUGEeNx6a0a-GFiPoNJdBtimx0zUrNLj084ojBSeYXZ3w1G5EBIg906-zg0lu0fc8Rk2tb5mvRObhocRnk85YJgYyupG5kiEDTsKUxoFzdWzs4sUbK0p5zb7xHihcjRbb0c Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 7ebe08e8369848b580f6c239341306e2 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesGetTestJSON-647191545 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7ebe08e8369848b580f6c239341306e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ebe08e8369848b580f6c239341306e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ebe08e8369848b580f6c239341306e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7ebe08e8369848b580f6c239341306e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesGetTestJSON-647191545 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 7ebe08e8369848b580f6c239341306e2 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesGetTestJSON-647191545 Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesGetTestJSON-647191545-project Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 90b357053c57485f82a33429c11c000b Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesGetTestJSON-647191545-project Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '0117f075-b2b1-49be-b465-fc855ef06305'} Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. (HTTP 404) (Request-ID: req-9f5ac006-6377-4d97-8c15-d545999b05ad) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:38:43.952991 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:38:43.957853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02adda4e-07eb-4881-837f-8a5c05acdfef tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] Returning 404 to user: Volume 0117f075-b2b1-49be-b465-fc855ef06305 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:38:43.962057 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02adda4e-07eb-4881-837f-8a5c05acdfef tempest-VolumesGetTestJSON-647191545 tempest-VolumesGetTestJSON-647191545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305" status: 404 len: 109 microversion: 2.1 time: 0.133154 Jul 26 04:38:43.967971 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1519/2929] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:38:43 2022] GET /compute/v2.1/os-volumes/0117f075-b2b1-49be-b465-fc855ef06305 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:43.973206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1934334629", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "af4025e1-f51c-4d1d-ad88-5db57161b2b9"}, {"port": "452afe63-3b8d-477c-8d81-ac6cd7ed22f9", "tag": "port-1"}, {"port": "62e220ae-0d94-4379-8eec-40ace2a2643d", "tag": "port-2"}, {"uuid": "1d329ab9-e4a1-4647-977a-f996044c92f3", "tag": "net-1"}, {"uuid": "1d329ab9-e4a1-4647-977a-f996044c92f3"}, {"uuid": "35bd62a7-53b6-4656-ac9d-c8eb55d83ac7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "35bd62a7-53b6-4656-ac9d-c8eb55d83ac7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bb2b3d49-4e13-4447-be2a-9d655dd402ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6a2d14ee-5e30-45f6-a4b0-b5a722a77d27", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5e64d12b-4a4b-4888-8c6e-189e75e98a40", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--184030289"}], "key_name": "tempest-keypair-1858168389", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:43.987731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:43.988470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:44.009971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:44.014618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:44.015771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:44.017422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.086922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:45.097591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06d027ab-dde0-42cd-b7ca-ef77e13415b4 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1313 microversion: 2.1 time: 1.154266 Jul 26 04:38:45.102128 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1411/2930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:43 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1313 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:45.112755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:45.116675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:45.138752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.140350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.141351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.142394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.535285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:45.546142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d13ff91-565a-4e03-9b48-fe7d6ee34566 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1316 microversion: 2.1 time: 0.437377 Jul 26 04:38:45.549602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1412/2931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:45 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:45.556519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:45.561909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:45.588590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.591333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.593110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.594684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.771719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:45.782974 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6929975a-9255-4489-b94e-d6bf2e8a2f74 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1217 microversion: 2.1 time: 0.231775 Jul 26 04:38:45.785003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1413/2932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:45 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:45.797418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:45.798468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:45.808191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.811280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.812384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:45.813139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:45.818484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] validate_networks() for [('af4025e1-f51c-4d1d-ad88-5db57161b2b9', None, None, None, None, None), (None, None, '452afe63-3b8d-477c-8d81-ac6cd7ed22f9', None, None, None), (None, None, '62e220ae-0d94-4379-8eec-40ace2a2643d', None, None, None), ('1d329ab9-e4a1-4647-977a-f996044c92f3', None, None, None, None, None), ('1d329ab9-e4a1-4647-977a-f996044c92f3', None, None, None, None, None), ('35bd62a7-53b6-4656-ac9d-c8eb55d83ac7', '10.2.2.100', None, None, None, None), ('35bd62a7-53b6-4656-ac9d-c8eb55d83ac7', '10.2.2.200', None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:46.753723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:46.764872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c13a856a-52ad-4e06-b2ad-c0698a0c1dc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.977591 Jul 26 04:38:46.765903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1414/2933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:45 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:46.772946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ff54e219-cc06-406f-bb5a-673b43c7b9cb req-f36f412f-5e03-4cc4-9862-08e8722720af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a8be1-306b-4a75-b21a-183197fdc398", "name": "network-vif-plugged", "status": "completed", "tag": "e04cd38a-7dcc-4879-9393-8a5e57c5d305"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:46.799937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff54e219-cc06-406f-bb5a-673b43c7b9cb req-f36f412f-5e03-4cc4-9862-08e8722720af service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:46.800740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff54e219-cc06-406f-bb5a-673b43c7b9cb req-f36f412f-5e03-4cc4-9862-08e8722720af service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:46.822094 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ff54e219-cc06-406f-bb5a-673b43c7b9cb req-f36f412f-5e03-4cc4-9862-08e8722720af service nova] Creating event network-vif-plugged:e04cd38a-7dcc-4879-9393-8a5e57c5d305 for instance 558a8be1-306b-4a75-b21a-183197fdc398 on n-h1-848886-16 Jul 26 04:38:46.835441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ff54e219-cc06-406f-bb5a-673b43c7b9cb req-f36f412f-5e03-4cc4-9862-08e8722720af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065513 Jul 26 04:38:46.836351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1415/2934] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:46.844201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:46.845247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:46.868487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:46.869414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:46.870482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:46.871081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:47.172046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:47.180378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32eedfd4-3838-4660-9660-9665a7bae30e tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.342633 Jul 26 04:38:47.180975 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1416/2935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:46 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:47.189290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:47.189911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:47.212672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:47.213140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:47.216487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:47.218118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:47.460205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:47.468837 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f10d32f8-2686-4b10-bc55-e8a69b41ea95 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1304 microversion: 2.1 time: 0.285116 Jul 26 04:38:47.470583 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1417/2936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:47 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1304 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:47.823467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc8dc2dd-eaed-45b9-a12c-fd013820f2b6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Action: 'create', calling method: .version_select at 0x7f38b5a47af0>, body: {"keypair": {"name": "tempest-keypair-1842271856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqfxpHKi5plpmHo86vV1N2sZkjS3giQcNyKufTWrnI66mt2KigGyfm2WGYV3GsvYEA3J9nNCwahaZKKhJoOIhN5mKljv7shPFZw1j9PBazIRt9vlhROJIGvfYIwcuGGfg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:47.885393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-fc8dc2dd-eaed-45b9-a12c-fd013820f2b6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Getting quotas for project e98487227d9c4aa3bab7756d9a13406d. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:47.927912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-fc8dc2dd-eaed-45b9-a12c-fd013820f2b6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Getting quotas for user 7d9bcfdda3f7431192eb5abeb110e192 and project e98487227d9c4aa3bab7756d9a13406d. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:48.053250 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc8dc2dd-eaed-45b9-a12c-fd013820f2b6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.575625 Jul 26 04:38:48.056170 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1418/2937] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:38:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:48.065482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:48.067205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:48.091460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.093066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:48.094585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.095289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:48.187467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:48.205767 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bbe53705-7f0f-44e9-8a50-e68c6a0176e8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1271 microversion: 2.1 time: 0.147984 Jul 26 04:38:48.213666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1419/2938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:48 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:48.228312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:48.228312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:48.247817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.248071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:48.248983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.249563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:48.859914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:48.877978 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02569ea3-5978-4f0f-a265-1f12c3034c03 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1317 microversion: 2.1 time: 0.656008 Jul 26 04:38:48.882326 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1420/2939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:48 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:48.910132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:48.911855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:48.951545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.952219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:48.953190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:48.960015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:49.345773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:49.357695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f6be859-aadd-4a80-b1e2-67855aab6570 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.468613 Jul 26 04:38:49.358648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1421/2940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:48 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:49.367553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:49.368188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:49.383889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:49.383889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:49.385989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:49.386666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:49.501707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:49.513378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-694b25c5-c08c-48d6-8033-9c37ab53d120 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1304 microversion: 2.1 time: 0.153593 Jul 26 04:38:49.513990 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1422/2941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:49 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:49.531122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-29ecfb3c-36f7-486d-a495-798e29f6b462 req-7c2d308f-f488-4e8f-9cf9-fb66e7c66490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "tag": "841bdd40-cd09-4757-b757-a2afe0822dea"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:49.546451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-29ecfb3c-36f7-486d-a495-798e29f6b462 req-7c2d308f-f488-4e8f-9cf9-fb66e7c66490 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:49.552825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-29ecfb3c-36f7-486d-a495-798e29f6b462 req-7c2d308f-f488-4e8f-9cf9-fb66e7c66490 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:49.576976 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-29ecfb3c-36f7-486d-a495-798e29f6b462 req-7c2d308f-f488-4e8f-9cf9-fb66e7c66490 service nova] Creating event network-changed:841bdd40-cd09-4757-b757-a2afe0822dea for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:38:49.583449 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-29ecfb3c-36f7-486d-a495-798e29f6b462 req-7c2d308f-f488-4e8f-9cf9-fb66e7c66490 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066793 Jul 26 04:38:49.584993 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1423/2942] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:49.592326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:49.594084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:49.604820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:49.606693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:49.607943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:49.608782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:50.044894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:50.094321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d061c556-2fc8-405b-b433-2359c617e11d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1271 microversion: 2.1 time: 0.505636 Jul 26 04:38:50.097110 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1424/2943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:49 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1271 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:50.392442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-416313683", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "375077fe-0b05-4c6a-9dfb-0eb433eff9f2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:50.518075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] validate_networks() for [('375077fe-0b05-4c6a-9dfb-0eb433eff9f2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:52.345261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:52.398773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:52.399276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:52.403383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:52.403857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=43 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:52.404046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:52.404325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:52.440759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:52.441593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:52.442688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:52.449626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:52.526501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:52.540679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for user 8644f4ea57d44617b1b4652993df8cdd and project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:52.580527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:52.584963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:52.795529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8248920c-b363-47b4-8d65-1d6d0e2492e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685884 Jul 26 04:38:52.796313 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1425/2944] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:52.812931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:52.813586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:52.838523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:52.857882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:52.858425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:52.861261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:52.861730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:53.775410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=66 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.096541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:54.118071 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c5d25bd-3a6b-4f6a-91b0-896f88445089 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1466 microversion: 2.1 time: 1.310659 Jul 26 04:38:54.122638 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1426/2945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:52 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1466 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:54.140700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:54.143631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:54.168590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.169098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.169942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.170413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.531438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:54.546598 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9dd9f55e-d925-4d49-b73d-e8378bba54ca tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.420828 Jul 26 04:38:54.556612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1427/2946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:54 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:54.561651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:54.569360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:54.580516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.585992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.586887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.587901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.836433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:54.845575 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fb12840-e888-47b9-9eb0-034960fed9f1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.287566 Jul 26 04:38:54.846739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1428/2947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:54 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:54.852324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:54.855216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:54.871277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.872140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.873169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:54.873939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:54.934703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:55.106198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.115875 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bdf7e963-400c-44fe-801c-9814e447217d tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.266963 Jul 26 04:38:55.117927 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1429/2948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:54 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:55.123142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6a58bc18-db54-4d4b-b0ab-f6cb4cc5c451 req-3952dc5a-168c-4068-a3ba-5f0a4d6d787b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "tag": "a37bfb25-ec93-4013-a1a9-4e451bf30065"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:55.139421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6a58bc18-db54-4d4b-b0ab-f6cb4cc5c451 req-3952dc5a-168c-4068-a3ba-5f0a4d6d787b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.140229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6a58bc18-db54-4d4b-b0ab-f6cb4cc5c451 req-3952dc5a-168c-4068-a3ba-5f0a4d6d787b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.158715 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6a58bc18-db54-4d4b-b0ab-f6cb4cc5c451 req-3952dc5a-168c-4068-a3ba-5f0a4d6d787b service nova] Creating event network-changed:a37bfb25-ec93-4013-a1a9-4e451bf30065 for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:38:55.167653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6a58bc18-db54-4d4b-b0ab-f6cb4cc5c451 req-3952dc5a-168c-4068-a3ba-5f0a4d6d787b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048195 Jul 26 04:38:55.170823 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1430/2949] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:55.178102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:55.179046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:55.188327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.189043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.190038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.190668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.269092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.278938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b55c066a-80a9-49c5-8975-41d05552b948 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1265 microversion: 2.1 time: 0.106147 Jul 26 04:38:55.280068 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1431/2950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:55 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:55.286181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:55.287503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:55.298962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.299417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.300199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.300633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.442798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.452502 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8bbc8362-9289-4a57-905e-b08662d01803 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 200 len: 1467 microversion: 2.1 time: 0.171240 Jul 26 04:38:55.453093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1432/2951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:55 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 1467 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:55.472353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:55.478101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.479105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Searching by: {'reservation_id': 'r-ycaih7ad', 'deleted': False, 'project_id': 'b021402842234f30a0c3464f83ef416c'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:38:55.484698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.485147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.485943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.486406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.581722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:38:55.653915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.661075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.661451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.793826 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32d79d91-43c9-446b-bf2f-861303af6d3b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-ycaih7ad" status: 200 len: 2926 microversion: 2.1 time: 0.324914 Jul 26 04:38:55.794482 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1433/2952] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Jul 26 04:38:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ycaih7ad => generated 2926 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:55.799878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:55.800568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:55.808108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.808973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.809873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.810651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:55.965925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:55.973569 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e384f6ac-a1ed-4702-a3d6-28e13e363702 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.178084 Jul 26 04:38:55.974143 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1434/2953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:55 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:55.982115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5b16f2b-4df9-4201-8557-33a647fdd1b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:55.998254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.server_groups [None req-c5b16f2b-4df9-4201-8557-33a647fdd1b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Querying cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) for 2 instances {{(pid=119487) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 04:38:55.999277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5b16f2b-4df9-4201-8557-33a647fdd1b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:55.999882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5b16f2b-4df9-4201-8557-33a647fdd1b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.040956 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5b16f2b-4df9-4201-8557-33a647fdd1b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/939dc1d5-003f-4236-8a35-1a999d752e07" status: 200 len: 271 microversion: 2.1 time: 0.064219 Jul 26 04:38:56.041189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1435/2954] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:38:55 2022] GET /compute/v2.1/os-server-groups/939dc1d5-003f-4236-8a35-1a999d752e07 => generated 271 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:56.052393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:56.054046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:56.061880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.062624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.063746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.064404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.252539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:56.262532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30122f64-6642-4df7-a3b5-9a7a45f9224c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.215305 Jul 26 04:38:56.274386 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1436/2955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:56 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:56.274386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:56.274386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:56.279643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.280109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.280904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.281393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.516123 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6a8dc1aa-4dc1-4cf5-8007-b0840870acd5 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 200 len: 1619 microversion: 2.1 time: 0.251649 Jul 26 04:38:56.517484 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1437/2956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:56 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 1619 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:56.526143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:56.526785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:56.539096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.539615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.540888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.541397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.790432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:56.800500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-23f80dc4-2286-4777-949b-2cf15828a0f3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.281895 Jul 26 04:38:56.801289 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1438/2957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:56 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:56.807990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:56.809173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:56.824853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.825571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.826675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.829317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.915413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:56.933807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7e15d1f-a953-456d-9f0a-9dfef4d21e9d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1265 microversion: 2.1 time: 0.130829 Jul 26 04:38:56.935295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1439/2958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:56 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:56.941327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:56.942346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:56.951299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.952132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:56.953560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:56.954176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:57.137883 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29e250f0-5c98-44c0-9ea9-e492b08520c8 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 200 len: 1620 microversion: 2.1 time: 0.201334 Jul 26 04:38:57.140241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1440/2959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:56 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 1620 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:57.147215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8574bd98-12f2-46e2-8f2e-dae9a2af2f84 req-4bc3a722-2c5b-4702-a407-932ed1f023cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df72ea7-0256-4a4b-99f9-4423750a361e", "tag": "6cd141c2-fd7f-4fbb-a9d5-5f9e91500067"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:57.167867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8574bd98-12f2-46e2-8f2e-dae9a2af2f84 req-4bc3a722-2c5b-4702-a407-932ed1f023cf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:57.168422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8574bd98-12f2-46e2-8f2e-dae9a2af2f84 req-4bc3a722-2c5b-4702-a407-932ed1f023cf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:57.183550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8574bd98-12f2-46e2-8f2e-dae9a2af2f84 req-4bc3a722-2c5b-4702-a407-932ed1f023cf service nova] Creating event network-changed:6cd141c2-fd7f-4fbb-a9d5-5f9e91500067 for instance 8df72ea7-0256-4a4b-99f9-4423750a361e on n-h2-848886-16 Jul 26 04:38:57.209908 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8574bd98-12f2-46e2-8f2e-dae9a2af2f84 req-4bc3a722-2c5b-4702-a407-932ed1f023cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067819 Jul 26 04:38:57.220255 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1441/2960] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:38:57.237222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a4adb455-1d9c-48ff-837c-723400be6555"}], "security_groups": [{"name": "tempest-securitygroup--1373938782"}], "key_name": "tempest-keypair-1842271856", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:57.536381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] validate_networks() for [('a4adb455-1d9c-48ff-837c-723400be6555', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:58.223675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:58.224148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:58.225224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:58.226818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:58.227245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:58.239610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.241723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.243057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.243762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.266413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Getting quotas for project e98487227d9c4aa3bab7756d9a13406d. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:58.272455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Getting quotas for user 7d9bcfdda3f7431192eb5abeb110e192 and project e98487227d9c4aa3bab7756d9a13406d. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:58.288087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:58.290814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:58.345908 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ddb6f883-7959-456f-868b-7e8ebb2d3986 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.123805 Jul 26 04:38:58.346680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1442/2961] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:58.351359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:58.351981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:58.360974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.361789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.362845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.363513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.531048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:58.531048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:58.531048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:58.531647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:58.531737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:58.544173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.544993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.548043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.548692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.570951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Getting quotas for project 1618901939a44ef2b44d98dbc2a821b7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:58.577303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Getting quotas for user 30724f41927d42b78babcf9b382d31e9 and project 1618901939a44ef2b44d98dbc2a821b7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:58.589939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:58.599413 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-825f20dc-bb06-4d24-b56c-c04fe745e057 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.251645 Jul 26 04:38:58.600226 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1443/2962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:58 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:58.604964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:58.605746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:58.611956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.612619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.613602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:58.614239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:58.815683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:58.825359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e77ef3ea-cbe2-4c89-b452-df626c539c11 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.223977 Jul 26 04:38:58.826041 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1444/2963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:58 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:58.831082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-734431463", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "98f46604-10b1-44f0-9e50-56a9f36f6f8e"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:38:58.874827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:58.882884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bb2b3d49-4e13-4447-be2a-9d655dd402ac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6a2d14ee-5e30-45f6-a4b0-b5a722a77d27',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e64d12b-4a4b-4888-8c6e-189e75e98a40',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:58.895490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:38:59.335125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:38:59.335563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:38:59.336051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:38:59.336470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:38:59.337463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:38:59.349032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.349837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.351608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.352223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.431352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:38:59.439682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:38:59.460688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:38:59.463398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:38:59.527106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f651225-4f0c-4279-b548-a699b74dcf90 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699729 Jul 26 04:38:59.528339 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1445/2964] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:38:59.545623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:59.548279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:59.557933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.558671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.559617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.561593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.563992 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1254dd24-7f6a-44c7-9920-c206702cb3a2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 15.594631 Jul 26 04:38:59.584443 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1520/2965] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Jul 26 04:38:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 15616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:38:59.599405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:59.607798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:59.634928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.636149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.637989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.638963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.886514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:59.898971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4747489-9f3f-49b3-94ab-9eee89b99eb3 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.369199 Jul 26 04:38:59.911287 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1446/2966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:59 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:59.921372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:38:59.922259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:38:59.933589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.934287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.935417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:38:59.936026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:38:59.965374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:38:59.978439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-188320ab-430c-44cf-b9a6-40d96f8db8ff tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.392802 Jul 26 04:38:59.987284 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1521/2967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:59 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:00.012514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}, {"name": "network-changed", "server_uuid": "c595005c-360b-440d-b7a2-d441fb1266a2", "tag": "b773a32f-1bc3-461d-9c4e-09cd538e7d13"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:00.040094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.040835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.061384 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] Creating event network-changed:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:39:00.062038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] Creating event network-changed:b773a32f-1bc3-461d-9c4e-09cd538e7d13 for instance c595005c-360b-440d-b7a2-d441fb1266a2 on n-h1-848886-16 Jul 26 04:39:00.072688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9d670712-edbe-4cab-ae20-70e0c5251451 req-c0c00ddd-6cb8-4442-80f8-5e5b704208e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081237 Jul 26 04:39:00.073803 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1522/2968] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:00.079459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e11b3410-3a66-4cb3-bfd0-c80dad7bd532 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:00.080300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e11b3410-3a66-4cb3-bfd0-c80dad7bd532 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:00.091932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.100289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1704684d-8b25-4b74-8382-445fa13880ba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1230 microversion: 2.1 time: 0.183008 Jul 26 04:39:00.103405 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1447/2969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:38:59 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1230 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:00.110206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:00.110834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:00.204282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.213166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.215137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.216481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f59c96e1-8ee1-4bda-997e-d68bd493b65a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1286 microversion: 2.42 time: 0.110124 Jul 26 04:39:00.224416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e11b3410-3a66-4cb3-bfd0-c80dad7bd532 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.231178 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1448/2970] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:00 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:00.233122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e11b3410-3a66-4cb3-bfd0-c80dad7bd532 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1216 microversion: 2.1 time: 0.157642 Jul 26 04:39:00.233682 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1523/2971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:00 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:00.241012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:00.241913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:00.250555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.251289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.252399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.253007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.255071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:00.256279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:00.273715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.274324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.275330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.275823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.704743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.791063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:00.805944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d2d209b-20f8-4dc0-8b1e-1f642f29f5a1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.567002 Jul 26 04:39:00.821025 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1524/2972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:00 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:00.922927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:00.923795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:00.932956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.935596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:00.938624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:00.939248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.109399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.124870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c216a3fe-80c4-4d48-8e50-a5372d29c758 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.888044 Jul 26 04:39:01.127249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1449/2973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:00 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:01.137749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:01.141434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:01.153956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.156117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.157263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.159375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.278563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.287779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5345b889-98a7-4346-ae45-905c77602140 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.368688 Jul 26 04:39:01.288514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1525/2974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:00 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:01.294795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:01.295703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:01.310916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.313685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.314811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.316407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.462445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.470120 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-686e1ee6-9f26-4a9a-9d22-622cc7eeb97b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.341545 Jul 26 04:39:01.487523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1450/2975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:01 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:01.499380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:01.500001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:01.516586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.517049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.517837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.525259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.627533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.639203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dce770ed-1830-43c6-b38b-6fd5ce4aba3c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1278 microversion: 2.1 time: 0.344654 Jul 26 04:39:01.640592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1526/2976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:01 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1278 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:01.657173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:01.657863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:01.674514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.676365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.683418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.684440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.880977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.888399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.901116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-709b0fa2-f9ea-4b36-8c02-d20919322bc6 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1268 microversion: 2.1 time: 0.259355 Jul 26 04:39:01.908218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.909457 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1527/2977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:01 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:01.920998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:01.923214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:01.924662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-057f54d4-3051-4b30-b576-1ffd1cfea105 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1520 microversion: 2.42 time: 0.436061 Jul 26 04:39:01.925409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1451/2978] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:01 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:01.925957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:01.929980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=88,nova_api:INSERT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.938533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.941536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:01.942787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:01.946532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.148822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:02.150220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:02.159486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.160206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.161267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.161937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.266961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:02.280194 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4d1c38c7-cfad-458a-9186-a8ae0faeeb83 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.362059 Jul 26 04:39:02.281363 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1528/2979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:01 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:02.309221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:02.310333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:02.316474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.318449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.319248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.319825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.527689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:02.536182 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4785ab89-b1f0-4542-b3fc-79948b8d702d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.392756 Jul 26 04:39:02.537680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1452/2980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:02 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:02.543060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:02.544066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:02.551489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.552992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.554278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.554906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.626221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:02.634726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4a450d3-92c2-4e62-b831-d5517a0f2fd1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.329415 Jul 26 04:39:02.635622 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1529/2981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:02 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:02.671151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:02.671788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:02.688993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.689451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.690263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.690708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.765283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:02.787961 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e4295fd-1a76-4af5-8ad6-49f2acda07a7 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1284 microversion: 2.1 time: 0.121192 Jul 26 04:39:02.796138 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1530/2982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:02 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:02.932218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:02.932937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:02.940514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.941259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:02.942343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:02.943633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.036866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.045484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09df644c-b26a-4afd-acb6-a31808c191c1 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1274 microversion: 2.1 time: 0.118129 Jul 26 04:39:03.046604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1531/2983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:02 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:03.051593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:03.052375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:03.059989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.060446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.061406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.062005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.135397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.160532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ca5639c-58c4-497f-9c39-a14df5260319 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.621270 Jul 26 04:39:03.174500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1453/2984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:02 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:03.215573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.230833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.232455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.233728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2ec3fe3-d985-4fd1-8c7b-f79ea539f4a6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1584 microversion: 2.42 time: 0.186175 Jul 26 04:39:03.247078 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1532/2985] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:03 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1584 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:03.301736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:03.303071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:03.311199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.312042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.313016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.313730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.558381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:03.559511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:03.570346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.570851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.571609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.572062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.625910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.634314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-034f77e1-0661-4d19-bdbf-67af1ba16d2a tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.336582 Jul 26 04:39:03.638284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1454/2986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:03 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:03.646812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-24125f1b-9037-46c3-9358-9a9a6708fa90 req-81361182-77b3-435a-9a08-5cd96ab0f63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "name": "network-vif-plugged", "status": "completed", "tag": "a37bfb25-ec93-4013-a1a9-4e451bf30065"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:03.672641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-24125f1b-9037-46c3-9358-9a9a6708fa90 req-81361182-77b3-435a-9a08-5cd96ab0f63b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.673163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-24125f1b-9037-46c3-9358-9a9a6708fa90 req-81361182-77b3-435a-9a08-5cd96ab0f63b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.706520 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-24125f1b-9037-46c3-9358-9a9a6708fa90 req-81361182-77b3-435a-9a08-5cd96ab0f63b service nova] Creating event network-vif-plugged:a37bfb25-ec93-4013-a1a9-4e451bf30065 for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:39:03.724554 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-24125f1b-9037-46c3-9358-9a9a6708fa90 req-81361182-77b3-435a-9a08-5cd96ab0f63b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082279 Jul 26 04:39:03.725440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1455/2987] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:03.748951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:03.751332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:03.787925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.788700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.789709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.790340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.873783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:03.887051 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4671dcc-b81e-4205-a7e8-ebf3e7f39410 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.332616 Jul 26 04:39:03.888135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1533/2988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:03 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:03.894375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:03.895188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:03.904968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.907222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:03.908261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:03.908877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.095995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.115259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29e84547-711f-4f13-a479-6949c12d6c11 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.224679 Jul 26 04:39:04.116266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1534/2989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:03 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:04.122420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:04.123244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:04.136091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.137104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.138111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.139241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.279069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.294705 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9eae95d-398e-42e7-8e54-f73d49d12a93 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.567905 Jul 26 04:39:04.295306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1456/2990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:03 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:04.308325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:04.309582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:04.325871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.326608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.328181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.328824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.406348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.417245 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a82fb33-44ad-4099-a43e-4b01ed03e366 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.297887 Jul 26 04:39:04.422562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1535/2991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:04 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:04.445679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:04.446445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:04.455482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.456122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.457145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.457750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.563491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.587447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.590476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.592847 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c27d0e55-6041-4f0e-9b56-9081ae9b9089 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1584 microversion: 2.42 time: 0.169373 Jul 26 04:39:04.609737 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1536/2992] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:04 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1584 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:04.665697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:04.666739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:04.666861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:04.677513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.678246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.679734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.680351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.684234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-614cc3cd-dbd4-4687-b25a-56a83cb1d50b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.383639 Jul 26 04:39:04.700407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1457/2993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:04 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:04.912145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:04.913329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:04.933347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:04.939853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.941996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:04.945073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:04.947098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:05.087485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:05.098511 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b2e56c5-5661-4748-9332-437e42550460 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.439717 Jul 26 04:39:05.100017 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1537/2994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:04 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:05.141287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:05.142189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:05.149821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:05.150863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:05.153390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:05.154925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:05.521223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:05.530866 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d16caa3b-b4ce-400f-8c43-d462d2477e46 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.625940 Jul 26 04:39:05.538582 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1458/2995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:04 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:05.544201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:05.544840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:05.570499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:05.570850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:05.588395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:05.594173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.034935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.040521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.043938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:06.046675 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5370ede-c335-40b6-b6f4-c093a323f797 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.505051 Jul 26 04:39:06.054590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d8be16a-5bc7-4024-b79a-a0637360000c tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.917010 Jul 26 04:39:06.061827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1459/2996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:05 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:06.068685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:06.068865 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1538/2997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:05 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:06.069653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:06.074749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:06.078532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.079396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:06.081883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.082911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.083427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.095017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.095987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.096982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.097541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.252735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.269420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.279124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.280892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a496acf5-af90-4ae6-8e20-340844730470 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1594 microversion: 2.42 time: 0.210760 Jul 26 04:39:06.281915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1539/2998] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:06 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1594 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:06.300066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:06.301185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:06.311384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.312362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.314129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.314982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.440377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:06.456168 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92c440b4-bb54-4982-a8e6-843201d0c2f4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.391743 Jul 26 04:39:06.461721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1460/2999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:06 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:06.478679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c11be7cf-257e-4d95-8e82-5d6b00fe4bc6 req-a8844c09-4c52-45d8-8e4f-d22c033bfe24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "name": "network-vif-plugged", "status": "completed", "tag": "841bdd40-cd09-4757-b757-a2afe0822dea"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:06.579893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c11be7cf-257e-4d95-8e82-5d6b00fe4bc6 req-a8844c09-4c52-45d8-8e4f-d22c033bfe24 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.580420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c11be7cf-257e-4d95-8e82-5d6b00fe4bc6 req-a8844c09-4c52-45d8-8e4f-d22c033bfe24 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.608682 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c11be7cf-257e-4d95-8e82-5d6b00fe4bc6 req-a8844c09-4c52-45d8-8e4f-d22c033bfe24 service nova] Creating event network-vif-plugged:841bdd40-cd09-4757-b757-a2afe0822dea for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:39:06.636909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c11be7cf-257e-4d95-8e82-5d6b00fe4bc6 req-a8844c09-4c52-45d8-8e4f-d22c033bfe24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172189 Jul 26 04:39:06.639579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1461/3000] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:06.648904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:06.649873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:06.662340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.665726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:06.668494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:06.669120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.389330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:07.402080 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0fa8d51a-68f8-4e18-9547-c033eb203f7d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 1.118495 Jul 26 04:39:07.404639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:07.420249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1540/3001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:06 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:07.425076 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d36468ba-0bbb-4577-80ea-2334566b4202 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.783993 Jul 26 04:39:07.428917 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1462/3002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:06 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:07.430829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f474b73f-6ac2-4ddd-b58d-11116b3f2953 req-bd311ea7-eaa4-4e12-89bb-621cbdf03fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499a21e2-e11f-4399-a490-a97692b87ad8", "tag": "7a40aadb-af5a-469c-b367-d3f720231387"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:07.457724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:07.458912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:07.476794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.477284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.480639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f474b73f-6ac2-4ddd-b58d-11116b3f2953 req-bd311ea7-eaa4-4e12-89bb-621cbdf03fd4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.481239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f474b73f-6ac2-4ddd-b58d-11116b3f2953 req-bd311ea7-eaa4-4e12-89bb-621cbdf03fd4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.481403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.483022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.523278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f474b73f-6ac2-4ddd-b58d-11116b3f2953 req-bd311ea7-eaa4-4e12-89bb-621cbdf03fd4 service nova] Creating event network-changed:7a40aadb-af5a-469c-b367-d3f720231387 for instance 499a21e2-e11f-4399-a490-a97692b87ad8 on n-h1-848886-16 Jul 26 04:39:07.533458 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f474b73f-6ac2-4ddd-b58d-11116b3f2953 req-bd311ea7-eaa4-4e12-89bb-621cbdf03fd4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111441 Jul 26 04:39:07.533779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1541/3003] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:07.555723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:07.556444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:07.562864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.563328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.564127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.573558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.856621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:07.887366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eca47a2b-ee1d-437f-853c-30ce4994ba22 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.349565 Jul 26 04:39:07.889974 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1542/3004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:07 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:07.906094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:07.910848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:07.919674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.920420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:07.921384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:07.922483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.282472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.294862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a93e97c-865f-4b7d-8e6e-7fef57f5e5e9 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1334 microversion: 2.1 time: 0.847238 Jul 26 04:39:08.298753 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1463/3005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:07 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1334 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:08.312351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:08.316753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:08.325886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.339188 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb1ec399-20df-4723-aa5d-ca707154eea9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.441910 Jul 26 04:39:08.340082 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1543/3006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:07 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:08.352763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.352763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.352763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.352763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.358121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:08.363006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:08.376773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.377484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.383825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.384498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.560882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:08.680532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.692604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7bd1010e-eb2a-4d81-9a79-dbf17ac90443 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.338023 Jul 26 04:39:08.695374 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1544/3007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:08 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:08.707742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:08.709725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:08.721001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.726076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.727190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.727798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.831998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.844956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.846780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:08.848149 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9e65968-1a8c-4444-87d6-77b0ae9c1edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1661 microversion: 2.42 time: 0.546742 Jul 26 04:39:08.851273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1464/3008] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:08 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1661 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:08.857823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:08.858861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:08.866084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.866834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:08.867808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:08.868425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.281943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:09.291546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4c97653-d617-43f7-9166-915d8987ebf8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.594773 Jul 26 04:39:09.305979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1545/3009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:08 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:09.313040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8300332c-95d9-4773-9ea4-d2763451bd52 req-444d44c7-7351-4329-aeea-8f1fb9ddfdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "name": "network-vif-plugged", "status": "completed", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:09.332595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8300332c-95d9-4773-9ea4-d2763451bd52 req-444d44c7-7351-4329-aeea-8f1fb9ddfdfd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:09.334047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8300332c-95d9-4773-9ea4-d2763451bd52 req-444d44c7-7351-4329-aeea-8f1fb9ddfdfd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.351005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8300332c-95d9-4773-9ea4-d2763451bd52 req-444d44c7-7351-4329-aeea-8f1fb9ddfdfd service nova] Creating event network-vif-plugged:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:39:09.359305 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8300332c-95d9-4773-9ea4-d2763451bd52 req-444d44c7-7351-4329-aeea-8f1fb9ddfdfd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062080 Jul 26 04:39:09.360124 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1546/3010] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:09.365043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:09.369130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:09.383638 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2fda583-32df-4681-97ab-3ead26344f1c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.527611 Jul 26 04:39:09.384938 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1465/3011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:08 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:09.393779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:09.395834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:09.412901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:09.417381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.425310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:09.431104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.436565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:09.437329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.444994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:09.445458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.446288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:09.467970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:09.970618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:09.983115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99d897b2-9533-4526-bcae-72890838bdb5 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1669 microversion: 2.1 time: 0.592951 Jul 26 04:39:09.984998 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1466/3012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:09 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1669 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:09.994796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:09.996601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.009995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.010805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.012287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.012896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.044664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.054462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.062545 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5919bc52-016e-4f9a-91cc-98f86c1bc5da tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.700556 Jul 26 04:39:10.062965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1547/3013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:09 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:10.078091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9df2f2dd-5258-4fdd-90b2-a2b8a031afb2 req-d730fbaf-eff8-44a6-9f5b-5383d0437822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f8fda7-f463-4845-893c-e4e319496d87", "tag": "f2adf75f-88e3-41f2-84ef-1c299a9083ee"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:10.088623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9df2f2dd-5258-4fdd-90b2-a2b8a031afb2 req-d730fbaf-eff8-44a6-9f5b-5383d0437822 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.089319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9df2f2dd-5258-4fdd-90b2-a2b8a031afb2 req-d730fbaf-eff8-44a6-9f5b-5383d0437822 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.101855 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9df2f2dd-5258-4fdd-90b2-a2b8a031afb2 req-d730fbaf-eff8-44a6-9f5b-5383d0437822 service nova] Creating event network-changed:f2adf75f-88e3-41f2-84ef-1c299a9083ee for instance 94f8fda7-f463-4845-893c-e4e319496d87 on n-h2-848886-16 Jul 26 04:39:10.107289 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9df2f2dd-5258-4fdd-90b2-a2b8a031afb2 req-d730fbaf-eff8-44a6-9f5b-5383d0437822 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043000 Jul 26 04:39:10.108132 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1548/3014] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:10.113721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:10.115230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.121909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.122822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.123780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.124363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.212217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=76 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.228905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.384312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.401288 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb696b48-f2cc-4762-86ee-eb09fe9befba tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.414967 Jul 26 04:39:10.402248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1467/3015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:09 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:10.407586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:10.412672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.430928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.432234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.433637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.437719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.701651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.719150 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-66a2f8e8-17c7-4830-b076-cde0a5793f88 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.608247 Jul 26 04:39:10.720032 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1549/3016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:10 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:10.729677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:10.730528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.742718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.743483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.744729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.747590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.777325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.799090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.802784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:10.808385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33bef747-93e1-4187-8405-338a7628cbd8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1707 microversion: 2.42 time: 0.404929 Jul 26 04:39:10.811057 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1468/3017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:10 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1707 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:10.822761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:10.823609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.823984 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5de44427-0bd6-483e-9112-75e4e1cddecc tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad/ips" status: 200 len: 179 microversion: 2.1 time: 0.102654 Jul 26 04:39:10.825066 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1550/3018] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:39:10 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad/ips => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:10.830645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:10.831507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:10.839893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.841255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.842299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.842905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.849414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.850218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:10.851216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:10.852418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.004373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.014292 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84b62ae7-6ca7-43b0-b4b9-17eaee77753d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.201328 Jul 26 04:39:11.015354 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1469/3019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:10 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:11.028496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.033754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.046097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.046578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.047370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.047806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.083548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:39:11.153216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.177116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-abe35891-f38c-426e-973d-e422fb29db56 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.349718 Jul 26 04:39:11.206004 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1551/3020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:10 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:11.212245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.213230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.219956 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75d32e48-f40c-459f-91e8-20ba40716461 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 204 len: 0 microversion: 2.1 time: 0.202882 Jul 26 04:39:11.220660 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1470/3021] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:11 2022] DELETE /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:11.226844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.227301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.228133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.228578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.248323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.249736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.262999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.263730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.266319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.267122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.420941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.431389 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14d428f2-be1e-444f-8471-631b12912a5f tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.223849 Jul 26 04:39:11.445601 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1552/3022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:11 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:11.448103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c595005c-360b-440d-b7a2-d441fb1266a2", "name": "network-vif-plugged", "status": "completed", "tag": "b773a32f-1bc3-461d-9c4e-09cd538e7d13"}, {"server_uuid": "8df72ea7-0256-4a4b-99f9-4423750a361e", "name": "network-vif-plugged", "status": "completed", "tag": "6cd141c2-fd7f-4fbb-a9d5-5f9e91500067"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:11.464844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.465557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.491441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] Creating event network-vif-plugged:b773a32f-1bc3-461d-9c4e-09cd538e7d13 for instance c595005c-360b-440d-b7a2-d441fb1266a2 on n-h1-848886-16 Jul 26 04:39:11.491916 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] Creating event network-vif-plugged:6cd141c2-fd7f-4fbb-a9d5-5f9e91500067 for instance 8df72ea7-0256-4a4b-99f9-4423750a361e on n-h2-848886-16 Jul 26 04:39:11.494771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.501902 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5d2cbbaa-8e4d-4cf9-a75b-d33924ec1375 req-a62c3d4b-ef75-4a02-a563-dab87a35af58 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065670 Jul 26 04:39:11.502568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1553/3023] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:11.504766 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-591cc626-165b-4549-87e8-9010fddc3278 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1675 microversion: 2.1 time: 0.264049 Jul 26 04:39:11.508288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.509091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.515987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.516569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.517361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.517808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.522267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1471/3024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:11 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1675 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:11.747858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.759371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.775542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.782457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2e0a6e3-eaf4-4fb7-a012-53b3afbc0ba0 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.278565 Jul 26 04:39:11.793108 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1554/3025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:11 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:11.793311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.793736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.794645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.795093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.844767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:11.846090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:11.854200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.854952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.856396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:11.857254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:11.947896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:11.956566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ddf5026-316f-4d18-b04d-c36d6afaca99 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.213107 Jul 26 04:39:11.958876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1472/3026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:11 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:12.031544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.036739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.037365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.044150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.044297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.044932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.045872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.046058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.046676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.047713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b5b4055-939f-4602-a478-d95681eb3710 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1753 microversion: 2.42 time: 0.206310 Jul 26 04:39:12.048592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1555/3027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:11 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:39:12.193950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.204187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.204884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.206525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-901c4f98-1333-4c32-aecf-997d8c30d595 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1307 microversion: 2.1 time: 0.174010 Jul 26 04:39:12.208240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1473/3028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:12.212190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.212891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.213869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.214526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.359306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.367537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8fbe9a1-942b-4420-9b39-b6dd802aa60d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.167049 Jul 26 04:39:12.368519 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1556/3029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:12.453128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.453845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.460718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.461232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.462068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.462549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.534111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.535084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.554693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.555203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.557133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.557739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.628198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.637110 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74f26068-85b5-4af8-8cc8-70890aceb212 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.187888 Jul 26 04:39:12.637824 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1474/3030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:12.725669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:12.733421 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e966dd51-ddd3-4739-812b-d98adf17765a tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1675 microversion: 2.1 time: 0.204251 Jul 26 04:39:12.733995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1557/3031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:12.804099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.804842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.811307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.811771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.812556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.813004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:12.981775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:12.982718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:12.996740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:12.997199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.001332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.002843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.045484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.056518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-708fb42f-707c-4fc9-bee5-ceeff0590a0a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.256392 Jul 26 04:39:13.061481 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1475/3032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:13.069596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:13.076120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.080195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.094726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.095477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.097014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.097632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.286330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.296404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.297933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.299144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1900eeb4-8900-4bfd-90c2-37bd2dd3cd69 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1753 microversion: 2.42 time: 0.228458 Jul 26 04:39:13.299706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1476/3033] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:39:13.311772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.312554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.322925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.323479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.324143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.324585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.341622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.354704 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d6ce45f-f915-4bb2-8e67-04f9d8acb6b9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.378525 Jul 26 04:39:13.355645 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1558/3034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:12 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:13.398861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.399514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.405876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.406360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.407571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.408278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.531776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.540270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e0ae35c-c61a-44fb-a73d-e2884a130926 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1488 microversion: 2.1 time: 0.232459 Jul 26 04:39:13.554401 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1477/3035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:13.561135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:13.561965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.569083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.569762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.570786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.571394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.657897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3b6f05ae-690c-417a-8289-cc4b31b2b7db tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2/action" status: 202 len: 0 microversion: 2.1 time: 0.098834 Jul 26 04:39:13.662003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1478/3036] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:39:13 2022] POST /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:39:13.669988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.671489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.686714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.695579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.696836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.697936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.880197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.889710 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d669f107-d15f-408e-8be3-4b458e7af3f2 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.225885 Jul 26 04:39:13.890331 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1479/3037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:13.896420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.897031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.923603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.924190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.924983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.925704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.927351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:13.942279 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f9232b31-835b-4c9b-8244-80866f088cce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1371 microversion: 2.1 time: 0.554385 Jul 26 04:39:13.943947 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1559/3038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:13.960910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:13.961543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:13.967786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.968240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:13.969156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:13.969809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.110073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:14.118483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5734fb32-8ee5-4bb1-8cf0-71d350b98199 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 200 len: 1473 microversion: 2.1 time: 0.226513 Jul 26 04:39:14.119826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1480/3039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:14.124705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:14.125320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:14.132358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.133011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.133905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.134725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.158432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:14.176506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:14.189928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d07db75c-505b-4a36-9509-0186373495b2 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1675 microversion: 2.1 time: 0.244534 Jul 26 04:39:14.202953 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1560/3040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:13 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:14.209619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-555606532"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:14.213407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:14.221804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.222573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.224635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.225255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.579548 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6b00293-946f-411f-a1bd-bc41dc4b3733 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2/action" status: 202 len: 0 microversion: 2.1 time: 0.374533 Jul 26 04:39:14.581326 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1561/3041] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:39:14 2022] POST /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:39:14.591530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:14.592498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:14.603825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.604567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.605614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.606282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.716611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:14.728769 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ee23c67-50c5-4406-8516-4811eb8bdbee tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.607417 Jul 26 04:39:14.729807 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1481/3042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:14 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:14.735428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:14.736368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:14.765587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.766039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.767165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:14.770196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:14.990711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.012037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aeeb02b0-30ff-4e49-beca-5e798d644823 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.280457 Jul 26 04:39:15.013562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1482/3043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:14 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:15.032284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06dc527c-84f3-4b51-8655-d04996e41172 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b507d4c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.070037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.083702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.085078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.086676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8abfac0-34d8-4b72-a6c3-37ae5a0b739d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1799 microversion: 2.42 time: 0.503358 Jul 26 04:39:15.090768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06dc527c-84f3-4b51-8655-d04996e41172 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.075995 Jul 26 04:39:15.092040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1483/3044] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:15.097169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.098786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:15.102703 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1562/3045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:14 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1799 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:15.116799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.117670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:15.120765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.121875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.123283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.125017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.125567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.126073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.127209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.127832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.382056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.393205 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a1d5a34-8abc-4368-8275-01b269c945b1 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.299701 Jul 26 04:39:15.407600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1484/3046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:15.420547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.422122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:15.438722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.439206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.442528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.442998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.480669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.490649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2422175-d3c2-4065-b9b4-60ab06eb79f3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1566 microversion: 2.1 time: 0.386767 Jul 26 04:39:15.491238 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1563/3047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1566 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:15.497851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d20a83cd-ada8-4c28-8b7e-b9eff4e9e470 req-622ef5c1-be3b-4bf5-a5a2-7e79860d6dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a21e2-e11f-4399-a490-a97692b87ad8", "name": "network-vif-plugged", "status": "completed", "tag": "7a40aadb-af5a-469c-b367-d3f720231387"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:15.525526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d20a83cd-ada8-4c28-8b7e-b9eff4e9e470 req-622ef5c1-be3b-4bf5-a5a2-7e79860d6dd0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.527573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d20a83cd-ada8-4c28-8b7e-b9eff4e9e470 req-622ef5c1-be3b-4bf5-a5a2-7e79860d6dd0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.558912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d20a83cd-ada8-4c28-8b7e-b9eff4e9e470 req-622ef5c1-be3b-4bf5-a5a2-7e79860d6dd0 service nova] Creating event network-vif-plugged:7a40aadb-af5a-469c-b367-d3f720231387 for instance 499a21e2-e11f-4399-a490-a97692b87ad8 on n-h1-848886-16 Jul 26 04:39:15.564765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d20a83cd-ada8-4c28-8b7e-b9eff4e9e470 req-622ef5c1-be3b-4bf5-a5a2-7e79860d6dd0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070252 Jul 26 04:39:15.565709 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1564/3048] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:15.574523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.575470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:15.584363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.587389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.588436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.589532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.654833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:15.666299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a0e3e1f4-8110-470b-a7e8-60c4bf755402 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1675 microversion: 2.1 time: 0.267785 Jul 26 04:39:15.684027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1485/3049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:15.755675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:15.756310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:15.766836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.771237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.772460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:15.772932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:15.780488 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8c534d5-a387-4e40-aec3-32d933d7ba78 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210257 Jul 26 04:39:15.780944 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1565/3050] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:16.033501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:16.034525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:16.045604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.054635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.056621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.057435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.145728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:16.159749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-513423aa-5710-4a05-bb6a-ef9e9ea38594 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 0.408980 Jul 26 04:39:16.161318 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1486/3051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:15 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:16.166536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:16.167420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:16.174659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.175413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.176453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.177321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.477586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:16.484418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30a0ef16-0604-49f8-86a5-288d2b8de8a5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.454691 Jul 26 04:39:16.484581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:16.488206 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1566/3052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:16 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:16.497263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b50a80b8-052c-49d2-a20a-be113ff2405b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b592c8b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:16.509119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:16.510834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:16.512375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba5a7ba1-60a5-4a27-91e7-4c0941b6f406 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1799 microversion: 2.42 time: 0.349793 Jul 26 04:39:16.528941 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1487/3053] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:16 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1799 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:16.534960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:16.536363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:16.542891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.543290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.544096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.544715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.600009 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b50a80b8-052c-49d2-a20a-be113ff2405b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.110278 Jul 26 04:39:16.600959 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1567/3054] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:16 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:16.689016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:16.697456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:16.718119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.719591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:16.721363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:16.721948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:17.110741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:17.123121 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae0c446c-17fa-4ed7-b2a6-93150c788d05 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1313 microversion: 2.1 time: 0.592988 Jul 26 04:39:17.126669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1488/3055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:16 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:17.182053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:17.182956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:17.201771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:17.205380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:17.206426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:17.209332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:17.606852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:17.627132 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8fe2729-0681-49be-b892-dfb8aafdbf2d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1675 microversion: 2.1 time: 0.939741 Jul 26 04:39:17.630797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1568/3056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:16 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1675 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:17.651377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:17.652099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:17.670740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:17.674476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:17.677618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:17.678352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:18.040246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:18.054340 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63bf3693-1f72-442d-a063-90b57a2cfbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1316 microversion: 2.1 time: 0.420640 Jul 26 04:39:18.056375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1569/3057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:17 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:18.067481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:18.068932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:18.084467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:18.084934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:18.089982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:18.090509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:18.693294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:18.709799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66b4e1e4-9032-4931-8ad9-ba9a12853259 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 1.532295 Jul 26 04:39:18.712088 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1489/3058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:17 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:18.750604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f8fda7-f463-4845-893c-e4e319496d87", "name": "network-vif-plugged", "status": "completed", "tag": "f2adf75f-88e3-41f2-84ef-1c299a9083ee"}, {"server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "name": "network-vif-unplugged", "status": "completed", "tag": "a37bfb25-ec93-4013-a1a9-4e451bf30065"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:18.803776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:18.812083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:18.826621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:18.845717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:18.857835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:18.861133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0e029c7-9314-4d7f-8274-e48cf92f3974 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1845 microversion: 2.42 time: 0.803151 Jul 26 04:39:18.861967 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1570/3059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:18 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1845 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:18.862830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] Creating event network-vif-plugged:f2adf75f-88e3-41f2-84ef-1c299a9083ee for instance 94f8fda7-f463-4845-893c-e4e319496d87 on n-h2-848886-16 Jul 26 04:39:18.863619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] Creating event network-vif-unplugged:a37bfb25-ec93-4013-a1a9-4e451bf30065 for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:39:18.884067 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ef5becab-693c-4a5c-8f17-cab6e8c0c2ae req-6da61eda-bc37-4616-9b88-1dfbf07ed1e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.162101 Jul 26 04:39:18.884295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cde228ba-9084-43a5-b4bc-13ef96721db0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5f010d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:18.885059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1490/3060] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:18.928275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-78ded054-5668-48ee-a5cf-1a8140593419 req-9e78c157-1a7d-481f-9ba4-c3ae8f8032c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "name": "network-vif-deleted", "tag": "841bdd40-cd09-4757-b757-a2afe0822dea"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:18.971424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-78ded054-5668-48ee-a5cf-1a8140593419 req-9e78c157-1a7d-481f-9ba4-c3ae8f8032c3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:18.971897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-78ded054-5668-48ee-a5cf-1a8140593419 req-9e78c157-1a7d-481f-9ba4-c3ae8f8032c3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:18.987163 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cde228ba-9084-43a5-b4bc-13ef96721db0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.123811 Jul 26 04:39:18.987987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1571/3061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:18 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:18.993413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:19.004436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:19.030108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.032311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.033534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.037910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-78ded054-5668-48ee-a5cf-1a8140593419 req-9e78c157-1a7d-481f-9ba4-c3ae8f8032c3 service nova] Creating event network-vif-deleted:841bdd40-cd09-4757-b757-a2afe0822dea for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:39:19.038923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.051568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-78ded054-5668-48ee-a5cf-1a8140593419 req-9e78c157-1a7d-481f-9ba4-c3ae8f8032c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155538 Jul 26 04:39:19.066654 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1491/3062] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:19.074108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:19.074847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:19.104664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.105160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.117533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.118446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.658239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:19.667774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68373885-a898-4f65-a754-6a1b2d368067 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1654 microversion: 2.1 time: 0.599473 Jul 26 04:39:19.668286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1492/3063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:19 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1654 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:19.680017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:19.697377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:19.724737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.727134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.727134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.729479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.834462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:19.858520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7aa04633-e0d2-4693-9d11-100daf5e84a6 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1497 microversion: 2.1 time: 0.863896 Jul 26 04:39:19.859358 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1572/3064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:18 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1497 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:19.878864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:19.880461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:19.908513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.912173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:19.913700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:19.917522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:20.592169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:20.603316 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc04aecc-38bd-466f-90c6-0235895b6125 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1466 microversion: 2.1 time: 0.928021 Jul 26 04:39:20.604417 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1493/3065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:19 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1466 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:20.617393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73792469-fa42-40dd-861e-2d0efa280934 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:20.656291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.server_groups [None req-73792469-fa42-40dd-861e-2d0efa280934 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Querying cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) for 1 instances {{(pid=119487) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 04:39:20.656291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73792469-fa42-40dd-861e-2d0efa280934 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:20.656291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73792469-fa42-40dd-861e-2d0efa280934 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:20.700924 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73792469-fa42-40dd-861e-2d0efa280934 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a" status: 200 len: 221 microversion: 2.1 time: 0.094618 Jul 26 04:39:20.702942 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1494/3066] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:39:20 2022] GET /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a => generated 221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:20.712088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:20.713162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:20.742215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:20.743017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:20.766948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:20.767714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:20.929750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:20.942834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17e94ee8-703e-49ea-a149-b5a0810f1900 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1352 microversion: 2.1 time: 1.079434 Jul 26 04:39:20.947988 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1573/3067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:19 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1352 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:20.984497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67463008-5531-4bca-a567-a7074449877f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b6082b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:21.094517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67463008-5531-4bca-a567-a7074449877f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.145100 Jul 26 04:39:21.095559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1574/3068] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:20 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:21.113422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c00c32e4-14e9-4a3f-a38b-108b7476d05b req-7bbe71cb-0e30-49db-9808-80d72e75c2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:21.156964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c00c32e4-14e9-4a3f-a38b-108b7476d05b req-7bbe71cb-0e30-49db-9808-80d72e75c2f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.157432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c00c32e4-14e9-4a3f-a38b-108b7476d05b req-7bbe71cb-0e30-49db-9808-80d72e75c2f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.208748 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c00c32e4-14e9-4a3f-a38b-108b7476d05b req-7bbe71cb-0e30-49db-9808-80d72e75c2f1 service nova] Creating event network-changed:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:39:21.240114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c00c32e4-14e9-4a3f-a38b-108b7476d05b req-7bbe71cb-0e30-49db-9808-80d72e75c2f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143129 Jul 26 04:39:21.245724 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1575/3069] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:21.263449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:21.265367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:21.293548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.296419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.306030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.306898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.358375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:21.398670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:21.403591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:21.404823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-649dc6c8-14cc-4b97-9130-09c867995e83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1845 microversion: 2.42 time: 0.700637 Jul 26 04:39:21.435537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1495/3070] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:20 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1845 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:21.452640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:21.453571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:21.475801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.481944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.483427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.491326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.587957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.588610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.589182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lazy-loading 'fault' on Instance uuid c4e7ba71-2ed7-481c-bc88-87938e56f7ad {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:39:21.656903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113f2b415ddf44519f9908d643958bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e51945c9cb04fa5ab1ac0d8ebdf83c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:21.670174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-190b8f78-c825-415c-9a23-8f623334d11d tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 200 len: 1303 microversion: 2.1 time: 0.231840 Jul 26 04:39:21.689217 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1496/3071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:21 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:21.689217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:21.689217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:21.708843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.709503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.710393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.710945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.767515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:39:21.961353 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bdc72b0-3eb5-4e6f-abed-6c90f7f1fff8 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 204 len: 0 microversion: 2.1 time: 0.283650 Jul 26 04:39:21.962218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1497/3072] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:21 2022] DELETE /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:21.974045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:21.975039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:21.992096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.992787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:21.994972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:21.995739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.216420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:22.220955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.234641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-09ad5cbc-145f-4df3-8a37-9bc4a08458a9 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1541 microversion: 2.1 time: 0.263247 Jul 26 04:39:22.248135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1498/3073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:21 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1541 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:22.267751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:22.268397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:22.280582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.281267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.282239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.282849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.334107 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3db8be56-e19d-4cf7-ae54-77b18f923c01 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1619 microversion: 2.1 time: 1.086756 Jul 26 04:39:22.350292 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1576/3074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:21 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1619 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:22.368415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c0f21b4f-6e6d-4e73-8730-7e9ee19dae5f req-248defa5-d81a-4b2b-ab27-c7f78c8300bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e7ba71-2ed7-481c-bc88-87938e56f7ad", "name": "network-vif-deleted", "tag": "a37bfb25-ec93-4013-a1a9-4e451bf30065"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:22.418481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c0f21b4f-6e6d-4e73-8730-7e9ee19dae5f req-248defa5-d81a-4b2b-ab27-c7f78c8300bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.419094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c0f21b4f-6e6d-4e73-8730-7e9ee19dae5f req-248defa5-d81a-4b2b-ab27-c7f78c8300bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.457913 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c0f21b4f-6e6d-4e73-8730-7e9ee19dae5f req-248defa5-d81a-4b2b-ab27-c7f78c8300bb service nova] Creating event network-vif-deleted:a37bfb25-ec93-4013-a1a9-4e451bf30065 for instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad on n-h2-848886-16 Jul 26 04:39:22.465099 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c0f21b4f-6e6d-4e73-8730-7e9ee19dae5f req-248defa5-d81a-4b2b-ab27-c7f78c8300bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114996 Jul 26 04:39:22.474241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1577/3075] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:22.487347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6191f65b-e001-4794-b463-1e14c6ef6ef3 req-aa18c0e1-fa8d-4242-aace-c11c1dd06d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c595005c-360b-440d-b7a2-d441fb1266a2", "name": "network-vif-plugged", "status": "completed", "tag": "b773a32f-1bc3-461d-9c4e-09cd538e7d13"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:22.512205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6191f65b-e001-4794-b463-1e14c6ef6ef3 req-aa18c0e1-fa8d-4242-aace-c11c1dd06d7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.514780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6191f65b-e001-4794-b463-1e14c6ef6ef3 req-aa18c0e1-fa8d-4242-aace-c11c1dd06d7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.539441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6191f65b-e001-4794-b463-1e14c6ef6ef3 req-aa18c0e1-fa8d-4242-aace-c11c1dd06d7a service nova] Creating event network-vif-plugged:b773a32f-1bc3-461d-9c4e-09cd538e7d13 for instance c595005c-360b-440d-b7a2-d441fb1266a2 on n-h1-848886-16 Jul 26 04:39:22.550390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6191f65b-e001-4794-b463-1e14c6ef6ef3 req-aa18c0e1-fa8d-4242-aace-c11c1dd06d7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074587 Jul 26 04:39:22.553256 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1578/3076] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:22.570272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96786312-3765-4b52-b860-aa23956f7940 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5903280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:22.659920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96786312-3765-4b52-b860-aa23956f7940 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.104955 Jul 26 04:39:22.661075 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1579/3077] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:22 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:22.671960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:22.673675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:22.688712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.694452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.703932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.704634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.727961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:22.737379 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f122535a-e3b6-44a1-bc7e-b3df219c5254 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1503 microversion: 2.1 time: 0.487720 Jul 26 04:39:22.740340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1499/3078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:22 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1503 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:22.755871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:22.756781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:22.778887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.779727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.780802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:22.781943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:22.833792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6366370f-e3ca-4b86-bef5-722d5b7a850f tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170520 Jul 26 04:39:22.841073 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1580/3079] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:39:22 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:22.841073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1136266842", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["98f46604-10b1-44f0-9e50-56a9f36f6f8e"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:22.951072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:39:23.229903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:23.268538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:23.276735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:23.285985 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0a98f45-f140-4d66-a26a-2ed652ddfb3c tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1845 microversion: 2.42 time: 0.538685 Jul 26 04:39:23.287834 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1500/3080] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:22 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1845 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:23.306199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:23.308214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:23.311830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.324819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.327697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.329680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.331420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.377905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad HTTP/1.1 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c4e7ba71-2ed7-481c-bc88-87938e56f7ad'} Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:23.386307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:23.391283 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:23.392609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:23.393673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79fe87b7-1c80-4fd8-855a-688c58957024 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 404 len: 111 microversion: 2.1 time: 0.104846 Jul 26 04:39:23.395372 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1501/3081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:23 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:23.689182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-883f0c4e-e621-4c58-8050-84c87720e952 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38baca9430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:23.812214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-883f0c4e-e621-4c58-8050-84c87720e952 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.139437 Jul 26 04:39:23.813485 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1502/3082] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:23 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:23.825508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:23.827327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:23.835490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.836167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.838034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.838960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.881960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:39:23.882637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:39:23.883146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:39:23.883824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:39:23.884470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:39:23.893556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.907871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.908700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.910325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:23.911011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:23.919114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.935411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:39:23.943087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:39:23.972089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:39:23.975442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:39:24.056754 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42619f58-16b4-41a1-8bad-0af3bd82012e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220770 Jul 26 04:39:24.057415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1581/3083] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:39:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:39:24.082397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6932e10-f56e-4953-bab5-605a5b1f9b47 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:24.085725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f6932e10-f56e-4953-bab5-605a5b1f9b47 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:24.619444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:24.632165 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53c728d6-f29c-4401-afb7-528bf5847a38 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1503 microversion: 2.1 time: 0.817462 Jul 26 04:39:24.635139 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1503/3084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:23 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1503 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:24.652230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:24.654690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:24.671352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:24.672292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:24.676624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:24.677363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:25.399555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f6932e10-f56e-4953-bab5-605a5b1f9b47 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:25.412063 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6932e10-f56e-4953-bab5-605a5b1f9b47 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1217 microversion: 2.1 time: 1.347042 Jul 26 04:39:25.414803 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1582/3085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:24 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1217 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:25.429756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-891ff5a7-314d-4361-9a71-a4d1a7003e39 req-724d4454-603c-410d-a671-c18594728827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "e7e068a4-8613-4ae4-8def-afe0aa160eb2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:25.452384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-891ff5a7-314d-4361-9a71-a4d1a7003e39 req-724d4454-603c-410d-a671-c18594728827 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:25.454465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-891ff5a7-314d-4361-9a71-a4d1a7003e39 req-724d4454-603c-410d-a671-c18594728827 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:25.489038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-891ff5a7-314d-4361-9a71-a4d1a7003e39 req-724d4454-603c-410d-a671-c18594728827 service nova] Creating event network-changed:e7e068a4-8613-4ae4-8def-afe0aa160eb2 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:25.507816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-891ff5a7-314d-4361-9a71-a4d1a7003e39 req-724d4454-603c-410d-a671-c18594728827 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091547 Jul 26 04:39:25.512802 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1583/3086] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:25.530195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09f82e16-0f49-4136-b8e0-c42cc6aa9fb7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38babf38b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:25.641492 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09f82e16-0f49-4136-b8e0-c42cc6aa9fb7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.124039 Jul 26 04:39:25.642088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1584/3087] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:25 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:25.665688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:25.666413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:25.667194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:25.692251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:25.696116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:25.696674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:25.698815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:25.699278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:25.702675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:25.708685 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6f270dd-24d4-464f-b73e-08be2b0ac83e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1845 microversion: 2.42 time: 1.071680 Jul 26 04:39:25.716783 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1504/3088] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:24 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1845 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:26.329838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6c68d6f0-9eaf-4619-9e8d-9f83d77bc7cc req-8d825279-e741-4043-bef6-c7c8a477557b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df72ea7-0256-4a4b-99f9-4423750a361e", "name": "network-vif-deleted", "tag": "6cd141c2-fd7f-4fbb-a9d5-5f9e91500067"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:26.366666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6c68d6f0-9eaf-4619-9e8d-9f83d77bc7cc req-8d825279-e741-4043-bef6-c7c8a477557b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:26.381218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6c68d6f0-9eaf-4619-9e8d-9f83d77bc7cc req-8d825279-e741-4043-bef6-c7c8a477557b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:26.429117 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6c68d6f0-9eaf-4619-9e8d-9f83d77bc7cc req-8d825279-e741-4043-bef6-c7c8a477557b service nova] Creating event network-vif-deleted:6cd141c2-fd7f-4fbb-a9d5-5f9e91500067 for instance 8df72ea7-0256-4a4b-99f9-4423750a361e on n-h2-848886-16 Jul 26 04:39:26.463283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffc4a65cd3946b3a7ebc2958f3cd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddff673af64c4a53a6ee90b9e8ebf0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:26.472781 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af7d75e9-90c1-40d9-9e8f-1aed247092ed tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 200 len: 1461 microversion: 2.1 time: 0.818758 Jul 26 04:39:26.477735 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1585/3089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:25 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 1461 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:26.495613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:26.498632 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6c68d6f0-9eaf-4619-9e8d-9f83d77bc7cc req-8d825279-e741-4043-bef6-c7c8a477557b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172651 Jul 26 04:39:26.499260 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1505/3090] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:26.503971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:26.523690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:26.542933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:26.544074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:26.544734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:26.658092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-444c11c7-dabc-4bc3-91f3-1a7c898d3281 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5296e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:26.849004 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-444c11c7-dabc-4bc3-91f3-1a7c898d3281 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.194896 Jul 26 04:39:26.858420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1506/3091] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:26 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:26.870817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:26.873043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:26.889053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:26.889764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:26.893196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:26.893965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.064505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:27.072729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55edc2dd-3805-42f7-8e69-6b445308da6e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1277 microversion: 2.1 time: 0.591319 Jul 26 04:39:27.073317 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1586/3092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:26 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1277 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:27.505476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:27.506218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:27.517617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.531612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.532634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.533110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.599765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e HTTP/1.1 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8df72ea7-0256-4a4b-99f9-4423750a361e'} Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:27.607324 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:27.611523 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:27.621316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:27.625434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08e2eadb-4bb2-4f87-a674-bc405945c39a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 404 len: 111 microversion: 2.1 time: 0.124548 Jul 26 04:39:27.631590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1587/3093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:27 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:27.645955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efdeff93-261a-4b2f-81f8-bce40a7a5415 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:27.714546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_groups [None req-efdeff93-261a-4b2f-81f8-bce40a7a5415 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Querying cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) for 1 instances {{(pid=119488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 04:39:27.715216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efdeff93-261a-4b2f-81f8-bce40a7a5415 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.715673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efdeff93-261a-4b2f-81f8-bce40a7a5415 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.742078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efdeff93-261a-4b2f-81f8-bce40a7a5415 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.099942 Jul 26 04:39:27.764440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1588/3094] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:39:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:27.788877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6edd0229-8072-4a8e-a37e-ebc9a30edb24 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:27.807169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:27.819548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:27.821761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:27.823319 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d4df778-e817-44d4-9975-030adba953cf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1866 microversion: 2.42 time: 0.963398 Jul 26 04:39:27.824266 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1507/3095] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:26 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1866 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:27.845544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_groups [None req-6edd0229-8072-4a8e-a37e-ebc9a30edb24 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Querying cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) for 1 instances {{(pid=119488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 04:39:27.854031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6edd0229-8072-4a8e-a37e-ebc9a30edb24 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.857054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6edd0229-8072-4a8e-a37e-ebc9a30edb24 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.864631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-604ab17c-1b87-4321-834a-a972c0d1de50 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5296c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:27.895689 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6edd0229-8072-4a8e-a37e-ebc9a30edb24 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a" status: 200 len: 183 microversion: 2.1 time: 0.129630 Jul 26 04:39:27.896271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1589/3096] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:39:27 2022] GET /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:27.922295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:27.923971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:27.942065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.944011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:27.946970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:27.947645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e HTTP/1.1 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8df72ea7-0256-4a4b-99f9-4423750a361e'} Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:28.017391 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-677f4658-4450-4e96-a2bd-cf224d1d4a2b tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 404 len: 111 microversion: 2.1 time: 0.105481 Jul 26 04:39:28.023018 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1590/3097] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:27 2022] DELETE /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.028784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.029568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] [instance: 8df72ea7-0256-4a4b-99f9-4423750a361e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:28.045876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.048821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.050392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.051013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.071268 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e HTTP/1.1 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8df72ea7-0256-4a4b-99f9-4423750a361e'} Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.072989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. Jul 26 04:39:28.077828 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.079224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance 8df72ea7-0256-4a4b-99f9-4423750a361e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.080661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe169bad-d958-46d0-a0fb-a954e73b28ea tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e" status: 404 len: 111 microversion: 2.1 time: 0.062102 Jul 26 04:39:28.081139 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1591/3098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:28 2022] GET /compute/v2.1/servers/8df72ea7-0256-4a4b-99f9-4423750a361e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.094781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63fc36be-38e0-4e8c-a317-11693da2be8e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.110487 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-63fc36be-38e0-4e8c-a317-11693da2be8e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63fc36be-38e0-4e8c-a317-11693da2be8e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-server-groups/e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f HTTP/1.1 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f'} Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.120863 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.126230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63fc36be-38e0-4e8c-a317-11693da2be8e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance group e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.129568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63fc36be-38e0-4e8c-a317-11693da2be8e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f" status: 404 len: 117 microversion: 2.1 time: 0.040805 Jul 26 04:39:28.130740 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1592/3099] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/e95c5ac3-db37-4a7b-a6b9-55e44fad5d7f => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.145919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.149294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:28.170698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.171213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.176649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.177383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.364842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:28.375239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dce86da3-15eb-4a53-a8b5-57d45ba6347a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1275 microversion: 2.1 time: 0.239062 Jul 26 04:39:28.378000 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1593/3100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:28 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:28.400548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a457ac6-f155-4ad6-bfec-370ce9e9cb10 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.410092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-1a457ac6-f155-4ad6-bfec-370ce9e9cb10 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a457ac6-f155-4ad6-bfec-370ce9e9cb10 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-server-groups/ea176f4f-cc93-4589-a28b-1ce907ea222a HTTP/1.1 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ea176f4f-cc93-4589-a28b-1ce907ea222a'} Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.412641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. Jul 26 04:39:28.416822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.419902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a457ac6-f155-4ad6-bfec-370ce9e9cb10 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance group ea176f4f-cc93-4589-a28b-1ce907ea222a could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.421257 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a457ac6-f155-4ad6-bfec-370ce9e9cb10 tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/ea176f4f-cc93-4589-a28b-1ce907ea222a" status: 404 len: 117 microversion: 2.1 time: 0.039967 Jul 26 04:39:28.426081 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1594/3101] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/ea176f4f-cc93-4589-a28b-1ce907ea222a => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.433741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96e1be74-ce81-44bf-b885-8564d21d500e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.444726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-96e1be74-ce81-44bf-b885-8564d21d500e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96e1be74-ce81-44bf-b885-8564d21d500e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-server-groups/e83f2877-f587-4226-96e7-c6b01764fbe9 HTTP/1.1 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'e83f2877-f587-4226-96e7-c6b01764fbe9'} Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.446862 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. Jul 26 04:39:28.450895 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.454933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96e1be74-ce81-44bf-b885-8564d21d500e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance group e83f2877-f587-4226-96e7-c6b01764fbe9 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.456182 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96e1be74-ce81-44bf-b885-8564d21d500e tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e83f2877-f587-4226-96e7-c6b01764fbe9" status: 404 len: 117 microversion: 2.1 time: 0.028090 Jul 26 04:39:28.461606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1595/3102] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/e83f2877-f587-4226-96e7-c6b01764fbe9 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.470846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91a7eadd-b19b-437e-97f2-69aa8dd5294a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.479697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-91a7eadd-b19b-437e-97f2-69aa8dd5294a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] HTTP exception thrown: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91a7eadd-b19b-437e-97f2-69aa8dd5294a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Request method failure captured: Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-server-groups/e876350c-3317-4d36-9696-0c6f79681293 HTTP/1.1 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_MMfSiDtm2N7ILn0MmoKUWU-ict6LaNeJdjF9qsyOt5NRLNKKX3C2ectmSnFiHDD8MzHujV3CtUwbLOrrIhxggrgSYfpGtZyE_S_Sc3GC0qolp1KXhoEkfzkDVCRdvLLOjL7cOBzhuUGiDbuiHRnssyTxTPyeRtuG0vcaKvYl_a8Q Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddff673af64c4a53a6ee90b9e8ebf0af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: ddff673af64c4a53a6ee90b9e8ebf0af Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1190431981 Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cffc4a65cd3946b3a7ebc2958f3cd6ef Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroupTestJSON-1190431981-project Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'e876350c-3317-4d36-9696-0c6f79681293'} Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.482674 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. Jul 26 04:39:28.486662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:39:28.491034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-91a7eadd-b19b-437e-97f2-69aa8dd5294a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Returning 404 to user: Instance group e876350c-3317-4d36-9696-0c6f79681293 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:28.492180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-91a7eadd-b19b-437e-97f2-69aa8dd5294a tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e876350c-3317-4d36-9696-0c6f79681293" status: 404 len: 117 microversion: 2.1 time: 0.028953 Jul 26 04:39:28.496794 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1596/3103] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/e876350c-3317-4d36-9696-0c6f79681293 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:28.503750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9786a10-5704-4634-883a-d1db17c26b4c tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.550249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9786a10-5704-4634-883a-d1db17c26b4c tempest-ServerGroupTestJSON-1190431981 tempest-ServerGroupTestJSON-1190431981-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a" status: 204 len: 0 microversion: 2.1 time: 0.051804 Jul 26 04:39:28.550953 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1597/3104] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/eccebeb5-2b0c-45f7-8e5e-0cbde0fc2b2a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:28.719174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-604ab17c-1b87-4321-834a-a972c0d1de50 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.859492 Jul 26 04:39:28.720806 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1508/3105] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:27 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:28.854983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:28.856447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:28.869973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.870459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:28.871253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:28.874371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:29.091267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-03c2a72a-5038-413f-aa28-2bfcace67b4e req-a03a3375-7652-40df-aa8d-ce16bd945ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "452afe63-3b8d-477c-8d81-ac6cd7ed22f9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:29.123599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-03c2a72a-5038-413f-aa28-2bfcace67b4e req-a03a3375-7652-40df-aa8d-ce16bd945ae2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:29.124251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-03c2a72a-5038-413f-aa28-2bfcace67b4e req-a03a3375-7652-40df-aa8d-ce16bd945ae2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:29.157691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-03c2a72a-5038-413f-aa28-2bfcace67b4e req-a03a3375-7652-40df-aa8d-ce16bd945ae2 service nova] Creating event network-changed:452afe63-3b8d-477c-8d81-ac6cd7ed22f9 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:29.179443 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-03c2a72a-5038-413f-aa28-2bfcace67b4e req-a03a3375-7652-40df-aa8d-ce16bd945ae2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093092 Jul 26 04:39:29.180648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1509/3106] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:29.406030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:29.406965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:29.432722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:29.434803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:29.436732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:29.439479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:29.676402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:29.691936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6073bf71-5d8b-4216-a795-dafaee08f735 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1275 microversion: 2.1 time: 0.293564 Jul 26 04:39:29.702622 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1510/3107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:29 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:29.738472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e01afce7-9a5b-4f1e-90b9-e76e8da22726 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bac9b670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:29.817845 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e01afce7-9a5b-4f1e-90b9-e76e8da22726 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.083372 Jul 26 04:39:29.818728 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1511/3108] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:29 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:30.718078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:30.718868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:30.751951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:30.752575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:30.754893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:30.755482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:30.846890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:30.864678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:30.905614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:30.906908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-617d6975-d949-4634-b710-4a3a98888b51 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1866 microversion: 2.42 time: 2.060361 Jul 26 04:39:30.938178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1598/3109] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:28 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1866 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:30.938178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8784bc06-58e8-41e1-9c05-1be1d2760368 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38babf3790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:31.021168 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8784bc06-58e8-41e1-9c05-1be1d2760368 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.093217 Jul 26 04:39:31.022088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1599/3110] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:30 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:31.331188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7535e028-5909-4727-8b79-2cb8dbbadfd9 req-1d9f1764-6434-460b-9eea-ffd7296d8067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f8fda7-f463-4845-893c-e4e319496d87", "tag": "f2adf75f-88e3-41f2-84ef-1c299a9083ee"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:31.344005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7535e028-5909-4727-8b79-2cb8dbbadfd9 req-1d9f1764-6434-460b-9eea-ffd7296d8067 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:31.344650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7535e028-5909-4727-8b79-2cb8dbbadfd9 req-1d9f1764-6434-460b-9eea-ffd7296d8067 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:31.369250 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7535e028-5909-4727-8b79-2cb8dbbadfd9 req-1d9f1764-6434-460b-9eea-ffd7296d8067 service nova] Creating event network-changed:f2adf75f-88e3-41f2-84ef-1c299a9083ee for instance 94f8fda7-f463-4845-893c-e4e319496d87 on n-h2-848886-16 Jul 26 04:39:31.403878 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7535e028-5909-4727-8b79-2cb8dbbadfd9 req-1d9f1764-6434-460b-9eea-ffd7296d8067 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074188 Jul 26 04:39:31.404986 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1600/3111] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:31.966477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:31.970175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:31.991152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:31.997271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:31.998925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.000734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.072989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:32.083301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cbeaec38-a627-4c2a-ab64-0813c38408ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 1.369335 Jul 26 04:39:32.095819 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1512/3112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:30 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:32.114103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-752faa91-7a86-457a-abda-02a142249fa2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5c12820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:32.188087 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-752faa91-7a86-457a-abda-02a142249fa2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.088930 Jul 26 04:39:32.191898 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1513/3113] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:32 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:32.230384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:32.231152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:32.239163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.255390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.256510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.257236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.309869 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad HTTP/1.1 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c4e7ba71-2ed7-481c-bc88-87938e56f7ad'} Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:32.313056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.317550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.320393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:32.324882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14fa8947-e0b4-4064-b448-696bdff5bc53 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 404 len: 111 microversion: 2.1 time: 0.097511 Jul 26 04:39:32.328545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1514/3114] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:32 2022] DELETE /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:32.342681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:32.345227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: c4e7ba71-2ed7-481c-bc88-87938e56f7ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:32.358987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.365456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.367683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.368351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.400664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad HTTP/1.1 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c4e7ba71-2ed7-481c-bc88-87938e56f7ad'} Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.406742 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. Jul 26 04:39:32.411015 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.414204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance c4e7ba71-2ed7-481c-bc88-87938e56f7ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:32.414204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15f4eae6-07bd-4b47-bb7f-240ad8a001ea tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad" status: 404 len: 111 microversion: 2.1 time: 0.079687 Jul 26 04:39:32.422327 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1515/3115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:32 2022] GET /compute/v2.1/servers/c4e7ba71-2ed7-481c-bc88-87938e56f7ad => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:39:32.446813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:32.446813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:32.463394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.464051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.464873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.465328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.503943 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 HTTP/1.1 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0'} Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:32.505599 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1982b284-50bb-4b06-a899-0093d12450a0 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 404 len: 111 microversion: 2.1 time: 0.083677 Jul 26 04:39:32.511364 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1516/3116] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:32 2022] DELETE /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:39:32.517937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:32.519139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] [instance: e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:32.535016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.535512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.536336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:32.536793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:32.572953 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] HTTP exception thrown: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Request method failure captured: Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 HTTP/1.1 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-ECaxDbFqrF707Ixube2UjOYESDuhnjMMYvu1O-I4c73ahnH4beHxKe_8R8cJcQKGNgCQ9MQaXXGIq_NlftIZdcVGlW2VmiEpxRoK0YP013n5UxIovkcBypAaO3QZdbC_nyZI1BdT6HW_CtOaqpnpwLu2AKqUHYOGIVDgDlkqQbCw Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e51945c9cb04fa5ab1ac0d8ebdf83c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 9e51945c9cb04fa5ab1ac0d8ebdf83c4 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestMultiNic-1528246819 Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 113f2b415ddf44519f9908d643958bab Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestMultiNic-1528246819-project Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0'} Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:39:32.576112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] Returning 404 to user: Instance e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce38de82-3392-4c9b-a316-de31816ab8b3 tempest-ServersTestMultiNic-1528246819 tempest-ServersTestMultiNic-1528246819-project] 10.222.0.43 "GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0" status: 404 len: 111 microversion: 2.1 time: 0.063744 Jul 26 04:39:32.580894 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1517/3117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:32 2022] GET /compute/v2.1/servers/e4cd5467-c6b6-42af-bfcf-cde6cdf5e4a0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:39:33.117062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:33.117689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:33.150254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:33.150727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:33.156126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:33.156700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:33.368622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:33.379452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:33.394566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:33.399656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7dae7e8-47ea-4d40-8efc-ce3a49263991 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1866 microversion: 2.42 time: 1.445668 Jul 26 04:39:33.416375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1601/3118] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:31 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1866 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:33.424085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-944beea7-7ac6-44d5-9dbc-a2e25192a22d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38baccfb80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:33.539464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-944beea7-7ac6-44d5-9dbc-a2e25192a22d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.121540 Jul 26 04:39:33.541263 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1602/3119] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:33 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:33.635902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:33.652352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93abf879-fbf6-4541-bcb2-7914047160c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.540106 Jul 26 04:39:33.665444 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1518/3120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:33 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:34.106181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.113915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a91638d-43f0-4f05-a941-c95d66b603c8 req-32221492-a348-42bf-a07a-3efef67c8f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "62e220ae-0d94-4379-8eec-40ace2a2643d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:34.156679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a91638d-43f0-4f05-a941-c95d66b603c8 req-32221492-a348-42bf-a07a-3efef67c8f74 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:34.161315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a91638d-43f0-4f05-a941-c95d66b603c8 req-32221492-a348-42bf-a07a-3efef67c8f74 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:34.186414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a91638d-43f0-4f05-a941-c95d66b603c8 req-32221492-a348-42bf-a07a-3efef67c8f74 service nova] Creating event network-changed:62e220ae-0d94-4379-8eec-40ace2a2643d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:34.205642 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a91638d-43f0-4f05-a941-c95d66b603c8 req-32221492-a348-42bf-a07a-3efef67c8f74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099779 Jul 26 04:39:34.207217 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1603/3121] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:34.435488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:34.436891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:34.446805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:34.458964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:34.460120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:34.463345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:34.555520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ba31db9-df2e-4d77-8e73-5fd335c8efbe tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bac5d9d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:34.647941 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ba31db9-df2e-4d77-8e73-5fd335c8efbe tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.096468 Jul 26 04:39:34.648544 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1604/3122] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:34 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:34.679750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:34.681690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:34.725318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:34.725764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:34.728885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:34.729301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:35.409476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.476452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:36.514634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:36.516164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:36.525984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7aeeff6-b1b4-4097-bc0e-3a67d4972aaa tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1887 microversion: 2.42 time: 2.097363 Jul 26 04:39:36.530687 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1519/3123] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:34 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1887 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:36.538904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8bbb2b1-18ec-41e9-b30f-1e9782c7f773 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b507d160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:36.650982 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8bbb2b1-18ec-41e9-b30f-1e9782c7f773 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.118937 Jul 26 04:39:36.659138 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1520/3124] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:36 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:36.897718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-914db408-d0ce-41bf-8b23-fd9f2bcb61fb req-63d28236-84f5-4765-9ba4-c37e8dc0f9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e216677-4521-48a6-bb98-f66edea0cad3", "tag": "bf158433-4407-4375-9405-21f8fbd17742"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:36.928791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-914db408-d0ce-41bf-8b23-fd9f2bcb61fb req-63d28236-84f5-4765-9ba4-c37e8dc0f9c2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:36.947930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-914db408-d0ce-41bf-8b23-fd9f2bcb61fb req-63d28236-84f5-4765-9ba4-c37e8dc0f9c2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:37.012114 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-914db408-d0ce-41bf-8b23-fd9f2bcb61fb req-63d28236-84f5-4765-9ba4-c37e8dc0f9c2 service nova] Creating event network-changed:bf158433-4407-4375-9405-21f8fbd17742 for instance 7e216677-4521-48a6-bb98-f66edea0cad3 on n-h1-848886-16 Jul 26 04:39:37.025912 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-914db408-d0ce-41bf-8b23-fd9f2bcb61fb req-63d28236-84f5-4765-9ba4-c37e8dc0f9c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133631 Jul 26 04:39:37.027370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:37.028785 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1521/3125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:37.056478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0112ce7-d06d-425b-b654-fbfca2052918 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 2.380622 Jul 26 04:39:37.074995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1605/3126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:34 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:37.555757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:37.556828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:37.579293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:37.579904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:37.583658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:37.584120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:37.667713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18f6c882-d442-4dd7-b310-73d2e4620583 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bad41dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:37.809736 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18f6c882-d442-4dd7-b310-73d2e4620583 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.143876 Jul 26 04:39:37.819523 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1606/3127] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:37 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:38.082513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:38.083344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:38.102777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:38.104151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:38.105982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:38.106606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:38.176905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:38.191994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:38.196725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:38.197994 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2fe53aa1-ca95-4eb7-bf19-1a48ea9f544a tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1887 microversion: 2.42 time: 0.648912 Jul 26 04:39:38.198594 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1522/3128] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:37 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1887 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:38.827387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-008ea9c2-ed14-4cab-8004-31abc4aef9d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a30dc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:39.086430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-008ea9c2-ed14-4cab-8004-31abc4aef9d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.264091 Jul 26 04:39:39.087185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1523/3129] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:38 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:39.090677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:39.105772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-816f2e31-6742-4391-982b-941adf91ebd3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 1.027792 Jul 26 04:39:39.109278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1607/3130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:38 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:39.126460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-013630f8-fb58-47a6-a0b2-24e5eef4c99b req-70254c69-04c8-4c45-8656-ceb52eadd4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "2b593d86-fde5-4581-9219-47464ec7f35d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:39.160263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-013630f8-fb58-47a6-a0b2-24e5eef4c99b req-70254c69-04c8-4c45-8656-ceb52eadd4ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:39.166851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-013630f8-fb58-47a6-a0b2-24e5eef4c99b req-70254c69-04c8-4c45-8656-ceb52eadd4ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:39.194361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-013630f8-fb58-47a6-a0b2-24e5eef4c99b req-70254c69-04c8-4c45-8656-ceb52eadd4ec service nova] Creating event network-changed:2b593d86-fde5-4581-9219-47464ec7f35d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:39.201519 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-013630f8-fb58-47a6-a0b2-24e5eef4c99b req-70254c69-04c8-4c45-8656-ceb52eadd4ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078791 Jul 26 04:39:39.204502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1524/3131] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:39.228342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:39.228951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:39.237076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:39.237770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:39.238868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:39.239469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:39.859302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:39.877163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:39.882897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:39.887552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f21dd6aa-6261-4da5-9c2a-12fe77f37bae tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.662137 Jul 26 04:39:39.902952 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1608/3132] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:39 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:40.105038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2968d0ef-87e7-4f26-a524-f2b70ec0932c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a1e550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:40.131642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:40.132997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:40.143933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:40.147315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:40.149993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:40.150763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:40.329568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2968d0ef-87e7-4f26-a524-f2b70ec0932c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.231957 Jul 26 04:39:40.332907 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1525/3133] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:40 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:40.784951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:40.812337 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-063bb8b0-2af1-4431-9dfc-9903358f8fc5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.685682 Jul 26 04:39:40.818935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1609/3134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:40 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:40.915014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:40.916509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:40.970136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:40.975039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:40.976053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:40.981362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:41.275475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-601efb86-1019-408f-bfab-cf3430625a42 req-1ce54269-27bc-4035-a030-4d251d0d572b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "0b317ddc-d069-4f82-adae-d1c6e5f4802b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:41.298737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-601efb86-1019-408f-bfab-cf3430625a42 req-1ce54269-27bc-4035-a030-4d251d0d572b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:41.300356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-601efb86-1019-408f-bfab-cf3430625a42 req-1ce54269-27bc-4035-a030-4d251d0d572b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:41.344914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-601efb86-1019-408f-bfab-cf3430625a42 req-1ce54269-27bc-4035-a030-4d251d0d572b service nova] Creating event network-changed:0b317ddc-d069-4f82-adae-d1c6e5f4802b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:41.364938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-601efb86-1019-408f-bfab-cf3430625a42 req-1ce54269-27bc-4035-a030-4d251d0d572b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091878 Jul 26 04:39:41.369110 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1610/3135] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:41.396220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f87dac5-0100-4246-b4b2-743d96254780 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bac5db80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:41.750514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4f87dac5-0100-4246-b4b2-743d96254780 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.379781 Jul 26 04:39:41.752925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1611/3136] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:41 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:41.838253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:41.839105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:41.859520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:41.859981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:41.870904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:41.871534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:42.274909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:42.285176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:42.287414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2797597-9bd3-405c-bf22-36f46acc9280 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.453699 Jul 26 04:39:42.294008 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1612/3137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:41 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:42.311038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:42.326040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:42.335481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50703945-3371-4c7f-9f50-be3e7262e320 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 1.425765 Jul 26 04:39:42.369208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1526/3138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:40 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:39:42.770788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f2a5ab0-adf3-425e-bead-280021192b40 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bac5d8b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:42.843028 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f2a5ab0-adf3-425e-bead-280021192b40 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.078524 Jul 26 04:39:42.844029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1613/3139] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:42 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:43.309891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:43.311251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:43.326122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:43.326942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:43.327955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:43.328605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:43.379443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:43.389078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:43.440617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:43.446741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:43.449441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:43.453759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:43.908959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:43.922737 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6a7306e8-d537-4ff9-a15e-f5ac047b4b8a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.613049 Jul 26 04:39:43.927214 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1527/3140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:43 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:43.946569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "e6c3d498-1a9e-4939-a012-995cbbff985b"}, {"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "2ae64922-ff5d-44c7-89c5-d34c8e95b633"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:43.971420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:43.972192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:44.006212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] Creating event network-changed:e6c3d498-1a9e-4939-a012-995cbbff985b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:44.008559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] Creating event network-changed:2ae64922-ff5d-44c7-89c5-d34c8e95b633 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:39:44.022610 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-796b16a0-19d3-46ce-94e9-a6275dd8aaa0 req-23aa4dd9-9182-47fc-8042-1a3cc95afb02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092435 Jul 26 04:39:44.023687 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1528/3141] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:44.029232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c2dcb3a-d47a-4fb3-bca7-2b758266785d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5b75790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:44.111410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c2dcb3a-d47a-4fb3-bca7-2b758266785d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.086385 Jul 26 04:39:44.112548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1529/3142] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:44 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:44.127481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-188d688a-1107-422d-b30a-f79574d6e18e req-316c125a-35f3-48e6-8407-7df91972b9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e216677-4521-48a6-bb98-f66edea0cad3", "name": "network-vif-plugged", "status": "completed", "tag": "bf158433-4407-4375-9405-21f8fbd17742"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:44.151209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-188d688a-1107-422d-b30a-f79574d6e18e req-316c125a-35f3-48e6-8407-7df91972b9a6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:44.151930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-188d688a-1107-422d-b30a-f79574d6e18e req-316c125a-35f3-48e6-8407-7df91972b9a6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:44.173135 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-188d688a-1107-422d-b30a-f79574d6e18e req-316c125a-35f3-48e6-8407-7df91972b9a6 service nova] Creating event network-vif-plugged:bf158433-4407-4375-9405-21f8fbd17742 for instance 7e216677-4521-48a6-bb98-f66edea0cad3 on n-h1-848886-16 Jul 26 04:39:44.181060 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-188d688a-1107-422d-b30a-f79574d6e18e req-316c125a-35f3-48e6-8407-7df91972b9a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064672 Jul 26 04:39:44.182168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1530/3143] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:44.218899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:44.240369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:44.249316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:44.255359 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f56601fa-330a-4877-ab6c-988145070275 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.884625 Jul 26 04:39:44.256531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1614/3144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:43 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:44.973139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:44.975043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:45.003402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:45.004359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:45.007377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:45.010785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:45.150937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-672d3603-366d-4eee-9bb4-eb123588de85 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a47ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:45.230720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-672d3603-366d-4eee-9bb4-eb123588de85 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1413 microversion: 2.1 time: 0.107397 Jul 26 04:39:45.231395 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1615/3145] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:45 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:45.281771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:45.282828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:45.306823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:45.311987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:45.318191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:45.319717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:45.459974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:45.472448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.482816 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5e33d49-cf39-4b8f-9f07-d135906298d2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.517554 Jul 26 04:39:45.485740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1531/3146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:44 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:46.133720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:46.151954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:46.153479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:46.157837 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2533c280-514f-4dc3-815c-3714523c0d66 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.880786 Jul 26 04:39:46.162573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1616/3147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:45 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:46.249864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30f97620-8e43-454c-b00d-59d5a6100ded tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a47c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:46.342770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30f97620-8e43-454c-b00d-59d5a6100ded tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1422 microversion: 2.1 time: 0.099568 Jul 26 04:39:46.347280 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1532/3148] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:46 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:46.361145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88f9cf44-662c-48eb-8110-0d45e6eaf9e4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bad29d30>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:46.423741 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88f9cf44-662c-48eb-8110-0d45e6eaf9e4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 200 len: 1422 microversion: 2.1 time: 0.067522 Jul 26 04:39:46.425108 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1617/3149] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:39:46 2022] GET /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:46.439449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0a82983-6988-4a3f-b7e2-1abc39073a86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b51ecee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:46.508194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:46.509139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:46.516446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:46.518427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:46.519302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:46.520052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:46.920560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:46.930086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01e7e10e-207a-44c3-a34d-020dca8eefa3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1317 microversion: 2.1 time: 0.426304 Jul 26 04:39:46.934282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1618/3150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:46 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:47.191449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:47.192133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:47.206526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.207827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:47.209420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.210332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:47.235653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:47.568347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:47.578171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:47.584997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:47.586291 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15d58362-8e27-4ea5-9798-26b1dbccebef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.400683 Jul 26 04:39:47.598279 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1619/3151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:47 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:47.722852 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0a82983-6988-4a3f-b7e2-1abc39073a86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 204 len: 0 microversion: 2.1 time: 1.288005 Jul 26 04:39:47.725152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1533/3152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:46 2022] DELETE /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 0 bytes in 1291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:47.743848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:47.744977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:47.751414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.752567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:47.753557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.754129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:47.792210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:39:47.931832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f88a1723-3836-438e-9a8c-474b3b8b47c3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 204 len: 0 microversion: 2.1 time: 0.202090 Jul 26 04:39:47.932796 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1620/3153] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:39:47 2022] DELETE /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:47.962699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:47.963343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:47.975714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.977140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:47.984152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:47.985721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:48.244416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1735280652", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "375077fe-0b05-4c6a-9dfb-0eb433eff9f2"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:48.321085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] validate_networks() for [('375077fe-0b05-4c6a-9dfb-0eb433eff9f2', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:39:48.643883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:48.652689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31a4bce5-3491-4ed1-88c8-e22d6cdcee3d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1466 microversion: 2.1 time: 0.694994 Jul 26 04:39:48.672056 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1534/3154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:47 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1466 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:48.684293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:48.685167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:48.694969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:48.695595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:48.698003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:48.698674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:49.166102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:49.176766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:49.178300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:49.179869 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2047656-1b9e-474f-a5b5-308d5a4669f8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.506572 Jul 26 04:39:49.195717 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1535/3155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:48 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:49.203175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:49.204053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:49.211251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:49.211916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:49.212855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:49.213459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:49.383308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:39:49.384309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:39:49.385218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:39:49.386648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:39:49.387384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:39:49.449649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:49.450314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:49.454580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:49.457261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:49.467116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0115eadf-c583-4214-b6f0-ed64379d33db tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1619 microversion: 2.1 time: 0.268986 Jul 26 04:39:49.468876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1536/3156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:49 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1619 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:49.489669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:39:49.498554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for user 8644f4ea57d44617b1b4652993df8cdd and project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:39:49.505606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.519439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:39:49.523477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:39:49.591999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d52fdf4-bc09-4324-bde5-e594514546d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352257 Jul 26 04:39:49.593666 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1621/3157] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:39:49.615466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38b4bc11-cb29-4195-add8-ca51ba38099b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:49.616775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38b4bc11-cb29-4195-add8-ca51ba38099b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:49.715913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2079320198", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "98f46604-10b1-44f0-9e50-56a9f36f6f8e"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:49.750234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38b4bc11-cb29-4195-add8-ca51ba38099b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:49.775046 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38b4bc11-cb29-4195-add8-ca51ba38099b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1208 microversion: 2.1 time: 0.167668 Jul 26 04:39:49.775657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1537/3158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:49 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:49.840405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:39:50.088095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f49947ab-4ea6-4308-8d22-2096939b2a54 req-18d3c29a-25af-4af6-86f9-7d8dbdbd055e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c595005c-360b-440d-b7a2-d441fb1266a2", "name": "network-vif-unplugged", "status": "completed", "tag": "b773a32f-1bc3-461d-9c4e-09cd538e7d13"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:50.119466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f49947ab-4ea6-4308-8d22-2096939b2a54 req-18d3c29a-25af-4af6-86f9-7d8dbdbd055e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.119919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f49947ab-4ea6-4308-8d22-2096939b2a54 req-18d3c29a-25af-4af6-86f9-7d8dbdbd055e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.133954 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f49947ab-4ea6-4308-8d22-2096939b2a54 req-18d3c29a-25af-4af6-86f9-7d8dbdbd055e service nova] Creating event network-vif-unplugged:b773a32f-1bc3-461d-9c4e-09cd538e7d13 for instance c595005c-360b-440d-b7a2-d441fb1266a2 on n-h1-848886-16 Jul 26 04:39:50.149935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f49947ab-4ea6-4308-8d22-2096939b2a54 req-18d3c29a-25af-4af6-86f9-7d8dbdbd055e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066255 Jul 26 04:39:50.151622 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1538/3159] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:39:50.242177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:50.243276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:50.280150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.281953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.284349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.285155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.623348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:50.642068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:50.645959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:50.650423 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6230b43-67e9-4e3d-8066-c438a5c02935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.426322 Jul 26 04:39:50.666968 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1539/3160] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:50 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:50.750129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:39:50.750669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:39:50.751033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:39:50.751446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:39:50.753076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:39:50.770332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.771078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.772321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.773205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.795266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:39:50.803376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:50.803891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Getting quotas for user 2c8f07914c3944709e6fa1bf613255bc and project b021402842234f30a0c3464f83ef416c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:39:50.804012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:50.813801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.819180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.820437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:50.820916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:50.822066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:39:50.826137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:39:50.909025 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1f7d752-c992-4f98-8167-fd0b589b3000 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199510 Jul 26 04:39:50.911587 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1622/3161] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:39:50.923288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7de1a866-cb14-4668-9182-818262f8761f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:50.926666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7de1a866-cb14-4668-9182-818262f8761f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:50.994355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:51.004512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1aae5b11-b292-454c-aad7-4b5961fc1572 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1212 microversion: 2.1 time: 0.211863 Jul 26 04:39:51.007239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1540/3162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:50 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1212 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:51.194109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7de1a866-cb14-4668-9182-818262f8761f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:51.210129 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7de1a866-cb14-4668-9182-818262f8761f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1217 microversion: 2.1 time: 0.292776 Jul 26 04:39:51.227946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1623/3163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:50 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1217 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:51.689054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:51.692153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:51.718346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:51.719247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:51.720258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:51.721862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.039789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:52.041003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:52.060462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:52.061428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.065180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:52.066289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.321245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:52.331944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b03c569e-57f6-47a6-a837-119bdd455344 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1266 microversion: 2.1 time: 0.307139 Jul 26 04:39:52.332853 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1624/3164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:52 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:52.347093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:52.348287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:52.352410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:52.358782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:52.359506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.360818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:52.362045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.371000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:52.373288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:52.375000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-106a5fab-ad5c-463c-8006-8dfd07c85436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.696226 Jul 26 04:39:52.376278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1541/3165] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:51 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:52.416851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d6b7b2cf-0d0c-4609-98d8-b2c540d8f609 req-09324518-148c-4c08-ac01-cf1cd95d3b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c595005c-360b-440d-b7a2-d441fb1266a2", "name": "network-vif-deleted", "tag": "b773a32f-1bc3-461d-9c4e-09cd538e7d13"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:52.445930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d6b7b2cf-0d0c-4609-98d8-b2c540d8f609 req-09324518-148c-4c08-ac01-cf1cd95d3b7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:52.446743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d6b7b2cf-0d0c-4609-98d8-b2c540d8f609 req-09324518-148c-4c08-ac01-cf1cd95d3b7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:52.476989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d6b7b2cf-0d0c-4609-98d8-b2c540d8f609 req-09324518-148c-4c08-ac01-cf1cd95d3b7a service nova] Creating event network-vif-deleted:b773a32f-1bc3-461d-9c4e-09cd538e7d13 for instance c595005c-360b-440d-b7a2-d441fb1266a2 on n-h1-848886-16 Jul 26 04:39:52.482934 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d6b7b2cf-0d0c-4609-98d8-b2c540d8f609 req-09324518-148c-4c08-ac01-cf1cd95d3b7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076679 Jul 26 04:39:52.491855 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1542/3166] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:52.705198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:52.721520 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65fd1ab4-f62d-4f26-a90c-992a340c84d3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1269 microversion: 2.1 time: 0.386661 Jul 26 04:39:52.727752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1625/3167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:52 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1269 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:53.356450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:53.357164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:53.359514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=63 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:53.373419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.377562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.381757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.383584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.403985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:53.405709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:53.419889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.420881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.422300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.428873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.560059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:53.574401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8238651-0a72-4095-b03e-72afacfc6603 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1266 microversion: 2.1 time: 0.222940 Jul 26 04:39:53.588465 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1543/3168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:53 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:53.750966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:53.751615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:53.762917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.765451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.766486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:53.767341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:53.885492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:53.899759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b99ff38-ad2a-42e8-a5fe-ca81aede00e7 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1275 microversion: 2.1 time: 0.153281 Jul 26 04:39:53.915744 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1544/3169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:53 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:54.312907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:54.326948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:54.330569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:54.332098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-634c8023-f4ec-4628-97bd-b355c05ff2c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.932774 Jul 26 04:39:54.332901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1626/3170] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:53 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:39:54.597538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:54.598249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:54.630142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:54.630619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:54.631410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:54.631850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:54.927376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:54.928054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:54.938470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:54.941035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:54.946544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:54.958140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:55.075056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:55.123625 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-712185b2-8365-44ab-ab04-34cbc5b63af0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.529719 Jul 26 04:39:55.125684 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1545/3171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:54 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:55.227335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9805e9dc-0fac-49ba-86e7-596f2faf448a req-8333b331-1528-4820-aecc-6eb7f1d9706b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c518e51c-de3f-4b20-a9b2-0d9805d73e12", "tag": "581ead2d-71b7-4be2-be27-68b81fbbb8f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:39:55.242084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9805e9dc-0fac-49ba-86e7-596f2faf448a req-8333b331-1528-4820-aecc-6eb7f1d9706b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:55.243856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9805e9dc-0fac-49ba-86e7-596f2faf448a req-8333b331-1528-4820-aecc-6eb7f1d9706b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:55.280871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:55.301278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe32d522-3c69-4e94-ac65-c7c3f3e01a05 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1275 microversion: 2.1 time: 0.379948 Jul 26 04:39:55.319780 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1627/3172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:54 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1275 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:55.320546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9805e9dc-0fac-49ba-86e7-596f2faf448a req-8333b331-1528-4820-aecc-6eb7f1d9706b service nova] Creating event network-changed:581ead2d-71b7-4be2-be27-68b81fbbb8f6 for instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 on n-h2-848886-16 Jul 26 04:39:55.331368 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9805e9dc-0fac-49ba-86e7-596f2faf448a req-8333b331-1528-4820-aecc-6eb7f1d9706b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110118 Jul 26 04:39:55.333919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1546/3173] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:39:55.361729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:55.362747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:55.377118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:55.378182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:55.379773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:55.381343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:56.146560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:56.147506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:56.156394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:56.157139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:56.159586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:56.160257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:56.275091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:56.287063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:56.289016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:56.291151 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab5f3ebb-e58c-4d40-87b6-32146e49f1d7 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.935584 Jul 26 04:39:56.292956 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1628/3174] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:55 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:56.339919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:56.340530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:56.347185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:56.347886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:56.348831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:56.349433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:56.401428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:56.410481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-adff0bb5-f70c-42fc-b3d7-0f4a164e6630 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.268545 Jul 26 04:39:56.411248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1547/3175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:56 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:56.476631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:56.484679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20a68f47-ac65-4e0a-930b-973a9d33622e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1275 microversion: 2.1 time: 0.148505 Jul 26 04:39:56.492789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1629/3176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:56 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:57.319028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:57.320342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:57.334570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.337360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.339122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.339604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.433237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:57.433851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:57.448241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.450145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.452922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.455486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.734955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:57.759951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:57.761498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:57.762739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6aa82fe-69a0-4571-b9be-82a723e0b37b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.450046 Jul 26 04:39:57.763312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1548/3177] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:57 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:39:57.781443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:57.783841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:57.797675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.798055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.798904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:57.799350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:57.853898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:57.864701 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab866ef3-e8db-47db-a5fe-5004f57564b2 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.436060 Jul 26 04:39:57.871076 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1630/3178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:57 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:58.058096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:58.074530 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5f2f1c2-bc67-4318-8ce8-ce5cfade348d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.309959 Jul 26 04:39:58.089716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1549/3179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:57 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:58.791155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:58.791960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:58.802503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:58.812815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:58.814414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:58.815100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:58.897258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:58.898398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:58.914622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:58.915500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:58.916536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:58.917206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:59.232531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:59.242041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-935d2871-47aa-4ebd-9bdc-cd2513816cda tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.348569 Jul 26 04:39:59.255219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1550/3180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:58 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:59.255219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:39:59.255219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:39:59.259384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:59.260343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:59.261216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:39:59.261823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:39:59.582772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:39:59.591771 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95fd10f2-ec83-4f83-8fb6-3dcf85e1a441 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.347489 Jul 26 04:39:59.597275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1551/3181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:39:59 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:00.231657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:00.250677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:00.254694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:00.256001 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2bb185f3-c6e4-411d-a761-4a856dafbccf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 1.469172 Jul 26 04:40:00.256576 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1631/3182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:39:58 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:00.273458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:00.274345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:00.285754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.293958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:00.294940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:00.296054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:00.296676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:00.493345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:00.501860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe00d482-3b30-48ac-a947-2d5034367625 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.241325 Jul 26 04:40:00.504040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1552/3183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:00 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:00.622744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:00.622744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:00.640823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:00.642766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:00.643688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:00.644532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:00.785586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.200156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=14 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.285802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:01.287136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:01.303992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:01.304527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:01.305520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:01.306253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:01.353773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:02.078912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:02.092266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:02.093798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:02.108653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4416ef49-077b-47fb-8120-064bd780d0dc tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.827655 Jul 26 04:40:02.109261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1553/3184] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:01 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:02.136271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:02.137106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:02.150755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:02.151650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:02.156594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:02.157677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:02.326621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:02.345643 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-443c3394-4c51-435f-a07f-305af2953919 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 1.729314 Jul 26 04:40:02.348468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1632/3185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:00 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:03.007559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:03.018839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-938eed77-41ce-4a47-8110-771dae9b41bb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.893434 Jul 26 04:40:03.035849 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1554/3186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:02 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:03.136778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:03.137889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:03.146944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:03.147936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:03.149332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:03.150033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:03.371140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:03.372149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:03.381098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:03.381820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:03.383225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:03.385194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:03.717385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:03.736096 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11c0e0b7-466e-4f1a-97d6-8f851ed85790 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.370812 Jul 26 04:40:03.741454 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1555/3187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:03 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:03.785331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d7e19a6b-553e-4b97-ad21-80560239fb17 req-e8312d5e-3118-4977-99cd-529e56120aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98553f54-cc85-497b-8343-59170b9275ab", "tag": "630583a0-ad09-4252-ad9a-27331c5e426a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:03.807979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d7e19a6b-553e-4b97-ad21-80560239fb17 req-e8312d5e-3118-4977-99cd-529e56120aa2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:03.810678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d7e19a6b-553e-4b97-ad21-80560239fb17 req-e8312d5e-3118-4977-99cd-529e56120aa2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:03.844238 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d7e19a6b-553e-4b97-ad21-80560239fb17 req-e8312d5e-3118-4977-99cd-529e56120aa2 service nova] Creating event network-changed:630583a0-ad09-4252-ad9a-27331c5e426a for instance 98553f54-cc85-497b-8343-59170b9275ab on n-h2-848886-16 Jul 26 04:40:03.858286 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d7e19a6b-553e-4b97-ad21-80560239fb17 req-e8312d5e-3118-4977-99cd-529e56120aa2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080087 Jul 26 04:40:03.861486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1556/3188] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:40:03.996869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:04.021573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:04.025902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:04.031868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5a36b5e-716d-483f-8025-e7b0830337ad tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.899020 Jul 26 04:40:04.050727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:04.052982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:04.055754 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1633/3189] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:03 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:04.071146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:04.072677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:04.073878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:04.074568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:04.539740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:04.554203 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-422771d1-5a16-4e13-9a51-1b2026532b6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.510371 Jul 26 04:40:04.555412 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1557/3190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:04 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:04.764059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:04.764885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:04.779890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:04.790806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:04.793039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:04.794559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:04.951540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1810210417", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:05.071512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] validate_networks() for [('084ac9de-f3e7-4f24-87e6-b6afed804c19', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:40:05.366735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:05.384469 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed40b6e2-06c9-4fc9-8e54-64a4651ff945 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.625016 Jul 26 04:40:05.388478 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1558/3191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:04 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:05.405589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:05.410747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:05.432188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.432814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:05.433725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.435855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:05.697072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:40:05.697664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:40:05.698246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:40:05.698893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:40:05.699525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:40:05.710972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.716769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:05.718090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.718835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:05.756089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Getting quotas for project b88ec1896b5f475680b27b8a728ea3fc. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:40:05.776470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Getting quotas for user a56cb37e745f4ef6bcd8bc54969165c3 and project b88ec1896b5f475680b27b8a728ea3fc. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:40:05.808329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:40:05.813683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:40:05.899465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-068ca562-b673-4ced-869f-9fa8486fed1c tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314774 Jul 26 04:40:05.902084 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1634/3192] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:40:05.914095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:05.917310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:05.943103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.944035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:05.945182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:05.946672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:06.225681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:06.233630 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8823d6db-cec6-4b04-bbdb-e175bff946f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.330172 Jul 26 04:40:06.234241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1635/3193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:05 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:06.258446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d0d2a1b7-101f-4008-a146-5e4528076875 req-a6c7b7d6-ddc1-4624-a877-411a586d988e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c518e51c-de3f-4b20-a9b2-0d9805d73e12", "name": "network-vif-plugged", "status": "completed", "tag": "581ead2d-71b7-4be2-be27-68b81fbbb8f6"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:06.283152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d0d2a1b7-101f-4008-a146-5e4528076875 req-a6c7b7d6-ddc1-4624-a877-411a586d988e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:06.283991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d0d2a1b7-101f-4008-a146-5e4528076875 req-a6c7b7d6-ddc1-4624-a877-411a586d988e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:06.301911 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d0d2a1b7-101f-4008-a146-5e4528076875 req-a6c7b7d6-ddc1-4624-a877-411a586d988e service nova] Creating event network-vif-plugged:581ead2d-71b7-4be2-be27-68b81fbbb8f6 for instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 on n-h2-848886-16 Jul 26 04:40:06.309970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d0d2a1b7-101f-4008-a146-5e4528076875 req-a6c7b7d6-ddc1-4624-a877-411a586d988e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057777 Jul 26 04:40:06.311382 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1636/3194] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:06.318849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e83684a-e3c8-4e4d-b150-e66644d77606 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:06.320003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e83684a-e3c8-4e4d-b150-e66644d77606 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:06.409943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:06.421881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:06.429325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:06.437689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-460e26c3-3396-4dc2-82ab-672c9ee17d32 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 1.040390 Jul 26 04:40:06.439010 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1559/3195] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:05 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:06.445682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:06.449801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:06.462557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:06.462714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:06.463496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:06.463932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:06.484543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e83684a-e3c8-4e4d-b150-e66644d77606 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:06.493852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e83684a-e3c8-4e4d-b150-e66644d77606 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1224 microversion: 2.1 time: 0.180678 Jul 26 04:40:06.504052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1637/3196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:06 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:07.267100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:07.268164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:07.286093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:07.287015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:07.306232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:07.306891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:07.386941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:07.406324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1a5b346-4b57-48c4-be4e-88f6a94fc031 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.965882 Jul 26 04:40:07.407999 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1560/3197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:06 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:07.467711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:07.469705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:07.485771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:07.489379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:07.490443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:07.491062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:08.166359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.184575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.190680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.201421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f7385b48-cd9b-46f2-b1b6-17904ff5abcd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.738126 Jul 26 04:40:08.202409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1561/3198] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:07 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:40:08.222234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:08.222867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:08.241738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:08.242241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:08.245415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:08.246535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:08.434595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.443309 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-875611b2-05a1-465f-b9d8-83fcd70667e6 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1282 microversion: 2.1 time: 0.239440 Jul 26 04:40:08.457948 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1562/3199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:08 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:08.464112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:08.464731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:08.486830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:08.487451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:08.488070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:08.488515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:08.753717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.771780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18c258df-76c0-4384-badc-2f42a2cc7ee2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.312532 Jul 26 04:40:08.773007 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1563/3200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:08 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:08.824767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:08.833799 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-004068be-0fcd-42ca-b726-1888a57616b8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 1.583197 Jul 26 04:40:08.847268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1638/3201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:07 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:09.228504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:09.229166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:09.248042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.248766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:09.249756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.250988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:09.466573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:09.467770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:09.487050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.487579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:09.488595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.493236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:09.570314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.712294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:09.720695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-edae3647-c73f-43dc-b565-285b6617123d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1282 microversion: 2.1 time: 0.259771 Jul 26 04:40:09.725415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1639/3202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:09 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:09.793436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:09.794305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:09.801305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.801971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:09.803141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:09.803746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:10.100011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:10.117244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:10.119384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:10.120880 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fdc65b1-b99e-4789-b8a0-08ae9ff0ea83 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.896364 Jul 26 04:40:10.135004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1564/3203] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:09 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:10.146127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:10.147204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:10.154753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:10.155469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:10.157903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:10.158911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:10.289580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:10.330760 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d3342ee4-42ef-4b03-a330-b608e82ff1c4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.537276 Jul 26 04:40:10.333592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1640/3204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:09 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:10.741609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:10.742501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:10.757642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:10.763304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:10.764498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:10.765163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:10.786660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:10.806247 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7995e481-667d-4efe-816b-bd17d21713e1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.669592 Jul 26 04:40:10.815381 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1565/3205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:10 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:11.150666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:11.152126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:11.166028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.170580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:11.171793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.173600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:11.306010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:11.319564 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d998c5c0-4977-4ee8-b2a5-de4acf52236f tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.581734 Jul 26 04:40:11.322922 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1641/3206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:10 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:11.351828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:11.352463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:11.392994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.393469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:11.394401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.394724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:11.877019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:11.886532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:11.891679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:11.893158 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9d1ea5a-58ff-4bc0-8438-b9af40c98935 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.746644 Jul 26 04:40:11.907383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:11.913131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1566/3207] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:11 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:11.917251 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a07bcb08-6f01-430e-8404-ddba5fcc0446 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.569279 Jul 26 04:40:11.921957 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1642/3208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:11 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:11.936951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:11.943944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:11.962988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.963449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:11.966512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:11.966976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.358852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:12.360077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:12.378510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.378975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.379819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.380271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.789998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:12.801270 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f624aa6e-0fc0-40eb-aeee-a77d3a027ee4 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.461122 Jul 26 04:40:12.801862 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1643/3209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:12 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:12.824663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:12.873730 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bc8c6bf-ab35-42cd-b929-d42c06b0d228 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1308 microversion: 2.1 time: 0.959133 Jul 26 04:40:12.882398 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1567/3210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:11 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1308 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:12.921296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:12.922949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:12.932013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.941937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.947964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.948662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.949831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:12.951374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:12.964050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.967254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:12.968447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:12.969261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:13.342995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:13.351078 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f2341f3-1e8e-4234-9f4f-792f564c4910 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.408563 Jul 26 04:40:13.351668 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1568/3211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:12 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:13.827028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:13.828455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:13.855858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:13.856121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:13.857125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:13.857436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:13.981564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:13.993908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:14.004347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:14.005640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81a39a0e-532c-465a-a841-9e84ebb72f22 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 1.088696 Jul 26 04:40:14.006271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1644/3212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:12 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:14.011458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-21a7c2ac-2fc7-4c80-9e59-e33845395642 req-17d1a893-a9bf-43dd-8080-be728ecb55f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064d2b43-8e52-4edb-ae91-68e9c46427af", "tag": "7d64e038-c41b-4550-9256-20f52bb666ae"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:14.040646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-21a7c2ac-2fc7-4c80-9e59-e33845395642 req-17d1a893-a9bf-43dd-8080-be728ecb55f0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.041103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-21a7c2ac-2fc7-4c80-9e59-e33845395642 req-17d1a893-a9bf-43dd-8080-be728ecb55f0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.066021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-21a7c2ac-2fc7-4c80-9e59-e33845395642 req-17d1a893-a9bf-43dd-8080-be728ecb55f0 service nova] Creating event network-changed:7d64e038-c41b-4550-9256-20f52bb666ae for instance 064d2b43-8e52-4edb-ae91-68e9c46427af on n-h1-848886-16 Jul 26 04:40:14.083771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-21a7c2ac-2fc7-4c80-9e59-e33845395642 req-17d1a893-a9bf-43dd-8080-be728ecb55f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076191 Jul 26 04:40:14.091287 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1645/3213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:14.103249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:14.103987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:14.129862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.130343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.134352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.140642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.258652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:14.272975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7dc9bee6-dd61-4265-9aa1-5277436da245 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.450661 Jul 26 04:40:14.288600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1569/3214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:13 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:14.372913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:14.373539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:14.386046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.386525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.387306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.387952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.546931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:14.550774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.556197 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a924f31-2be5-4e30-b25e-52fd86f8943c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.187958 Jul 26 04:40:14.556743 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1570/3215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:14 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:14.614809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:14.622917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4738a335-5928-4d4b-b620-8c2a58b265d8 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1489 microversion: 2.1 time: 0.530040 Jul 26 04:40:14.623440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1646/3216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:14 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1489 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:14.644759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2371cff-9011-453c-b418-34af3d30936b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:14.651011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2371cff-9011-453c-b418-34af3d30936b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.651472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2371cff-9011-453c-b418-34af3d30936b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.713024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2371cff-9011-453c-b418-34af3d30936b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:40:14.764279 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2371cff-9011-453c-b418-34af3d30936b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12/action" status: 202 len: 0 microversion: 2.1 time: 0.123401 Jul 26 04:40:14.766020 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1571/3217] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:40:14 2022] POST /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:40:14.774925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:14.775631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:14.785172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.786010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:14.786916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:14.787421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.036838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:15.051326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:15.060834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.062235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.064712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.065400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.154331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.154839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d65cc5fd-7b6d-4823-ba9c-875b36bfb16c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.384069 Jul 26 04:40:15.183911 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1647/3218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:14 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:15.300006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:15.300801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:15.310395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.311020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.312263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.313068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.363118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.372890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.375281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.377077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e981b44-9992-4ff0-a5a6-24d398c68a7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.346131 Jul 26 04:40:15.377809 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1572/3219] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:15 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:15.562393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.574906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9023c3a0-5e9e-4e55-819a-4756cebcfad5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.282197 Jul 26 04:40:15.575778 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1648/3220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:15 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:15.592625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:15.594060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:15.601568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.602385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.603366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:15.604017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:15.767983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:15.781324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f29d88b6-fd21-4f71-b3e5-6f4f4e21ffa5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.208073 Jul 26 04:40:15.798352 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1573/3221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:15 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:16.188943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:16.189702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:16.200803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:16.209137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.209705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.212323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.215087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.404419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:16.407089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:16.424291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.426298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.430138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.430871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.491025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:16.657778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:16.669970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24fb2470-a6f6-463a-a137-8fe0a790232f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.486748 Jul 26 04:40:16.677271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1649/3222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:16 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:16.686925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:16.689676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:16.713431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.713905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.714768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.715263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:16.913471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:16.922871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:16.924396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:16.925785 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11c2d0f1-5094-4e17-840c-c20a06eb3747 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.527432 Jul 26 04:40:16.944706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1574/3223] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:16 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:16.949922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:16.967461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:16.988622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:16.997157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:17.002247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:17.002972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:17.285810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:17.302320 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32744a97-c4dd-4625-9ede-ad3a2484f2fc tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.356147 Jul 26 04:40:17.303187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1575/3224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:16 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:17.700637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:17.702261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:17.715780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:17.717438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:17.721409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:17.724088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:17.774215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:17.781885 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41e4161f-7782-46e6-86e6-db26d3015d78 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 1.102859 Jul 26 04:40:17.785187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1650/3225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:16 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:17.905517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:17.915759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd929eec-c842-4f7b-b358-755b48bbafba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.221085 Jul 26 04:40:17.917262 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1576/3226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:17 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:17.951759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:17.952364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:17.964125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:17.964854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:17.971020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:17.971900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.323744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:18.331637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:18.338926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.339735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.340741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.341400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.497400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:18.520078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:18.525988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:18.530466 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24360db0-3e09-46cb-926d-d7e5a35e160e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.583585 Jul 26 04:40:18.532226 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1651/3227] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:17 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:18.549573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:18.564215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee6e07c7-3677-4ac3-8cb8-c15dbc703c5c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.244051 Jul 26 04:40:18.576556 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1577/3228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:18 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:18.809081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:18.810455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:18.817481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:18.830898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.831439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.832301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.832809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.938187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:18.938902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:18.946961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.947898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:18.949364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:18.949981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:19.015455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.024506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b00a4982-9321-4010-acbe-4d24cbafd5ae tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.224123 Jul 26 04:40:19.025658 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1652/3229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:18 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:19.236849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.246286 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fbecbdbb-861b-4e8e-9677-03df1f9ac222 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.312281 Jul 26 04:40:19.247028 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1578/3230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:18 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:19.559152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:19.559873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:19.568873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:19.569521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:19.570551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:19.571185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:19.592047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:19.592664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:19.602451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:19.606256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:19.607100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:19.607554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:19.810922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.821862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.823500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.824742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bd3fe3ce-be55-4b90-942b-a7a86e6e9583 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.271144 Jul 26 04:40:19.832124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:19.839770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dae73698-bf17-4298-b183-480199c7dfe3 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.251878 Jul 26 04:40:19.839950 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1653/3231] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:19 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:19.840732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1579/3232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:19 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:20.047495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:20.048662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:20.059090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.059839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.060800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.061595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.112465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fc013bf5-262f-4c87-a16c-cf7430de31d2 req-f371cc75-cb3e-4fff-a57a-7b99e23d1f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064d2b43-8e52-4edb-ae91-68e9c46427af", "name": "network-vif-plugged", "status": "completed", "tag": "7d64e038-c41b-4550-9256-20f52bb666ae"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:20.127365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fc013bf5-262f-4c87-a16c-cf7430de31d2 req-f371cc75-cb3e-4fff-a57a-7b99e23d1f25 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.128111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fc013bf5-262f-4c87-a16c-cf7430de31d2 req-f371cc75-cb3e-4fff-a57a-7b99e23d1f25 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.147273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fc013bf5-262f-4c87-a16c-cf7430de31d2 req-f371cc75-cb3e-4fff-a57a-7b99e23d1f25 service nova] Creating event network-vif-plugged:7d64e038-c41b-4550-9256-20f52bb666ae for instance 064d2b43-8e52-4edb-ae91-68e9c46427af on n-h1-848886-16 Jul 26 04:40:20.160938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fc013bf5-262f-4c87-a16c-cf7430de31d2 req-f371cc75-cb3e-4fff-a57a-7b99e23d1f25 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053302 Jul 26 04:40:20.161554 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1580/3233] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:20.269400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:20.270345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:20.281800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.282676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.283661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.283983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.455799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:20.466115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-436346e6-caae-46aa-8a0e-a96e0792880a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.201757 Jul 26 04:40:20.467432 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1581/3234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:20 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:20.548615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:20.556142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e56bd5e3-c07f-4b58-a710-dfa88864654d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.514291 Jul 26 04:40:20.570427 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1654/3235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:20 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:20.850781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:20.851671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:20.861304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.861786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.862647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.863271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.865779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:20.867035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:20.882248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.884256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:20.885253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:20.885854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:21.075278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.085965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.087443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.088941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33d73dec-3452-4a9d-9fc6-cb324897c878 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.242445 Jul 26 04:40:21.089424 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1582/3236] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:20 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:21.125307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.134613 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3f24dd6-0974-4ec1-9aab-7e9398d47759 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.274780 Jul 26 04:40:21.135480 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1655/3237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:20 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:21.490780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:21.491566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:21.498353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:21.498809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:21.499667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:21.500105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:21.577022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:21.578329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:21.585577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:21.586347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:21.587526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:21.588309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:21.609864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.742907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.754999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:21.759338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92ab839f-9dec-404a-9c2d-9cd4afebe1a9 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1324 microversion: 2.1 time: 0.178576 Jul 26 04:40:21.770216 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1656/3238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:21 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:21.770957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a00c09d3-eeed-4c4f-ae89-9c00c201105e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.285119 Jul 26 04:40:21.785192 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1583/3239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:21 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:22.113326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:22.113958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:22.122099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.122677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.123456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.124852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.156870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:22.157497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:22.164698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.165166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.165964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.166438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.354844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:22.368314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:22.370396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:22.372283 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-570b780f-b843-4c92-a723-5afd5744f9d8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.263034 Jul 26 04:40:22.373417 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1657/3240] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:22 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:22.378974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-aa3d0c3b-add4-4b32-a5a7-2df63f1a1349 req-a82938e7-880a-4687-85e8-3879aa7bdcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98553f54-cc85-497b-8343-59170b9275ab", "name": "network-vif-plugged", "status": "completed", "tag": "630583a0-ad09-4252-ad9a-27331c5e426a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:22.414572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa3d0c3b-add4-4b32-a5a7-2df63f1a1349 req-a82938e7-880a-4687-85e8-3879aa7bdcc9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.415306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa3d0c3b-add4-4b32-a5a7-2df63f1a1349 req-a82938e7-880a-4687-85e8-3879aa7bdcc9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.439974 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-aa3d0c3b-add4-4b32-a5a7-2df63f1a1349 req-a82938e7-880a-4687-85e8-3879aa7bdcc9 service nova] Creating event network-vif-plugged:630583a0-ad09-4252-ad9a-27331c5e426a for instance 98553f54-cc85-497b-8343-59170b9275ab on n-h2-848886-16 Jul 26 04:40:22.447546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-aa3d0c3b-add4-4b32-a5a7-2df63f1a1349 req-a82938e7-880a-4687-85e8-3879aa7bdcc9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071490 Jul 26 04:40:22.448967 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1658/3241] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:22.607081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:22.617681 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3369f756-5029-4551-97bf-61e5deafcbea tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.465276 Jul 26 04:40:22.619466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1584/3242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:22 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:22.784593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:22.785295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:22.792891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:22.793503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:22.794324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.795263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.797377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.798165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.802992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.803454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.804387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:22.804838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:22.952735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:22.961203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a190180-6fb5-4309-94c0-77734c9c7099 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1520 microversion: 2.1 time: 0.181024 Jul 26 04:40:22.962502 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1659/3243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:22 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:23.033376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95b137b7-18e7-4f59-a147-8c447d879330 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1560784958", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95b137b7-18e7-4f59-a147-8c447d879330 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 243 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1560784958", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1560784958', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '084ac9de-f3e7-4f24-87e6-b6afed804c19'}]}}} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:40:23.039508 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95b137b7-18e7-4f59-a147-8c447d879330 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95b137b7-18e7-4f59-a147-8c447d879330 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.013104 Jul 26 04:40:23.048656 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1660/3244] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:40:23.054458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.055024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: db1cb57b-67d1-49dc-b189-437228ab1f61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.061413 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] HTTP exception thrown: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. Jul 26 04:40:23.067315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.075214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7abbfcf6-0811-4070-98ce-85e567fd8701 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.286204 Jul 26 04:40:23.075874 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1585/3245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:22 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/db1cb57b-67d1-49dc-b189-437228ab1f61/metadata HTTP/1.1 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': 'db1cb57b-67d1-49dc-b189-437228ab1f61'} Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.076689 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 404 to user: Instance db1cb57b-67d1-49dc-b189-437228ab1f61 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.081349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f331c577-59b9-4b69-985c-47f40a061b88 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/db1cb57b-67d1-49dc-b189-437228ab1f61/metadata" status: 404 len: 111 microversion: 2.1 time: 0.029132 Jul 26 04:40:23.086397 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1661/3246] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:40:23 2022] GET /compute/v2.1/servers/db1cb57b-67d1-49dc-b189-437228ab1f61/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:40:23.132413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2cef2daf-c252-4f0e-ab82-4469175486c1 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1032685444", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2cef2daf-c252-4f0e-ab82-4469175486c1 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 499 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1032685444", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1032685444', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '084ac9de-f3e7-4f24-87e6-b6afed804c19'}]}}} Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:40:23.137208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2cef2daf-c252-4f0e-ab82-4469175486c1 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2cef2daf-c252-4f0e-ab82-4469175486c1 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010297 Jul 26 04:40:23.141014 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1586/3247] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:40:23.191982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7e1820a-67d8-484b-ae1f-b3a934fa3d5d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1127611269", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7e1820a-67d8-484b-ae1f-b3a934fa3d5d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 500 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1127611269", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1127611269', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '084ac9de-f3e7-4f24-87e6-b6afed804c19'}]}}} Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:40:23.196229 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7e1820a-67d8-484b-ae1f-b3a934fa3d5d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7e1820a-67d8-484b-ae1f-b3a934fa3d5d tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009629 Jul 26 04:40:23.199430 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1662/3248] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:40:23.251565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff07c15e-9060-426b-96a0-37e9a7e8057a tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-36038047", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff07c15e-9060-426b-96a0-37e9a7e8057a tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 752 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-36038047", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-36038047', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '084ac9de-f3e7-4f24-87e6-b6afed804c19'}]}}} Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:40:23.257019 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:40:23.259838 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:40:23.262580 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.262580 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.262580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff07c15e-9060-426b-96a0-37e9a7e8057a tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.262580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff07c15e-9060-426b-96a0-37e9a7e8057a tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011824 Jul 26 04:40:23.264635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1587/3249] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 04:40:23.314827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-530abc96-0a1d-4cd3-bc86-1328c4fc8fa5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-638372213", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-530abc96-0a1d-4cd3-bc86-1328c4fc8fa5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 1265 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-638372213", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "084ac9de-f3e7-4f24-87e6-b6afed804c19"}]}} Jul 26 04:40:23.320244 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-638372213', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '084ac9de-f3e7-4f24-87e6-b6afed804c19'}]}}} Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.322496 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:40:23.323795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:40:23.325768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 04:40:23.325768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.325768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-530abc96-0a1d-4cd3-bc86-1328c4fc8fa5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.325768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-530abc96-0a1d-4cd3-bc86-1328c4fc8fa5 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014229 Jul 26 04:40:23.327781 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1663/3250] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 26 04:40:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 04:40:23.333625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.334132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: a0dfa585-2c28-4cc9-afaf-90738b6a4f21] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.340232 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] HTTP exception thrown: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/a0dfa585-2c28-4cc9-afaf-90738b6a4f21/metadata/test2 HTTP/1.1 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': 'a0dfa585-2c28-4cc9-afaf-90738b6a4f21', 'id': 'test2'} Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:23.341972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 404 to user: Instance a0dfa585-2c28-4cc9-afaf-90738b6a4f21 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0b2d194-8287-4bd3-8b94-0a18cc12d1bd tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/a0dfa585-2c28-4cc9-afaf-90738b6a4f21/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014367 Jul 26 04:40:23.349539 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1588/3251] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 04:40:23 2022] GET /compute/v2.1/servers/a0dfa585-2c28-4cc9-afaf-90738b6a4f21/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:23.359434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.360008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.366404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.367120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.368402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.368843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.397481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.398098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.399501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:23.401122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=88 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:23.408184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.408639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.409419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.409863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.530659 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-38ffa390-6214-4f9e-8209-e2441aa00739 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "DELETE /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 204 len: 0 microversion: 2.1 time: 0.175372 Jul 26 04:40:23.531805 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1664/3252] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:23 2022] DELETE /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:23.542642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.543478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.552099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.552562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.553347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.553831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.646325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.658947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.660459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.661648 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b71fe12c-a0f2-4c9f-bcbf-1c386a64c95d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.268274 Jul 26 04:40:23.662242 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1589/3253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:23 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:40:23.667085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:23.667884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:23.676385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.676843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.677624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:23.678067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:23.682716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:23.789458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.803167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7269d885-9488-4376-b863-ed689e522b44 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1526 microversion: 2.1 time: 0.266383 Jul 26 04:40:23.805185 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1665/3254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:23 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1526 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:23.836965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:23.847159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-012faf62-5a20-4657-adc3-e79b6fdc17e9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1317 microversion: 2.1 time: 0.183723 Jul 26 04:40:23.847898 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1590/3255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:23 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:24.100701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:24.101622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:24.113116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.114142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.115940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.116827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.360420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:24.372591 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c20f72d6-b00c-43f5-ae7c-40180ef4e81a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.276050 Jul 26 04:40:24.373458 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1666/3256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:24 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:24.469884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8f20e9b6-7a8c-42f7-ace0-eded8fb1834b req-2abc8bca-6a4d-4320-95f1-fc0670c484c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "0b317ddc-d069-4f82-adae-d1c6e5f4802b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:24.481309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8f20e9b6-7a8c-42f7-ace0-eded8fb1834b req-2abc8bca-6a4d-4320-95f1-fc0670c484c0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.482220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8f20e9b6-7a8c-42f7-ace0-eded8fb1834b req-2abc8bca-6a4d-4320-95f1-fc0670c484c0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.500477 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8f20e9b6-7a8c-42f7-ace0-eded8fb1834b req-2abc8bca-6a4d-4320-95f1-fc0670c484c0 service nova] Creating event network-vif-plugged:0b317ddc-d069-4f82-adae-d1c6e5f4802b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:24.510136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8f20e9b6-7a8c-42f7-ace0-eded8fb1834b req-2abc8bca-6a4d-4320-95f1-fc0670c484c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044602 Jul 26 04:40:24.511102 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1591/3257] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:24.685859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:24.687542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:24.695257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.695738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.699050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.699757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.828870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:24.830221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:24.843592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.845775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:24.847197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:24.851007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.024816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.034759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.054085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.056652 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb339edc-0797-4875-8037-4480f3a5b422 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.373976 Jul 26 04:40:25.059331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1667/3258] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:24 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:25.077785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:25.081497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:25.096331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.096947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.098636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.099489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.099652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.110390 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8805c058-3219-4211-bdbc-2c31baf49d56 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1526 microversion: 2.1 time: 0.286656 Jul 26 04:40:25.111543 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1592/3259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:24 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:25.399182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:25.399797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:25.413552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.415101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.416047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.417045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.639034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.650935 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-276a865b-b973-44ff-92ac-e8076325e7fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1467 microversion: 2.1 time: 0.588149 Jul 26 04:40:25.651775 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1668/3260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:25 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1467 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:25.681917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:25.683245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:25.693351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.693820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.694643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:25.695088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:25.696199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:25.712434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0f5adb0-53b2-4fad-acea-a4a58d47f4f6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.317127 Jul 26 04:40:25.727919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1593/3261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:25 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:26.083098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:26.084372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:26.099181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.099995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.101019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.101766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.262292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b02fcfe0-4857-4f8f-b18f-ae156f830545 tempest-ServersOnMultiNodesTest-1143874541 tempest-ServersOnMultiNodesTest-1143874541-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1620 microversion: 2.1 time: 0.592539 Jul 26 04:40:26.264285 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1669/3262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:25 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1620 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:26.269637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:26.270442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:26.302821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.303576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.304561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.305194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.343135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.343853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.344469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lazy-loading 'fault' on Instance uuid 064d2b43-8e52-4edb-ae91-68e9c46427af {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:40:26.397788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56cb37e745f4ef6bcd8bc54969165c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88ec1896b5f475680b27b8a728ea3fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.407534 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61cebd2d-4379-45bf-b0b7-1d7b0049f3ea tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 200 len: 1314 microversion: 2.1 time: 0.141346 Jul 26 04:40:26.408364 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1670/3263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:26 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:26.425937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-360188b4-7aad-45c9-a74a-446b0db2d51e req-288b4bb4-70c6-493f-89a0-9997577d4150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064d2b43-8e52-4edb-ae91-68e9c46427af", "name": "network-vif-deleted", "tag": "7d64e038-c41b-4550-9256-20f52bb666ae"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:26.438244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-360188b4-7aad-45c9-a74a-446b0db2d51e req-288b4bb4-70c6-493f-89a0-9997577d4150 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.439364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-360188b4-7aad-45c9-a74a-446b0db2d51e req-288b4bb4-70c6-493f-89a0-9997577d4150 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.446690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.453638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-360188b4-7aad-45c9-a74a-446b0db2d51e req-288b4bb4-70c6-493f-89a0-9997577d4150 service nova] Creating event network-vif-deleted:7d64e038-c41b-4550-9256-20f52bb666ae for instance 064d2b43-8e52-4edb-ae91-68e9c46427af on n-h1-848886-16 Jul 26 04:40:26.459167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-360188b4-7aad-45c9-a74a-446b0db2d51e req-288b4bb4-70c6-493f-89a0-9997577d4150 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039089 Jul 26 04:40:26.460355 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1671/3264] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:26.463967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.465968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.466116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:26.466611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:26.468358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0100464f-4570-42b2-a90b-0a84c55a2b87 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.390129 Jul 26 04:40:26.470055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1594/3265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:26 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:26.478009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.479919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.481486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.482756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.515278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:26.551817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "2ae64922-ff5d-44c7-89c5-d34c8e95b633"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "e6c3d498-1a9e-4939-a012-995cbbff985b"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "2b593d86-fde5-4581-9219-47464ec7f35d"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "e7e068a4-8613-4ae4-8def-afe0aa160eb2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:26.569309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.570253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.586317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Creating event network-vif-plugged:2ae64922-ff5d-44c7-89c5-d34c8e95b633 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:26.589723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Creating event network-vif-plugged:e6c3d498-1a9e-4939-a012-995cbbff985b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:26.590499 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Creating event network-vif-plugged:2b593d86-fde5-4581-9219-47464ec7f35d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:26.591426 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] Creating event network-vif-plugged:e7e068a4-8613-4ae4-8def-afe0aa160eb2 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:26.599889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3d257cbf-70bf-4478-92ec-61d960a4dd56 req-bd55f145-192d-4fa3-af5a-24af4207ea4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.053492 Jul 26 04:40:26.601112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1595/3266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:26.618885 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75b17d5e-e435-422a-93e7-ea8314c72cbd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 204 len: 0 microversion: 2.1 time: 0.156893 Jul 26 04:40:26.619946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1672/3267] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:26 2022] DELETE /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:26.628597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:26.629559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:26.636971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.637778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.638676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.639357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.739292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:26.739989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:26.746821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.747272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.748046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:26.748477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:26.919930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.943065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:26.953752 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f015c74b-0dbd-4a07-ac17-5fa047066c3f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.220438 Jul 26 04:40:26.955682 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1673/3268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:26 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:26.962322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52de9456-a03f-47e9-be8c-e029f7e946d5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1473 microversion: 2.1 time: 0.338091 Jul 26 04:40:26.963556 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1596/3269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:26 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1473 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:27.430319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:27.431084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] [instance: 064d2b43-8e52-4edb-ae91-68e9c46427af] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:27.449891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.451398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:27.452773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.453417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:27.471237 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] HTTP exception thrown: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Request method failure captured: Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af HTTP/1.1 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33AkC7kgAkzQwkPnWCb7GWo_ScTDPlNEsHgpyDsTMH2NhXD7iZvojspwgeurx_cgpA5zs_SlNNGfkwILqW8qgzibAraNDBP05B2WvqwnMkBe9_J4qhbCT13eOVtNfyGAEziYe0LsPzePSIvgW4RgQDcWprYbnNDG-yNcl1LMfEgobUo Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b88ec1896b5f475680b27b8a728ea3fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b88ec1896b5f475680b27b8a728ea3fc Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2088713302 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a56cb37e745f4ef6bcd8bc54969165c3 Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2088713302-project Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '064d2b43-8e52-4edb-ae91-68e9c46427af'} Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:27.473333 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:27.478319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] Returning 404 to user: Instance 064d2b43-8e52-4edb-ae91-68e9c46427af could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:27.479810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5897922a-4088-4a16-8462-1758bd648361 tempest-ServerMetadataNegativeTestJSON-2088713302 tempest-ServerMetadataNegativeTestJSON-2088713302-project] 10.222.0.43 "GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af" status: 404 len: 111 microversion: 2.1 time: 0.053407 Jul 26 04:40:27.484569 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1674/3270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:27 2022] GET /compute/v2.1/servers/064d2b43-8e52-4edb-ae91-68e9c46427af => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:27.494198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:27.497247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:27.508090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.508816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:27.509604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.510081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:27.961032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:27.972907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:27.974728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:27.975599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:27.976269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:27.976409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00e2b0b3-70a3-4050-98e1-2b949f150a94 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.487132 Jul 26 04:40:27.977686 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1597/3271] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:27 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:27.984293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.985024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:27.985989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:27.986631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:28.001511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:28.002539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:28.009367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:28.010073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:28.011064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:28.011677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:28.032461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:28.163726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:28.175768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7985174-f571-4c96-a5b6-945e2efeb1c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.203885 Jul 26 04:40:28.176866 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1675/3272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:27 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:28.325128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:28.337597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b838559-a9a6-496c-a48c-31dc5dc10289 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1473 microversion: 2.1 time: 0.341703 Jul 26 04:40:28.350869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1598/3273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:27 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:28.620388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "452afe63-3b8d-477c-8d81-ac6cd7ed22f9"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-plugged", "status": "completed", "tag": "62e220ae-0d94-4379-8eec-40ace2a2643d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:28.637287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:28.638147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:28.659371 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] Creating event network-vif-plugged:452afe63-3b8d-477c-8d81-ac6cd7ed22f9 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:28.660519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] Creating event network-vif-plugged:62e220ae-0d94-4379-8eec-40ace2a2643d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:28.668017 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-21d11b02-2a18-4974-9ee9-e922b007e21b req-4b986bed-f0ce-4b71-995e-d34e8fa9a627 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051704 Jul 26 04:40:28.669527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1676/3274] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:40:29.003140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:29.004701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:29.014515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.015414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.017103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.017660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.198778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:29.199489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:29.211437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.212858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.215391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.216846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.442114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:29.455489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:29.457386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:29.458977 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce01d082-5fc3-4638-b466-412483fafc5e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.461872 Jul 26 04:40:29.460177 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1599/3275] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:28 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:29.466685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:29.473328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:29.473927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:29.482233 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-586f8061-375e-4adb-8d50-48b4f029b28d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.288717 Jul 26 04:40:29.482829 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1677/3276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:29 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:29.490971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.491479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.492511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.493124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.773653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:29.784802 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c2ba80b-8e08-41ce-a64e-2ed57123d186 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 200 len: 1431 microversion: 2.1 time: 0.323119 Jul 26 04:40:29.785971 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1600/3277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:29 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 1431 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:29.853300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-cf2a0ede-8e11-4460-ad99-ff8d4f1218a2 req-f1c8faff-ff07-43b6-8235-1c4caf3a2c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98553f54-cc85-497b-8343-59170b9275ab", "name": "network-vif-deleted", "tag": "630583a0-ad09-4252-ad9a-27331c5e426a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:29.870268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-cf2a0ede-8e11-4460-ad99-ff8d4f1218a2 req-f1c8faff-ff07-43b6-8235-1c4caf3a2c6a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:29.871290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-cf2a0ede-8e11-4460-ad99-ff8d4f1218a2 req-f1c8faff-ff07-43b6-8235-1c4caf3a2c6a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:29.896129 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-cf2a0ede-8e11-4460-ad99-ff8d4f1218a2 req-f1c8faff-ff07-43b6-8235-1c4caf3a2c6a service nova] Creating event network-vif-deleted:630583a0-ad09-4252-ad9a-27331c5e426a for instance 98553f54-cc85-497b-8343-59170b9275ab on n-h2-848886-16 Jul 26 04:40:29.907829 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-cf2a0ede-8e11-4460-ad99-ff8d4f1218a2 req-f1c8faff-ff07-43b6-8235-1c4caf3a2c6a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066091 Jul 26 04:40:29.911395 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1678/3278] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:30.486463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:30.487926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:30.507000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:30.508941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:30.519619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:30.520102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:30.520917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:30.521369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:30.524434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:30.528808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:30.530503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:30.535316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.006702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:31.019927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d0dd22e-93bc-49f1-91a7-68896c5f49a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.518054 Jul 26 04:40:31.020961 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1679/3279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:30 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:31.025831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:31.031549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98553f54-cc85-497b-8343-59170b9275ab] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:31.049587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.052984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.058321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.059176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.085337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:31.098041 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. Jul 26 04:40:31.101069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab HTTP/1.1 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '98553f54-cc85-497b-8343-59170b9275ab'} Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:31.101859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. Jul 26 04:40:31.106380 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:31.107025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:31.107025 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-857a3724-62a7-4556-8397-45ba58e7309e tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1875 microversion: 2.42 time: 0.624192 Jul 26 04:40:31.108368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 98553f54-cc85-497b-8343-59170b9275ab could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:31.109502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1601/3280] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:30 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1875 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:31.109712 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-48900e9a-6b17-44ee-bc7d-1a81692b47ef tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab" status: 404 len: 111 microversion: 2.1 time: 0.087354 Jul 26 04:40:31.110434 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1680/3281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:31 2022] GET /compute/v2.1/servers/98553f54-cc85-497b-8343-59170b9275ab => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:31.124137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:31.124846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:31.147425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.148011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.149388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.152030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.233377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:31.343780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7421a87-1f17-4a9a-afeb-e565ae47fa6d tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 204 len: 0 microversion: 2.1 time: 0.223857 Jul 26 04:40:31.344908 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1602/3282] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:31 2022] DELETE /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:40:31.356563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:31.357377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:31.365314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.365865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.366594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:31.367042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:31.766680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:31.783049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8de0cac8-1ffa-4006-a6ea-3f26ef49987a tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1472 microversion: 2.1 time: 0.431003 Jul 26 04:40:31.783667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1681/3283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:31 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:32.049144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:32.049869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:32.080131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.081017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.082809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.083289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.133978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:32.134959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:32.150370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.152590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.153590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.158115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.281505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:32.291027 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e9b6d42-1a5e-4535-916b-acb3f862af11 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.248724 Jul 26 04:40:32.292254 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1603/3284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:32 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:32.624506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:32.641257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:32.643179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:32.644777 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71aa9ef8-fb13-4d7e-b38f-5978665efeb2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2833 microversion: 2.42 time: 0.515627 Jul 26 04:40:32.645880 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1682/3285] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:40:32 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2833 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:32.670947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:32.671978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:32.679289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.680091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.681037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.681647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.805093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:32.805556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:32.815442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.815892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.820004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:32.820707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:32.920148 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3dcc10b-20b2-4b05-8d4f-914a7aca6af1 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.253634 Jul 26 04:40:32.921092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1604/3286] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:40:32 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec/os-interface => generated 1831 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:40:33.274399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:33.299915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37726aab-d636-4040-a1c2-651e94f70bdb tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1472 microversion: 2.1 time: 0.497766 Jul 26 04:40:33.302636 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1683/3287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:32 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:33.314903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:33.315690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:33.336810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:33.337788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:33.344558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:33.345423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:34.280322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fe7e0aad-b53f-47ad-b1fb-0a57197679f5 req-1e85d3d1-3c88-4371-b1ae-88db335fba2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e216677-4521-48a6-bb98-f66edea0cad3", "name": "network-vif-deleted", "tag": "bf158433-4407-4375-9405-21f8fbd17742"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:34.313057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe7e0aad-b53f-47ad-b1fb-0a57197679f5 req-1e85d3d1-3c88-4371-b1ae-88db335fba2d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:34.315684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe7e0aad-b53f-47ad-b1fb-0a57197679f5 req-1e85d3d1-3c88-4371-b1ae-88db335fba2d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:34.336480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:34.347057 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fe7e0aad-b53f-47ad-b1fb-0a57197679f5 req-1e85d3d1-3c88-4371-b1ae-88db335fba2d service nova] Creating event network-vif-deleted:bf158433-4407-4375-9405-21f8fbd17742 for instance 7e216677-4521-48a6-bb98-f66edea0cad3 on n-h1-848886-16 Jul 26 04:40:34.352763 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5354d8f6-3a45-4ee3-a900-bf815c506353 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 1.042835 Jul 26 04:40:34.360217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fe7e0aad-b53f-47ad-b1fb-0a57197679f5 req-1e85d3d1-3c88-4371-b1ae-88db335fba2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086999 Jul 26 04:40:34.361256 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1684/3288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:34.369128 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1605/3289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:33 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:34.375356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:34.379947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:34.391817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:34.394543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:34.395903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:34.397520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:34.916136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:34.930762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7aeaa879-1716-42d3-8360-d1dc2cd2761e tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 200 len: 1302 microversion: 2.1 time: 0.566679 Jul 26 04:40:34.933178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1685/3290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:34 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 1302 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:35.115151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bf86ac74-9822-4056-aef6-9979183dd41a req-40687ae0-55da-4753-a6f3-3d6be4149587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "tag": "e7e068a4-8613-4ae4-8def-afe0aa160eb2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:35.127386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf86ac74-9822-4056-aef6-9979183dd41a req-40687ae0-55da-4753-a6f3-3d6be4149587 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:35.128247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf86ac74-9822-4056-aef6-9979183dd41a req-40687ae0-55da-4753-a6f3-3d6be4149587 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:35.143273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bf86ac74-9822-4056-aef6-9979183dd41a req-40687ae0-55da-4753-a6f3-3d6be4149587 service nova] Creating event network-changed:e7e068a4-8613-4ae4-8def-afe0aa160eb2 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:40:35.149361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bf86ac74-9822-4056-aef6-9979183dd41a req-40687ae0-55da-4753-a6f3-3d6be4149587 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039245 Jul 26 04:40:35.155182 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1606/3291] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:40:35.378211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:35.379632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:35.392541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:35.393363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:35.394457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:35.399054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:35.719031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:35.736498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1555c18c-fec5-4237-8511-5daf2515b5ea tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.364975 Jul 26 04:40:35.750818 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1686/3292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:35 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:35.954732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:35.955544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 7e216677-4521-48a6-bb98-f66edea0cad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:35.974093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:35.974701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:35.975567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:35.977478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.013205 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 HTTP/1.1 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7e216677-4521-48a6-bb98-f66edea0cad3'} Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:36.016856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. Jul 26 04:40:36.021794 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:36.023234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 7e216677-4521-48a6-bb98-f66edea0cad3 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:36.024223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54ebac7a-be22-4ee5-b567-4ff0b6f5af49 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3" status: 404 len: 111 microversion: 2.1 time: 0.075002 Jul 26 04:40:36.026623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1607/3293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:35 2022] GET /compute/v2.1/servers/7e216677-4521-48a6-bb98-f66edea0cad3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:36.036217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:36.037383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:36.050017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.053616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.056580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.057164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.128997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:36.253286 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b75b14a2-0ea3-4d97-babe-000358ebd105 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 204 len: 0 microversion: 2.1 time: 0.220712 Jul 26 04:40:36.253926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1687/3294] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:36 2022] DELETE /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:36.263274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:36.264656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:36.278181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.278926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.280442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.280997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.291203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:36.570635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:36.582896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a4875a7-3a19-4857-bb72-5a7b5d2a3d14 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1472 microversion: 2.1 time: 0.323636 Jul 26 04:40:36.584486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1608/3295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:36 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:36.774412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:36.775187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:36.788889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.789362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:36.790784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:36.791843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:37.036465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:37.047014 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c2ff6cc-e6ff-4463-a28b-4876ba2ac163 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.278678 Jul 26 04:40:37.048238 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1688/3296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:36 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:37.606137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:37.608267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:37.615880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:37.616623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:37.617471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:37.617915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:37.910906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:37.926458 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c396edc-ed14-4961-bf66-ffcf28b708fa tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1472 microversion: 2.1 time: 0.324277 Jul 26 04:40:37.928276 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1609/3297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:37 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:38.068853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:38.069474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:38.088253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:38.089663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:38.091306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:38.092503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:38.340814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c864966d-63d2-45f5-a7a0-db23600351f3 req-a0bff86a-f886-4b6b-b17a-2870094914f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a21e2-e11f-4399-a490-a97692b87ad8", "name": "network-vif-deleted", "tag": "7a40aadb-af5a-469c-b367-d3f720231387"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:38.365741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c864966d-63d2-45f5-a7a0-db23600351f3 req-a0bff86a-f886-4b6b-b17a-2870094914f7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:38.369556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c864966d-63d2-45f5-a7a0-db23600351f3 req-a0bff86a-f886-4b6b-b17a-2870094914f7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:38.403321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c864966d-63d2-45f5-a7a0-db23600351f3 req-a0bff86a-f886-4b6b-b17a-2870094914f7 service nova] Creating event network-vif-deleted:7a40aadb-af5a-469c-b367-d3f720231387 for instance 499a21e2-e11f-4399-a490-a97692b87ad8 on n-h1-848886-16 Jul 26 04:40:38.411351 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c864966d-63d2-45f5-a7a0-db23600351f3 req-a0bff86a-f886-4b6b-b17a-2870094914f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075279 Jul 26 04:40:38.412826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1610/3298] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:38.449881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:38.461242 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9003159a-02b6-4f75-b854-1aa59892f968 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.396118 Jul 26 04:40:38.462215 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1689/3299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:38 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:38.952126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:38.952986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:38.967446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:38.968104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:38.968682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:38.969121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:39.045897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:39.046412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:39.047266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lazy-loading 'fault' on Instance uuid 499a21e2-e11f-4399-a490-a97692b87ad8 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:40:39.175672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:39.187059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-12447229-a037-4235-8f99-f87f101e9d0c tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 200 len: 1306 microversion: 2.1 time: 0.240495 Jul 26 04:40:39.191307 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1611/3300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:38 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 1306 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:39.484443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:39.485571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:39.499105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:39.500260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:39.501201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:39.503850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:39.816602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:39.824782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5191a09d-bd3d-4565-a8aa-002e0a138576 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.344798 Jul 26 04:40:39.838808 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1690/3301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:39 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:40.225051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:40.226387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 499a21e2-e11f-4399-a490-a97692b87ad8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:40.245608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.246594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.255472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.255953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.273546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 HTTP/1.1 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '499a21e2-e11f-4399-a490-a97692b87ad8'} Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:40.275721 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. Jul 26 04:40:40.281081 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:40.284329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 499a21e2-e11f-4399-a490-a97692b87ad8 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:40.289929 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe6aeb20-70d7-4ce2-8cb0-12a273799494 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8" status: 404 len: 111 microversion: 2.1 time: 0.072816 Jul 26 04:40:40.291143 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1612/3302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:40 2022] GET /compute/v2.1/servers/499a21e2-e11f-4399-a490-a97692b87ad8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:40.301468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:40.302225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:40.309416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.310119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.311553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.312169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.373252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:40.440356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:40.481320 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a88407fb-e90e-4ed2-a540-c3ad031bf5a2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 204 len: 0 microversion: 2.1 time: 0.184664 Jul 26 04:40:40.484676 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1691/3303] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:40 2022] DELETE /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:40.491450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:40.492105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:40.499405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.500581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.501536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.501988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.535158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:40.619440 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b978cd0e-45f7-49b6-b2af-54eeb60394e4 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 204 len: 0 microversion: 2.1 time: 0.131825 Jul 26 04:40:40.620147 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1613/3304] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:40 2022] DELETE /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:40.629762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:40.630485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:40.634588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:40.639071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.639840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.640623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.641057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.848945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:40.850067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:40.857619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.858425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.859458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:40.860139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:40.956280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:40.966070 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f27b65cd-c255-4f4f-9553-2b2ba63bf216 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 200 len: 1473 microversion: 2.1 time: 0.340551 Jul 26 04:40:40.968716 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1692/3305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:40 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:41.332600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:41.343389 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41297c7d-212e-4f06-a9bc-21d892965039 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.498735 Jul 26 04:40:41.371189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1614/3306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:40 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:41.993247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:41.993887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:42.007505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:42.008234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:42.009045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:42.009488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:42.369098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:42.369916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:42.384220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:42.387020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:42.389452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:42.396273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:42.931214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:42.942295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-27a4b0cc-2df8-456e-8f41-537f7b0e0546 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.577251 Jul 26 04:40:42.945552 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1615/3307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:42 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:42.959898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:42.989489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-971711e9-8c0a-49f7-8ecc-3beea02276be tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 200 len: 1473 microversion: 2.1 time: 1.001926 Jul 26 04:40:42.999805 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1693/3308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:41 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 1473 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:43.368068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c6fb718d-5c88-4427-8b44-0b0c89e65108 req-f31388c1-b6a1-4627-b7c7-fa9ff072f9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943fee86-3a28-4987-814c-61be59a28c5a", "name": "network-vif-deleted", "tag": "573774f4-b9bf-49f1-a1db-8608bd32d073"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:43.381345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c6fb718d-5c88-4427-8b44-0b0c89e65108 req-f31388c1-b6a1-4627-b7c7-fa9ff072f9f9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:43.382576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c6fb718d-5c88-4427-8b44-0b0c89e65108 req-f31388c1-b6a1-4627-b7c7-fa9ff072f9f9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:43.418920 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c6fb718d-5c88-4427-8b44-0b0c89e65108 req-f31388c1-b6a1-4627-b7c7-fa9ff072f9f9 service nova] Creating event network-vif-deleted:573774f4-b9bf-49f1-a1db-8608bd32d073 for instance 943fee86-3a28-4987-814c-61be59a28c5a on n-h2-848886-16 Jul 26 04:40:43.433529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c6fb718d-5c88-4427-8b44-0b0c89e65108 req-f31388c1-b6a1-4627-b7c7-fa9ff072f9f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068721 Jul 26 04:40:43.452341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1616/3309] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:43.456760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-12017c8f-e589-449f-97d9-cbc734adaf11 req-ddd419ee-3e58-4091-b55c-790408a66f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a8be1-306b-4a75-b21a-183197fdc398", "name": "network-vif-deleted", "tag": "e04cd38a-7dcc-4879-9393-8a5e57c5d305"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:43.487661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-12017c8f-e589-449f-97d9-cbc734adaf11 req-ddd419ee-3e58-4091-b55c-790408a66f04 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:43.488113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-12017c8f-e589-449f-97d9-cbc734adaf11 req-ddd419ee-3e58-4091-b55c-790408a66f04 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:43.519490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-12017c8f-e589-449f-97d9-cbc734adaf11 req-ddd419ee-3e58-4091-b55c-790408a66f04 service nova] Creating event network-vif-deleted:e04cd38a-7dcc-4879-9393-8a5e57c5d305 for instance 558a8be1-306b-4a75-b21a-183197fdc398 on n-h1-848886-16 Jul 26 04:40:43.530859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-12017c8f-e589-449f-97d9-cbc734adaf11 req-ddd419ee-3e58-4091-b55c-790408a66f04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079578 Jul 26 04:40:43.533512 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1694/3310] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:40:43.988437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:43.992630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:44.024120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:44.024831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:44.036761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:44.037226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:44.038027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:44.038540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:44.044438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:44.050849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:44.053622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:44.055737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:44.146393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:44.147251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:44.148220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lazy-loading 'fault' on Instance uuid 943fee86-3a28-4987-814c-61be59a28c5a {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:40:44.215909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:44.229970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6240a6c-b39d-4177-bb2e-fafda18e46ed tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 200 len: 1307 microversion: 2.1 time: 0.210309 Jul 26 04:40:44.235116 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1695/3311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:44 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:44.434069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:44.449941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f25ce225-c5de-4763-9a98-44cfec25bcf1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1499 microversion: 2.1 time: 0.486835 Jul 26 04:40:44.452108 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1617/3312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:43 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:45.253851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.254775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 943fee86-3a28-4987-814c-61be59a28c5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:45.280593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.281093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.281873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.282402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.316603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a HTTP/1.1 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '943fee86-3a28-4987-814c-61be59a28c5a'} Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:45.319180 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. Jul 26 04:40:45.323494 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.325653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 943fee86-3a28-4987-814c-61be59a28c5a could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:45.326984 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a56a156-8da6-4e29-981d-40654053fa75 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a" status: 404 len: 111 microversion: 2.1 time: 0.077253 Jul 26 04:40:45.328856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1696/3313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:45 2022] GET /compute/v2.1/servers/943fee86-3a28-4987-814c-61be59a28c5a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:45.337783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.338896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 558a8be1-306b-4a75-b21a-183197fdc398] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:45.352851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.355626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.356858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.360343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.394033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 HTTP/1.1 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '558a8be1-306b-4a75-b21a-183197fdc398'} Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:45.397720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. Jul 26 04:40:45.403581 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:45.405576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 558a8be1-306b-4a75-b21a-183197fdc398 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:45.408541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba1f0e3a-0c97-4300-b05c-1b85d6721016 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398" status: 404 len: 111 microversion: 2.1 time: 0.075815 Jul 26 04:40:45.412570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1618/3314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:45 2022] GET /compute/v2.1/servers/558a8be1-306b-4a75-b21a-183197fdc398 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:45.435667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bec265c-c584-4871-a547-ca8cdeb2fbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.476904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.477909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:45.489710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.496795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.498994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.501133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.582245 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2bec265c-c584-4871-a547-ca8cdeb2fbf9 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/939dc1d5-003f-4236-8a35-1a999d752e07" status: 204 len: 0 microversion: 2.1 time: 0.168058 Jul 26 04:40:45.583421 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1697/3315] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:40:45 2022] DELETE /compute/v2.1/os-server-groups/939dc1d5-003f-4236-8a35-1a999d752e07 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:45.593905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.594645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:45.630416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.633748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.636635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.638018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.712880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:45.911011 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b1f0062a-f5e7-482f-804b-8c99a46ab658 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 204 len: 0 microversion: 2.1 time: 0.320940 Jul 26 04:40:45.916311 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1698/3316] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:45 2022] DELETE /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:45.924598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:45.925442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:45.935518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.936789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:45.938326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:45.938952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.026095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:46.253999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cc4cb19-46ca-48c3-a457-76919ebf58fd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 204 len: 0 microversion: 2.1 time: 0.335383 Jul 26 04:40:46.256230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1699/3317] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:45 2022] DELETE /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:46.271539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:46.272417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:46.285675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.287678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.290984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.292360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.421532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:46.434612 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14b17ad2-395e-434c-a899-988ce2d5cfa4 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 200 len: 1476 microversion: 2.1 time: 0.959141 Jul 26 04:40:46.436285 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1619/3318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:45 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 1476 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:46.457659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1496158264"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:46.460444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:46.471759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.472228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.473027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.481476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.537123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:46.550435 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb4d4815-88fa-4e4f-ad72-3ad96319c04f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1474 microversion: 2.1 time: 0.289066 Jul 26 04:40:46.565209 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1700/3319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:46 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:46.772722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e587c23-1f9f-4f03-9f87-39855482bb21 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12/action" status: 202 len: 0 microversion: 2.1 time: 0.318660 Jul 26 04:40:46.774050 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1620/3320] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:40:46 2022] POST /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:40:46.781408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10af860e-f41f-4db7-92ff-6b39d01ee729"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:46.784504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:46.792000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.793083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.795297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:46.795925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:46.885612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-755042054", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "e1194655-f825-4935-8bd4-863c798f2ced"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:46.992526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] validate_networks() for [('e1194655-f825-4935-8bd4-863c798f2ced', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:40:47.422128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06877219-c853-4348-ae27-3cbd76e3409e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645181 Jul 26 04:40:47.424863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1621/3321] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:40:46 2022] POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:47.458432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9d499d6-df31-4398-853e-0319887132b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bab381f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:47.568820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9d499d6-df31-4398-853e-0319887132b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.139145 Jul 26 04:40:47.572565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1622/3322] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:47 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:47.605283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:47.606137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:47.626312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:47.627734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:47.629827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:47.630412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:47.686304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:40:47.686807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:40:47.687443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:40:47.688056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:40:47.689331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:40:47.703397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:47.704938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:47.706257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:47.706902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:47.728964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Getting quotas for project 449aabe7aa7c435abd8dd63aba6082c9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:40:47.736131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Getting quotas for user c5e221db066c45908d089add5de3983b and project 449aabe7aa7c435abd8dd63aba6082c9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:40:47.785399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:40:47.788510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:40:47.852640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd3b7e8b-6aee-4b9c-895f-4bc11485dd0b tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285768 Jul 26 04:40:47.853505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1701/3323] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:40:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:40:47.867242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9bcc3d92-e8e3-439e-bb0b-267587c4d848 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:47.869324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9bcc3d92-e8e3-439e-bb0b-267587c4d848 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:47.986420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9bcc3d92-e8e3-439e-bb0b-267587c4d848 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:47.999156 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9bcc3d92-e8e3-439e-bb0b-267587c4d848 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1215 microversion: 2.1 time: 0.138572 Jul 26 04:40:48.003664 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1702/3324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:47 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:48.442895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:48.446824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:48.455072 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f388610f-5557-4d96-937d-2d3117c510dd tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1474 microversion: 2.1 time: 0.876681 Jul 26 04:40:48.459113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1623/3325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:47 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1474 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:48.587402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b89c973-53e5-429b-9124-0581013eb802 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38babf3550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:48.690673 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b89c973-53e5-429b-9124-0581013eb802 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.107177 Jul 26 04:40:48.703456 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1703/3326] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:48 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:49.033119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:49.033787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:49.065472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:49.065934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:49.066780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:49.067224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:49.481025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:49.482533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:49.498621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:49.499556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:49.502904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:49.503965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:49.656078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:49.670926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-23525e35-4837-4c73-91c8-2b3db9e1aa95 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1211 microversion: 2.1 time: 0.644635 Jul 26 04:40:49.671524 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1624/3327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:49 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1211 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:49.708575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b829065d-7b74-4c39-94f9-2e0343f6af24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5f76550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:49.787774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b829065d-7b74-4c39-94f9-2e0343f6af24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.083644 Jul 26 04:40:49.792176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1625/3328] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:49 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:50.115507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:50.138235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8650b2e-8fc0-4fa6-b929-0003d667cf17 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1474 microversion: 2.1 time: 0.652184 Jul 26 04:40:50.139494 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1704/3329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:49 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1474 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:50.484111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-61163d61-1f14-45b9-aefb-ca5d03e99a09 req-cf2f1b0e-f411-488a-a675-f2e896ca5ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138a22ae-b68f-4262-9183-ae3202881194", "name": "network-vif-deleted", "tag": "e41b8a17-2a92-4fa5-ba91-a98872327e8a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:50.522970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61163d61-1f14-45b9-aefb-ca5d03e99a09 req-cf2f1b0e-f411-488a-a675-f2e896ca5ba2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:50.534982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61163d61-1f14-45b9-aefb-ca5d03e99a09 req-cf2f1b0e-f411-488a-a675-f2e896ca5ba2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:50.573451 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-61163d61-1f14-45b9-aefb-ca5d03e99a09 req-cf2f1b0e-f411-488a-a675-f2e896ca5ba2 service nova] Creating event network-vif-deleted:e41b8a17-2a92-4fa5-ba91-a98872327e8a for instance 138a22ae-b68f-4262-9183-ae3202881194 on n-h1-848886-16 Jul 26 04:40:50.595430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-61163d61-1f14-45b9-aefb-ca5d03e99a09 req-cf2f1b0e-f411-488a-a675-f2e896ca5ba2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116411 Jul 26 04:40:50.596050 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1626/3330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:50.692388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:50.693328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:50.704997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:50.713240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:50.714388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:50.715138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:50.803145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00e93d95-fe41-47fd-9752-a2b8f2ad9f7c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5de5670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:50.905645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00e93d95-fe41-47fd-9752-a2b8f2ad9f7c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.106646 Jul 26 04:40:50.914330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1627/3331] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:50 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:40:51.128662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:51.146985 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-abb6b975-1099-4915-89ab-434284bfebb8 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1273 microversion: 2.1 time: 0.458560 Jul 26 04:40:51.172241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:51.174768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:51.179609 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1705/3332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:50 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:51.191985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:51.199280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7bc128fa-96fc-4cf9-9ced-328ddfb785e6 req-3b1a0efb-51c7-435c-9142-181b9bc95ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8903bf4f-431a-45e1-8284-16a0550064d6", "name": "network-vif-deleted", "tag": "fc53b2dd-3497-4981-90a1-902aaf8d699a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:51.203383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:51.204706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:51.209054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:51.238704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7bc128fa-96fc-4cf9-9ced-328ddfb785e6 req-3b1a0efb-51c7-435c-9142-181b9bc95ffa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:51.239139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7bc128fa-96fc-4cf9-9ced-328ddfb785e6 req-3b1a0efb-51c7-435c-9142-181b9bc95ffa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:51.289620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7bc128fa-96fc-4cf9-9ced-328ddfb785e6 req-3b1a0efb-51c7-435c-9142-181b9bc95ffa service nova] Creating event network-vif-deleted:fc53b2dd-3497-4981-90a1-902aaf8d699a for instance 8903bf4f-431a-45e1-8284-16a0550064d6 on n-h1-848886-16 Jul 26 04:40:51.304106 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7bc128fa-96fc-4cf9-9ced-328ddfb785e6 req-3b1a0efb-51c7-435c-9142-181b9bc95ffa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109366 Jul 26 04:40:51.304970 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1706/3333] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:40:51.881366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:51.899707 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3bafe3c5-46b2-4502-af04-350d75d015f2 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 200 len: 1432 microversion: 2.1 time: 0.743153 Jul 26 04:40:51.900348 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1628/3334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:51 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 1432 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:51.935319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1053e936-f976-4289-b624-f61d92f5a804 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a49c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:52.055477 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1053e936-f976-4289-b624-f61d92f5a804 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.137979 Jul 26 04:40:52.058483 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1707/3335] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:51 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:52.172112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:52.173015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:52.192776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:52.211671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:52.212553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:52.213047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:52.862736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:52.875798 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99eb2e8e-1502-4807-ac34-174dd2b6d356 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.708375 Jul 26 04:40:52.876669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1629/3336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:52 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:52.921958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:52.923268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 8903bf4f-431a-45e1-8284-16a0550064d6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:52.966504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:52.969062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:52.988986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:52.989686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.033552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 HTTP/1.1 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8903bf4f-431a-45e1-8284-16a0550064d6'} Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:53.042234 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. Jul 26 04:40:53.048661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.051191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 8903bf4f-431a-45e1-8284-16a0550064d6 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:53.053813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ada49d98-14c6-4f25-b7f0-6d17d7c04d41 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6" status: 404 len: 111 microversion: 2.1 time: 0.135111 Jul 26 04:40:53.058723 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1708/3337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:52 2022] GET /compute/v2.1/servers/8903bf4f-431a-45e1-8284-16a0550064d6 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:53.068071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:53.071117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 138a22ae-b68f-4262-9183-ae3202881194] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:53.073265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e198bcbd-2cca-43c2-9587-d4adf0041ae9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f143a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:53.111523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.113075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.119509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.120320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.193307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 HTTP/1.1 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '138a22ae-b68f-4262-9183-ae3202881194'} Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:53.197208 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. Jul 26 04:40:53.205303 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:40:53.206246 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e198bcbd-2cca-43c2-9587-d4adf0041ae9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.136345 Jul 26 04:40:53.215252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 138a22ae-b68f-4262-9183-ae3202881194 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:53.218863 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fdc75092-7d9a-4318-8d24-2f6a1ecad5b5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194" status: 404 len: 111 microversion: 2.1 time: 0.159649 Jul 26 04:40:53.220766 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1709/3338] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:53 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:53.221500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1630/3339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:53 2022] GET /compute/v2.1/servers/138a22ae-b68f-4262-9183-ae3202881194 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:53.245764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2adfe850-357b-4bfd-a1ac-209b2a201e26 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:53.362814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2adfe850-357b-4bfd-a1ac-209b2a201e26 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/8b069c89-60d3-43e6-8197-6e1588d56a96" status: 204 len: 0 microversion: 2.1 time: 0.134557 Jul 26 04:40:53.365963 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1710/3340] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Jul 26 04:40:53 2022] DELETE /compute/v2.1/os-server-groups/8b069c89-60d3-43e6-8197-6e1588d56a96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:53.373430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:53.374090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:53.390506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.391723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.400356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.402462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.486385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:53.711915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:53.761534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8534c314-3dda-4bf9-8d7f-a2527470b24f tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "DELETE /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 204 len: 0 microversion: 2.1 time: 0.392802 Jul 26 04:40:53.766248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1631/3341] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:53 2022] DELETE /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:53.778048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:53.780256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:53.794424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.794876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.795665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:53.796102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:53.891995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bca72bfa-5cb7-4baf-b1ef-4bb4224418d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Action: 'create', calling method: .version_select at 0x7f38b5f6b670>, body: {"keypair": {"name": "tempest-keypair-1000587366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqy4akZPhDg2FUFUk+mAxoLHszf7/BnaTeOMZSDV9ZthL6PQY5u2dggnXssueUCZDnouD5+Hn5b6igOjnT9Khjibyt4e5DjocSYDPAuOUCpHeOkAA9mxfjVxJYMyM8r5w=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:53.953531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bca72bfa-5cb7-4baf-b1ef-4bb4224418d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Getting quotas for project 857998361fc2488f978c76241a4adaf7. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:40:53.965927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bca72bfa-5cb7-4baf-b1ef-4bb4224418d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Getting quotas for user d168d536863c44b3804754cae5757c58 and project 857998361fc2488f978c76241a4adaf7. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:40:54.001288 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bca72bfa-5cb7-4baf-b1ef-4bb4224418d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.122620 Jul 26 04:40:54.015175 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1632/3342] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:40:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:54.028709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:54.031020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:54.053591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:54.054054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:54.056746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:54.058856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:54.234484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:54.249923 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e8a5af6-13a5-4edc-ab9b-9611ff2e1d61 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1471 microversion: 2.1 time: 0.480596 Jul 26 04:40:54.255873 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1711/3343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:53 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:54.280811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-030f8696-7082-40fd-b2e6-47935caa2ee3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f14820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:54.377770 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-030f8696-7082-40fd-b2e6-47935caa2ee3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.107319 Jul 26 04:40:54.378379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1712/3344] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:54 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:54.645167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:54.659406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fdff025f-01e3-4c76-b5b7-3da84c47890d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.642903 Jul 26 04:40:54.660685 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1633/3345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:54 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:54.875316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-96a977df-38a1-4a3f-9f6c-99d21f26a1a6 req-60cd59f0-b30c-44a0-ab55-5236874d08e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f2e135-ca96-4ec0-8a04-6d8a8d8879b3", "tag": "f0a6f525-50ca-4a72-8d8d-951f1c285187"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:54.905007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96a977df-38a1-4a3f-9f6c-99d21f26a1a6 req-60cd59f0-b30c-44a0-ab55-5236874d08e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:54.905366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96a977df-38a1-4a3f-9f6c-99d21f26a1a6 req-60cd59f0-b30c-44a0-ab55-5236874d08e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:54.925302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-96a977df-38a1-4a3f-9f6c-99d21f26a1a6 req-60cd59f0-b30c-44a0-ab55-5236874d08e2 service nova] Creating event network-changed:f0a6f525-50ca-4a72-8d8d-951f1c285187 for instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 on n-h1-848886-16 Jul 26 04:40:54.931098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-96a977df-38a1-4a3f-9f6c-99d21f26a1a6 req-60cd59f0-b30c-44a0-ab55-5236874d08e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061290 Jul 26 04:40:54.933977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1713/3346] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:55.282691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:55.283312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:55.300175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:55.300635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:55.301430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:55.301873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:55.406660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec5c4017-c59c-4f86-b971-ff52833466ba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f73b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:55.486718 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec5c4017-c59c-4f86-b971-ff52833466ba tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.096566 Jul 26 04:40:55.488316 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1714/3347] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:55 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:55.697760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:55.700069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:55.713304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:55.714579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:55.715927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:55.716740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:55.835521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:55.849836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2407932d-5d74-4e7c-a474-8440af94ff2b tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1471 microversion: 2.1 time: 0.571653 Jul 26 04:40:55.852210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1634/3348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:55 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1471 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:56.103965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:56.122874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d25e0f88-b73f-4cf4-8dc6-85c0296640a6 req-19f8e2a1-9a69-498b-97ac-1f6621fd200c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c518e51c-de3f-4b20-a9b2-0d9805d73e12", "name": "network-vif-plugged", "status": "completed", "tag": "581ead2d-71b7-4be2-be27-68b81fbbb8f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:56.139787 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d931dafb-fc70-4fdb-96da-f3dcf8aa60a4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.447612 Jul 26 04:40:56.156634 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1715/3349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:55 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:56.165472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d25e0f88-b73f-4cf4-8dc6-85c0296640a6 req-19f8e2a1-9a69-498b-97ac-1f6621fd200c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:56.165923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d25e0f88-b73f-4cf4-8dc6-85c0296640a6 req-19f8e2a1-9a69-498b-97ac-1f6621fd200c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:56.200779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d25e0f88-b73f-4cf4-8dc6-85c0296640a6 req-19f8e2a1-9a69-498b-97ac-1f6621fd200c service nova] Creating event network-vif-plugged:581ead2d-71b7-4be2-be27-68b81fbbb8f6 for instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 on n-h2-848886-16 Jul 26 04:40:56.216018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d25e0f88-b73f-4cf4-8dc6-85c0296640a6 req-19f8e2a1-9a69-498b-97ac-1f6621fd200c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101169 Jul 26 04:40:56.223346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1635/3350] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:56.502987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-daaba950-d44a-4e70-80ab-551548bccabd tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b509d940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:56.583857 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-daaba950-d44a-4e70-80ab-551548bccabd tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.084865 Jul 26 04:40:56.591890 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1716/3351] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:56 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:56.874869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:56.875687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:56.887016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:56.888040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:56.889029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:56.889506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.165681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:57.166420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:57.187873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:57.189813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.193067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:57.194858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.277110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:57.367881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8f07914c3944709e6fa1bf613255bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b021402842234f30a0c3464f83ef416c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:57.412133 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2b0a8f8-dbda-4e3c-8130-2cc756ad40fe tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 200 len: 1471 microversion: 2.1 time: 0.543248 Jul 26 04:40:57.417602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1636/3352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:56 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:57.475413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a87f1766-1c34-4c58-9594-67647ca087a4 req-c68f1367-49aa-41f1-b574-2757ba16ee5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f46604-10b1-44f0-9e50-56a9f36f6f8e", "name": "network-vif-deleted", "tag": "ed81efa3-388c-46d5-a6ea-de855a9706fb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:57.498596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a87f1766-1c34-4c58-9594-67647ca087a4 req-c68f1367-49aa-41f1-b574-2757ba16ee5b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:57.499335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a87f1766-1c34-4c58-9594-67647ca087a4 req-c68f1367-49aa-41f1-b574-2757ba16ee5b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.533349 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a87f1766-1c34-4c58-9594-67647ca087a4 req-c68f1367-49aa-41f1-b574-2757ba16ee5b service nova] Creating event network-vif-deleted:ed81efa3-388c-46d5-a6ea-de855a9706fb for instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e on n-h2-848886-16 Jul 26 04:40:57.552412 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a87f1766-1c34-4c58-9594-67647ca087a4 req-c68f1367-49aa-41f1-b574-2757ba16ee5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127647 Jul 26 04:40:57.557612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1637/3353] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:40:57.566198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:57.567104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:57.629890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:57.633814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.635488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:57.638661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:57.719336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:57.768777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:40:57.838286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:57.865176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bffee7ae-b265-492d-ad18-a5791febfe75 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.705353 Jul 26 04:40:57.869304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1717/3354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:57 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:57.892535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6baa5f51-abc5-4920-9825-37f6a9cda922 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4fa6b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:57.971768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6baa5f51-abc5-4920-9825-37f6a9cda922 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.100125 Jul 26 04:40:57.978008 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1718/3355] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:57 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:58.133307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-578369ab-65b1-448b-9bde-c376ce781888 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "DELETE /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 204 len: 0 microversion: 2.1 time: 0.567582 Jul 26 04:40:58.134180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1638/3356] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:40:57 2022] DELETE /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:40:58.143255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:58.144458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:58.160802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:58.197483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.203168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:58.204595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.205228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:58.352721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-881613973", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e2660851-5152-4101-8186-5398c818e517"}, {"port": "498366f2-b698-4228-a825-f1e1babe35bc", "tag": "port-1"}, {"port": "7f898f01-f7ce-4201-b9dd-4572689bcdd3", "tag": "port-2"}, {"uuid": "5c767a45-fac5-40a9-804f-01f2acf452fd", "tag": "net-1"}, {"uuid": "5c767a45-fac5-40a9-804f-01f2acf452fd"}, {"uuid": "0c3a7e29-11db-4fa7-bfe4-7107540d56ec", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0c3a7e29-11db-4fa7-bfe4-7107540d56ec", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7a0bd335-37b8-4f9a-ad7b-5cda338f3fda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "eb36869a-fac2-432a-9f44-a0238c169be4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "995448b8-bda4-468a-836d-01868e1cf7f4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--114993863"}], "key_name": "tempest-keypair-1000587366", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:40:58.479470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:58.497729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3696e59b-16d4-40f9-82b8-539cc5a812af tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1665 microversion: 2.1 time: 0.356516 Jul 26 04:40:58.498442 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1719/3357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:58 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1665 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:58.503364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:58.503987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] [instance: 98f46604-10b1-44f0-9e50-56a9f36f6f8e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:58.520664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.521120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:58.521976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.522460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:58.530337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] validate_networks() for [('e2660851-5152-4101-8186-5398c818e517', None, None, None, None, None), (None, None, '498366f2-b698-4228-a825-f1e1babe35bc', None, None, None), (None, None, '7f898f01-f7ce-4201-b9dd-4572689bcdd3', None, None, None), ('5c767a45-fac5-40a9-804f-01f2acf452fd', None, None, None, None, None), ('5c767a45-fac5-40a9-804f-01f2acf452fd', None, None, None, None, None), ('0c3a7e29-11db-4fa7-bfe4-7107540d56ec', '10.2.2.100', None, None, None, None), ('0c3a7e29-11db-4fa7-bfe4-7107540d56ec', '10.2.2.200', None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:40:58.543840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] HTTP exception thrown: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Request method failure captured: Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e HTTP/1.1 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi3291wCpW72g1Wq2aZnRQPZ6AvZQIFDU671bm0PoS4RxowRYcOa5pZQqQduF468wArOSSGoKDv1KMj41VEemAvi9cZSvNYuhpqdDKPUZ6TwCZaeLDZz80ZqP1IyDwFdyHe1vPjCcyCV5nNRw-MQNnJ0JQ1Jd2kJTZwEwZ0HpYMgZA6Xg Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b021402842234f30a0c3464f83ef416c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b021402842234f30a0c3464f83ef416c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b021402842234f30a0c3464f83ef416c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b021402842234f30a0c3464f83ef416c Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1719298790 Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2c8f07914c3944709e6fa1bf613255bc Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersOnMultiNodesTest-1719298790-project Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '98f46604-10b1-44f0-9e50-56a9f36f6f8e'} Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:40:58.546050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] Returning 404 to user: Instance 98f46604-10b1-44f0-9e50-56a9f36f6f8e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:40:58.551550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2bb2d451-7435-4eb2-a765-0c798fe88bd5 tempest-ServersOnMultiNodesTest-1719298790 tempest-ServersOnMultiNodesTest-1719298790-project] 10.222.0.43 "GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e" status: 404 len: 111 microversion: 2.1 time: 0.048288 Jul 26 04:40:58.552958 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1720/3358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:58 2022] GET /compute/v2.1/servers/98f46604-10b1-44f0-9e50-56a9f36f6f8e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:40:58.892964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:58.893723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:58.909351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.914994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:58.917397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:58.920622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:59.182981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:59.194498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a20a97d-4878-4ea8-b343-fcd96aac4bce tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.308251 Jul 26 04:40:59.212504 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1721/3359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:58 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:59.219669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fe0a5d4-ae1f-4c88-8346-3b69775cf2aa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b51abb80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:59.322626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fe0a5d4-ae1f-4c88-8346-3b69775cf2aa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.106562 Jul 26 04:40:59.346193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1722/3360] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:40:59 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:40:59.519095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:40:59.520039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:40:59.535014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:59.538258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:59.542899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:40:59.544451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:40:59.851008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:40:59.860954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a8d59ba-713e-4532-9197-141ec417d5f6 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1665 microversion: 2.1 time: 0.345967 Jul 26 04:40:59.868608 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1723/3361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:40:59 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1665 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:00.217922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:00.220280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:00.232423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:00.238737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:00.239716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:00.240283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:00.641315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:00.661129 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca544c25-756b-47ca-a007-0ad50a6963b4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.448368 Jul 26 04:41:00.666531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1724/3362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:00 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:00.673887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a4d31ee-d0f7-4008-91e4-00cdc31136be tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38bab281f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:00.770095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a4d31ee-d0f7-4008-91e4-00cdc31136be tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.101646 Jul 26 04:41:00.771001 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1725/3363] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:00 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:00.888999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:00.889705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:00.902227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:00.902733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:00.911880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:00.912716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:01.427235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:01.437610 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f17f874b-7370-4938-bb8d-f5effb9bc775 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1665 microversion: 2.1 time: 0.553575 Jul 26 04:41:01.445346 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1726/3364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:00 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1665 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:01.486172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-aa009e8d-3455-4f26-a06e-9916fe0b3064 req-4b1a144f-b05f-4360-ad63-d3b0c29f6f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f2e135-ca96-4ec0-8a04-6d8a8d8879b3", "name": "network-vif-plugged", "status": "completed", "tag": "f0a6f525-50ca-4a72-8d8d-951f1c285187"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:01.540750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa009e8d-3455-4f26-a06e-9916fe0b3064 req-4b1a144f-b05f-4360-ad63-d3b0c29f6f30 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:01.541312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-aa009e8d-3455-4f26-a06e-9916fe0b3064 req-4b1a144f-b05f-4360-ad63-d3b0c29f6f30 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:01.577112 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-aa009e8d-3455-4f26-a06e-9916fe0b3064 req-4b1a144f-b05f-4360-ad63-d3b0c29f6f30 service nova] Creating event network-vif-plugged:f0a6f525-50ca-4a72-8d8d-951f1c285187 for instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 on n-h1-848886-16 Jul 26 04:41:01.586764 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-aa009e8d-3455-4f26-a06e-9916fe0b3064 req-4b1a144f-b05f-4360-ad63-d3b0c29f6f30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121642 Jul 26 04:41:01.589865 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1727/3365] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:01.692162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:01.693273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:01.716619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:01.720938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:01.724402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:01.725378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:02.309871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:02.322266 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8dc8e8c-2b4a-45f5-b7c1-9138c408ad80 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1315 microversion: 2.1 time: 0.630396 Jul 26 04:41:02.334734 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1728/3366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:01 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:02.358445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d54b768d-8c45-4759-8fba-a6f7825ae470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38babed700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:02.477923 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d54b768d-8c45-4759-8fba-a6f7825ae470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.141048 Jul 26 04:41:02.478702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1729/3367] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:02 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:02.484259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:02.491607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:02.504670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:02.505904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:02.508393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:02.508393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:02.622407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9bcfdda3f7431192eb5abeb110e192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98487227d9c4aa3bab7756d9a13406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:02.636118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54abfe3a-2117-419d-a249-0677e299e55e tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 200 len: 1597 microversion: 2.1 time: 0.155099 Jul 26 04:41:02.640253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1730/3368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:02 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:02.654462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-451dd2bb-ac01-4451-a228-1ba62392fca5 req-fd5e51d7-0bf8-4eba-9b3a-2033d293a016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f8fda7-f463-4845-893c-e4e319496d87", "name": "network-vif-deleted", "tag": "f2adf75f-88e3-41f2-84ef-1c299a9083ee"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:02.671948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:02.692285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-451dd2bb-ac01-4451-a228-1ba62392fca5 req-fd5e51d7-0bf8-4eba-9b3a-2033d293a016 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:02.694950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-451dd2bb-ac01-4451-a228-1ba62392fca5 req-fd5e51d7-0bf8-4eba-9b3a-2033d293a016 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:02.746763 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-451dd2bb-ac01-4451-a228-1ba62392fca5 req-fd5e51d7-0bf8-4eba-9b3a-2033d293a016 service nova] Creating event network-vif-deleted:f2adf75f-88e3-41f2-84ef-1c299a9083ee for instance 94f8fda7-f463-4845-893c-e4e319496d87 on n-h2-848886-16 Jul 26 04:41:02.770858 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-451dd2bb-ac01-4451-a228-1ba62392fca5 req-fd5e51d7-0bf8-4eba-9b3a-2033d293a016 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126771 Jul 26 04:41:02.774881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1731/3369] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:03.348630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:03.349239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:03.368562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:03.369091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:03.370061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:03.370557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:03.878897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:03.889513 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9acc0e9-6ddb-41e3-9529-05ac50baf9fb tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1502 microversion: 2.1 time: 0.547463 Jul 26 04:41:03.896412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1732/3370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:03 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1502 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:03.907674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b21f0241-46a7-43a7-a2c8-029395215712 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38babf3160>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:03.979744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:04.012105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b21f0241-46a7-43a7-a2c8-029395215712 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.111621 Jul 26 04:41:04.014875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1733/3371] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:03 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:04.032456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:04.034778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] [instance: 94f8fda7-f463-4845-893c-e4e319496d87] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:04.068018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.068880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.070169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.072896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.120445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] HTTP exception thrown: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Request method failure captured: Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 HTTP/1.1 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_WwTNVAUECVYc1ZetMZ2be1of03OuXqxoq2gxODKJCJn7P1iJhGtYCPLEdepDR0ebVb1_M935tdPZ5whwcwcKu38zqoN9bY4iR9L1J4WX7oeg-lZu0nTtcgQKdkHlnbkRjHDMY-uzl0U1KV5ad9jPBZZtVHDO28mdDXOBx0bXvYG4 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e98487227d9c4aa3bab7756d9a13406d Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestFqdnHostnames-1550189762 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e98487227d9c4aa3bab7756d9a13406d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e98487227d9c4aa3bab7756d9a13406d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e98487227d9c4aa3bab7756d9a13406d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e98487227d9c4aa3bab7756d9a13406d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestFqdnHostnames-1550189762 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e98487227d9c4aa3bab7756d9a13406d Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1550189762 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestFqdnHostnames-1550189762-project Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 7d9bcfdda3f7431192eb5abeb110e192 Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestFqdnHostnames-1550189762-project Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '94f8fda7-f463-4845-893c-e4e319496d87'} Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:04.134320 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. Jul 26 04:41:04.140599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.143041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Returning 404 to user: Instance 94f8fda7-f463-4845-893c-e4e319496d87 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:04.146783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-98790352-f51f-4331-9b5e-a176f66b2c50 tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87" status: 404 len: 111 microversion: 2.1 time: 0.130727 Jul 26 04:41:04.151945 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1734/3372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:04 2022] GET /compute/v2.1/servers/94f8fda7-f463-4845-893c-e4e319496d87 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:41:04.174813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:04.175755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:04.187861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.188570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.190844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.193048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.286105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:04.287083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:04.287675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:04.288193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:04.289184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:04.310481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.311887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.313804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.315195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.331336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3e52f1c-ac75-47ae-827b-913bb44ec052 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.177481 Jul 26 04:41:04.332979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1735/3373] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Jul 26 04:41:04 2022] DELETE /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3/os-server-password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:41:04.339813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08773ab1-8cd7-4928-9f80-39242290430a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] Calling method '.version_select at 0x7f38b4fa6dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:04.365884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Getting quotas for project 857998361fc2488f978c76241a4adaf7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:04.372213 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08773ab1-8cd7-4928-9f80-39242290430a tempest-ServersTestFqdnHostnames-1550189762 tempest-ServersTestFqdnHostnames-1550189762-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842271856" status: 202 len: 0 microversion: 2.1 time: 0.036026 Jul 26 04:41:04.375296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1736/3374] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842271856 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:41:04.381802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Getting quotas for user d168d536863c44b3804754cae5757c58 and project 857998361fc2488f978c76241a4adaf7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:04.812248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5a49d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:04.815572 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:04.815572 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:04.816795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.820124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.843279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.844051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.864592 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] HTTP exception thrown: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Request method failure captured: Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c HTTP/1.1 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 56 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33BgAWWxPyGHHWox8PA6nylJidbyH0woK59B8nlo35a00j0TXsKns5tkHwyevvJvGIkiDXIhqmkQjL47Pzt-6K0YUvE_tlyYAxiQPl9bI7RzYbUHxDZ45cHY4qWM4IYwi-QQSzf68Qtii0nZS3CuQflvbIySp_tA0_nSpslZRPol86w Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a309856e39be4922b1ba88e4c2812090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14f33487e3b345b3b6ac8bc0d7d52e59 Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: exception: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '81b7f31d-fed5-445f-b38c-2274e607e08c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:41:04.870859 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Returning 404 to user: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54cbcacc-8aba-4ae8-9bb5-fa747d6796e9 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c" status: 404 len: 110 microversion: 2.53 time: 0.498080 Jul 26 04:41:04.881768 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1737/3375] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Jul 26 04:41:04 2022] PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c => generated 110 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:41:04.889828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:41:04.889828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7a0bd335-37b8-4f9a-ad7b-5cda338f3fda',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='eb36869a-fac2-432a-9f44-a0238c169be4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='995448b8-bda4-468a-836d-01868e1cf7f4',volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:41:04.895455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:04.895960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:04.915908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.916611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.919389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:04.920029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:04.999333 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f2fc6849-a004-4c57-bcaf-742b4c20f918 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.120281 Jul 26 04:41:05.010462 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1738/3376] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Jul 26 04:41:04 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3/os-server-password => generated 16 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:41:05.022656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Action: 'update', calling method: .version_select at 0x7f38b5005af0>, body: {"status": "disabled"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:05.025968 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:05.025968 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:05.027975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.029553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.036314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.037034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.044040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] HTTP exception thrown: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Request method failure captured: Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c HTTP/1.1 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 22 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33BgAWWxPyGHHWox8PA6nylJidbyH0woK59B8nlo35a00j0TXsKns5tkHwyevvJvGIkiDXIhqmkQjL47Pzt-6K0YUvE_tlyYAxiQPl9bI7RzYbUHxDZ45cHY4qWM4IYwi-QQSzf68Qtii0nZS3CuQflvbIySp_tA0_nSpslZRPol86w Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a309856e39be4922b1ba88e4c2812090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14f33487e3b345b3b6ac8bc0d7d52e59 Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: {"status": "disabled"} Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: exception: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '81b7f31d-fed5-445f-b38c-2274e607e08c', 'body': {'status': 'disabled'}} Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:41:05.046078 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.051072 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.055294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Returning 404 to user: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:05.056377 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-402c63da-6d90-4ad8-8f09-95fca1adb17f tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c" status: 404 len: 110 microversion: 2.53 time: 0.044851 Jul 26 04:41:05.057492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1739/3377] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Jul 26 04:41:05 2022] PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:41:05.063392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:05.064324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:05.072354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.073252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.075080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.075755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.130828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:41:05.271415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9dfeb93c-c2b3-4767-8508-e7073fb9085d tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 204 len: 0 microversion: 2.1 time: 0.210541 Jul 26 04:41:05.272191 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1740/3378] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:41:05 2022] DELETE /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:41:05.289716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dbbbc7ff-1fe3-45a4-95de-468283c1f5fb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f141f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:05.384294 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dbbbc7ff-1fe3-45a4-95de-468283c1f5fb tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.106572 Jul 26 04:41:05.385149 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1741/3379] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:05 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:05.409468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Action: 'update', calling method: .version_select at 0x7f38b4cb6ee0>, body: {"status": "enabled"} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:05.413846 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:05.413846 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:05.417100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.417466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.442567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.443032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.451988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] HTTP exception thrown: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Request method failure captured: Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c HTTP/1.1 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 21 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33BgAWWxPyGHHWox8PA6nylJidbyH0woK59B8nlo35a00j0TXsKns5tkHwyevvJvGIkiDXIhqmkQjL47Pzt-6K0YUvE_tlyYAxiQPl9bI7RzYbUHxDZ45cHY4qWM4IYwi-QQSzf68Qtii0nZS3CuQflvbIySp_tA0_nSpslZRPol86w Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a309856e39be4922b1ba88e4c2812090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a309856e39be4922b1ba88e4c2812090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a309856e39be4922b1ba88e4c2812090 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14f33487e3b345b3b6ac8bc0d7d52e59 Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: {"status": "enabled"} Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: exception: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '81b7f31d-fed5-445f-b38c-2274e607e08c', 'body': {'status': 'enabled'}} Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:41:05.456154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. Jul 26 04:41:05.462677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:05.468447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Returning 404 to user: Service 81b7f31d-fed5-445f-b38c-2274e607e08c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:05.471945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81c6f8d7-f458-4213-a794-c39180876124 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c" status: 404 len: 110 microversion: 2.53 time: 0.083107 Jul 26 04:41:05.473301 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1742/3380] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Jul 26 04:41:05 2022] PUT /compute/v2.1/os-services/81b7f31d-fed5-445f-b38c-2274e607e08c => generated 110 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:41:05.485564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:05.487643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:05.505425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.506580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.509082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.510761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.551736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:05.687806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01727741-5182-487e-85a7-088ecc2bca38 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.340630 Jul 26 04:41:05.693430 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1639/3381] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Jul 26 04:40:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 7350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:41:05.698731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:05.751416 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:05.751416 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:41:05.753257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.753916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.754947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:05.769352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:05.870590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ffaa6c3-10de-48c9-8979-a7b67ed33994 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.173355 Jul 26 04:41:05.872847 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1640/3382] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Jul 26 04:41:05 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:05.891341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:05.892849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:06.108798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:06.111982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:06.121600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:06.125024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:06.126627 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ce58340-4a27-4eb5-9de7-7fe039d9b7c4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1508 microversion: 2.1 time: 0.651207 Jul 26 04:41:06.127494 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1743/3383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:05 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:06.129201 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5b02df69-f2c9-49dd-b570-87e065be773d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1285 microversion: 2.32 time: 0.253900 Jul 26 04:41:06.131556 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1641/3384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:05 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:06.149224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.153938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:06.156299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:06.160899 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:06.160899 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:41:06.163794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.165587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.167372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.169647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.174542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.175207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.178414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.179060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.225856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'flavor' on Instance uuid 27a70b24-580b-47d3-8837-04bf45ee8aaf {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:41:06.249512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6bb8c69-63ac-480a-a97b-344847719441 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.116206 Jul 26 04:41:06.250911 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1642/3385] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:06.264741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.281857 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:06.281857 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:41:06.284733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.290774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.295122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.295682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.360680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6908790-757d-415c-92fa-e4584d72af50 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.100365 Jul 26 04:41:06.361960 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1643/3386] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:06.382978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.398841 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:06.398841 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:41:06.404361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.409219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.414209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.414915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.494764 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e32e6ac-f4c7-4270-8676-45e02efb3f33 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/action" status: 200 len: 32 microversion: 2.1 time: 0.352478 Jul 26 04:41:06.509606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1744/3387] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:41:06 2022] POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:41:06.510403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90b94f0f-414a-4a10-bdf7-67c67018e99a tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-848886-16&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.129561 Jul 26 04:41:06.512210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1644/3388] 10.222.0.43 () {60 vars in 1237 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services?host=n-d-848886-16&binary=xxx => generated 16 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:06.523445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2023e340-9405-46d4-83a5-28ac5a544490 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4fa6dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.533378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.534460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:06.549998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.550504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.551308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.558217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.599343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2023e340-9405-46d4-83a5-28ac5a544490 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.083593 Jul 26 04:41:06.600123 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1745/3389] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:06.605996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.608905 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:06.608905 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:06.610911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.611576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.612561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.613393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.646408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-74e2d49e-f64d-410f-a0a8-9e7ebafef9c2 tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044637 Jul 26 04:41:06.647743 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1746/3390] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:06.660371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:06.673691 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:06.673691 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:06.675578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.676726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.677968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:06.678826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:06.733758 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89510a8f-3006-455c-ad3c-788af5678f7c tempest-ServicesAdminNegativeV253TestJSON-304798183 tempest-ServicesAdminNegativeV253TestJSON-304798183-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.076968 Jul 26 04:41:06.735447 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1747/3391] 10.222.0.43 () {60 vars in 1239 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:07.008579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3efa94d9-3bdb-4da1-af5e-0cd9221ebf21 tempest-ServicesAdminNegativeV253TestJSON-457338155 tempest-ServicesAdminNegativeV253TestJSON-457338155-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:07.011968 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:41:07.011968 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:41:07.015608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3efa94d9-3bdb-4da1-af5e-0cd9221ebf21 tempest-ServicesAdminNegativeV253TestJSON-457338155 tempest-ServicesAdminNegativeV253TestJSON-457338155-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e77695a6ace34ba1aed4d91215e2c56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26bba54e8ab4404bfa953c69fecc03a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3efa94d9-3bdb-4da1-af5e-0cd9221ebf21 tempest-ServicesAdminNegativeV253TestJSON-457338155 tempest-ServicesAdminNegativeV253TestJSON-457338155-project] Request method failure captured: Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33BesETpk1oWO30cZka1Dub_aQ69sitdKkMDvKK2q9Hcrq8GITkNWDJxfP9ybaJDw9hwINAhmmAaVN_aZxyjNEfTFkaXlyT1htszXh2cuWK9HAchy9FFR0dFmfu1Mk8ikL0A5HTQzv2aop_R1OEpe0XRZkf1Etk9JOMTTvmj-xRTCA8 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c26bba54e8ab4404bfa953c69fecc03a Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-457338155 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c26bba54e8ab4404bfa953c69fecc03a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c26bba54e8ab4404bfa953c69fecc03a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c26bba54e8ab4404bfa953c69fecc03a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c26bba54e8ab4404bfa953c69fecc03a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-457338155 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c26bba54e8ab4404bfa953c69fecc03a Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-457338155 Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-457338155-project Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: e77695a6ace34ba1aed4d91215e2c56e Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-457338155-project Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: action_args: {} Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:41:07.027973 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3efa94d9-3bdb-4da1-af5e-0cd9221ebf21 tempest-ServicesAdminNegativeV253TestJSON-457338155 tempest-ServicesAdminNegativeV253TestJSON-457338155-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:07.033599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3efa94d9-3bdb-4da1-af5e-0cd9221ebf21 tempest-ServicesAdminNegativeV253TestJSON-457338155 tempest-ServicesAdminNegativeV253TestJSON-457338155-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.287408 Jul 26 04:41:07.036817 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1748/3392] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:41:07.155116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:07.155839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:07.186059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:07.187538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:07.188977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:07.192423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:07.194293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:07.197079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1827ac3c-eec9-4d89-860d-5a98a70eb7c3 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.682570 Jul 26 04:41:07.197687 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1645/3393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:06 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:07.220166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:07.222448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:07.422534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:07.431167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:07.438780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:07.441635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0696dad7-3534-4977-baf8-e6ae069a205a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1285 microversion: 2.32 time: 0.239039 Jul 26 04:41:07.456526 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1646/3394] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:07 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:07.615194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-688c6714-49c3-4f36-b0a1-6c2825126586 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5bb1d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:07.742410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-688c6714-49c3-4f36-b0a1-6c2825126586 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.131680 Jul 26 04:41:07.744694 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1647/3395] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:07 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:08.200657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:08.214349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42f83a58-1900-4500-963c-047b8b05e444 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1508 microversion: 2.1 time: 1.064650 Jul 26 04:41:08.218434 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1749/3396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:07 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1508 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:08.239545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:08.240181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:08.249334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:08.249876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:08.250937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:08.252566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:08.489671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:08.490580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:08.504466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:08.507018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:08.508838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:08.509282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:08.604704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:08.625831 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8b7b99a-d12b-47c0-baf3-a6fe841e37a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.408260 Jul 26 04:41:08.640356 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1648/3397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:08 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:08.760984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:08.768869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0fd0eedd-d71c-4800-8f83-6578289a76d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b608f310>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:08.777231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:08.781952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:08.785133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-598e7b10-d370-40c5-836a-9f87934b25c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1593 microversion: 2.32 time: 0.300601 Jul 26 04:41:08.785718 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1750/3398] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:08 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1593 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:08.895874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0fd0eedd-d71c-4800-8f83-6578289a76d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.139127 Jul 26 04:41:08.896831 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1649/3399] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:08 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:09.246657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:09.248029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:09.263106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.270940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:09.272151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.272827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:09.652584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:09.653182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:09.671920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.672297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:09.673081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.678521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:09.686989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:09.888882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:09.901417 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a43d34c7-69e0-48e8-90f8-4f42c189a400 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.255180 Jul 26 04:41:09.917130 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1650/3400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:09 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:09.924446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:09.925557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:09.933880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.934772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:09.936012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:09.936012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:10.024198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:10.036702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:10.038728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:10.041508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0858626-4131-4927-9310-a3cd332a0f49 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1593 microversion: 2.32 time: 0.122143 Jul 26 04:41:10.042358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1651/3401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:09 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1593 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:10.063607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9231193c-3781-4a74-af8a-e0db9fbe175a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5383040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:10.130465 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9231193c-3781-4a74-af8a-e0db9fbe175a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.086195 Jul 26 04:41:10.131997 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1652/3402] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:10 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:10.455817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:10.465817 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6b55831-d6a6-403b-b70e-0ef78c3c6fe4 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1508 microversion: 2.1 time: 1.225013 Jul 26 04:41:10.470028 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1751/3403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:09 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1508 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:10.928247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:10.928873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:10.992939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:10.998247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:10.999379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.006230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.088462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:11.091498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:11.112158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.114056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.121469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.122268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.414780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:11.434730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:11.437852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:11.440215 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dddf93a4-0c87-4eee-8dd7-64ec7b843e3b tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1593 microversion: 2.32 time: 0.374405 Jul 26 04:41:11.442764 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1752/3404] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:11 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1593 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:11.485931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec51e235-4786-41f9-89a9-9f8443da2e42 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5005310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:11.584695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec51e235-4786-41f9-89a9-9f8443da2e42 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.140404 Jul 26 04:41:11.586075 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1753/3405] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:11 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:11.598397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3736ac90-9053-4a1f-a11b-63ee6a08dba6 req-682e8eea-1dfb-45dc-8668-e404468362a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f2e135-ca96-4ec0-8a04-6d8a8d8879b3", "name": "network-vif-deleted", "tag": "f0a6f525-50ca-4a72-8d8d-951f1c285187"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:11.626593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3736ac90-9053-4a1f-a11b-63ee6a08dba6 req-682e8eea-1dfb-45dc-8668-e404468362a0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.627399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3736ac90-9053-4a1f-a11b-63ee6a08dba6 req-682e8eea-1dfb-45dc-8668-e404468362a0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.671395 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3736ac90-9053-4a1f-a11b-63ee6a08dba6 req-682e8eea-1dfb-45dc-8668-e404468362a0 service nova] Creating event network-vif-deleted:f0a6f525-50ca-4a72-8d8d-951f1c285187 for instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 on n-h1-848886-16 Jul 26 04:41:11.709193 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3736ac90-9053-4a1f-a11b-63ee6a08dba6 req-682e8eea-1dfb-45dc-8668-e404468362a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117548 Jul 26 04:41:11.711196 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1754/3406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:11.731788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:11.732918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:11.749106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.750598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.752243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.754045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.822973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:11.823874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:11.824501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lazy-loading 'fault' on Instance uuid 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:41:11.949845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:11.960608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34575aca-115a-4905-9d04-29d88634f614 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 1.040393 Jul 26 04:41:11.966681 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1653/3407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:10 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:12.034331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e221db066c45908d089add5de3983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449aabe7aa7c435abd8dd63aba6082c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:12.060628 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd2169b2-124b-441a-ae1d-b33667566836 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 200 len: 1305 microversion: 2.1 time: 0.342309 Jul 26 04:41:12.069453 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1755/3408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:11 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 1305 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:12.470851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:12.471489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:12.492161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:12.492719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:12.503621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:12.504165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:12.600989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea46d39e-f439-4787-8a23-38d6815fe800 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5005af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:12.690578 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea46d39e-f439-4787-8a23-38d6815fe800 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.093494 Jul 26 04:41:12.692083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1756/3409] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:12 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:12.989588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:12.990665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:13.015463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:13.017261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:13.019557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:13.040269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:13.156484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:13.170285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:13.172663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:13.174601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5dfa42c7-f965-40d2-a191-13b7086d595f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1660 microversion: 2.32 time: 0.710026 Jul 26 04:41:13.175789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1654/3410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:12 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1660 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:13.181550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:13.182563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] [instance: 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:13.191168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:13.192020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:13.193088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:13.193945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:13.248933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] HTTP exception thrown: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Request method failure captured: Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 HTTP/1.1 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33BOiZGV95DwyYW2Uv2cc99hmCi289Drv2Qj_Bl8w2OCgw6yb6jfp2VE2qW8aCW5Akd4NTDgfVQXLz6r4Z51hYJu0cod7ugLrNg4RdVaxONxgUci4COTL6c0L7Ff2M8J_NzSkswrJ5kPyEc171yJbTH_aI3XPYLm3RQU_A1U8RguEFw Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 449aabe7aa7c435abd8dd63aba6082c9 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerPasswordTestJSON-1141357379 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/449aabe7aa7c435abd8dd63aba6082c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/449aabe7aa7c435abd8dd63aba6082c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/449aabe7aa7c435abd8dd63aba6082c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_449aabe7aa7c435abd8dd63aba6082c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerPasswordTestJSON-1141357379 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 449aabe7aa7c435abd8dd63aba6082c9 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1141357379 Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerPasswordTestJSON-1141357379-project Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c5e221db066c45908d089add5de3983b Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerPasswordTestJSON-1141357379-project Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '36f2e135-ca96-4ec0-8a04-6d8a8d8879b3'} Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:13.250948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. Jul 26 04:41:13.255899 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:41:13.257412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] Returning 404 to user: Instance 36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:13.261872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a177809a-b9df-4cef-94ef-9cb1b90aa185 tempest-ServerPasswordTestJSON-1141357379 tempest-ServerPasswordTestJSON-1141357379-project] 10.222.0.43 "GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3" status: 404 len: 111 microversion: 2.1 time: 0.084140 Jul 26 04:41:13.265725 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1655/3411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:13 2022] GET /compute/v2.1/servers/36f2e135-ca96-4ec0-8a04-6d8a8d8879b3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:41:13.708676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81e66aea-63ba-4c2d-99fa-633109b416bc tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5493700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:13.785788 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81e66aea-63ba-4c2d-99fa-633109b416bc tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.081614 Jul 26 04:41:13.786841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1656/3412] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:13 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:14.192671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:14.206031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:14.207302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:14.208883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58460ef3-ae6d-4f04-ad9f-6d06eee3a86d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 1.225195 Jul 26 04:41:14.211539 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1757/3413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:12 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:14.245347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:14.248397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:14.250708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:14.251190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:14.801885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42059e04-92fc-4f85-8fe9-1ea619c1143f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f14670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:14.884191 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42059e04-92fc-4f85-8fe9-1ea619c1143f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.083416 Jul 26 04:41:14.894284 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1758/3414] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:14 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:15.234600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:15.235245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:15.265648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:15.274406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:15.277922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:15.278699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:15.582505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:15.603478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:15.610608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:15.618494 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fcc128c4-0866-4e30-a532-2602a841fc80 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1660 microversion: 2.32 time: 1.417559 Jul 26 04:41:15.621092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1657/3415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:14 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1660 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:15.901576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ad76473-e5cc-4159-ac31-950d6fa9c75e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5a1e430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:16.023682 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ad76473-e5cc-4159-ac31-950d6fa9c75e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.126359 Jul 26 04:41:16.027652 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1658/3416] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:15 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:16.080484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:16.108242 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f45f73dc-8317-429f-8a3b-d9716cbee91d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.877561 Jul 26 04:41:16.110971 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1759/3417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:15 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:16.652899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:16.654621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:16.670273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:16.675214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:16.677175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:16.679798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:16.684060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:17.043710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a87ad9c6-c0ab-4144-a203-3fb872003347 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c93ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:17.055710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:17.152576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a87ad9c6-c0ab-4144-a203-3fb872003347 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.116027 Jul 26 04:41:17.168847 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1760/3418] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:17 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:17.184507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:17.189494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:17.208875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:17.210330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:17.211528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:17.212142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:17.427532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:17.653029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:17.664959 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f6cd31b-93b6-4105-bd28-39481bbf0037 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.494657 Jul 26 04:41:17.666884 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1761/3419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:17 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:17.773674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:17.790454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:17.795662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:17.797743 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2b0b943-1775-4309-bbcf-ce66f7e83140 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1706 microversion: 2.32 time: 1.151048 Jul 26 04:41:17.801400 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1659/3420] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:16 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1706 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:18.184852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec865b18-7a26-4c40-bae6-5adbbab56cfa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b6082b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:18.283292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec865b18-7a26-4c40-bae6-5adbbab56cfa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.101808 Jul 26 04:41:18.283995 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1762/3421] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:18 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:18.693498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:18.694535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:18.717334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:18.717801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:18.718813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:18.719269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:18.835855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:18.836728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:18.846967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:18.850644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:18.851500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:18.851973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:19.500572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:19.524568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:19.530673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:19.535792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40013d14-cc32-40d0-a812-17b8c1a0188f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1752 microversion: 2.32 time: 0.701028 Jul 26 04:41:19.537342 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1763/3422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:18 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1752 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:19.546081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb7a00d8-46cd-473f-b528-5a930e4ace10 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f14280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:19.694363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb7a00d8-46cd-473f-b528-5a930e4ace10 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.155287 Jul 26 04:41:19.695054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1764/3423] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:19 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:20.217678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:20.250635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd8de432-85ad-44f1-9cd4-b3f14f2e7cdb tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 1.550073 Jul 26 04:41:20.250635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1660/3424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:18 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:20.561738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:20.563266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:20.577376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:20.585579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:20.604521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:20.605342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:20.712283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1fcb386-2de3-4811-b3ef-94982a8bae73 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5f761f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:20.822365 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1fcb386-2de3-4811-b3ef-94982a8bae73 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.114302 Jul 26 04:41:20.823498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1661/3425] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:20 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:21.271176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:21.272126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:21.289795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:21.290307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:21.291242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:21.291692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:22.039615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:22.065206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:22.081325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:22.083068 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50b64dab-7d9a-43f6-9370-0a5d5358ca67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1798 microversion: 2.32 time: 1.525731 Jul 26 04:41:22.084235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1765/3426] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:20 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1798 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:22.089136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8cecd2aa-2d1f-483d-b60d-6becc23ade57 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4f145e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:22.214602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8cecd2aa-2d1f-483d-b60d-6becc23ade57 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1414 microversion: 2.1 time: 0.128950 Jul 26 04:41:22.215578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1766/3427] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:22 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:22.429029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:22.445352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c7d32b9-dd45-4918-92d2-adb43b91bcf2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 1.178051 Jul 26 04:41:22.447036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1662/3428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:21 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:23.112587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:23.113422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:23.123953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:23.139881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:23.141617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:23.143604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:23.231426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b35bfe8b-27be-40c3-b49c-f8eb58440c59 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b61d2a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:23.320672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b35bfe8b-27be-40c3-b49c-f8eb58440c59 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1423 microversion: 2.1 time: 0.092828 Jul 26 04:41:23.323488 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1663/3429] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:23 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:23.341282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84e88424-5987-429f-8fec-019c3ca32b19 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5d39280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:23.408140 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84e88424-5987-429f-8fec-019c3ca32b19 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 200 len: 1423 microversion: 2.1 time: 0.072515 Jul 26 04:41:23.408727 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1664/3430] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:23 2022] GET /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:23.426076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fdb1ab4-31c5-4664-b52a-d01a0bcb785e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5bbd9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:24.278125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:24.295328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:24.296995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:24.304161 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-410e61cd-a863-4e7c-8459-9f1d469aabef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1844 microversion: 2.32 time: 1.195508 Jul 26 04:41:24.305194 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1767/3431] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:23 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1844 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:24.600090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:24.601067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:24.612499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:24.612654 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fdb1ab4-31c5-4664-b52a-d01a0bcb785e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 204 len: 0 microversion: 2.1 time: 1.193276 Jul 26 04:41:24.613146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:24.616658 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1665/3432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:23 2022] DELETE /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:41:24.616811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:24.616811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:24.624836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:24.625385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:24.632935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:24.638692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:24.638692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:24.639409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:24.639911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:24.640377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:24.724582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:41:24.943336 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-154f2c13-d725-451b-b0e2-3dce82585352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 204 len: 0 microversion: 2.1 time: 0.323600 Jul 26 04:41:24.944114 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1666/3433] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:41:24 2022] DELETE /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:41:25.080157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:25.090499 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4496dcae-d906-4050-bbc6-01f5e6a403b9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 0.783460 Jul 26 04:41:25.094765 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1768/3434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:24 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:25.169836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1918150779", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "375077fe-0b05-4c6a-9dfb-0eb433eff9f2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:25.260269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] validate_networks() for [('375077fe-0b05-4c6a-9dfb-0eb433eff9f2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:41:25.336617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:25.338146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:25.354567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:25.358511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:25.359695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:25.360422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:26.035709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:26.060532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:26.067869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:26.069320 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d42b5918-282e-4c9c-8e13-6dd7198c3257 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1844 microversion: 2.32 time: 0.736993 Jul 26 04:41:26.070404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1769/3435] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:25 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1844 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:26.119529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:26.120417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:26.132394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:26.133310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:26.134995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:26.138514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:26.895068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:26.895606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:26.896181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:26.896656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:26.897104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:26.914968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:26.916829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:26.918315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:26.919502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:26.977162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:26.985691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for user 8644f4ea57d44617b1b4652993df8cdd and project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:27.030676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:41:27.042293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:41:27.178246 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c2a1cf5-1077-4401-8d04-a35659da548e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.011187 Jul 26 04:41:27.188692 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1667/3436] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:41:27.208751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5641de76-339b-4730-8861-b60d258c0fbd req-37d4a064-1d9a-46d3-ac48-ffa878cb8c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c518e51c-de3f-4b20-a9b2-0d9805d73e12", "name": "network-vif-unplugged", "status": "completed", "tag": "581ead2d-71b7-4be2-be27-68b81fbbb8f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:27.242798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5641de76-339b-4730-8861-b60d258c0fbd req-37d4a064-1d9a-46d3-ac48-ffa878cb8c3a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:27.243275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5641de76-339b-4730-8861-b60d258c0fbd req-37d4a064-1d9a-46d3-ac48-ffa878cb8c3a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:27.288315 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5641de76-339b-4730-8861-b60d258c0fbd req-37d4a064-1d9a-46d3-ac48-ffa878cb8c3a service nova] Creating event network-vif-unplugged:581ead2d-71b7-4be2-be27-68b81fbbb8f6 for instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 on n-h2-848886-16 Jul 26 04:41:27.316231 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5641de76-339b-4730-8861-b60d258c0fbd req-37d4a064-1d9a-46d3-ac48-ffa878cb8c3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126209 Jul 26 04:41:27.319334 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1668/3437] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:27.339745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:27.340503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:27.368662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:27.369193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:27.373883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:27.374612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:27.956828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:27.967537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ff3eaf41-f1bf-485d-96d2-af6541a834d2 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1737 microversion: 2.1 time: 1.851815 Jul 26 04:41:27.968135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1770/3438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:26 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1737 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:28.016029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20392848-cd3c-44b4-a267-8e62305fa390 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:28.016707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20392848-cd3c-44b4-a267-8e62305fa390 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:28.211079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:28.221702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:28.229052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:28.238812 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e5bf197-2e71-4155-9263-38a57853b1d8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1844 microversion: 2.32 time: 0.913203 Jul 26 04:41:28.241075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1669/3439] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:27 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1844 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:28.332322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20392848-cd3c-44b4-a267-8e62305fa390 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:28.351191 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20392848-cd3c-44b4-a267-8e62305fa390 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1208 microversion: 2.1 time: 0.360883 Jul 26 04:41:28.356212 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1771/3440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:27 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1208 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:28.930438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-45bd738a-522c-4de1-9b8d-bafc2ebcf75a req-d7be32a5-11b1-478f-912e-cb0fd291d426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "43b505ac-e909-4dd1-9dcb-4438bb257348"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:28.970050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-45bd738a-522c-4de1-9b8d-bafc2ebcf75a req-d7be32a5-11b1-478f-912e-cb0fd291d426 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:28.970570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-45bd738a-522c-4de1-9b8d-bafc2ebcf75a req-d7be32a5-11b1-478f-912e-cb0fd291d426 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:28.995312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:28.996879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:29.013375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-45bd738a-522c-4de1-9b8d-bafc2ebcf75a req-d7be32a5-11b1-478f-912e-cb0fd291d426 service nova] Creating event network-changed:43b505ac-e909-4dd1-9dcb-4438bb257348 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:29.024555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.026416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.029407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.033526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.035852 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-45bd738a-522c-4de1-9b8d-bafc2ebcf75a req-d7be32a5-11b1-478f-912e-cb0fd291d426 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106138 Jul 26 04:41:29.036827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1670/3441] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:29.269939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:29.271381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:29.284935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.285951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.287303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.287931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.858269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:29.881978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:29.884461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:29.885880 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad965264-124e-4979-9ad6-b437688e33d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1844 microversion: 2.32 time: 0.620777 Jul 26 04:41:29.887296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1671/3442] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:29 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1844 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:29.892378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:29.898741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:29.918900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.919424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.920216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:29.920657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:29.937587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:29.949243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c2029ea-da72-4b3c-afbf-189cac1493c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1717 microversion: 2.1 time: 0.960202 Jul 26 04:41:29.949833 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1772/3443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:28 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1717 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:30.112814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:30.120605 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3256f828-eaed-4e34-9afd-136096dcba3b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1266 microversion: 2.1 time: 0.231986 Jul 26 04:41:30.121368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1672/3444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:29 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:30.197543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:30.198126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:30.206178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.206709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.207506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.207950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.309154 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Cannot 'detach_volume' instance 27a70b24-580b-47d3-8837-04bf45ee8aaf while it is in vm_state rescued Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments/10af860e-f41f-4db7-92ff-6b39d01ee729 HTTP/1.1 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'detach_volume' instance 27a70b24-580b-47d3-8837-04bf45ee8aaf while it is in vm_state rescued Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '27a70b24-580b-47d3-8837-04bf45ee8aaf', 'id': '10af860e-f41f-4db7-92ff-6b39d01ee729'} Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 27a70b24-580b-47d3-8837-04bf45ee8aaf while it is in vm_state rescued Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:30.312067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 27a70b24-580b-47d3-8837-04bf45ee8aaf while it is in vm_state rescued Jul 26 04:41:30.317532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:41:30.319106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 409 to user: Cannot 'detach_volume' instance 27a70b24-580b-47d3-8837-04bf45ee8aaf while it is in vm_state rescued {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:41:30.320212 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad4515ee-9d66-4b05-93df-67b3866e3e8d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments/10af860e-f41f-4db7-92ff-6b39d01ee729" status: 409 len: 152 microversion: 2.1 time: 0.126909 Jul 26 04:41:30.321392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1773/3445] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:41:30 2022] DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments/10af860e-f41f-4db7-92ff-6b39d01ee729 => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:41:30.331186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:30.332389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:30.346521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.347412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.348430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.349150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.493457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:30.535411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac856ae7-b6fe-4141-a94d-19a28097bcfd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/action" status: 202 len: 0 microversion: 2.1 time: 0.206141 Jul 26 04:41:30.544861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1673/3446] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:41:30 2022] POST /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:41:30.547454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:30.548230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:30.558212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.559736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.560590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.561086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.919367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:30.921747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:30.948244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.948735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:30.952954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:30.956388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:31.344093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:31.377881 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-19815c1b-0b55-4a01-9e34-a704fc4642a7 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1725 microversion: 2.1 time: 0.836195 Jul 26 04:41:31.379093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1774/3447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:30 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1725 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:31.406562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:31.414360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:31.443625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:31.443801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:31.450375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:31.451925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:31.704882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:31.724400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:31.725959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:31.727195 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-945dbb71-dd76-44ce-9ee4-a1ae572a90f4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1844 microversion: 2.32 time: 0.816523 Jul 26 04:41:31.745641 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1674/3448] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:30 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1844 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:31.750751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-36cdbdf8-de74-4fc5-983c-ca85a6ea5366 req-77ea56a3-68b6-4f2a-9ae8-aa9b015581a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c518e51c-de3f-4b20-a9b2-0d9805d73e12", "name": "network-vif-deleted", "tag": "581ead2d-71b7-4be2-be27-68b81fbbb8f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:31.762050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36cdbdf8-de74-4fc5-983c-ca85a6ea5366 req-77ea56a3-68b6-4f2a-9ae8-aa9b015581a6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:31.762660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36cdbdf8-de74-4fc5-983c-ca85a6ea5366 req-77ea56a3-68b6-4f2a-9ae8-aa9b015581a6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:31.775369 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-36cdbdf8-de74-4fc5-983c-ca85a6ea5366 req-77ea56a3-68b6-4f2a-9ae8-aa9b015581a6 service nova] Creating event network-vif-deleted:581ead2d-71b7-4be2-be27-68b81fbbb8f6 for instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 on n-h2-848886-16 Jul 26 04:41:31.781527 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-36cdbdf8-de74-4fc5-983c-ca85a6ea5366 req-77ea56a3-68b6-4f2a-9ae8-aa9b015581a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034464 Jul 26 04:41:31.782375 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1675/3449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:31.788199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:31.789111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:31.798181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:31.798991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:31.800101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:31.800776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.083382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:32.100077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:32.104318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:32.110531 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca6f69e4-13fe-405e-a16f-cc4d17dc0436 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2951 microversion: 2.42 time: 0.727023 Jul 26 04:41:32.114224 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1775/3450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:31 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2951 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:32.143227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:32.144850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:32.155657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.158319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.159923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.161009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.466758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:32.477301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9344e57-b5e3-41da-99e2-46e31ae30ae5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 0.693379 Jul 26 04:41:32.504160 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1676/3451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:31 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:32.704995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-714190184", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:32.785520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:32.790466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:32.794378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:32.795132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:32.795722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:32.814341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.815216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.816205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.816831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.838359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Getting quotas for project 47d6a7d0653e4e86ac0440bfb7bb8839. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:32.846238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Getting quotas for user c4c0bffbc92e4dbb8020c9a54afb2aaf and project 47d6a7d0653e4e86ac0440bfb7bb8839. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:32.862578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:41:32.865107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:41:32.933476 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e0a17c7-9c67-4747-ac6b-9bc364a405ce tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.426343 Jul 26 04:41:32.940140 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1677/3452] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:41:32.940140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:32.947642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:32.962301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.962816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:32.965991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:32.969085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:33.322346 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80beef4d-eda7-4763-a835-7ed24cb698bd tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec/os-interface" status: 200 len: 1831 microversion: 2.42 time: 1.183394 Jul 26 04:41:33.334007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1776/3453] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:41:32 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec/os-interface => generated 1831 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:33.339071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:33.339732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:33.354181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:33.354908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:33.356671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:33.357323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:34.377860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.413467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.415526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.416875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52b36b3f-1214-428a-8875-789534b40b45 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1865 microversion: 2.32 time: 1.081737 Jul 26 04:41:34.421093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1777/3454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:33 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1865 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:34.424336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.426136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:34.428913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:34.428913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:34.437820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-232cf38a-4b59-40b0-9530-90b1567ac00b tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1725 microversion: 2.1 time: 1.502483 Jul 26 04:41:34.447079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:34.447797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:34.451172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:34.451826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:34.463973 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1678/3455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:32 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1725 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:34.477801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:34.479598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:34.489147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:34.489826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:34.490821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:34.491503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:34.939836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.960509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.977035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:34.987688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b954c71-a274-417c-91d0-ede7bd1dee69 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1329 microversion: 2.57 time: 0.564984 Jul 26 04:41:34.993577 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1778/3456] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:34 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1329 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:35.025444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-24f1f088-b208-42fd-9649-963e78bb39fe req-51f346d1-1b63-41fc-a686-ad7a4ad12230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "498366f2-b698-4228-a825-f1e1babe35bc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:35.080079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-24f1f088-b208-42fd-9649-963e78bb39fe req-51f346d1-1b63-41fc-a686-ad7a4ad12230 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:35.091062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-24f1f088-b208-42fd-9649-963e78bb39fe req-51f346d1-1b63-41fc-a686-ad7a4ad12230 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:35.153548 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-24f1f088-b208-42fd-9649-963e78bb39fe req-51f346d1-1b63-41fc-a686-ad7a4ad12230 service nova] Creating event network-changed:498366f2-b698-4228-a825-f1e1babe35bc for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:35.175302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-24f1f088-b208-42fd-9649-963e78bb39fe req-51f346d1-1b63-41fc-a686-ad7a4ad12230 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171151 Jul 26 04:41:35.178410 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1779/3457] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:35.329499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-597098417", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:35.459903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] validate_networks() for [('0d4506c7-700c-4bd0-bdab-f0a3c1923fdf', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:41:36.184475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:36.194667 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84eeb09c-2edb-400a-9c31-4efde4e9bff3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 1.726586 Jul 26 04:41:36.200012 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1679/3458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:34 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:36.219393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:36.227030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:36.235413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:36.243070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:36.245570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:36.246347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:37.345966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:37.346568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:37.346884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:37.347302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:37.347716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:37.357760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:37.358251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:37.359256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:37.359868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:37.390879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Getting quotas for project 61e162d202dc42688fee1f4a29da800c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:37.400322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Getting quotas for user f1154bf52cfe424babc6bb55e0ad4927 and project 61e162d202dc42688fee1f4a29da800c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:37.434999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:41:37.437480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:41:37.548049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb5862ab-c7cb-4f6f-9053-7ac85c3fc702 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.366412 Jul 26 04:41:37.554620 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1780/3459] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:41:37.561555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:37.563399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:37.582547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:37.582942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:37.583782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:37.584233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.171575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.194133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d79d028-e5a1-4a0e-a6ac-5555e014b979 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1731 microversion: 2.1 time: 0.643185 Jul 26 04:41:38.212206 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1781/3460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:37 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1731 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:38.222998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:38.224057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:38.241914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.243054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.244100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.244797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.319781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.333850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.338382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.346314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-863cea48-255d-436f-93f4-efda69591739 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1886 microversion: 2.32 time: 2.132896 Jul 26 04:41:38.347631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1680/3461] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:36 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1886 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:38.352891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:38.359220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:38.379286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.381838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.382892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.388107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.496009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.510812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.526468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.527733 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfa9db68-de44-4c48-99a2-59406c3a075d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1335 microversion: 2.57 time: 0.314132 Jul 26 04:41:38.541765 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1782/3462] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:38 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1335 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:38.558344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8a344255-7648-4db9-b5b8-458453d4a6c5 req-37ba6a38-c00a-4ab0-9c83-75a59ac87392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "7f898f01-f7ce-4201-b9dd-4572689bcdd3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:38.609116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8a344255-7648-4db9-b5b8-458453d4a6c5 req-37ba6a38-c00a-4ab0-9c83-75a59ac87392 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.609481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8a344255-7648-4db9-b5b8-458453d4a6c5 req-37ba6a38-c00a-4ab0-9c83-75a59ac87392 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.652675 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8a344255-7648-4db9-b5b8-458453d4a6c5 req-37ba6a38-c00a-4ab0-9c83-75a59ac87392 service nova] Creating event network-changed:7f898f01-f7ce-4201-b9dd-4572689bcdd3 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:38.676248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8a344255-7648-4db9-b5b8-458453d4a6c5 req-37ba6a38-c00a-4ab0-9c83-75a59ac87392 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129603 Jul 26 04:41:38.677256 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1783/3463] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:38.696841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:38.701200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:38.720990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.721851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.724491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:38.729030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:38.951955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:38.966708 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-07e7face-be6a-49ab-88aa-ec3df778feb5 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1227 microversion: 2.1 time: 0.282446 Jul 26 04:41:38.983978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1784/3464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:38 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1227 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:39.004785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-799a64d1-946a-40b8-80de-819b3063bcc2 req-8bb01274-9910-4004-ab41-1ee1ae88cf82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a879a17-64bf-4c5d-9861-2bfcffc20211", "tag": "5cd36556-c293-42b8-a72f-d3d2aad052ba"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:39.039353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-799a64d1-946a-40b8-80de-819b3063bcc2 req-8bb01274-9910-4004-ab41-1ee1ae88cf82 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:39.044860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:39.053943 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13371f0a-55cc-457b-8239-4dc3f8a95090 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 0.704864 Jul 26 04:41:39.057534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-799a64d1-946a-40b8-80de-819b3063bcc2 req-8bb01274-9910-4004-ab41-1ee1ae88cf82 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:39.063339 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1681/3465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:38 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:39.079102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:39.079982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:39.094399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:39.096233 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-799a64d1-946a-40b8-80de-819b3063bcc2 req-8bb01274-9910-4004-ab41-1ee1ae88cf82 service nova] Creating event network-changed:5cd36556-c293-42b8-a72f-d3d2aad052ba for instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 on n-h1-848886-16 Jul 26 04:41:39.096930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:39.101092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:39.101917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:39.107253 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-799a64d1-946a-40b8-80de-819b3063bcc2 req-8bb01274-9910-4004-ab41-1ee1ae88cf82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120726 Jul 26 04:41:39.112622 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1785/3466] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:39.377318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:39.378387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:39.388359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:39.394082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:39.395372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:39.395989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:39.977841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:39.991087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:39.995378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:39.998143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-03bf2d0d-b7f5-4fa2-8541-f070bb467127 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1886 microversion: 2.32 time: 0.627716 Jul 26 04:41:40.014987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1786/3467] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:39 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1886 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:40.022490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:40.023449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:40.034986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.036065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.037164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.037908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.230076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:40.243708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:40.245992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:40.247970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-921c2d2d-66f1-4069-8b15-e03447343b4d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1335 microversion: 2.57 time: 0.231864 Jul 26 04:41:40.249271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1787/3468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:40 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:40.255432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:40.256269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:40.265075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.266538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.267526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.268177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.399895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:40.408211 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3521e8e8-51c4-41bf-9035-c532a29d3807 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1281 microversion: 2.1 time: 0.157686 Jul 26 04:41:40.409053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1788/3469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:40 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:40.413651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:40.414363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:40.421119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.421711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.422630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.423154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.427610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:40.446448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef8984f0-ddf4-47ad-a9c5-eff3728d4217 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.378640 Jul 26 04:41:40.447013 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1682/3470] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:41:39 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-interface => generated 285 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:40.768605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-98e0320c-485e-4d29-aaec-174329421865 req-d4d77770-62cc-4c66-89f3-ff8d06799eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "262230a9-8aaa-4c4d-a757-1ee3d0b98f6f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:40.779934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-98e0320c-485e-4d29-aaec-174329421865 req-d4d77770-62cc-4c66-89f3-ff8d06799eaa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:40.780591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-98e0320c-485e-4d29-aaec-174329421865 req-d4d77770-62cc-4c66-89f3-ff8d06799eaa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:40.782693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:40.794639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-98e0320c-485e-4d29-aaec-174329421865 req-d4d77770-62cc-4c66-89f3-ff8d06799eaa service nova] Creating event network-changed:262230a9-8aaa-4c4d-a757-1ee3d0b98f6f for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:40.795292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-604f200d-9341-482b-82cf-c2915570c317 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 0.385008 Jul 26 04:41:40.795887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1789/3471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:40 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:40.814617 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-98e0320c-485e-4d29-aaec-174329421865 req-d4d77770-62cc-4c66-89f3-ff8d06799eaa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056076 Jul 26 04:41:40.815994 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1683/3472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:41:41.028025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:41.028878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.034897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.035480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.036253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.036697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.284107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:41.287340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.299161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.300023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.300935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.301489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.405351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:41.415208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:41.417377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:41.419704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88885283-9448-4361-b218-6a680cb883af tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1356 microversion: 2.57 time: 0.146120 Jul 26 04:41:41.421097 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1684/3473] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:41 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:41.438619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:41.439942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.448399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.449112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.450323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.451295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.568834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:41.579726 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13ce399d-8cbb-453d-9115-1f28df5f2232 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1281 microversion: 2.1 time: 0.151764 Jul 26 04:41:41.580597 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1685/3474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:41 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:41.589286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:41.593553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.602465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.603008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.603855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.605031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.729320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:41.731153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:41.741832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:41.742486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:41.743025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:41.879181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.886315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.886801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.887581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.888032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.921620 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4945c489-a3a1-449b-9505-139505150ff3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "POST /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c/action" status: 202 len: 1137 microversion: 2.57 time: 0.338802 Jul 26 04:41:41.922603 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1686/3475] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Jul 26 04:41:41 2022] POST /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c/action => generated 1137 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 04:41:41.927828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:41.928434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:41.948078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.948590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:41.949993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:41.950465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:42.020058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.034901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.037389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.043729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55fd97cc-4a4d-4554-9cda-4a6a1415554c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 1.019208 Jul 26 04:41:42.055266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1790/3476] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:41 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:42.059015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:42.060122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:42.072713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:42.073474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:42.075342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:42.075809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:42.247526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.270437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.278697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.281576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3c9c862-635a-43f7-88da-cf2136d531cc tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.235516 Jul 26 04:41:42.282064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1791/3477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:42 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:42.580053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:42.589661 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ebb9338-a5fe-410c-a7f6-3dc2ed68059d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 0.665377 Jul 26 04:41:42.602181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1687/3478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:41 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:42.608130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:42.609372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:42.616626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:42.617203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:42.618093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:42.618787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:42.966840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-03c3dfc5-6578-4c26-94f7-0ee1e3a040e9 req-718dd1fe-f030-4d17-85ec-6ec3f992d245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "edce5445-4999-467e-b597-faf7ab02f1b9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:42.971912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:42.972605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:42.991094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-03c3dfc5-6578-4c26-94f7-0ee1e3a040e9 req-718dd1fe-f030-4d17-85ec-6ec3f992d245 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:42.991567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-03c3dfc5-6578-4c26-94f7-0ee1e3a040e9 req-718dd1fe-f030-4d17-85ec-6ec3f992d245 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.016132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-03c3dfc5-6578-4c26-94f7-0ee1e3a040e9 req-718dd1fe-f030-4d17-85ec-6ec3f992d245 service nova] Creating event network-changed:edce5445-4999-467e-b597-faf7ab02f1b9 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:43.030996 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-03c3dfc5-6578-4c26-94f7-0ee1e3a040e9 req-718dd1fe-f030-4d17-85ec-6ec3f992d245 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070161 Jul 26 04:41:43.031955 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1688/3479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:43.073244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:43.073978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:43.091080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.091467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.092286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.092738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.399455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.412709 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c0460cf-9618-4023-9025-3a64a3b22a6c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.812221 Jul 26 04:41:43.426248 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1792/3480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:42 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:43.427442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:43.428075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:43.435922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.436640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.437588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.438788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.641037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.653894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.658064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.661988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2ea87bef-4189-4871-9f36-18243e52ab1f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.241905 Jul 26 04:41:43.663600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1793/3481] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:43 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:43.676262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:43.677147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:43.684812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.685774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.686977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:43.687591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:43.972234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.987536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.988973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:43.990407 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7188f47f-f841-46a1-a45e-c8b9e8dbfbc7 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.921578 Jul 26 04:41:44.011107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1689/3482] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:43 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:44.437913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:44.439117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:44.451409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:44.452183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:44.453974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:44.454661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:44.652390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:44.679797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f40fb2d-32b0-45f7-91e8-7c4a2fdc6d24 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 1.014267 Jul 26 04:41:44.687443 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1794/3483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:43 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:44.693687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:44.694292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:44.703611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:44.707043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:44.708279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:44.708796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:44.926728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:44.939160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:44.946787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6d70c72-81f2-45cb-ae08-a2337d39f3aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.513263 Jul 26 04:41:44.960381 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1690/3484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:44 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:44.960381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-335fab5b-814e-4d9b-baf5-39ffed958b08 req-6ec9e03e-6bce-4c3e-8a80-53a7016115d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:44.979490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-335fab5b-814e-4d9b-baf5-39ffed958b08 req-6ec9e03e-6bce-4c3e-8a80-53a7016115d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:44.980219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-335fab5b-814e-4d9b-baf5-39ffed958b08 req-6ec9e03e-6bce-4c3e-8a80-53a7016115d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:44.981783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:44.985924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:44.992399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d0f7734-08da-43ad-bde2-bd9c0b73020a tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.303685 Jul 26 04:41:44.998752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1795/3485] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:44 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:45.011627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-335fab5b-814e-4d9b-baf5-39ffed958b08 req-6ec9e03e-6bce-4c3e-8a80-53a7016115d7 service nova] Creating event network-changed:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:41:45.017650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:45.018376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:45.030606 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-335fab5b-814e-4d9b-baf5-39ffed958b08 req-6ec9e03e-6bce-4c3e-8a80-53a7016115d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078739 Jul 26 04:41:45.032795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1691/3486] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:45.036213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.036683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.039638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.040137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.120857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b8a35f61-e8a4-4414-a565-9e3ad44662ec req-facad292-9a33-4b50-ac61-9d1e747d05ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:45.156777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b8a35f61-e8a4-4414-a565-9e3ad44662ec req-facad292-9a33-4b50-ac61-9d1e747d05ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.157867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b8a35f61-e8a4-4414-a565-9e3ad44662ec req-facad292-9a33-4b50-ac61-9d1e747d05ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.172493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:45.186018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b8a35f61-e8a4-4414-a565-9e3ad44662ec req-facad292-9a33-4b50-ac61-9d1e747d05ce service nova] Creating event network-changed:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:41:45.193681 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b8a35f61-e8a4-4414-a565-9e3ad44662ec req-facad292-9a33-4b50-ac61-9d1e747d05ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076916 Jul 26 04:41:45.194764 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1692/3487] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:45.326169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2ea55a3b-2a31-4b7b-86b1-4e4afbb5dea7 req-5d56156e-d611-47e9-92bf-bbba5717e99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a879a17-64bf-4c5d-9861-2bfcffc20211", "name": "network-vif-plugged", "status": "completed", "tag": "5cd36556-c293-42b8-a72f-d3d2aad052ba"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:45.367024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2ea55a3b-2a31-4b7b-86b1-4e4afbb5dea7 req-5d56156e-d611-47e9-92bf-bbba5717e99c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.368634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2ea55a3b-2a31-4b7b-86b1-4e4afbb5dea7 req-5d56156e-d611-47e9-92bf-bbba5717e99c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.406317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2ea55a3b-2a31-4b7b-86b1-4e4afbb5dea7 req-5d56156e-d611-47e9-92bf-bbba5717e99c service nova] Creating event network-vif-plugged:5cd36556-c293-42b8-a72f-d3d2aad052ba for instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 on n-h1-848886-16 Jul 26 04:41:45.423592 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2ea55a3b-2a31-4b7b-86b1-4e4afbb5dea7 req-5d56156e-d611-47e9-92bf-bbba5717e99c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101571 Jul 26 04:41:45.427462 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1693/3488] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:45.447684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:45.488909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:45.490734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:45.491947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96f79a58-e404-49cf-b9fc-fc1584127d35 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.478221 Jul 26 04:41:45.507543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1796/3489] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:45 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:45.704283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:45.705501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:45.721107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.726291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.727318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:45.732249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:45.996069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:45.996998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:46.015399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.016219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.019353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.020066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.484106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:46.493038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7af23146-95a9-4dc6-9cba-0c93bb977e2b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.521811 Jul 26 04:41:46.506789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1797/3490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:45 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:46.507664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:46.515306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:46.516163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:46.516448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ecea650f-82f9-41dc-bffe-b5cf359f26b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1308 microversion: 2.1 time: 0.818558 Jul 26 04:41:46.517037 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1694/3491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:45 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:46.523751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.524406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.525318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.525896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.526656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:46.527272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:46.550731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.551208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.551988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:46.552621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:46.667328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:46.677659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:46.679211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:46.680846 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-240c55c1-8276-48dc-ba37-5b7cf2157d45 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.172693 Jul 26 04:41:46.681693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1798/3492] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:46 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:47.274557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:47.285578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:47.287523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:47.289371 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-091929b1-646c-4811-8b1c-c33a4751e413 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.766383 Jul 26 04:41:47.290572 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1695/3493] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:46 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:47.349994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}, {"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "5bdf322f-6bb6-4bc4-85f1-17a21627fc1e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:47.375559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:47.377312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:47.382295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:47.396054 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] Creating event network-changed:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:41:47.396941 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] Creating event network-changed:5bdf322f-6bb6-4bc4-85f1-17a21627fc1e for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:47.407287 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c2d0f658-2f00-4801-ac46-273ebcccfd8a req-e07b42be-11f4-440a-a6ac-cfd957c01a94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062521 Jul 26 04:41:47.408441 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1799/3494] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:47.513973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:47.516486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:47.530814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:47.531276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:47.532068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:47.533796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:47.539364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:47.540369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:47.550742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:47.555097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:47.556566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:47.561583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:47.562180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:47.838105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:47.848370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3aa83677-d526-46f2-b90a-ffc00b9d1b3a tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.339144 Jul 26 04:41:47.869548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1696/3495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:47 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:47.972746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c13b936-1438-463f-b767-b4daae26b82f tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Action: 'create', calling method: .version_select at 0x7f38b5433f70>, body: {"keypair": {"name": "tempest-keypair-113116270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtUXo3yzJSLT6nNEm8R8eT6sOq0FT0akxHp1qNrpHMwiOUr3TYnFBeDLGX36IDxnQDjlQZTkF/uVNZrUYNgAqu4602tqo9Ab7uvjtuJqho9ynR0u/P64dK6WwDQwav19Q=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:47.976196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:47.980494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:47.985646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eec93b36-5e40-4909-bb28-e3ad6727dd3c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1488 microversion: 2.1 time: 0.450769 Jul 26 04:41:47.990880 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1800/3496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:47 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1488 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:47.995859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:48.000580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-1c13b936-1438-463f-b767-b4daae26b82f tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for project 88aa32dea95442aa966324952618081b. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:48.011085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:48.012478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-1c13b936-1438-463f-b767-b4daae26b82f tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for user ae6a2b6400ca4c86be7d888d66c87fa3 and project 88aa32dea95442aa966324952618081b. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:48.018090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.018670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.019754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.020396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.052892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c13b936-1438-463f-b767-b4daae26b82f tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173131 Jul 26 04:41:48.054060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1697/3497] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:41:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:48.079065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:48.080058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:48.095320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.099186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.107255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.107960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.138193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lazy-loading 'flavor' on Instance uuid 0a879a17-64bf-4c5d-9861-2bfcffc20211 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:41:48.243042 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c413167-3d39-4bde-b82e-f80efa8182ef tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211/action" status: 202 len: 0 microversion: 2.1 time: 0.187245 Jul 26 04:41:48.245472 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1698/3498] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:41:48 2022] POST /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:41:48.257884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:48.260418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:48.270763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.271608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.273638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.274395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.304820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:48.322368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:48.324175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:48.325724 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b9de8d15-ec98-484d-9eae-2b74f6d4d940 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.333600 Jul 26 04:41:48.326805 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1801/3499] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:47 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:48.332700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:48.333725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:48.344728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.345426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:48.346447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:48.347046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.078766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.096655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.099580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.102101 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e175987b-935d-46c0-bd04-536c1bf3e0f9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.774165 Jul 26 04:41:49.107262 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1802/3500] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:48 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:49.108406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.119761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:49.121785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:49.128922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fcd31c8e-7097-43e3-8bee-1cd3ff08e693 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1496 microversion: 2.1 time: 0.877997 Jul 26 04:41:49.129515 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1699/3501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:48 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1496 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:49.138377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:49.139122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.141615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:49.145208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.369598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:49.370320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:49.410601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:49.413242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.414729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:49.415390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.522889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.534381 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-234dca7b-912f-4253-b672-a00bda1c42cb tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.424500 Jul 26 04:41:49.536149 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1803/3502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:49 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:49.561959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.566114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5bb0a800-c39b-4c69-8865-05545ff45868 req-c9636b47-5097-4fc3-9985-1e898df3e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "271c850f-38eb-489c-973b-4f26b89eebff"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:49.571587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.578034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:49.579625 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db98dec8-2f1a-4258-8f48-4e53927c84e0 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.229747 Jul 26 04:41:49.596590 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1700/3503] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:49 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:49.596755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5bb0a800-c39b-4c69-8865-05545ff45868 req-c9636b47-5097-4fc3-9985-1e898df3e9b2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:49.609874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5bb0a800-c39b-4c69-8865-05545ff45868 req-c9636b47-5097-4fc3-9985-1e898df3e9b2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:49.636486 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5bb0a800-c39b-4c69-8865-05545ff45868 req-c9636b47-5097-4fc3-9985-1e898df3e9b2 service nova] Creating event network-changed:271c850f-38eb-489c-973b-4f26b89eebff for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:41:49.653252 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5bb0a800-c39b-4c69-8865-05545ff45868 req-c9636b47-5097-4fc3-9985-1e898df3e9b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108845 Jul 26 04:41:49.654900 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1804/3504] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:50.129055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:50.130404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:50.138391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.139260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.140395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.141073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.154253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:50.160496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:50.176638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.179661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.180675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.191261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.566805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.583048 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8cb2a4f9-3719-4f79-bc53-25370efb6aaa tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 200 len: 1479 microversion: 2.1 time: 0.432266 Jul 26 04:41:50.584225 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1805/3505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:50 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 1479 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:50.598600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:50.599578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:50.612446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.613834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.619095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.619701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.661957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.672005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.675621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.677323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c46eb64f-ec91-4062-8200-ecff35be0510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.552256 Jul 26 04:41:50.683507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1701/3506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:50 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:50.691461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:50.694964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:50.722785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.723384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.724417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.725051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.862229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.885315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.890521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:50.893811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-769b30be-2de8-4b89-b3d4-11689264f2ba tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.206199 Jul 26 04:41:50.895367 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1702/3507] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:50 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:50.903373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1772776310"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:50.906830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:50.913770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.917278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:50.919920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:50.921182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:51.315018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-881bb912-9e6a-4934-bc59-1a7fe311f3b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211/action" status: 202 len: 0 microversion: 2.1 time: 0.416362 Jul 26 04:41:51.319973 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1703/3508] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:41:50 2022] POST /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 04:41:51.597635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:51.607852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-beb67137-12c7-4bfa-890a-fe2f3a04178c tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 1.022231 Jul 26 04:41:51.608833 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1806/3509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:50 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:51.623748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-102aad12-261d-48cd-a83a-01218b083892 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c4e310>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:51.636649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-29749119-d962-4bd7-9d24-5e0f8d6c067a req-a6d23bb8-5a66-44ab-b4d2-72438851b2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "name": "network-vif-plugged", "status": "completed", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:51.677768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-29749119-d962-4bd7-9d24-5e0f8d6c067a req-a6d23bb8-5a66-44ab-b4d2-72438851b2e1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:51.678272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-29749119-d962-4bd7-9d24-5e0f8d6c067a req-a6d23bb8-5a66-44ab-b4d2-72438851b2e1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:51.711142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-29749119-d962-4bd7-9d24-5e0f8d6c067a req-a6d23bb8-5a66-44ab-b4d2-72438851b2e1 service nova] Creating event network-vif-plugged:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:41:51.716414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-102aad12-261d-48cd-a83a-01218b083892 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.104539 Jul 26 04:41:51.722383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1807/3510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:51 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:51.726744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-29749119-d962-4bd7-9d24-5e0f8d6c067a req-a6d23bb8-5a66-44ab-b4d2-72438851b2e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403061 Jul 26 04:41:51.727881 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1704/3511] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:51.735669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:51.736289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:51.750964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:51.751436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:51.752232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:51.752669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:51.757351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:51.921073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:51.921454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:51.942870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:51.948115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:51.963522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:51.964091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:52.127500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.127938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.136985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.141893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.143866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.145253 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21b58543-4e8c-4c82-92ee-79df7168f424 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.229650 Jul 26 04:41:52.158208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1705/3512] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:51 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:52.158976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:52.158976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a023e5a-d983-42dd-915c-60bf954f037a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.425922 Jul 26 04:41:52.171838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1808/3513] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:51 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:52.208294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-196838917", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6045f805-d1e7-41e2-9b01-97eb1acecbd2"}], "security_groups": [{"name": "tempest-securitygroup--1362495429"}], "key_name": "tempest-keypair-113116270", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:52.381496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] validate_networks() for [('6045f805-d1e7-41e2-9b01-97eb1acecbd2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:41:52.631874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:52.632768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:52.641847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:52.642892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:52.643792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:52.644459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:52.860579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for project 88aa32dea95442aa966324952618081b. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:52.866737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for user ae6a2b6400ca4c86be7d888d66c87fa3 and project 88aa32dea95442aa966324952618081b. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:52.881017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:41:52.881429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:41:52.881908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:41:52.882349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:41:52.882767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:41:52.892459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:52.892911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:52.893718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:52.894208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:52.912649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for project 88aa32dea95442aa966324952618081b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:41:52.918856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Getting quotas for user ae6a2b6400ca4c86be7d888d66c87fa3 and project 88aa32dea95442aa966324952618081b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:41:52.939086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:41:52.944439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:41:53.013606 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb49e362-f2ce-44af-861d-fd07c7b434e3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.811270 Jul 26 04:41:53.020016 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1706/3514] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:41:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:41:53.020016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac30129a-4634-4e96-9669-2cdd78e9d9d7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5433430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:53.058563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.069723 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d506ba43-ee24-49e3-8d6e-273d8cfe913e tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1323 microversion: 2.1 time: 0.444448 Jul 26 04:41:53.076926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac30129a-4634-4e96-9669-2cdd78e9d9d7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.055362 Jul 26 04:41:53.076926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1707/3515] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:53 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:53.077129 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1809/3516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:52 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:53.078811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-782d71ef-5093-4674-b3a9-a0daffc29b68 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:53.079535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-782d71ef-5093-4674-b3a9-a0daffc29b68 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:53.142727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-782d71ef-5093-4674-b3a9-a0daffc29b68 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.159813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-782d71ef-5093-4674-b3a9-a0daffc29b68 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1268 microversion: 2.1 time: 0.085936 Jul 26 04:41:53.173666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1708/3517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:53 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:53.175797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:53.176592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:53.180563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:53.183682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:53.190514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:53.191203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:53.192271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:53.192783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:53.193052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:53.193389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:53.194522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:53.195019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:53.341475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.351441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.368740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.370956 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4f0dbee-de84-46a7-a055-4d157274bc8d tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.205811 Jul 26 04:41:53.376391 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1810/3518] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:53 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:53.516562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.527307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.530317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:53.531699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-692225b3-96ce-4dc6-acf7-e66545c1f8fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.356532 Jul 26 04:41:53.532629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1709/3519] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:53 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:54.087200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c742d52f-5355-495c-9fb3-ca8fc7d805a3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c4e430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:54.100637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:54.102015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:54.115278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.116607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.118348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.120473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.194117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c742d52f-5355-495c-9fb3-ca8fc7d805a3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.110716 Jul 26 04:41:54.194893 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1811/3520] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:54 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:54.208619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:54.209600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:54.224825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.225657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.226634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.227350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.401365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:54.417464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-acd71b17-211d-47a6-b67e-0906058ce0a1 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1320 microversion: 2.1 time: 0.219164 Jul 26 04:41:54.417580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:54.419796 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1812/3521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:54 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:54.425259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:54.426091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:54.429935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69466fe0-499a-4409-bb5a-9ae569744476 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1519 microversion: 2.1 time: 0.333581 Jul 26 04:41:54.430587 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1710/3522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:54 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:54.446845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.448166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.450333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.451147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.455324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-629825aa-0df4-4301-a3db-e9d66779ab9d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'create', calling method: .version_select at 0x7f38b5fdd4c0>, body: {"pool": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:54.631308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:54.667008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:54.671736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:54.676556 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78da8ef3-a6cd-4683-beca-2b68bca00812 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.254248 Jul 26 04:41:54.677432 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1813/3523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:54 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:54.697495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:54.700404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:54.717122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.718055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:54.719166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:54.720996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.071241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.092322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.097663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.100561 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed83abff-6bbb-41bb-b3b0-2cd264c2a7b0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.421366 Jul 26 04:41:55.102600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1814/3524] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:54 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:55.210491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93f79daa-afd9-44f1-89e6-f86af09256fc tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c00700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:55.315065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93f79daa-afd9-44f1-89e6-f86af09256fc tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.108748 Jul 26 04:41:55.316042 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1815/3525] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:55 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:41:55.339227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a7c83a10-4f6f-443b-8af6-01c8a4d4d72f req-849c47da-2f9f-4188-bbc5-8ec512c37181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a879a17-64bf-4c5d-9861-2bfcffc20211", "name": "network-vif-plugged", "status": "completed", "tag": "5cd36556-c293-42b8-a72f-d3d2aad052ba"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:55.359942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a7c83a10-4f6f-443b-8af6-01c8a4d4d72f req-849c47da-2f9f-4188-bbc5-8ec512c37181 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:55.364540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a7c83a10-4f6f-443b-8af6-01c8a4d4d72f req-849c47da-2f9f-4188-bbc5-8ec512c37181 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.389429 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a7c83a10-4f6f-443b-8af6-01c8a4d4d72f req-849c47da-2f9f-4188-bbc5-8ec512c37181 service nova] Creating event network-vif-plugged:5cd36556-c293-42b8-a72f-d3d2aad052ba for instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 on n-h1-848886-16 Jul 26 04:41:55.400098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a7c83a10-4f6f-443b-8af6-01c8a4d4d72f req-849c47da-2f9f-4188-bbc5-8ec512c37181 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064831 Jul 26 04:41:55.404706 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1816/3526] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:41:55.439748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:55.442264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:55.453664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:55.456739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.459167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:55.461554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.598608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.607841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29fa7959-36cc-4675-a8ae-2da5490fa551 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1326 microversion: 2.1 time: 0.172416 Jul 26 04:41:55.608435 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1817/3527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:55 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:55.704334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:55.704951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:55.722133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:55.722885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.723855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:55.727244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:55.898884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.909609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.911184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:55.912366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b85966b-ae18-42a6-9cb5-85b21f08a9a1 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.213002 Jul 26 04:41:55.924167 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1818/3528] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:55 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:56.134735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:56.135419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:56.150097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:56.153564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:56.154463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:56.154915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:56.748792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:56.767496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:56.769253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:56.770695 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-022918a4-b8ed-4eb8-822c-3f47389f1d79 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.645254 Jul 26 04:41:56.783354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1819/3529] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:56 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:56.788295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47cdadb0-06f1-4b87-aac3-97ea59b30065 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c00dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:56.907095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47cdadb0-06f1-4b87-aac3-97ea59b30065 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.122356 Jul 26 04:41:56.907683 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1820/3530] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:56 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:56.917068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:56.923952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:56.935914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:56.937994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:56.951415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:56.952144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:57.161478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:57.174732 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-531b610d-79e7-4f0d-a0d8-6428af9cc342 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1326 microversion: 2.1 time: 0.263779 Jul 26 04:41:57.176848 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1821/3531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:56 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:57.190890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:57.194666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:57.206059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:57.206833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:57.207884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:57.208550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:57.480816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:57.493390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:57.497258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:57.504573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a614382-0c1a-432e-8e0f-245f253e721e tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.326137 Jul 26 04:41:57.505688 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1822/3532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:57 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:57.919379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:57.920181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:57.938798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:57.939270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:57.940091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:57.942268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:58.365310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.377382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.379333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.381145 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96957fe8-536b-4e9a-b6a7-d76257b7ea8a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.468093 Jul 26 04:41:58.394640 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1823/3533] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:57 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:41:58.403554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-abc7f2c5-a7a2-4a39-8e05-5659253f403f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c03670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:58.463448 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-abc7f2c5-a7a2-4a39-8e05-5659253f403f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.067337 Jul 26 04:41:58.464034 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1824/3534] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:41:58 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:58.475739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:58.476658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:58.486883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:58.487702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:58.488761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:58.489550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:58.665425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.676259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92a47daa-25d0-4060-ab7a-39af30ab8618 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.205966 Jul 26 04:41:58.677387 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1825/3535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:41:58 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:41:58.694873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:58.696120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:58.698509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:58.705488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:58.706242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:58.707174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:58.707773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:58.857243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.876124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.878779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:41:58.880451 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6acba756-d877-472a-befc-d975bfbb73d8 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.201941 Jul 26 04:41:58.881245 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1826/3536] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:58 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:41:59.054545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-629825aa-0df4-4301-a3db-e9d66779ab9d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.602959 Jul 26 04:41:59.060191 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1711/3537] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Jul 26 04:41:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:41:59.297051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2063448062", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:41:59.393221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] validate_networks() for [('0d4506c7-700c-4bd0-bdab-f0a3c1923fdf', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:41:59.408885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:41:59.409861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:41:59.424392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:59.424876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:59.425660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:41:59.426102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:41:59.480220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:00.091438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:00.106923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:00.114623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:00.116328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-557bd66c-3724-46fd-a650-0c1a8cf85d85 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.713263 Jul 26 04:42:00.117450 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1712/3538] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:41:59 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:00.127205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa3b03cd-1150-4b16-be96-619f5e29332c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38baca9040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:00.212966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa3b03cd-1150-4b16-be96-619f5e29332c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.094094 Jul 26 04:42:00.214256 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1713/3539] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:00 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:00.229319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:00.230616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:00.247492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.248181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.249171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.252251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.706292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:42:00.706991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:42:00.707433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:42:00.708068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:42:00.708814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:42:00.729272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.729973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.742293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.743649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.782378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Getting quotas for project 61e162d202dc42688fee1f4a29da800c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:42:00.801398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Getting quotas for user f1154bf52cfe424babc6bb55e0ad4927 and project 61e162d202dc42688fee1f4a29da800c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:42:00.818248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:42:00.820535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:42:00.896380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:00.902932 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ce9b61a-7911-4e7a-9dbd-544f69f9fba8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615025 Jul 26 04:42:00.909537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-622b598c-6275-46d7-9d52-0bdc030c1e4c tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.690001 Jul 26 04:42:00.910234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1714/3540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:00 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:00.911398 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1827/3541] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:42:00.921897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b67534a2-1643-44cc-be1d-8b9df1cb74d8 req-71bc0a90-6225-4624-8907-503e62d056e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f0f602-36e3-4868-b093-2a3ff12dfee9", "tag": "8cb810b2-89a9-4fad-9fc5-8cb19f34c094"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:00.922147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:00.924097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:00.940524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.941523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.944776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.946482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.946628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b67534a2-1643-44cc-be1d-8b9df1cb74d8 req-71bc0a90-6225-4624-8907-503e62d056e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:00.947220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b67534a2-1643-44cc-be1d-8b9df1cb74d8 req-71bc0a90-6225-4624-8907-503e62d056e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:00.970784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b67534a2-1643-44cc-be1d-8b9df1cb74d8 req-71bc0a90-6225-4624-8907-503e62d056e2 service nova] Creating event network-changed:8cb810b2-89a9-4fad-9fc5-8cb19f34c094 for instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 on n-h2-848886-16 Jul 26 04:42:00.986738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b67534a2-1643-44cc-be1d-8b9df1cb74d8 req-71bc0a90-6225-4624-8907-503e62d056e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073875 Jul 26 04:42:00.987924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1828/3542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:00.993494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-26d866d5-7334-4e55-892b-d5a6d1c4bc6d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:00.994452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-26d866d5-7334-4e55-892b-d5a6d1c4bc6d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:01.069381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-26d866d5-7334-4e55-892b-d5a6d1c4bc6d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.095198 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-26d866d5-7334-4e55-892b-d5a6d1c4bc6d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1224 microversion: 2.1 time: 0.105742 Jul 26 04:42:01.095699 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1829/3543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:00 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:01.152106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.165385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:01.166402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.166853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:01.175401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.177481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9919079-b0b3-4fe8-9c05-3ddb4e2c316b tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.266049 Jul 26 04:42:01.178746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:01.179576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:01.182415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:01.183010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:01.183807 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1715/3544] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:00 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:01.231391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bed4b8f9-4633-4346-9dd6-ece3a0c13f6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b53835e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:01.342740 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bed4b8f9-4633-4346-9dd6-ece3a0c13f6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.117384 Jul 26 04:42:01.344215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1716/3545] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:01 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:01.546095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.570550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.572046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:01.573222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8c45e548-74d0-4583-ada0-16e5029aae7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.433348 Jul 26 04:42:01.574087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1830/3546] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:01 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:01.936600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:01.938955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:01.950873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:01.951424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:01.952230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:01.956684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.117590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:02.118231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:02.137460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.141080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.142200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.144089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.275123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:02.297600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58658b81-ce4e-46da-972f-6af2ca4b5775 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.370214 Jul 26 04:42:02.298611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1717/3547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:01 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:02.307706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:02.309643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:02.332119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.334244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.335473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.337473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.474401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:02.488244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:02.489759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:02.490979 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-331b328e-f5c0-4243-8850-e7f77c1dfe90 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.191232 Jul 26 04:42:02.491531 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1718/3548] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:02 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:02.498770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc71aa64-912e-4492-a44d-5d293e278880 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5255ee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:02.545387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:02.548955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:02.557981 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f873678d-24a5-4678-bad7-dd7a4fa490f8 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1228 microversion: 2.1 time: 0.445214 Jul 26 04:42:02.562570 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1831/3549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:02 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1228 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:02.605578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:02.607110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:02.608417 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc71aa64-912e-4492-a44d-5d293e278880 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.114854 Jul 26 04:42:02.611976 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1719/3550] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:02 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:02.624325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.627363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:02.628484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:02.629166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.199233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.220957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.224253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.231785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ebfa72ec-ab91-42dd-b6e0-53e451b0f5ce tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.637110 Jul 26 04:42:03.233954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1832/3551] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:02 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:03.316666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:03.319579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:03.323800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:03.324479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:03.353242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.353684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.354510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.354958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.520880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:03.522012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:03.538089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.539048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.540082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.540688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.651944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.675528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.685218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.687450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.688903 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae398ba3-f722-4a50-a3ba-311cecb552eb tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.177323 Jul 26 04:42:03.690047 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1833/3552] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:03 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:03.695440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:03.696653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:03.698909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3aac360e-fa4f-4a9a-886f-94f5a9be5027 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.383167 Jul 26 04:42:03.699520 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1720/3553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:03 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:03.705188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da878b0a-a447-4fdf-acc0-2025f9f3dd35 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b529e9d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:03.705662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.706546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.707642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:03.708314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:03.786478 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da878b0a-a447-4fdf-acc0-2025f9f3dd35 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.085078 Jul 26 04:42:03.787075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1721/3554] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:03 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:03.912549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:03.931160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b69d8897-eb4a-49c9-8f68-a033a71e51aa tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1282 microversion: 2.1 time: 0.234713 Jul 26 04:42:03.932378 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1834/3555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:03 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:04.257471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:04.258104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:04.273513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:04.277200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:04.280618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:04.281106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:04.716706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:04.717528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:04.740013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:04.741375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:04.746715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:04.748712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:05.084234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.097006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.103060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.104687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d7c7b11-beda-4a2c-b981-9c8edd7996d3 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.392182 Jul 26 04:42:05.106955 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1835/3556] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:04 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:05.112031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:05.112866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:05.119655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:05.120342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:05.121324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:05.122099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:05.473343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.486077 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-504adc07-a8d7-4f63-aa3d-cd6d38dbc0a5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.377673 Jul 26 04:42:05.490103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1836/3557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:05 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:05.497618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a253bb1d-3673-404e-b766-75392ac79395 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c12f70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:05.577211 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a253bb1d-3673-404e-b766-75392ac79395 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.083332 Jul 26 04:42:05.577998 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1837/3558] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:05 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:05.594501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:05.595364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:05.611695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:05.612163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:05.612939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:05.613382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:05.648275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.662422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.664912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:05.666571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3b24bbec-9841-446f-9d38-a1642a039804 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 1.413453 Jul 26 04:42:05.671707 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1722/3559] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:04 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:06.064761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-002d681e-d039-4548-821a-6a705ce56cbf req-fd2e648c-261b-412f-a05b-7f8aeee065d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe150a8-6b33-4432-a16a-cbf4efd42a5a", "tag": "01c8f07e-9b42-4002-bb61-2100fb103218"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:06.078885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:06.082433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-002d681e-d039-4548-821a-6a705ce56cbf req-fd2e648c-261b-412f-a05b-7f8aeee065d9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.086747 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54841cde-69d1-4fc3-911f-0f776b015cd2 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.507535 Jul 26 04:42:06.101189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-002d681e-d039-4548-821a-6a705ce56cbf req-fd2e648c-261b-412f-a05b-7f8aeee065d9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.113404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1838/3560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:05 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:06.133862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-002d681e-d039-4548-821a-6a705ce56cbf req-fd2e648c-261b-412f-a05b-7f8aeee065d9 service nova] Creating event network-changed:01c8f07e-9b42-4002-bb61-2100fb103218 for instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a on n-h1-848886-16 Jul 26 04:42:06.142376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:06.143546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:06.153457 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-002d681e-d039-4548-821a-6a705ce56cbf req-fd2e648c-261b-412f-a05b-7f8aeee065d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205607 Jul 26 04:42:06.154758 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1723/3561] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:42:06.164650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.170804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.171995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.176642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.433936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:06.451947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:06.454254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:06.460098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c4f67c6-d066-4519-9498-d78de22543c6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.326699 Jul 26 04:42:06.474686 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1839/3562] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:06 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:06.514813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:06.515818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:06.526133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.526133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.526133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.526133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.593125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27b51b00-0912-4fff-a614-da3be36aa59f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c18dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:06.642243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27b51b00-0912-4fff-a614-da3be36aa59f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.053517 Jul 26 04:42:06.643269 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1840/3563] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:06 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:06.718306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:06.719117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:06.720654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:06.731513 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-258e2a08-7055-4c10-8043-1167302a06f5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.223008 Jul 26 04:42:06.745536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.745536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.745536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:06.745536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:06.747599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1724/3564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:06 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:07.047416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4e84ad1e-a9dd-4519-b9c8-fa1d67501b51 req-6d96777e-181e-40aa-8152-d81a388bc1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f0f602-36e3-4868-b093-2a3ff12dfee9", "name": "network-vif-plugged", "status": "completed", "tag": "8cb810b2-89a9-4fad-9fc5-8cb19f34c094"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:07.066611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e84ad1e-a9dd-4519-b9c8-fa1d67501b51 req-6d96777e-181e-40aa-8152-d81a388bc1d6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.067078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e84ad1e-a9dd-4519-b9c8-fa1d67501b51 req-6d96777e-181e-40aa-8152-d81a388bc1d6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.104296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4e84ad1e-a9dd-4519-b9c8-fa1d67501b51 req-6d96777e-181e-40aa-8152-d81a388bc1d6 service nova] Creating event network-vif-plugged:8cb810b2-89a9-4fad-9fc5-8cb19f34c094 for instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 on n-h2-848886-16 Jul 26 04:42:07.112046 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4e84ad1e-a9dd-4519-b9c8-fa1d67501b51 req-6d96777e-181e-40aa-8152-d81a388bc1d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069832 Jul 26 04:42:07.112667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1725/3565] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:07.132071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:07.134455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:07.145006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.145783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.146831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.147449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.400045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.417149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.417149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.417149 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-699a80e8-74cd-4503-8e3e-fbf5ad281637 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.724549 Jul 26 04:42:07.426819 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1841/3566] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:06 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:07.446040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.455635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2125e38-9671-40ed-80cb-8af04a9e7409 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.335922 Jul 26 04:42:07.456224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1726/3567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:07 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:07.485176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:07.485794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:07.501878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.502374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.503258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.503709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.622895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.636290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.638560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:07.640514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb7e3895-498b-4461-92cb-bd6560318102 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.159896 Jul 26 04:42:07.641594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1842/3568] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:07 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:07.665111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41b28864-84f1-4dd5-a1af-9834da1871d3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5ff8d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:07.752762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:07.754262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:07.774788 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41b28864-84f1-4dd5-a1af-9834da1871d3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.114494 Jul 26 04:42:07.780309 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1727/3569] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:07 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:07.783858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.784588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:07.786804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:07.787477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.047558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.056141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0374ac3e-702f-43db-a444-3f0b40431ab6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1394 microversion: 2.1 time: 0.307217 Jul 26 04:42:08.067294 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1843/3570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:07 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1394 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:08.440905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:08.441640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:08.473922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.474795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.476320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.477001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.482925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:08.483558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:08.507996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.511267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.515341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.517182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.766693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.780531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.783307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.786057 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dee1aeb3-5517-4f21-a526-214d3d4271cf tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.351575 Jul 26 04:42:08.802204 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1728/3571] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:08 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:08.812841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:08.813719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:08.821493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.822378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.823485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:08.824100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:08.946480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.979522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.985839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:08.989172 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ad474ec-2c3f-4006-9fda-cb818aea3c0f tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.195017 Jul 26 04:42:09.006375 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1729/3572] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:08 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:09.013815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42f9fa1d-efc2-42c2-acb7-df2d2f8f32c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b516c040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:09.079807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42f9fa1d-efc2-42c2-acb7-df2d2f8f32c9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.071854 Jul 26 04:42:09.080636 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1730/3573] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:09 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:09.094075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:09.095016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:09.103958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.105544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:09.108614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:09.110130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.112258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:09.119792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7996a617-f083-4adb-8880-9e049d0d0332 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.642229 Jul 26 04:42:09.126675 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1844/3574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:08 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:09.327432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:09.339077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1e053b2-c6fb-4f9d-9672-6df7882abb20 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1575 microversion: 2.1 time: 0.248112 Jul 26 04:42:09.347404 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1731/3575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:09 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:09.360049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:09.360550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:09.368411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.369258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:09.370377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.371054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:09.544966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b6381f4e-c482-4d41-9a56-c5b3f25519fc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188896 Jul 26 04:42:09.547242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1845/3576] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:42:09 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:42:09.820221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:09.821462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:09.833615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.835019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:09.836004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:09.837120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:10.015107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:10.015715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:10.038672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:10.039160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:10.040208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:10.043110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:10.336240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.353148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.358402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.362568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31372af3-4767-496f-ac1a-093d1ae5b510 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.547614 Jul 26 04:42:10.365347 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1732/3577] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:09 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:10.375216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8254ff3-49fe-4747-9a8b-3c0ee338ea91 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5447160>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:10.472602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8254ff3-49fe-4747-9a8b-3c0ee338ea91 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.105919 Jul 26 04:42:10.473186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1733/3578] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:10 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:10.483305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:10.484347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:10.495340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:10.496650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:10.498642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:10.499630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:10.754353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.769854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:10.782706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.793299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.795630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:10.798026 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad35c51d-cf3a-44ef-a487-603d9fade440 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1365 microversion: 2.57 time: 0.788858 Jul 26 04:42:10.811749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-588795f6-c4b7-4b6a-ba6a-e986d2c59ba0 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.329321 Jul 26 04:42:10.812117 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1846/3579] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:10 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1365 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:10.812219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1734/3580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:10 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:11.391790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:11.392698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:11.403151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:11.407963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.409036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.412435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.413585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.497118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0fd3ef27-27cc-4950-93ad-0de5676e8c32 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5433c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:11.588993 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0fd3ef27-27cc-4950-93ad-0de5676e8c32 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.103808 Jul 26 04:42:11.589993 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1735/3581] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:11 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:11.611488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:11.614648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:11.629163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.629954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.631110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.631714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.893498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:11.912291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:11.913806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:11.924051 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a586674-e2d0-4f8d-b8e7-5f846026f22e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.527761 Jul 26 04:42:11.925026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1847/3582] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:11 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:11.939700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-70360eed-ac3d-4c69-9e11-28545fac7bfc req-d77c7cde-b922-4027-af69-568383972517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f0f602-36e3-4868-b093-2a3ff12dfee9", "tag": "8cb810b2-89a9-4fad-9fc5-8cb19f34c094"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:11.948844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:11.960772 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26dddf7b-be1c-4b62-9ff1-fcf91fd8a8f3 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1575 microversion: 2.1 time: 0.361355 Jul 26 04:42:11.963042 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1736/3583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:11 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1575 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:11.968529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:11.969437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:11.974696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-70360eed-ac3d-4c69-9e11-28545fac7bfc req-d77c7cde-b922-4027-af69-568383972517 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.975155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-70360eed-ac3d-4c69-9e11-28545fac7bfc req-d77c7cde-b922-4027-af69-568383972517 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.979175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.979843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:11.980814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:11.982146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:12.001068 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-70360eed-ac3d-4c69-9e11-28545fac7bfc req-d77c7cde-b922-4027-af69-568383972517 service nova] Creating event network-changed:8cb810b2-89a9-4fad-9fc5-8cb19f34c094 for instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 on n-h2-848886-16 Jul 26 04:42:12.016540 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-70360eed-ac3d-4c69-9e11-28545fac7bfc req-d77c7cde-b922-4027-af69-568383972517 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089195 Jul 26 04:42:12.021288 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1848/3584] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:12.031067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:12.033932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:12.051547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:12.053985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:12.058686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:12.059539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:12.271947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:12.282123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:12.284428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:12.285819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4841e11a-1399-4804-bff7-fa88ac5a59a7 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1371 microversion: 2.57 time: 0.262979 Jul 26 04:42:12.286960 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1849/3585] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:12 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:12.290664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:12.293051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a74c9ed0-9209-4f11-806b-6a1f02d99526 req-1d480f59-758c-43d2-bf87-cc5810459a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe150a8-6b33-4432-a16a-cbf4efd42a5a", "name": "network-vif-plugged", "status": "completed", "tag": "01c8f07e-9b42-4002-bb61-2100fb103218"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:12.301251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a15147d-c193-4691-97a3-da7febcb51ee tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.335986 Jul 26 04:42:12.302588 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1737/3586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:11 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:12.316575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a74c9ed0-9209-4f11-806b-6a1f02d99526 req-1d480f59-758c-43d2-bf87-cc5810459a06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:12.316575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a74c9ed0-9209-4f11-806b-6a1f02d99526 req-1d480f59-758c-43d2-bf87-cc5810459a06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:12.350181 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a74c9ed0-9209-4f11-806b-6a1f02d99526 req-1d480f59-758c-43d2-bf87-cc5810459a06 service nova] Creating event network-vif-plugged:01c8f07e-9b42-4002-bb61-2100fb103218 for instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a on n-h1-848886-16 Jul 26 04:42:12.367582 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a74c9ed0-9209-4f11-806b-6a1f02d99526 req-1d480f59-758c-43d2-bf87-cc5810459a06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079019 Jul 26 04:42:12.368609 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1850/3587] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:12.604998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5b5c88de-6900-4957-8ea5-a70186596d9c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5447b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:12.671806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5b5c88de-6900-4957-8ea5-a70186596d9c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1440 microversion: 2.1 time: 0.070636 Jul 26 04:42:12.680397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1738/3588] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:12 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1440 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:12.952115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:12.953680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:12.961287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:12.961975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:12.963069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:12.963877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:13.332424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:13.333340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:13.349712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:13.350480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:13.351443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:13.352049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:13.386226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:13.533763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.545133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.547057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.548479 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d2fecc0-03a0-4ca4-a8be-1c31b729d5b1 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.603191 Jul 26 04:42:13.558377 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1851/3589] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:12 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:13.563279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:13.564107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:13.572003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:13.572983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:13.584241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:13.584241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:13.589775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:13.680030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.693973 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99525163-abe4-40c3-9847-81ee0971375d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.365072 Jul 26 04:42:13.695054 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1739/3590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:13 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:13.704461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae5c3b30-613c-46fb-9dce-d349240c848f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5ff8ca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:13.765553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.776387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.782420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:13.784005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f3c4897-830d-4e64-a09c-5521a32d4662 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1371 microversion: 2.57 time: 0.226426 Jul 26 04:42:13.795690 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae5c3b30-613c-46fb-9dce-d349240c848f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1449 microversion: 2.1 time: 0.098337 Jul 26 04:42:13.796763 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1740/3591] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:13 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:13.797142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1852/3592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:13 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:13.810128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-57929e34-54d6-4702-ace3-366785ed9d1c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b529eaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:13.882829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-57929e34-54d6-4702-ace3-366785ed9d1c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 200 len: 1449 microversion: 2.1 time: 0.077004 Jul 26 04:42:13.884146 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1741/3593] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:13 2022] GET /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 1449 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:13.898619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ee72ac3-dcf6-4c52-884b-5db35f82ee1c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c4e5e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:14.536023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ee72ac3-dcf6-4c52-884b-5db35f82ee1c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 204 len: 0 microversion: 2.1 time: 0.641227 Jul 26 04:42:14.536605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1853/3594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:13 2022] DELETE /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:14.545484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:14.545994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:14.549215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:14.559178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.564255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:14.566006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.566696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:14.576658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:14.577289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:14.584940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.585398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:14.586253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.586698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:14.604776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:14.719409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74f1ef2d-bc44-4a8e-960b-28a850aa667d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 204 len: 0 microversion: 2.1 time: 0.178197 Jul 26 04:42:14.722381 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1742/3595] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:14 2022] DELETE /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:14.732204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:14.733306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:14.742902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.755183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:14.757427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:14.759023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.017370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.027547 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd4c2ca4-9e56-429d-bd5d-b934cadb0e55 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1324 microversion: 2.1 time: 0.303257 Jul 26 04:42:15.031969 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1743/3596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:14 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:15.047677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:15.048294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:15.054493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.055179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.056904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.058016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.149272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.160754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.162721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.164271 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2348a5bb-44cb-46fc-89b2-32e297e56808 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1356 microversion: 2.57 time: 0.131203 Jul 26 04:42:15.165460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1744/3597] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:15 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1356 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:15.175450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.183385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-852288433", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "375077fe-0b05-4c6a-9dfb-0eb433eff9f2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:15.186475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.192025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.198751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc9c466c-1358-4bdb-ba71-db3d218a60ef tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.629403 Jul 26 04:42:15.199560 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1854/3598] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:14 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:15.215162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:15.216714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:15.225533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.226771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.227736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.228342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.265633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:15.288139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] validate_networks() for [('375077fe-0b05-4c6a-9dfb-0eb433eff9f2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:42:15.389567 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e82c960d-a4e7-4455-89cc-6234a7240d06 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 204 len: 0 microversion: 2.57 time: 0.187250 Jul 26 04:42:15.390956 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1855/3599] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:42:15 2022] DELETE /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:42:15.401341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:15.402512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:15.410805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.411540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.412598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:15.413256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:15.548010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.559020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.561687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:15.562996 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-402a32d5-f181-4415-b75e-e41a6c5df3ed tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1362 microversion: 2.57 time: 0.167341 Jul 26 04:42:15.563556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1856/3600] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:15 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:16.053565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:16.054539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:16.063719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.064477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.065475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.066141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.170404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:42:16.170892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:42:16.171291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:42:16.172346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:42:16.172768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:42:16.195618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.196478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.197657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.198466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.223678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:42:16.230168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Getting quotas for user 8644f4ea57d44617b1b4652993df8cdd and project efc1ca26ebac4a96adf2b4b46215bdbe. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:42:16.248510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:42:16.251304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:42:16.266818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.285033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bce9bf3-6aa7-4f71-b6fc-11918eac9674 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 200 len: 1519 microversion: 2.1 time: 0.235459 Jul 26 04:42:16.286377 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1857/3601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:16 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:16.295081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:16.295928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:16.308049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.310086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.311601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.314378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.349851 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b47278d6-21b9-4d30-875b-5b683bcb496c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181358 Jul 26 04:42:16.352737 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1745/3602] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:42:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:42:16.363720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.154"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:16.366275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:16.379367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.380011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.381149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.381750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.429566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Acquired lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:42:16.588446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.599200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.600795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.602146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3878e0da-baf1-4a5e-9590-f315ee5759f8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.314165 Jul 26 04:42:16.617015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1858/3603] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:16 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:16.639807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2314e10f-bd28-4fff-a5ea-5c0127f8e929 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:16.640698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2314e10f-bd28-4fff-a5ea-5c0127f8e929 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:16.706139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2314e10f-bd28-4fff-a5ea-5c0127f8e929 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.713725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2314e10f-bd28-4fff-a5ea-5c0127f8e929 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1207 microversion: 2.1 time: 0.095476 Jul 26 04:42:16.715226 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1859/3604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:16 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:16.721654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:16.722297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:16.736858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.737380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.738502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:16.739379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:16.882064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.894720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.899728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c0bffbc92e4dbb8020c9a54afb2aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a7d0653e4e86ac0440bfb7bb8839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:16.905179 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdaf532c-a231-4126-aade-f5f376a78224 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 200 len: 1362 microversion: 2.57 time: 0.186134 Jul 26 04:42:16.905799 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1860/3605] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:16 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:17.629939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:17.630648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:17.644771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:17.645253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:17.647418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:17.647998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:18.364856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:18.383961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:18.386063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:18.394040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f559414c-24d4-489b-b1ff-72955f8170fb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.768653 Jul 26 04:42:18.394842 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1861/3606] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:17 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:18.401054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:18.401674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:18.428298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:18.430474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:18.431322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:18.431778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:18.768286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:18.778617 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d35a5243-7d27-49d6-8d28-a884f5de283f tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1265 microversion: 2.1 time: 0.382396 Jul 26 04:42:18.791408 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1862/3607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:18 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:18.806722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:18.809447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] [instance: e0383158-e61f-4dd1-aedf-3e09b7f29a3c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:18.822345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:18.822872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:18.824713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:18.826509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:18.861753 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] HTTP exception thrown: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Request method failure captured: Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c HTTP/1.1 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33B8mQ0I0X-DD3jkVlNGsf6XtMc23Ya0H-srPzeYAYIPj6CCROuGjl0Y3_90zg0DwCJWt4lMvIpFHPoult-Bw9Uv4mAXR4NlHMX0ok_SUdRNNWaAmNL0wcG2IVYmD_4aoaiQ1-eXuv2AoqK9qynRXQbJxZ0wgUdsIpHGuXIErhtaRgs Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.57 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 47d6a7d0653e4e86ac0440bfb7bb8839 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerShowV257Test-1757820333 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/47d6a7d0653e4e86ac0440bfb7bb8839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/47d6a7d0653e4e86ac0440bfb7bb8839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/47d6a7d0653e4e86ac0440bfb7bb8839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_47d6a7d0653e4e86ac0440bfb7bb8839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerShowV257Test-1757820333 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 47d6a7d0653e4e86ac0440bfb7bb8839 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerShowV257Test-1757820333 Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerShowV257Test-1757820333-project Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c4c0bffbc92e4dbb8020c9a54afb2aaf Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerShowV257Test-1757820333-project Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'e0383158-e61f-4dd1-aedf-3e09b7f29a3c'} Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:18.865406 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] Returning 404 to user: Instance e0383158-e61f-4dd1-aedf-3e09b7f29a3c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:18.872185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45452b88-efec-48b5-bf26-34153c67d4a6 tempest-ServerShowV257Test-1757820333 tempest-ServerShowV257Test-1757820333-project] 10.222.0.43 "GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c" status: 404 len: 111 microversion: 2.57 time: 0.077999 Jul 26 04:42:18.873299 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1863/3608] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:18 2022] GET /compute/v2.1/servers/e0383158-e61f-4dd1-aedf-3e09b7f29a3c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:42:18.995794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-694b47b1-1315-48ba-9d06-f8306031d955 req-1c6cac88-cded-4aab-83c9-968167150d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a879a17-64bf-4c5d-9861-2bfcffc20211", "name": "network-vif-deleted", "tag": "5cd36556-c293-42b8-a72f-d3d2aad052ba"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:19.017954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-694b47b1-1315-48ba-9d06-f8306031d955 req-1c6cac88-cded-4aab-83c9-968167150d16 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:19.018757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-694b47b1-1315-48ba-9d06-f8306031d955 req-1c6cac88-cded-4aab-83c9-968167150d16 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:19.057618 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-694b47b1-1315-48ba-9d06-f8306031d955 req-1c6cac88-cded-4aab-83c9-968167150d16 service nova] Creating event network-vif-deleted:5cd36556-c293-42b8-a72f-d3d2aad052ba for instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 on n-h1-848886-16 Jul 26 04:42:19.080194 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-694b47b1-1315-48ba-9d06-f8306031d955 req-1c6cac88-cded-4aab-83c9-968167150d16 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092526 Jul 26 04:42:19.086826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1864/3609] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:19.424466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:19.425544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:19.442927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:19.443822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:19.446708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:19.447638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:19.880329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:19.996449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:20.008222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:20.015296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:20.020018 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dae56e02-7de3-4663-92a0-533d8d074c4e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.600347 Jul 26 04:42:20.022837 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1865/3610] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:19 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:20.041675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:20.042823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:20.055398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:20.055872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:20.059839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:20.062772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:20.371656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:20.390220 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fec42af-2b2a-4063-9550-c0985f1bb6d1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.365900 Jul 26 04:42:20.391202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1866/3611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:20 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:20.714190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8a86e255-e07e-46e5-9ef3-f9c56df7327b req-55590b42-1a95-44ce-8305-6bcfe6c9c95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:20.739047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:20.744998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8a86e255-e07e-46e5-9ef3-f9c56df7327b req-55590b42-1a95-44ce-8305-6bcfe6c9c95d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:20.745454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8a86e255-e07e-46e5-9ef3-f9c56df7327b req-55590b42-1a95-44ce-8305-6bcfe6c9c95d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:20.794503 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8a86e255-e07e-46e5-9ef3-f9c56df7327b req-55590b42-1a95-44ce-8305-6bcfe6c9c95d service nova] Creating event network-changed:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:42:20.806188 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8a86e255-e07e-46e5-9ef3-f9c56df7327b req-55590b42-1a95-44ce-8305-6bcfe6c9c95d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413655 Jul 26 04:42:20.807446 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1867/3612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:21.055872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:21.062451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:21.093620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:21.094648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:21.096322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:21.097313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:21.596199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Updating instance_info_cache with network_info: [{"id": "79cdd291-d012-41e2-b52d-896958606e0c", "address": "fa:16:3e:3a:00:66", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79cdd291-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:21.615151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Releasing lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:42:21.616105 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af0b86c0-d151-42d7-be75-b40012b54098 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action" status: 202 len: 0 microversion: 2.1 time: 5.262185 Jul 26 04:42:21.616868 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1746/3613] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:16 2022] POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action => generated 0 bytes in 5264 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:42:21.626300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:21.627012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:21.643712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:21.644173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:21.647491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:21.648018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:22.018548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:22.029083 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0eac682-d952-4b3d-a159-74827610e799 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.410481 Jul 26 04:42:22.032171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:22.032771 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1747/3614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:21 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:22.046446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.154"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:22.049274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:22.054538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:22.056890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:22.062691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08b9f9cd-05c0-4d24-ac21-a661aa8a31c9 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 1.018675 Jul 26 04:42:22.065629 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1868/3615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:21 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:22.072175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:22.072642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:22.073432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:22.073872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:22.120410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Acquired lock "refresh_cache-bbe150a8-6b33-4432-a16a-cbf4efd42a5a" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:42:22.609150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-73b1ecbd-fbb1-499f-83a0-106c078da86f req-a8e71798-771b-4aad-b965-5a7f6e0b57fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "498366f2-b698-4228-a825-f1e1babe35bc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:22.634371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-73b1ecbd-fbb1-499f-83a0-106c078da86f req-a8e71798-771b-4aad-b965-5a7f6e0b57fd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:22.637370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-73b1ecbd-fbb1-499f-83a0-106c078da86f req-a8e71798-771b-4aad-b965-5a7f6e0b57fd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:22.671367 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-73b1ecbd-fbb1-499f-83a0-106c078da86f req-a8e71798-771b-4aad-b965-5a7f6e0b57fd service nova] Creating event network-vif-plugged:498366f2-b698-4228-a825-f1e1babe35bc for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:22.678989 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-73b1ecbd-fbb1-499f-83a0-106c078da86f req-a8e71798-771b-4aad-b965-5a7f6e0b57fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074534 Jul 26 04:42:22.681685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1869/3616] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:42:22.991065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9dd411ce-284c-40d0-9a4b-7f73e3a24ba4 req-4d2b3eb4-7892-4d2e-b477-965c7487ac47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8", "tag": "3cd91ef5-7ba7-404f-9b90-9c393350fd42"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:23.026578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9dd411ce-284c-40d0-9a4b-7f73e3a24ba4 req-4d2b3eb4-7892-4d2e-b477-965c7487ac47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:23.029511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9dd411ce-284c-40d0-9a4b-7f73e3a24ba4 req-4d2b3eb4-7892-4d2e-b477-965c7487ac47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:23.055820 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9dd411ce-284c-40d0-9a4b-7f73e3a24ba4 req-4d2b3eb4-7892-4d2e-b477-965c7487ac47 service nova] Creating event network-changed:3cd91ef5-7ba7-404f-9b90-9c393350fd42 for instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 on n-h2-848886-16 Jul 26 04:42:23.062524 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9dd411ce-284c-40d0-9a4b-7f73e3a24ba4 req-4d2b3eb4-7892-4d2e-b477-965c7487ac47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078210 Jul 26 04:42:23.064245 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1870/3617] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:42:23.070746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:23.073737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:23.081209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:23.083158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:23.085824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:23.087352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:23.473418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:23.492415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aff28adb-1d9e-4655-8c34-904c09f82bd5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.426296 Jul 26 04:42:23.507010 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1871/3618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:23 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:23.512860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:23.514037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:23.520911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:23.521545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:23.522511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:23.523111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:23.560719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:24.008293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:24.018958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:24.020812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:24.022274 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1eab4d31-669c-4c3d-b441-bc8811432474 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.513756 Jul 26 04:42:24.039141 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1872/3619] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:23 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:24.514749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:24.515364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:24.525785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:24.530558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:24.531714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:24.532347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:24.928153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:24.940688 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-abe493e8-c5d2-4224-9126-aca843ba40d0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.426712 Jul 26 04:42:24.946300 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1873/3620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:24 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:24.968778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "7f898f01-f7ce-4201-b9dd-4572689bcdd3"}, {"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "43b505ac-e909-4dd1-9dcb-4438bb257348"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:25.001884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:25.002446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:25.030720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] Creating event network-vif-plugged:7f898f01-f7ce-4201-b9dd-4572689bcdd3 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:25.031233 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] Creating event network-vif-plugged:43b505ac-e909-4dd1-9dcb-4438bb257348 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:25.036939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4e641186-34f6-4573-ace1-954a6ab86f17 req-b4005f1f-4d07-41b2-9206-be32fa633d40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085335 Jul 26 04:42:25.038374 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1874/3621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:25.052411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:25.054094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:25.066101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:25.070404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:25.071231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:25.071687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:25.560475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:25.574788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:25.580302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:25.586469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be5a19be-62da-4e38-8168-933866cd8a7f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.533742 Jul 26 04:42:25.588092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1875/3622] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:25 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:25.964797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:25.967766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:25.989407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:25.990703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:25.993172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:25.993633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:26.213982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:26.227718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.neutron [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] re-assign floating IP 172.25.7.154 from instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf Jul 26 04:42:26.343981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:26.351569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:26.401336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:26.420571 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d3c3488-9c60-4cc0-a9ec-a1b73fb90da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.460960 Jul 26 04:42:26.440067 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1876/3623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:25 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:26.448037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a2fff656-5d69-4a15-9b7e-a5d04abf1854 req-ccf8b0c0-060a-4729-80e8-7ec2a9a0428e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:26.458777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2fff656-5d69-4a15-9b7e-a5d04abf1854 req-ccf8b0c0-060a-4729-80e8-7ec2a9a0428e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:26.459518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2fff656-5d69-4a15-9b7e-a5d04abf1854 req-ccf8b0c0-060a-4729-80e8-7ec2a9a0428e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:26.472909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a2fff656-5d69-4a15-9b7e-a5d04abf1854 req-ccf8b0c0-060a-4729-80e8-7ec2a9a0428e service nova] Creating event network-changed:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:42:26.480681 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a2fff656-5d69-4a15-9b7e-a5d04abf1854 req-ccf8b0c0-060a-4729-80e8-7ec2a9a0428e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038382 Jul 26 04:42:26.483415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1877/3624] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:26.617827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:26.619345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:26.640187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:26.655874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:26.656979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:26.657450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:26.737333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:27.943357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:27.958434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:27.959969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:27.961161 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c42c057a-c03e-42eb-b324-8dd301e4fe50 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 1.348639 Jul 26 04:42:27.964873 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1878/3625] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:26 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:27.986767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a9ec4211-2a7f-47f4-8d15-ed1eefcb0b45 req-5ade1794-ab81-485e-8edf-0adf59659b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "5bdf322f-6bb6-4bc4-85f1-17a21627fc1e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:28.001937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a9ec4211-2a7f-47f4-8d15-ed1eefcb0b45 req-5ade1794-ab81-485e-8edf-0adf59659b51 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:28.002745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a9ec4211-2a7f-47f4-8d15-ed1eefcb0b45 req-5ade1794-ab81-485e-8edf-0adf59659b51 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:28.026390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a9ec4211-2a7f-47f4-8d15-ed1eefcb0b45 req-5ade1794-ab81-485e-8edf-0adf59659b51 service nova] Creating event network-vif-plugged:5bdf322f-6bb6-4bc4-85f1-17a21627fc1e for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:28.040861 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a9ec4211-2a7f-47f4-8d15-ed1eefcb0b45 req-5ade1794-ab81-485e-8edf-0adf59659b51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074474 Jul 26 04:42:28.041675 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1879/3626] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:28.045845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Updating instance_info_cache with network_info: [{"id": "79cdd291-d012-41e2-b52d-896958606e0c", "address": "fa:16:3e:3a:00:66", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79cdd291-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:28.052751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:28.054960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:28.070565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Building network info cache for instance {{(pid=119487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:28.071915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:28.072558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:28.073558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:28.080369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:28.547816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:28.568659 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bada16c-c53d-4bd4-ad7f-704544e1e4b3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.525479 Jul 26 04:42:28.569887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1880/3627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:28 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:28.574623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-efafaaca-6a75-42f7-b0f8-e6e5b074b927 req-cf1576dd-c416-46e1-a875-7d612a522401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe150a8-6b33-4432-a16a-cbf4efd42a5a", "tag": "01c8f07e-9b42-4002-bb61-2100fb103218"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:28.596457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-efafaaca-6a75-42f7-b0f8-e6e5b074b927 req-cf1576dd-c416-46e1-a875-7d612a522401 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:28.597157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-efafaaca-6a75-42f7-b0f8-e6e5b074b927 req-cf1576dd-c416-46e1-a875-7d612a522401 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:28.618262 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-efafaaca-6a75-42f7-b0f8-e6e5b074b927 req-cf1576dd-c416-46e1-a875-7d612a522401 service nova] Creating event network-changed:01c8f07e-9b42-4002-bb61-2100fb103218 for instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a on n-h1-848886-16 Jul 26 04:42:28.626371 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-efafaaca-6a75-42f7-b0f8-e6e5b074b927 req-cf1576dd-c416-46e1-a875-7d612a522401 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055032 Jul 26 04:42:28.638581 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1881/3628] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:28.994959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:28.999493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:29.009832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.010764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:29.011835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.012459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:29.255183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:29.265114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:29.266818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:29.269799 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95a2039b-540d-4ce0-8318-5dcef6999c8d tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.284426 Jul 26 04:42:29.292029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1882/3629] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:28 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:42:29.416320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Updating instance_info_cache with network_info: [{"id": "01c8f07e-9b42-4002-bb61-2100fb103218", "address": "fa:16:3e:20:36:43", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap01c8f07e-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:29.431824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Releasing lock "refresh_cache-bbe150a8-6b33-4432-a16a-cbf4efd42a5a" {{(pid=119487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:42:29.433138 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6345e50-fa21-40f2-87b8-e0d88be01731 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a/action" status: 202 len: 0 microversion: 2.1 time: 7.399491 Jul 26 04:42:29.433785 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1748/3630] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:22 2022] POST /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a/action => generated 0 bytes in 7401 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:42:29.443608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.154"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:29.596282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:29.597248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:29.603839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.604850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:29.606028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.607479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:29.613204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:29.619905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.620373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:29.621214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:29.621662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.025580 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] HTTP exception thrown: Floating IP 172.25.7.154 is not associated with instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf. Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Request method failure captured: Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action HTTP/1.1 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 49 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33B-5v-GJaKJWK2nxMNwvYkyXH2nxo_zxwN1L6mDySJC_ouJDL7FFK7prrTUMCd20Q3tXGw0qJaRNebQS5qz8wE2K1Yvp5SF8aWwBtcPpWX5Cg-9kDxesfb8wI-kkEwqkRAokf4FXi_kKj9WszxY5IHAyA6gyMbM19HUJBx-Ar2XHV0 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61e162d202dc42688fee1f4a29da800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f1154bf52cfe424babc6bb55e0ad4927 Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: {"removeFloatingIp": {"address": "172.25.7.154"}} Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: exception: Floating IP 172.25.7.154 is not associated with instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf. Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf', 'body': {'removeFloatingIp': {'address': '172.25.7.154'}}} Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.154 is not associated with instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf. Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.154 is not associated with instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf. Jul 26 04:42:30.028396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:30.036785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Returning 409 to user: Floating IP 172.25.7.154 is not associated with instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:30.037898 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05d6cfe1-ec1b-448a-a235-eb58b8136767 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action" status: 409 len: 146 microversion: 2.1 time: 0.598547 Jul 26 04:42:30.038895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1883/3631] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:29 2022] POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action => generated 146 bytes in 600 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:30.050414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.154"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:30.269322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:30.284881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:30.286712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.288662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:30.289693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.385321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:30.394668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13cd2b0f-5fa9-43dd-b9f0-3b00c37456c7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.803877 Jul 26 04:42:30.408645 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1749/3632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:29 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:30.415891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "edce5445-4999-467e-b597-faf7ab02f1b9"}, {"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "262230a9-8aaa-4c4d-a757-1ee3d0b98f6f"}, {"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-plugged", "status": "completed", "tag": "271c850f-38eb-489c-973b-4f26b89eebff"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:30.426936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:30.428093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.441445 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Creating event network-vif-plugged:edce5445-4999-467e-b597-faf7ab02f1b9 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:30.442247 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Creating event network-vif-plugged:262230a9-8aaa-4c4d-a757-1ee3d0b98f6f for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:30.442944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] Creating event network-vif-plugged:271c850f-38eb-489c-973b-4f26b89eebff for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:30.449432 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0b56e36c-814b-40af-902e-7c802603a503 req-bd85216e-cdd3-4f9b-a493-fe2350101ff1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039172 Jul 26 04:42:30.451055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1750/3633] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:30.456750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:30.458077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:30.464844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:30.465550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.466791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:30.478977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:30.831675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Acquired lock "refresh_cache-bbe150a8-6b33-4432-a16a-cbf4efd42a5a" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:42:30.919467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:30.950328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:30.952216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:30.956508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54d9f6af-695b-48c1-819e-4ecd4e149ab4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.503233 Jul 26 04:42:30.957679 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1751/3634] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:30 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:31.416214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:31.417139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:31.425664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:31.426519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:31.427748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:31.428787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:31.770188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:31.778062 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97325804-89b9-4a13-96ca-87e9d95a8d0d tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.365786 Jul 26 04:42:31.790884 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1752/3635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:31 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:31.981120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:31.984566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:31.995540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:31.999950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:32.001080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:32.004532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:32.457289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:32.474360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:32.485372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:32.491779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ba2bb97-8d08-42de-99ac-17a9be4144ba tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1874 microversion: 2.32 time: 0.514475 Jul 26 04:42:32.509746 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1753/3636] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:31 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1874 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:32.815880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:32.818994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:32.827482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:32.832413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:32.833439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:32.834053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:33.153175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Building network info cache for instance {{(pid=119488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:33.248451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:33.255945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:33.263737 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-440cd5e7-1866-40b1-8499-06411a41f7b0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.451006 Jul 26 04:42:33.267720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1754/3637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:32 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:33.282499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-492e9676-274f-4ac4-850a-3878055cc0cc req-67e08e04-a03e-458b-a64d-072c48992bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8", "name": "network-vif-plugged", "status": "completed", "tag": "3cd91ef5-7ba7-404f-9b90-9c393350fd42"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:33.298352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-492e9676-274f-4ac4-850a-3878055cc0cc req-67e08e04-a03e-458b-a64d-072c48992bcd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:33.299188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-492e9676-274f-4ac4-850a-3878055cc0cc req-67e08e04-a03e-458b-a64d-072c48992bcd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:33.343416 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-492e9676-274f-4ac4-850a-3878055cc0cc req-67e08e04-a03e-458b-a64d-072c48992bcd service nova] Creating event network-vif-plugged:3cd91ef5-7ba7-404f-9b90-9c393350fd42 for instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 on n-h2-848886-16 Jul 26 04:42:33.360707 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-492e9676-274f-4ac4-850a-3878055cc0cc req-67e08e04-a03e-458b-a64d-072c48992bcd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088944 Jul 26 04:42:33.371505 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1755/3638] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:33.415119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b795732b-7fc6-46e2-9908-2332d1b5e3e0 req-f648d6d7-b8b9-42e9-8a6f-6846cff65ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe150a8-6b33-4432-a16a-cbf4efd42a5a", "tag": "01c8f07e-9b42-4002-bb61-2100fb103218"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:33.460011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b795732b-7fc6-46e2-9908-2332d1b5e3e0 req-f648d6d7-b8b9-42e9-8a6f-6846cff65ecc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:33.461453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b795732b-7fc6-46e2-9908-2332d1b5e3e0 req-f648d6d7-b8b9-42e9-8a6f-6846cff65ecc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:33.495870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b795732b-7fc6-46e2-9908-2332d1b5e3e0 req-f648d6d7-b8b9-42e9-8a6f-6846cff65ecc service nova] Creating event network-changed:01c8f07e-9b42-4002-bb61-2100fb103218 for instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a on n-h1-848886-16 Jul 26 04:42:33.509454 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b795732b-7fc6-46e2-9908-2332d1b5e3e0 req-f648d6d7-b8b9-42e9-8a6f-6846cff65ecc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130923 Jul 26 04:42:33.526820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1756/3639] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:33.545963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:33.547609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:33.556974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:33.557436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:33.558259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:33.558832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.254300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:34.266379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:34.268353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:34.282141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e950c10d-30f3-4483-b214-2ca1c9d11a09 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2825 microversion: 2.32 time: 0.753499 Jul 26 04:42:34.304806 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1757/3640] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:42:33 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2825 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:34.310280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:34.311285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:34.322892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.323936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.325045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.325223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Updating instance_info_cache with network_info: [{"id": "01c8f07e-9b42-4002-bb61-2100fb103218", "address": "fa:16:3e:20:36:43", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap01c8f07e-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:34.326861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.346872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Releasing lock "refresh_cache-bbe150a8-6b33-4432-a16a-cbf4efd42a5a" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:42:34.349993 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be104230-0747-4c89-a9a7-594f02da726d tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a/action" status: 202 len: 0 microversion: 2.1 time: 4.306002 Jul 26 04:42:34.352381 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1884/3641] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:30 2022] POST /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a/action => generated 0 bytes in 4310 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:42:34.369113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:34.373479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:34.390133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.402939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.406255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.406947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.608192 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f85156c9-b35b-4aa8-a523-a34924495118 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.248782 Jul 26 04:42:34.609128 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1885/3642] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:42:34 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4/os-interface => generated 1830 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:42:34.625022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:34.625520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:34.640978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.650650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.651923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.652549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.708091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:34.931978 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb425b74-0c55-47db-9233-46d083af2145 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 204 len: 0 microversion: 2.1 time: 0.310483 Jul 26 04:42:34.939649 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1886/3643] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:34 2022] DELETE /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:34.952661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.154"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:34.956412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:34.964757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.965476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.966606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:34.967145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:34.991058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:35.001775 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50038bb9-bb03-43d8-b53c-476ff13a1ec7 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1307 microversion: 2.1 time: 0.696363 Jul 26 04:42:35.006778 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1758/3644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:34 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1307 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:35.020250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Acquired lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:42:36.029815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:36.030469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:36.043596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:36.046573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:36.047700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:36.049368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:36.664682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:36.673189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-917b40d6-2274-460d-b881-bf6589d4601c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1488 microversion: 2.1 time: 0.649405 Jul 26 04:42:36.684386 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1759/3645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:36 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1488 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:36.710995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2016669294"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:36.713538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:36.739422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:36.739814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:36.740843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:36.741237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.164592 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81c1aeab-a51e-41fa-8409-13882b46b74e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "POST /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8/action" status: 202 len: 0 microversion: 2.1 time: 0.457597 Jul 26 04:42:37.167118 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1760/3646] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:36 2022] POST /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 04:42:37.187392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5143c025-1257-4bf1-895e-197f60024da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b51b2940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:37.274873 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5143c025-1257-4bf1-895e-197f60024da3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605" status: 200 len: 1414 microversion: 2.1 time: 0.097458 Jul 26 04:42:37.275699 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1761/3647] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:37 2022] GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:37.289518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:37.290329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:37.317654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:37.319569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.320540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:37.324012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.534439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'services' on Instance uuid 27a70b24-580b-47d3-8837-04bf45ee8aaf {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:42:37.706556 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1f3adf4e-3f42-4788-8872-f98484eb66af tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments/10af860e-f41f-4db7-92ff-6b39d01ee729" status: 202 len: 0 microversion: 2.1 time: 0.423839 Jul 26 04:42:37.709403 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1762/3648] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:42:37 2022] DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments/10af860e-f41f-4db7-92ff-6b39d01ee729 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:42:37.720420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1bee3e1d-1cc0-4db4-9392-65907225f574 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5d8a280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:37.795532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1bee3e1d-1cc0-4db4-9392-65907225f574 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605" status: 200 len: 1414 microversion: 2.1 time: 0.083837 Jul 26 04:42:37.806299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1763/3649] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:37 2022] GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:37.817851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3fc3d1ed-b960-4493-b671-f035386f84ab req-a81d80f2-acfc-4075-be23-4daa5a7313dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "tag": "43b505ac-e909-4dd1-9dcb-4438bb257348"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:37.850235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3fc3d1ed-b960-4493-b671-f035386f84ab req-a81d80f2-acfc-4075-be23-4daa5a7313dc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:37.850784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3fc3d1ed-b960-4493-b671-f035386f84ab req-a81d80f2-acfc-4075-be23-4daa5a7313dc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.879418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3fc3d1ed-b960-4493-b671-f035386f84ab req-a81d80f2-acfc-4075-be23-4daa5a7313dc service nova] Creating event network-changed:43b505ac-e909-4dd1-9dcb-4438bb257348 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:42:37.915992 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3fc3d1ed-b960-4493-b671-f035386f84ab req-a81d80f2-acfc-4075-be23-4daa5a7313dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107524 Jul 26 04:42:37.916755 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1764/3650] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:37.924304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:37.928005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:37.939150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:37.939690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.940881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:37.941462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:37.987284 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-333029c9-052e-4f47-96b6-f8180885aeb1 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069188 Jul 26 04:42:37.992221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1765/3651] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:37 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:37.994276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de42d240-11c0-4723-8de2-1937abde160c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b54334c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:38.267150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de42d240-11c0-4723-8de2-1937abde160c tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605" status: 204 len: 0 microversion: 2.1 time: 0.277261 Jul 26 04:42:38.269053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1766/3652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:37 2022] DELETE /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:38.280275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1616392a-a5f2-4ee9-a3bf-2edd2e4a4323 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5146280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:38.319395 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1616392a-a5f2-4ee9-a3bf-2edd2e4a4323 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Image not found. Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1616392a-a5f2-4ee9-a3bf-2edd2e4a4323 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 HTTP/1.1 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bf284ca2-99d0-4a07-aaea-e29477007605'} Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bf284ca2-99d0-4a07-aaea-e29477007605 Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 04:42:38.321757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf284ca2-99d0-4a07-aaea-e29477007605 could not be found. Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1616392a-a5f2-4ee9-a3bf-2edd2e4a4323 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1616392a-a5f2-4ee9-a3bf-2edd2e4a4323 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605" status: 404 len: 62 microversion: 2.1 time: 0.049595 Jul 26 04:42:38.332452 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1767/3653] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Jul 26 04:42:38 2022] GET /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:38.338011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:38.338011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:38.353674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:38.360302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:38.363184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:38.363962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:38.915193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Building network info cache for instance {{(pid=119488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:40.057856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:40.078250 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0805880-54af-4d0e-9d8b-931f7bc868a0 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1500 microversion: 2.1 time: 1.747095 Jul 26 04:42:40.082548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1768/3654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:38 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1500 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:40.095223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6595a19a-657d-4bfd-89b3-b89e8f6e596b req-15c731f1-4f9d-4d72-9e2a-42b4b1dc834f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe150a8-6b33-4432-a16a-cbf4efd42a5a", "name": "network-vif-deleted", "tag": "01c8f07e-9b42-4002-bb61-2100fb103218"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:40.119697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6595a19a-657d-4bfd-89b3-b89e8f6e596b req-15c731f1-4f9d-4d72-9e2a-42b4b1dc834f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:40.120467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6595a19a-657d-4bfd-89b3-b89e8f6e596b req-15c731f1-4f9d-4d72-9e2a-42b4b1dc834f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:40.150568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6595a19a-657d-4bfd-89b3-b89e8f6e596b req-15c731f1-4f9d-4d72-9e2a-42b4b1dc834f service nova] Creating event network-vif-deleted:01c8f07e-9b42-4002-bb61-2100fb103218 for instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a on n-h1-848886-16 Jul 26 04:42:40.158645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6595a19a-657d-4bfd-89b3-b89e8f6e596b req-15c731f1-4f9d-4d72-9e2a-42b4b1dc834f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073956 Jul 26 04:42:40.159903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1769/3655] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:40.168261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:40.176397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:40.185136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:40.186059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:40.187573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:40.189606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:40.243695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e36c15b-d7e9-48c2-81ba-55389d74ad2c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081149 Jul 26 04:42:40.245519 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1770/3656] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:40 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:40.252188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-48d804bd-118f-4dd7-a9d6-5705926602b8 req-77b251f4-3ebc-4715-8561-0ada92639515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:40.266694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-48d804bd-118f-4dd7-a9d6-5705926602b8 req-77b251f4-3ebc-4715-8561-0ada92639515 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:40.267450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-48d804bd-118f-4dd7-a9d6-5705926602b8 req-77b251f4-3ebc-4715-8561-0ada92639515 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:40.283251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-48d804bd-118f-4dd7-a9d6-5705926602b8 req-77b251f4-3ebc-4715-8561-0ada92639515 service nova] Creating event network-changed:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:42:40.290901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-48d804bd-118f-4dd7-a9d6-5705926602b8 req-77b251f4-3ebc-4715-8561-0ada92639515 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043255 Jul 26 04:42:40.293360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1771/3657] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:41.107924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:41.108698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:41.124212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:41.127978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:41.129209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:41.133127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:41.648085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:41.661926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0897895-7d35-40f1-b14c-a8313b036f7e tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1506 microversion: 2.1 time: 0.562520 Jul 26 04:42:41.676368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1772/3658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:41 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:41.681909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:41.685459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:41.693011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:41.693802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:41.695284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:41.696080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:41.755892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9060025-3e5a-41aa-be66-1b86ecaed231 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077816 Jul 26 04:42:41.758377 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1773/3659] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:41 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:41.867615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Updating instance_info_cache with network_info: [{"id": "79cdd291-d012-41e2-b52d-896958606e0c", "address": "fa:16:3e:3a:00:66", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79cdd291-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:41.896872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Releasing lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:42:41.899079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-472e3fa3-6504-4fff-aefc-8993e86d4aed tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action" status: 202 len: 0 microversion: 2.1 time: 6.957356 Jul 26 04:42:41.899514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1887/3660] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:34 2022] POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action => generated 0 bytes in 6959 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:42:41.908505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5fe4b4d5-d1cd-4687-af65-d0cd9637f1f3 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '.version_select at 0x7f38b5f6bf70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:42.463467 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5fe4b4d5-d1cd-4687-af65-d0cd9637f1f3 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/2c2e2b70-b0c9-4594-a571-6e508429f528" status: 200 len: 185 microversion: 2.1 time: 0.559576 Jul 26 04:42:42.464410 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1774/3661] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Jul 26 04:42:41 2022] GET /compute/v2.1/os-floating-ips/2c2e2b70-b0c9-4594-a571-6e508429f528 => generated 185 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:42.478092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.154"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:42.683281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:42.683904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:42.696650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:42.697085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:42.698101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:42.701283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:42.868565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:42.877677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:42.878461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:42.880282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:42.883390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:43.225796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Acquired lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 04:42:43.253006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:43.262815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a95cfff4-a72d-4a82-8d24-70bcc88dbcf6 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1506 microversion: 2.1 time: 0.583345 Jul 26 04:42:43.278713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1775/3662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:42 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:43.289732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:43.299238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:43.346401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:43.346862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:43.350722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:43.352995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:43.441311 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32385073-d28c-48fc-bfb9-de0afc66c4cd tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158547 Jul 26 04:42:43.441951 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1776/3663] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:43 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:44.297230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:44.297959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:44.330499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:44.331114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:44.332027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:44.332481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:45.117890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:45.120363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:45.129055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c79745b-2e11-4978-bd1d-be4e0aa76c84 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1506 microversion: 2.1 time: 0.845065 Jul 26 04:42:45.129746 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1777/3664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:44 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:45.162252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:45.166438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:45.178794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:45.181239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:45.182698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:45.183806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:45.193016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:45.275183 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e04f92d5-cdfa-44ad-b5ff-75aae6b2092f tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123161 Jul 26 04:42:45.276800 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1778/3665] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:45 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:46.046482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Building network info cache for instance {{(pid=119488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 04:42:46.074752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dea30396-edbb-4a87-950f-a18815320d8e req-51d051fa-9c8d-4c8d-870c-7fcbd43f938a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:46.096584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dea30396-edbb-4a87-950f-a18815320d8e req-51d051fa-9c8d-4c8d-870c-7fcbd43f938a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:46.097321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dea30396-edbb-4a87-950f-a18815320d8e req-51d051fa-9c8d-4c8d-870c-7fcbd43f938a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:46.133872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dea30396-edbb-4a87-950f-a18815320d8e req-51d051fa-9c8d-4c8d-870c-7fcbd43f938a service nova] Creating event network-changed:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:42:46.149915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dea30396-edbb-4a87-950f-a18815320d8e req-51d051fa-9c8d-4c8d-870c-7fcbd43f938a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074616 Jul 26 04:42:46.151094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1779/3666] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:46.161723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:46.163922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:46.177937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:46.178580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:46.182445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:46.183187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:46.873572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:46.886179 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-deda8cba-77ac-4bed-b7a6-243bffecd352 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1501 microversion: 2.1 time: 0.733618 Jul 26 04:42:46.895047 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1780/3667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:46 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1501 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:46.901887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:46.908935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:46.916387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:46.916979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:46.918490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:46.919126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:46.977080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9d8d9d9-c776-4578-bfac-51204aca1db5 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080920 Jul 26 04:42:46.978964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1781/3668] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:42:46 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:42:47.197193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-759633074", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "0cf2c1ea-6da0-40d3-a117-7da1ff9a0cfb"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:47.277953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] validate_networks() for [('0cf2c1ea-6da0-40d3-a117-7da1ff9a0cfb', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:42:47.843983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Updating instance_info_cache with network_info: [{"id": "79cdd291-d012-41e2-b52d-896958606e0c", "address": "fa:16:3e:3a:00:66", "network": {"id": "0d4506c7-700c-4bd0-bdab-f0a3c1923fdf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-356106650-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61e162d202dc42688fee1f4a29da800c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79cdd291-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:42:47.848899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:47.858623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Releasing lock "refresh_cache-fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" {{(pid=119488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 04:42:47.859515 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba89b323-02ae-43fb-b901-80c06e47d413 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action" status: 202 len: 0 microversion: 2.1 time: 5.386480 Jul 26 04:42:47.866412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1888/3669] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:42 2022] POST /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf/action => generated 0 bytes in 5394 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 04:42:47.872159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:47.879875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:47.901049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:42:47.901480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:42:47.901962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:42:47.904263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:42:47.904263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:42:47.916838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:47.917417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:47.918366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:47.918944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:47.927526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:47.932084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:47.933090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:47.933545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:47.990666 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Cannot 'reboot' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action HTTP/1.1 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 28 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: {"reboot": {"type": "HARD"}} Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'reboot' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'eae1e975-620a-4b90-ac0a-39e6ca7c185e', 'body': {'reboot': {'type': 'HARD'}}} Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:42:47.998314 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.005680 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.007327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Getting quotas for project e20deb2a13034af5bc7146592559d779. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:42:48.008361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 409 to user: Cannot 'reboot' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:48.009511 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8e22e55-ae9b-4677-9314-dd2c4fcf1645 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action" status: 409 len: 145 microversion: 2.1 time: 0.142016 Jul 26 04:42:48.010739 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1889/3670] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:47 2022] POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action => generated 145 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:48.016355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1ba613f2-c58a-4e99-a9ca-766f1e1a2023 req-51ea894c-7fbb-4905-b36e-e2f634471741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8", "name": "network-vif-plugged", "status": "completed", "tag": "3cd91ef5-7ba7-404f-9b90-9c393350fd42"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:48.019949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Getting quotas for user d799d31539654a4b911888fbe57c32ec and project e20deb2a13034af5bc7146592559d779. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:42:48.032369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1ba613f2-c58a-4e99-a9ca-766f1e1a2023 req-51ea894c-7fbb-4905-b36e-e2f634471741 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.034728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1ba613f2-c58a-4e99-a9ca-766f1e1a2023 req-51ea894c-7fbb-4905-b36e-e2f634471741 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.053390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1ba613f2-c58a-4e99-a9ca-766f1e1a2023 req-51ea894c-7fbb-4905-b36e-e2f634471741 service nova] Creating event network-vif-plugged:3cd91ef5-7ba7-404f-9b90-9c393350fd42 for instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 on n-h2-848886-16 Jul 26 04:42:48.059116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1ba613f2-c58a-4e99-a9ca-766f1e1a2023 req-51ea894c-7fbb-4905-b36e-e2f634471741 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046890 Jul 26 04:42:48.060102 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1890/3671] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:48.061621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:42:48.066049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.068934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:42:48.071630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.081091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.081717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.082675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.083224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.110330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] HTTP exception thrown: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Request method failure captured: Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a HTTP/1.1 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33B-5v-GJaKJWK2nxMNwvYkyXH2nxo_zxwN1L6mDySJC_ouJDL7FFK7prrTUMCd20Q3tXGw0qJaRNebQS5qz8wE2K1Yvp5SF8aWwBtcPpWX5Cg-9kDxesfb8wI-kkEwqkRAokf4FXi_kKj9WszxY5IHAyA6gyMbM19HUJBx-Ar2XHV0 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61e162d202dc42688fee1f4a29da800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f1154bf52cfe424babc6bb55e0ad4927 Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'bbe150a8-6b33-4432-a16a-cbf4efd42a5a'} Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:48.113248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.118635 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.120205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Returning 404 to user: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:48.124444 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8308e463-ee1f-4134-9139-4daa5c1fb009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 404 len: 111 microversion: 2.1 time: 0.062761 Jul 26 04:42:48.128177 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1891/3672] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:48 2022] DELETE /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:48.142642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.144890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.160019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.160862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.161928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.162705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.172021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce9a2034-b5ff-4e17-8311-6c856f54c218 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191204 Jul 26 04:42:48.172684 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1782/3673] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:42:48.177551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:48.184447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.211144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.213007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.214518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.215131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.298418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Cannot 'rebuild' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action HTTP/1.1 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 65 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'rebuild' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'eae1e975-620a-4b90-ac0a-39e6ca7c185e', 'body': {'rebuild': {'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b'}}} Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:42:48.312978 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 409 to user: Cannot 'rebuild' instance eae1e975-620a-4b90-ac0a-39e6ca7c185e while it is in vm_state rescued {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:48.317586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-951cfe8a-ea59-4711-8515-b37f8aad6ef0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action" status: 409 len: 146 microversion: 2.1 time: 0.140837 Jul 26 04:42:48.320518 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1783/3674] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:42:48 2022] POST /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e/action => generated 146 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:48.328823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.329452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: bbe150a8-6b33-4432-a16a-cbf4efd42a5a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.363025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.363487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.368601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.369268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.416700 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] HTTP exception thrown: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Request method failure captured: Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a HTTP/1.1 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33B-5v-GJaKJWK2nxMNwvYkyXH2nxo_zxwN1L6mDySJC_ouJDL7FFK7prrTUMCd20Q3tXGw0qJaRNebQS5qz8wE2K1Yvp5SF8aWwBtcPpWX5Cg-9kDxesfb8wI-kkEwqkRAokf4FXi_kKj9WszxY5IHAyA6gyMbM19HUJBx-Ar2XHV0 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61e162d202dc42688fee1f4a29da800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f1154bf52cfe424babc6bb55e0ad4927 Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bbe150a8-6b33-4432-a16a-cbf4efd42a5a'} Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.420152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. Jul 26 04:42:48.427529 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:48.432877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Returning 404 to user: Instance bbe150a8-6b33-4432-a16a-cbf4efd42a5a could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:48.433986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36a62dda-83ed-41d7-a30e-003638ee80de tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a" status: 404 len: 111 microversion: 2.1 time: 0.113876 Jul 26 04:42:48.440722 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1784/3675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:48 2022] GET /compute/v2.1/servers/bbe150a8-6b33-4432-a16a-cbf4efd42a5a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:48.450696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f7a908b-df62-4fe3-9b13-7e64f6bda33a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.451355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f7a908b-df62-4fe3-9b13-7e64f6bda33a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.582430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4f7a908b-df62-4fe3-9b13-7e64f6bda33a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:48.592538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f7a908b-df62-4fe3-9b13-7e64f6bda33a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1227 microversion: 2.1 time: 0.150214 Jul 26 04:42:48.593163 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1785/3676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:48 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1227 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:48.602797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.603296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.631781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.632220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.633217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.633665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.705410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:48.918900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:48.923714 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa2061da-5cfa-43e2-979f-85907b9e8399 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 204 len: 0 microversion: 2.1 time: 0.328067 Jul 26 04:42:48.924315 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1786/3677] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:48 2022] DELETE /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:48.930538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21958294-d4df-4297-bf35-2c728abf6009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '.version_select at 0x7f38b54339d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.932955 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c40227c6-06a1-4aa7-8579-f1d17974f8d9 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1488 microversion: 2.1 time: 0.806250 Jul 26 04:42:48.933777 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1892/3678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:48 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1488 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:48.941771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:48.949949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:48.972599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.974348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:48.983638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:48.984184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:49.822187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:49.835772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c6da5e8-db04-4f38-8986-78504b5aaa06 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1691 microversion: 2.1 time: 0.898917 Jul 26 04:42:49.836703 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1893/3679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:48 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1691 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:49.842593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:49.843099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:49.849747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:49.850238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:49.851024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:49.851496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:49.881306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:49.979343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-66a8bb34-8569-4aa3-aee2-817091524d6b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 204 len: 0 microversion: 2.1 time: 0.139927 Jul 26 04:42:49.980953 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1894/3680] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:49 2022] DELETE /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:49.988484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:49.989397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:49.997423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:49.998032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:49.999478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.000098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.105236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21958294-d4df-4297-bf35-2c728abf6009 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/2c2e2b70-b0c9-4594-a571-6e508429f528" status: 202 len: 0 microversion: 2.1 time: 1.179640 Jul 26 04:42:50.108852 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1787/3681] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 04:42:48 2022] DELETE /compute/v2.1/os-floating-ips/2c2e2b70-b0c9-4594-a571-6e508429f528 => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:42:50.113933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5368b1f5-066a-48fa-97df-b0a4855889b5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b51b0f70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.121485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:50.130596 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1db9d6b3-3438-487e-b0dc-2a7dccc952e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1231 microversion: 2.1 time: 0.147451 Jul 26 04:42:50.131188 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1895/3682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:49 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1231 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:50.139823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.147307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:50.155444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-5368b1f5-066a-48fa-97df-b0a4855889b5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Image not found. Jul 26 04:42:50.158489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5368b1f5-066a-48fa-97df-b0a4855889b5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 HTTP/1.1 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bf284ca2-99d0-4a07-aaea-e29477007605'} Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf284ca2-99d0-4a07-aaea-e29477007605 to delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf284ca2-99d0-4a07-aaea-e29477007605 could not be found. Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.159036 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:42:50.164595 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:50.167700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5368b1f5-066a-48fa-97df-b0a4855889b5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:50.168831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.169786 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5368b1f5-066a-48fa-97df-b0a4855889b5 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605" status: 404 len: 62 microversion: 2.1 time: 0.058603 Jul 26 04:42:50.170857 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1788/3683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:50 2022] DELETE /compute/v2.1/images/bf284ca2-99d0-4a07-aaea-e29477007605 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:50.171859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.174055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.180451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a9d157d8-f80b-41ea-920b-22799a31970a req-114b4fb4-eed4-4729-a4a9-94d646e3ed6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8", "name": "network-vif-unplugged", "status": "completed", "tag": "3cd91ef5-7ba7-404f-9b90-9c393350fd42"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:50.205058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9d157d8-f80b-41ea-920b-22799a31970a req-114b4fb4-eed4-4729-a4a9-94d646e3ed6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.205906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9d157d8-f80b-41ea-920b-22799a31970a req-114b4fb4-eed4-4729-a4a9-94d646e3ed6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.227994 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a9d157d8-f80b-41ea-920b-22799a31970a req-114b4fb4-eed4-4729-a4a9-94d646e3ed6d service nova] Creating event network-vif-unplugged:3cd91ef5-7ba7-404f-9b90-9c393350fd42 for instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 on n-h2-848886-16 Jul 26 04:42:50.229304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:50.235052 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a9d157d8-f80b-41ea-920b-22799a31970a req-114b4fb4-eed4-4729-a4a9-94d646e3ed6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062497 Jul 26 04:42:50.236474 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1789/3684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:50.242763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.243993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:50.252988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.253537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.255291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.255870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.312724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:42:50.379473 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2872d6ed-4a0f-44b0-8919-64c0ed2e9a90 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 204 len: 0 microversion: 2.1 time: 0.243829 Jul 26 04:42:50.380446 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1896/3685] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:50 2022] DELETE /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:50.389719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.392028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:50.405779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.408254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.411156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.411805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.422664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.compute.api [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Instance is already in deleting state, ignoring this request Jul 26 04:42:50.424523 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37c578fd-88bb-4fe3-9860-a72411699c64 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 204 len: 0 microversion: 2.1 time: 0.186674 Jul 26 04:42:50.432545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1790/3686] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:50 2022] DELETE /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:42:50.443775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.444846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:50.458714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.464371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.465423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.466139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.626580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:50.641656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-562e4d6d-6aab-466b-810c-24704cf3b0df tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1525 microversion: 2.1 time: 0.257049 Jul 26 04:42:50.642464 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1897/3687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:50 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1525 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:50.702677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:50.717377 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb7fb723-c916-4247-8bb0-78d97689555b tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1494 microversion: 2.1 time: 0.278825 Jul 26 04:42:50.718688 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1791/3688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:50 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:50.864307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:50.865665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:50.880046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.880511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:50.881695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:50.882163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.073984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:51.082883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79b9e320-9b74-4dc6-ad66-ec23f41a5605 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1691 microversion: 2.1 time: 0.224377 Jul 26 04:42:51.083580 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1898/3689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:50 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:51.152325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:51.152938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:51.160623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.161081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.161856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.162332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.239540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:51.250796 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-004f872a-9687-4898-b30c-7e93f56e3290 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1231 microversion: 2.1 time: 0.101949 Jul 26 04:42:51.251717 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1792/3690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:51 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:51.665338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:51.666699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:51.670069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:51.678697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.680163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.682321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.683322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.741927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:51.742687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:51.764365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.765037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.765958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:51.766516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:51.866513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:51.883919 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df820130-c16a-44ef-a3e6-e91ff545e504 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1525 microversion: 2.1 time: 0.224374 Jul 26 04:42:51.884914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1899/3691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:51 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1525 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:52.106235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:52.106943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:52.115727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.116350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:52.117199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.117555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:52.272607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:52.288536 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de981b93-6437-45f7-a931-b7276a641aad tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1494 microversion: 2.1 time: 0.552985 Jul 26 04:42:52.290231 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1793/3692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:51 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1494 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:52.315586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:52.319458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:52.331539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.332920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:52.334073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.335326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:52.337795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:52.348607 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-637a11be-69e2-4476-9792-0699ec99f404 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1691 microversion: 2.1 time: 0.246954 Jul 26 04:42:52.363291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1900/3693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:52 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:52.492833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:52.528102 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d55b0a97-f735-48ca-8c8c-a7d3ca428c02 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1231 microversion: 2.1 time: 0.232670 Jul 26 04:42:52.530858 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1794/3694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:52 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1231 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:52.905618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:52.906282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:52.919844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.920391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:52.921176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:52.921630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.017481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:53.029658 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d5fba135-028f-491a-a4b7-c27fc56aa553 tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1483 microversion: 2.1 time: 0.127882 Jul 26 04:42:53.030694 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1901/3695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:52 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1483 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:53.327847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:53.328496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-65ae8e69-8116-43f4-a948-a5b3499e5efb req-0799572f-f3db-45b3-8eb0-51b7f01a6ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf", "name": "network-vif-deleted", "tag": "79cdd291-d012-41e2-b52d-896958606e0c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:53.329758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:53.361818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.366300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.369508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.370316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.371308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-65ae8e69-8116-43f4-a948-a5b3499e5efb req-0799572f-f3db-45b3-8eb0-51b7f01a6ba4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.387561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-65ae8e69-8116-43f4-a948-a5b3499e5efb req-0799572f-f3db-45b3-8eb0-51b7f01a6ba4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.423975 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-65ae8e69-8116-43f4-a948-a5b3499e5efb req-0799572f-f3db-45b3-8eb0-51b7f01a6ba4 service nova] Creating event network-vif-deleted:79cdd291-d012-41e2-b52d-896958606e0c for instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf on n-h1-848886-16 Jul 26 04:42:53.434181 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-65ae8e69-8116-43f4-a948-a5b3499e5efb req-0799572f-f3db-45b3-8eb0-51b7f01a6ba4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115113 Jul 26 04:42:53.436297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1902/3696] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:42:53.442728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:53.443720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:53.472163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.474182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.475293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.477584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.804361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:53.819180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22d81b90-fc09-44f7-9626-b4509abb704c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1691 microversion: 2.1 time: 0.379926 Jul 26 04:42:53.832208 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1903/3697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:53 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1691 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:53.838536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:53.839772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:53.847682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.849043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.883944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:53.886756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:53.898745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:54.018619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:54.027441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ab37eb8-e462-4b3a-9ec6-9245a26b4470 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1494 microversion: 2.1 time: 0.713416 Jul 26 04:42:54.030481 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1795/3698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:53 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1494 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:54.054686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:54.055648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:54.069642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:54.079192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:54.082936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:54.085215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:54.178629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:54.179097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:54.179645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lazy-loading 'fault' on Instance uuid fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:42:54.319974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1154bf52cfe424babc6bb55e0ad4927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e162d202dc42688fee1f4a29da800c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:54.328642 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e218f8a-43c7-4c45-b439-153fee870d7b tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 200 len: 1313 microversion: 2.1 time: 0.277729 Jul 26 04:42:54.341273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1796/3699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:54 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:54.489636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:54.507480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c7f4b3e6-ec0d-4187-bf8f-2dd5a7ef05e6 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1279 microversion: 2.1 time: 0.672963 Jul 26 04:42:54.510306 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1904/3700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:53 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1279 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:54.856013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:54.857164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:54.872145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:54.874791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:54.877115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:54.877815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:54.914030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:55.053310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:55.054238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:55.064942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.066313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.068177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.068837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.462540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:55.474050 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8e72b5c0-ebe7-4a54-8c95-89a615bbad41 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1691 microversion: 2.1 time: 0.622453 Jul 26 04:42:55.474869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1797/3701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:54 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1691 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:55.479222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:55.479839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] [instance: fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:55.483838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:55.499879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30ee3bd4-6dee-4ca4-95e8-e2750051bc95 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1494 microversion: 2.1 time: 0.449438 Jul 26 04:42:55.502904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1905/3702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:55 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1494 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:55.505993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.506810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.508338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.509071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.528398 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] HTTP exception thrown: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. Jul 26 04:42:55.536400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:55.537394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Request method failure captured: Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf HTTP/1.1 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33B-5v-GJaKJWK2nxMNwvYkyXH2nxo_zxwN1L6mDySJC_ouJDL7FFK7prrTUMCd20Q3tXGw0qJaRNebQS5qz8wE2K1Yvp5SF8aWwBtcPpWX5Cg-9kDxesfb8wI-kkEwqkRAokf4FXi_kKj9WszxY5IHAyA6gyMbM19HUJBx-Ar2XHV0 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61e162d202dc42688fee1f4a29da800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61e162d202dc42688fee1f4a29da800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 61e162d202dc42688fee1f4a29da800c Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1666747423 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f1154bf52cfe424babc6bb55e0ad4927 Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1666747423-project Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf'} Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:55.541787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. Jul 26 04:42:55.547768 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:55.551081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] Returning 404 to user: Instance fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:55.552171 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73a722c6-44d1-4b54-b151-585a826c42be tempest-FloatingIPsAssociationTestJSON-1666747423 tempest-FloatingIPsAssociationTestJSON-1666747423-project] 10.222.0.43 "GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf" status: 404 len: 111 microversion: 2.1 time: 0.076453 Jul 26 04:42:55.552555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.553200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.554465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:55.555080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:55.562300 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1798/3703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:55 2022] GET /compute/v2.1/servers/fe6fa114-f9e6-4d26-a2b9-f9a1c7c733cf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:55.704804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:55.733651 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-525c7c42-17ff-48f9-bddb-45b21ea8e17b tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1285 microversion: 2.1 time: 0.201658 Jul 26 04:42:55.749270 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1906/3704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:55 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:56.263385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aa9379a1-87e7-4080-97ba-07585eb216a6 req-5eda1f38-8617-44b0-bda9-196ca1479c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8", "name": "network-vif-deleted", "tag": "3cd91ef5-7ba7-404f-9b90-9c393350fd42"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:56.300866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aa9379a1-87e7-4080-97ba-07585eb216a6 req-5eda1f38-8617-44b0-bda9-196ca1479c9e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.301802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aa9379a1-87e7-4080-97ba-07585eb216a6 req-5eda1f38-8617-44b0-bda9-196ca1479c9e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.325701 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aa9379a1-87e7-4080-97ba-07585eb216a6 req-5eda1f38-8617-44b0-bda9-196ca1479c9e service nova] Creating event network-vif-deleted:3cd91ef5-7ba7-404f-9b90-9c393350fd42 for instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 on n-h2-848886-16 Jul 26 04:42:56.346280 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aa9379a1-87e7-4080-97ba-07585eb216a6 req-5eda1f38-8617-44b0-bda9-196ca1479c9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087795 Jul 26 04:42:56.347684 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1799/3705] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:56.508378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:56.511307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:56.527480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:56.529750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:56.547224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.548034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.550850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.551323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.552016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.552697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.553724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.557326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.644133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.644807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.650484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lazy-loading 'fault' on Instance uuid cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:42:56.798784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8644f4ea57d44617b1b4652993df8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc1ca26ebac4a96adf2b4b46215bdbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:56.809262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab7d0869-f8d1-4ea8-93c0-cc7abb323cc3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 200 len: 1297 microversion: 2.1 time: 0.286693 Jul 26 04:42:56.812045 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1800/3706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:56 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 1297 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:42:56.828463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:56.829852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:56.861466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.861923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.862775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:56.863215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:56.956328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:56.977811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a45a2de3-dc84-4486-ac34-3c2ed119967e tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1624 microversion: 2.1 time: 0.483150 Jul 26 04:42:56.983203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1907/3707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:56 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1624 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:57.245394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:57.258171 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d483001-98d1-488f-927f-532a285dfd7e tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.444965 Jul 26 04:42:57.258778 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1801/3708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:56 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:57.838442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:57.839041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:57.853492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:57.857001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:57.858240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:57.861017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:57.906747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-47d75ce8-7820-412b-97fd-6ef877f88772 req-270c330d-de6f-4543-894c-e1448b622f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9edfc9-4a82-42b9-b5c1-cdebc53e011f", "tag": "c54d0e6d-2831-40db-912c-89dcf989874d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:57.927178 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 HTTP/1.1 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8'} Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:57.931804 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. Jul 26 04:42:57.938316 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:57.941304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:57.948714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-596dacce-0957-4d8d-9741-365eb388b351 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8" status: 404 len: 111 microversion: 2.1 time: 0.111087 Jul 26 04:42:57.951835 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1908/3709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:57 2022] GET /compute/v2.1/servers/cfcbefcf-9966-4df6-9a0b-9a81b4bfc5f8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:57.953059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47d75ce8-7820-412b-97fd-6ef877f88772 req-270c330d-de6f-4543-894c-e1448b622f4f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:57.954996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47d75ce8-7820-412b-97fd-6ef877f88772 req-270c330d-de6f-4543-894c-e1448b622f4f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:57.970639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:57.973821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15f58b2e-7fa0-4d66-aec3-9988f0678967 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b4c18ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.011343 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-47d75ce8-7820-412b-97fd-6ef877f88772 req-270c330d-de6f-4543-894c-e1448b622f4f service nova] Creating event network-changed:c54d0e6d-2831-40db-912c-89dcf989874d for instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f on n-h2-848886-16 Jul 26 04:42:58.028385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-47d75ce8-7820-412b-97fd-6ef877f88772 req-270c330d-de6f-4543-894c-e1448b622f4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125852 Jul 26 04:42:58.032687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-15f58b2e-7fa0-4d66-aec3-9988f0678967 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Image not found. Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15f58b2e-7fa0-4d66-aec3-9988f0678967 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea HTTP/1.1 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '12e7c026-73c0-412b-a02b-b6e81afde3ea'} Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 12e7c026-73c0-412b-a02b-b6e81afde3ea to delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12e7c026-73c0-412b-a02b-b6e81afde3ea could not be found. Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.035108 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15f58b2e-7fa0-4d66-aec3-9988f0678967 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.040436 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15f58b2e-7fa0-4d66-aec3-9988f0678967 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea" status: 404 len: 62 microversion: 2.1 time: 0.080724 Jul 26 04:42:58.042564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1909/3710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:57 2022] DELETE /compute/v2.1/images/12e7c026-73c0-412b-a02b-b6e81afde3ea => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:58.047032 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1802/3711] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:58.055238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.062369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.067820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.073627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.094510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.095087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.095944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.096386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.100461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.100919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.101708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.102183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.155847 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 HTTP/1.1 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0a879a17-64bf-4c5d-9861-2bfcffc20211'} Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.161809 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9080ecca-8535-40db-9c0f-ca206dd5f339 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 404 len: 111 microversion: 2.1 time: 0.115181 Jul 26 04:42:58.167572 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1803/3712] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:58 2022] DELETE /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:58.181418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.182044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: 0a879a17-64bf-4c5d-9861-2bfcffc20211] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.193292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.193806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.194630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.195075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.218507 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 HTTP/1.1 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0a879a17-64bf-4c5d-9861-2bfcffc20211'} Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.220535 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.225268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance 0a879a17-64bf-4c5d-9861-2bfcffc20211 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.235770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b216f250-cbd5-4762-8812-8b714e2cbf5a tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211" status: 404 len: 111 microversion: 2.1 time: 0.056406 Jul 26 04:42:58.240420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1804/3713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] GET /compute/v2.1/servers/0a879a17-64bf-4c5d-9861-2bfcffc20211 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:58.254641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e87dffd7-b831-46e2-a21e-fa63e86854ce tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b5183820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.295534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-e87dffd7-b831-46e2-a21e-fa63e86854ce tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Image not found. Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e87dffd7-b831-46e2-a21e-fa63e86854ce tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c HTTP/1.1 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'a29b6a88-5808-42ee-8985-6e739d71638c'} Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a29b6a88-5808-42ee-8985-6e739d71638c to delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a29b6a88-5808-42ee-8985-6e739d71638c could not be found. Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.297518 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e87dffd7-b831-46e2-a21e-fa63e86854ce tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e87dffd7-b831-46e2-a21e-fa63e86854ce tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c" status: 404 len: 62 microversion: 2.1 time: 0.057236 Jul 26 04:42:58.303590 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1805/3714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] DELETE /compute/v2.1/images/a29b6a88-5808-42ee-8985-6e739d71638c => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:58.311068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.313633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.335966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.338265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.340718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.343137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.370240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:58.393360 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df814ee9-896c-4f78-b12f-93a50dffaae6 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 200 len: 1624 microversion: 2.1 time: 0.344054 Jul 26 04:42:58.399336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1910/3715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 1624 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:58.423811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.425665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.433860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.434866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.436588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.437745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.462940 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 HTTP/1.1 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c518e51c-de3f-4b20-a9b2-0d9805d73e12'} Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.464818 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.470486 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.478485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.479933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b3490fe-255b-4ce1-aea0-6bbec81a9870 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 404 len: 111 microversion: 2.1 time: 0.067886 Jul 26 04:42:58.483294 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1911/3716] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:58 2022] DELETE /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:58.496177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6b9dacae-7f0b-4fc0-b8ad-7faf688009bf req-83576219-902e-4348-b3a1-d7210d645129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a70b24-580b-47d3-8837-04bf45ee8aaf", "name": "network-vif-deleted", "tag": "9321c322-a16c-406a-9672-d83546c6ec49"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:42:58.514852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6b9dacae-7f0b-4fc0-b8ad-7faf688009bf req-83576219-902e-4348-b3a1-d7210d645129 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.515672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6b9dacae-7f0b-4fc0-b8ad-7faf688009bf req-83576219-902e-4348-b3a1-d7210d645129 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.561355 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6b9dacae-7f0b-4fc0-b8ad-7faf688009bf req-83576219-902e-4348-b3a1-d7210d645129 service nova] Creating event network-vif-deleted:9321c322-a16c-406a-9672-d83546c6ec49 for instance 27a70b24-580b-47d3-8837-04bf45ee8aaf on n-h2-848886-16 Jul 26 04:42:58.569155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6b9dacae-7f0b-4fc0-b8ad-7faf688009bf req-83576219-902e-4348-b3a1-d7210d645129 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084169 Jul 26 04:42:58.570073 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1912/3717] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:42:58.576846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.577217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c518e51c-de3f-4b20-a9b2-0d9805d73e12] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.585885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.586380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.586743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:58.587173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.588967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.613118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 HTTP/1.1 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c518e51c-de3f-4b20-a9b2-0d9805d73e12'} Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.615677 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. Jul 26 04:42:58.620945 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.622574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance c518e51c-de3f-4b20-a9b2-0d9805d73e12 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.624018 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf9d6739-46d1-42ab-b530-ddc1e57165f3 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12" status: 404 len: 111 microversion: 2.1 time: 0.052484 Jul 26 04:42:58.624785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1913/3718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] GET /compute/v2.1/servers/c518e51c-de3f-4b20-a9b2-0d9805d73e12 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:58.633023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e21ee789-9673-408a-b10f-f37994b302b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '.version_select at 0x7f38b522cd30>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.659690 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e21ee789-9673-408a-b10f-f37994b302b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Image not found. Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e21ee789-9673-408a-b10f-f37994b302b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 HTTP/1.1 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '2ae0b4be-7612-46c4-96e0-d6a614d213a5'} Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ae0b4be-7612-46c4-96e0-d6a614d213a5 to delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ae0b4be-7612-46c4-96e0-d6a614d213a5 could not be found. Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.661712 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:42:58.666943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.670474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e21ee789-9673-408a-b10f-f37994b302b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.671519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e21ee789-9673-408a-b10f-f37994b302b1 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5" status: 404 len: 62 microversion: 2.1 time: 0.042568 Jul 26 04:42:58.672564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1914/3719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] DELETE /compute/v2.1/images/2ae0b4be-7612-46c4-96e0-d6a614d213a5 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:42:58.682609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.686917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.701025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.701885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.702923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.703536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.718941 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 HTTP/1.1 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c595005c-360b-440d-b7a2-d441fb1266a2'} Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.720732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.725794 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.728869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.740346 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e103c462-eb26-4bd8-b2e0-9254f4707498 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 404 len: 111 microversion: 2.1 time: 0.053049 Jul 26 04:42:58.741587 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1915/3720] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:42:58 2022] DELETE /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:58.750182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:58.753948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] [instance: c595005c-360b-440d-b7a2-d441fb1266a2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:58.769923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:42:58.772344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.773120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.774123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:58.774943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:58.782946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37eb2ca1-d6d4-43f6-823d-2eb928504454 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.478535 Jul 26 04:42:58.785818 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1806/3721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:42:58.808139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] HTTP exception thrown: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Request method failure captured: Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 HTTP/1.1 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32_YF39GZPycKRHcrJNrnD3XFkOrlPv81HySxj5XJjeRePFeyRCThPWDADvO57ZRD854T6daWjExWmYAEEjKAhMKltCrqFHhPKbcl4bmKjuf5CKqX3OHILDxta8hslTssoZ3Qz8OOlU1McD1Yzi4_5-Yw23CUSuLApNRzqfjKv56-tc Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_efc1ca26ebac4a96adf2b4b46215bdbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: efc1ca26ebac4a96adf2b4b46215bdbe Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesTestJSON-1806165327 Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8644f4ea57d44617b1b4652993df8cdd Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesTestJSON-1806165327-project Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c595005c-360b-440d-b7a2-d441fb1266a2'} Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.811467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. Jul 26 04:42:58.817753 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:42:58.820419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] Returning 404 to user: Instance c595005c-360b-440d-b7a2-d441fb1266a2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:58.821911 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eeab390b-1b83-49b9-8540-b53250eecf86 tempest-ImagesTestJSON-1806165327 tempest-ImagesTestJSON-1806165327-project] 10.222.0.43 "GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2" status: 404 len: 111 microversion: 2.1 time: 0.076354 Jul 26 04:42:58.823155 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1916/3722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:58 2022] GET /compute/v2.1/servers/c595005c-360b-440d-b7a2-d441fb1266a2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:59.424271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:59.426126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 27a70b24-580b-47d3-8837-04bf45ee8aaf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:59.435194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:59.435975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:59.436761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:59.437374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:59.460358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf HTTP/1.1 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '27a70b24-580b-47d3-8837-04bf45ee8aaf'} Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:59.462769 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 404 to user: Instance 27a70b24-580b-47d3-8837-04bf45ee8aaf could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ffb397a-f129-4c17-b2fa-7e104e338b99 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf" status: 404 len: 111 microversion: 2.1 time: 0.043870 Jul 26 04:42:59.473291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1807/3723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:59 2022] GET /compute/v2.1/servers/27a70b24-580b-47d3-8837-04bf45ee8aaf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:42:59.484196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15b9f931-7c43-4273-ae94-06c6c3d65cde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '.version_select at 0x7f38bac7cee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:59.516165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15b9f931-7c43-4273-ae94-06c6c3d65cde tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415453824" status: 202 len: 0 microversion: 2.1 time: 0.038623 Jul 26 04:42:59.516393 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1917/3724] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415453824 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:42:59.819989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:42:59.820955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:42:59.837603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:59.839541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:42:59.840779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:42:59.841621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:00.327918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:00.340328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1991769-77ae-4927-af00-ca6e7257ad5a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.536680 Jul 26 04:43:00.343049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1808/3725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:42:59 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:01.368444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:01.369252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:01.383995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:01.386890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:01.388048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:01.394729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:02.337996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:02.351854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61ec9195-4358-4470-9d73-4f67f28781e0 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.987679 Jul 26 04:43:02.355274 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1918/3726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:01 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:03.377899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:03.379185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:03.398871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:03.400131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:03.406426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:03.407509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:04.001413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:04.019344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a5d65d5-65ed-4c70-a596-7bba837b3a4a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.646456 Jul 26 04:43:04.019933 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1809/3727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:03 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:05.048350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:05.049042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:05.070090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:05.072131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:05.074624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:05.077298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:05.558343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:05.576189 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2af62aa9-3547-4514-8d1d-13cc437380f3 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.538456 Jul 26 04:43:05.577520 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1919/3728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:05 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:05.764740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f93e943d-ea21-4cc1-b54f-2a1ec143fe07 req-96e84504-6c2a-4eb8-93dc-8a78ae6e81c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9edfc9-4a82-42b9-b5c1-cdebc53e011f", "name": "network-vif-plugged", "status": "completed", "tag": "c54d0e6d-2831-40db-912c-89dcf989874d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:05.797728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f93e943d-ea21-4cc1-b54f-2a1ec143fe07 req-96e84504-6c2a-4eb8-93dc-8a78ae6e81c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:05.801889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f93e943d-ea21-4cc1-b54f-2a1ec143fe07 req-96e84504-6c2a-4eb8-93dc-8a78ae6e81c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:05.830291 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f93e943d-ea21-4cc1-b54f-2a1ec143fe07 req-96e84504-6c2a-4eb8-93dc-8a78ae6e81c1 service nova] Creating event network-vif-plugged:c54d0e6d-2831-40db-912c-89dcf989874d for instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f on n-h2-848886-16 Jul 26 04:43:05.849136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f93e943d-ea21-4cc1-b54f-2a1ec143fe07 req-96e84504-6c2a-4eb8-93dc-8a78ae6e81c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088809 Jul 26 04:43:05.850332 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1810/3729] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:06.597380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:06.598867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:06.610537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:06.611003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:06.611823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:06.612846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:06.857577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:06.868825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f08376c4-5cb3-49c7-98b4-02ac5ca8e813 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.275125 Jul 26 04:43:06.884063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1920/3730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:06 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:07.895119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:07.896445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:07.929148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:07.929740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:07.930502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:07.930932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:08.278444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:08.292407 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-64528083-7dc0-4cae-b0c1-c07e4c1fd42c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1327 microversion: 2.1 time: 0.402809 Jul 26 04:43:08.293644 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1811/3731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:07 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1327 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:09.321709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:09.322506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:09.335294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.335762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.337107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.338478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.722915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:09.724045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:09.735327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.737352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.738822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.743225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.779418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:09.794429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:43:09.798889 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a2b3c36-9493-4e22-8099-8fde637407e1 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1527 microversion: 2.1 time: 0.482193 Jul 26 04:43:09.805561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1921/3732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:09 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1527 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:09.840537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:09.843615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:09.867841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.877296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.880136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:09.880775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:09.996214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d52742bb-0fb7-49ca-a653-c0d63701d49d tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 204 len: 0 microversion: 2.1 time: 0.275932 Jul 26 04:43:09.998536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1812/3733] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:09 2022] DELETE /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:43:10.013900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.015078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:10.028646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.031590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.034303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.038128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.164963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:10.174665 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-329b8c9a-5367-4da5-954f-6c23ac0e7b88 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1527 microversion: 2.1 time: 0.345733 Jul 26 04:43:10.191517 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1922/3734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:09 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1527 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:10.373012 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1bc14eae-32d7-4565-80a2-1e875f211c51 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.179459 Jul 26 04:43:10.374719 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1923/3735] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 04:43:10.528340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.529820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:10.543878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.545949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.547149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.547812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.568372 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] HTTP exception thrown: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Request method failure captured: Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f HTTP/1.1 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33DG-qaOb7HPncr5g9WC7cUXCYF30PJVSVcCs8kMLl5LtZqWzahigXMeL9AKE57lwggtgjKHJEMVmhbufqsSPkT8JFSyJCt6wVzEnlyL8DZkMG8MAxP_Hx9aS3nQ5jaicr0aOEi3dakV6l0OEMMv07XWdIKvuG2qub6X36ny4ZAR-ic Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4a08a572cae34b858daca34e22ecc89e Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4a08a572cae34b858daca34e22ecc89e Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1388311540-project Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: db2de1c9b4e04e8d975867b1ce9df9c4 Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540-project Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '4f9edfc9-4a82-42b9-b5c1-cdebc53e011f'} Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:10.572120 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:10.580927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.584618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Returning 404 to user: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:10.586400 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a373ec9-5da8-4ee0-93a6-2612487351c8 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 404 len: 111 microversion: 2.1 time: 0.209733 Jul 26 04:43:10.587304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1924/3736] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:10.619519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca9b12c5-f20d-401d-bddc-e7e75297bb3e tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Calling method '.version_select at 0x7f38bac61ca0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.671574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ca9b12c5-f20d-401d-bddc-e7e75297bb3e tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] HTTP exception thrown: Image not found. Jul 26 04:43:10.672989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca9b12c5-f20d-401d-bddc-e7e75297bb3e tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Request method failure captured: Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Dd1-r-29ecOcXa2TZBOFz3KOgtBs014pc6LMwK-dJjqDq-jtR_omy8MQFeK39QfCs9pNNd_RPqwBQ1j_AyskRXfvoRfIx-Peat701ujyEZw0I7opuMaECNxYrEkbBfFQYuYQIL6YFeNpMtX0d1WPs6oVBAclfJWJs56XIOkRx57rE Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 52da42f39be04610b6a9972861cd4fba Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: exception: Image not found. Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '-1'} Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.674556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:43:10.683393 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.691759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca9b12c5-f20d-401d-bddc-e7e75297bb3e tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Returning 404 to user: Image not found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:10.694255 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca9b12c5-f20d-401d-bddc-e7e75297bb3e tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.105280 Jul 26 04:43:10.696140 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1925/3737] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:43:10.701895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b055bd6c-fc89-4e7a-824d-0604377132ce tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1507 microversion: 2.1 time: 0.698617 Jul 26 04:43:10.705906 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1813/3738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:10 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:10.707890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.709374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:10.721051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.722958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.724448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:10.725286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:10.728961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26da1cba-5a86-4e74-b3a7-9ce4d67d7ba3 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Calling method '.version_select at 0x7f38b5d9a820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.803701 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-26da1cba-5a86-4e74-b3a7-9ce4d67d7ba3 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] HTTP exception thrown: Image not found. Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26da1cba-5a86-4e74-b3a7-9ce4d67d7ba3 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Request method failure captured: Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/be4cfabe-5936-4ccb-9cab-715ff6d0a08j HTTP/1.1 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Dd1-r-29ecOcXa2TZBOFz3KOgtBs014pc6LMwK-dJjqDq-jtR_omy8MQFeK39QfCs9pNNd_RPqwBQ1j_AyskRXfvoRfIx-Peat701ujyEZw0I7opuMaECNxYrEkbBfFQYuYQIL6YFeNpMtX0d1WPs6oVBAclfJWJs56XIOkRx57rE Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 52da42f39be04610b6a9972861cd4fba Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'be4cfabe-5936-4ccb-9cab-715ff6d0a08j'} Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image be4cfabe-5936-4ccb-9cab-715ff6d0a08j to delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be4cfabe-5936-4ccb-9cab-715ff6d0a08j could not be found. Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.808332 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26da1cba-5a86-4e74-b3a7-9ce4d67d7ba3 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26da1cba-5a86-4e74-b3a7-9ce4d67d7ba3 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/be4cfabe-5936-4ccb-9cab-715ff6d0a08j" status: 404 len: 62 microversion: 2.1 time: 0.091133 Jul 26 04:43:10.815442 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1814/3739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/be4cfabe-5936-4ccb-9cab-715ff6d0a08j => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:43:10.834347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78512e8f-3029-4038-9c76-b2e495a0ad4d tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Calling method '.version_select at 0x7f38b509fee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.859572 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-78512e8f-3029-4038-9c76-b2e495a0ad4d tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] HTTP exception thrown: Image not found. Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78512e8f-3029-4038-9c76-b2e495a0ad4d tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Request method failure captured: Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/03cdd170-e897-4ff1-9ff7-aa333604dd801 HTTP/1.1 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Dd1-r-29ecOcXa2TZBOFz3KOgtBs014pc6LMwK-dJjqDq-jtR_omy8MQFeK39QfCs9pNNd_RPqwBQ1j_AyskRXfvoRfIx-Peat701ujyEZw0I7opuMaECNxYrEkbBfFQYuYQIL6YFeNpMtX0d1WPs6oVBAclfJWJs56XIOkRx57rE Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 52da42f39be04610b6a9972861cd4fba Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '03cdd170-e897-4ff1-9ff7-aa333604dd801'} Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 03cdd170-e897-4ff1-9ff7-aa333604dd801 to delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 03cdd170-e897-4ff1-9ff7-aa333604dd801 could not be found. Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.862229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:43:10.866810 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.871244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78512e8f-3029-4038-9c76-b2e495a0ad4d tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:10.872331 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78512e8f-3029-4038-9c76-b2e495a0ad4d tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/03cdd170-e897-4ff1-9ff7-aa333604dd801" status: 404 len: 62 microversion: 2.1 time: 0.045098 Jul 26 04:43:10.874236 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1815/3740] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/03cdd170-e897-4ff1-9ff7-aa333604dd801 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:43:10.895017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4ed48f1-d249-4177-a59d-fa5e537f0ea8 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Calling method '.version_select at 0x7f38b4f5f790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:10.929434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b4ed48f1-d249-4177-a59d-fa5e537f0ea8 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] HTTP exception thrown: Image not found. Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4ed48f1-d249-4177-a59d-fa5e537f0ea8 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Request method failure captured: Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/tempest-invalid-887974085 HTTP/1.1 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Dd1-r-29ecOcXa2TZBOFz3KOgtBs014pc6LMwK-dJjqDq-jtR_omy8MQFeK39QfCs9pNNd_RPqwBQ1j_AyskRXfvoRfIx-Peat701ujyEZw0I7opuMaECNxYrEkbBfFQYuYQIL6YFeNpMtX0d1WPs6oVBAclfJWJs56XIOkRx57rE Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 52da42f39be04610b6a9972861cd4fba Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'tempest-invalid-887974085'} Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-887974085 to delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-887974085 could not be found. Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.931228 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4ed48f1-d249-4177-a59d-fa5e537f0ea8 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:10.948323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4ed48f1-d249-4177-a59d-fa5e537f0ea8 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/tempest-invalid-887974085" status: 404 len: 62 microversion: 2.1 time: 0.065094 Jul 26 04:43:10.956839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1816/3741] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/tempest-invalid-887974085 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:43:10.970793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a706b87-4c11-4186-bc7f-ba258993e909 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Calling method '.version_select at 0x7f38b5d9a820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:11.015212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3a706b87-4c11-4186-bc7f-ba258993e909 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] HTTP exception thrown: Image not found. Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a706b87-4c11-4186-bc7f-ba258993e909 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Request method failure captured: Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/images/a22b5b0c-a039-4217-94cc-ca0e97269e8f HTTP/1.1 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Dd1-r-29ecOcXa2TZBOFz3KOgtBs014pc6LMwK-dJjqDq-jtR_omy8MQFeK39QfCs9pNNd_RPqwBQ1j_AyskRXfvoRfIx-Peat701ujyEZw0I7opuMaECNxYrEkbBfFQYuYQIL6YFeNpMtX0d1WPs6oVBAclfJWJs56XIOkRx57rE Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e4d52069e6b46dd80547ffb020889b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 3e4d52069e6b46dd80547ffb020889b6 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-147255602 Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 52da42f39be04610b6a9972861cd4fba Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-147255602-project Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: exception: Image not found. Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'a22b5b0c-a039-4217-94cc-ca0e97269e8f'} Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a22b5b0c-a039-4217-94cc-ca0e97269e8f to delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a22b5b0c-a039-4217-94cc-ca0e97269e8f could not be found. Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:11.020297 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a706b87-4c11-4186-bc7f-ba258993e909 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] Returning 404 to user: Image not found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a706b87-4c11-4186-bc7f-ba258993e909 tempest-ImagesDeleteNegativeTestJSON-147255602 tempest-ImagesDeleteNegativeTestJSON-147255602-project] 10.222.0.43 "DELETE /compute/v2.1/images/a22b5b0c-a039-4217-94cc-ca0e97269e8f" status: 404 len: 62 microversion: 2.1 time: 0.063403 Jul 26 04:43:11.029158 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1817/3742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:10 2022] DELETE /compute/v2.1/images/a22b5b0c-a039-4217-94cc-ca0e97269e8f => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 04:43:11.057589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:11.070774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dcc44e5b-342c-412c-9a1c-b4e56bbb031a tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1527 microversion: 2.1 time: 0.372883 Jul 26 04:43:11.073544 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1926/3743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:10 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:11.099534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Action: 'update', calling method: >, body: {"server": {"name": "4f9edfc9-4a82-42b9-b5c1-cdebc53e011f_new"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:11.103038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:11.123097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.124416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.128790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.129618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.161060 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] HTTP exception thrown: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Request method failure captured: Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f HTTP/1.1 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 64 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33DG-qaOb7HPncr5g9WC7cUXCYF30PJVSVcCs8kMLl5LtZqWzahigXMeL9AKE57lwggtgjKHJEMVmhbufqsSPkT8JFSyJCt6wVzEnlyL8DZkMG8MAxP_Hx9aS3nQ5jaicr0aOEi3dakV6l0OEMMv07XWdIKvuG2qub6X36ny4ZAR-ic Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4a08a572cae34b858daca34e22ecc89e Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a08a572cae34b858daca34e22ecc89e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4a08a572cae34b858daca34e22ecc89e Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1388311540-project Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: db2de1c9b4e04e8d975867b1ce9df9c4 Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1388311540-project Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "4f9edfc9-4a82-42b9-b5c1-cdebc53e011f_new"}} Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4f9edfc9-4a82-42b9-b5c1-cdebc53e011f', 'body': {'server': {'name': '4f9edfc9-4a82-42b9-b5c1-cdebc53e011f_new'}}} Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:43:11.166508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] Returning 404 to user: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ccb143f6-d9cc-44a8-8b39-3f97bb5ff711 tempest-ServersNegativeTestMultiTenantJSON-1388311540 tempest-ServersNegativeTestMultiTenantJSON-1388311540-project] 10.222.0.43 "PUT /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 404 len: 111 microversion: 2.1 time: 0.073281 Jul 26 04:43:11.177031 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1818/3744] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:43:11 2022] PUT /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:11.180973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:11.183201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:11.193508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.193959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.194822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.195394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.255213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:43:11.443835 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a2ea3af-de9a-47a5-b9f5-83b77e8ccdc5 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 204 len: 0 microversion: 2.1 time: 0.268613 Jul 26 04:43:11.444661 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1927/3745] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:11 2022] DELETE /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:43:11.455031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:11.456352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:11.464417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:11.468043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.468628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.470103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.470740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.728373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:11.729126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:11.742706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.743191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.743998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:11.747981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:11.981124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:11.989559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0916159-3f04-49bc-94c3-8807173f4b68 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1533 microversion: 2.1 time: 0.540276 Jul 26 04:43:11.990705 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1819/3746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:11 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1533 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:12.124053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:12.127970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:12.136876 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75496a28-c95d-431a-9283-00e48defc5c0 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1507 microversion: 2.1 time: 0.413156 Jul 26 04:43:12.155722 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1928/3747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:11 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:12.431735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e650f9b3-4504-4222-ba9d-1593e9cfd757 req-371f614b-ccad-4b11-ab85-9fd8449bb557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae1e975-620a-4b90-ac0a-39e6ca7c185e", "name": "network-vif-deleted", "tag": "384606ae-4f32-48f9-817b-5d1e652be3bc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:12.455636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e650f9b3-4504-4222-ba9d-1593e9cfd757 req-371f614b-ccad-4b11-ab85-9fd8449bb557 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:12.458511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e650f9b3-4504-4222-ba9d-1593e9cfd757 req-371f614b-ccad-4b11-ab85-9fd8449bb557 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:12.496240 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e650f9b3-4504-4222-ba9d-1593e9cfd757 req-371f614b-ccad-4b11-ab85-9fd8449bb557 service nova] Creating event network-vif-deleted:384606ae-4f32-48f9-817b-5d1e652be3bc for instance eae1e975-620a-4b90-ac0a-39e6ca7c185e on n-h2-848886-16 Jul 26 04:43:12.508928 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e650f9b3-4504-4222-ba9d-1593e9cfd757 req-371f614b-ccad-4b11-ab85-9fd8449bb557 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081130 Jul 26 04:43:12.510817 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1820/3748] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:13.016943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:13.018557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:13.031623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:13.037505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:13.040329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:13.042516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:13.166136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:13.168542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:13.184326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:13.185798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:13.192291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:13.194860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:13.274904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:13.275741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:13.276441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'fault' on Instance uuid eae1e975-620a-4b90-ac0a-39e6ca7c185e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:43:13.424579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:13.434417 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ddfef3cf-d7e1-475c-b621-5aa96799e54c tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 200 len: 1311 microversion: 2.1 time: 0.274370 Jul 26 04:43:13.435666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1821/3749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:13 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 1311 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:13.854940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:13.876133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9fac1812-f5e0-4c6b-b5fa-4fea91dc6e7c tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1533 microversion: 2.1 time: 0.858012 Jul 26 04:43:13.877051 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1929/3750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:13 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1533 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:14.459519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:14.460115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: eae1e975-620a-4b90-ac0a-39e6ca7c185e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:14.475906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.483736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.484762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.485223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.535678 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e HTTP/1.1 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'eae1e975-620a-4b90-ac0a-39e6ca7c185e'} Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:14.546525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. Jul 26 04:43:14.552220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:14.554260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 404 to user: Instance eae1e975-620a-4b90-ac0a-39e6ca7c185e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:14.567176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b10800f1-de9b-4736-befb-863a1a5e7fb1 req-00492d7f-1b80-4f2d-8209-500be3a7b41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9edfc9-4a82-42b9-b5c1-cdebc53e011f", "name": "network-vif-deleted", "tag": "c54d0e6d-2831-40db-912c-89dcf989874d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:14.568263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0db747f-2ddb-48c7-bbdd-8cd274b2d973 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e" status: 404 len: 111 microversion: 2.1 time: 0.105991 Jul 26 04:43:14.571241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1822/3751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:14 2022] GET /compute/v2.1/servers/eae1e975-620a-4b90-ac0a-39e6ca7c185e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:14.595593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:14.596552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:14.606050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.609498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.610578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.614324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b10800f1-de9b-4736-befb-863a1a5e7fb1 req-00492d7f-1b80-4f2d-8209-500be3a7b41e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.614802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.619816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:14.620906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b10800f1-de9b-4736-befb-863a1a5e7fb1 req-00492d7f-1b80-4f2d-8209-500be3a7b41e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.670206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b10800f1-de9b-4736-befb-863a1a5e7fb1 req-00492d7f-1b80-4f2d-8209-500be3a7b41e service nova] Creating event network-vif-deleted:c54d0e6d-2831-40db-912c-89dcf989874d for instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f on n-h2-848886-16 Jul 26 04:43:14.683646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b10800f1-de9b-4736-befb-863a1a5e7fb1 req-00492d7f-1b80-4f2d-8209-500be3a7b41e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120069 Jul 26 04:43:14.692349 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1930/3752] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:14.711497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:43:14.900290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:14.901259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:14.910727 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e024d7aa-5d8a-40bd-ae4b-68cdd3ec82bf tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 204 len: 0 microversion: 2.1 time: 0.325675 Jul 26 04:43:14.912885 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1823/3753] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:14 2022] DELETE /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:43:14.913670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.914137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.914947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.923011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.928369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:14.929557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:14.946101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.948835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:14.952167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:14.952825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:15.052976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:15.053454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:15.053933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lazy-loading 'fault' on Instance uuid 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:43:15.227018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd799d31539654a4b911888fbe57c32ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20deb2a13034af5bc7146592559d779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:15.240144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c52e95f3-29ab-4c9a-a1a8-2754ac6ae328 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 200 len: 1317 microversion: 2.1 time: 0.344049 Jul 26 04:43:15.241329 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1931/3754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:14 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:43:15.436078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2beb9221-1ec7-48d5-a09a-a2b1ef033159 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38baccfb80>, body: {"keypair": {"name": "tempest-keypair-1160755839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN4dDR7tZAC1EEWTZS+PlqwL31Ip8t+yvdkK8vY1JmPAwEtQ3SQUiJmlY4RF7H12KS7YO7p+JrqLiAaU/GwDfkNskX6A6+8Ck/uSaoGEiTPz9/p0wd49roqsXhaSrCEVg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:15.461842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2beb9221-1ec7-48d5-a09a-a2b1ef033159 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:15.473075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2beb9221-1ec7-48d5-a09a-a2b1ef033159 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:15.508841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2beb9221-1ec7-48d5-a09a-a2b1ef033159 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257816 Jul 26 04:43:15.518418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1932/3755] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:15.532075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76e4e640-10e3-4e1e-8328-668abcb72c36 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38b4cb6a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:15.552233 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76e4e640-10e3-4e1e-8328-668abcb72c36 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1160755839" status: 200 len: 498 microversion: 2.1 time: 0.032608 Jul 26 04:43:15.552822 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1933/3756] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:43:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1160755839 => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:15.564841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc2bd1c8-3688-4cc6-ac6b-72bf5d7afab3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38bad29dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:15.570343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:15.584078 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01c699c8-af9a-4499-8e60-6407a55b1198 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 0.666825 Jul 26 04:43:15.585246 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1824/3757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:14 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:15.608731 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc2bd1c8-3688-4cc6-ac6b-72bf5d7afab3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160755839" status: 202 len: 0 microversion: 2.1 time: 0.048159 Jul 26 04:43:15.611089 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1934/3758] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160755839 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:43:15.623916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-424e8032-0fb9-4374-a15b-5e9794372918 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38b4f71a60>, body: {"keypair": {"name": "tempest-keypair-1137556574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoIfy/V0AzSahifP7tuDykh4HCW//qUK/A7X1xnygBBbK9Op7f9y7vgR0DtojBVOh6I4sAUqoSDeu55zi7+vNhtV/2HGTRppaB+9ym+8XQKFWfFtsFgYoQJYcwMkXj8Ug=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:15.642269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-424e8032-0fb9-4374-a15b-5e9794372918 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:15.647996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-424e8032-0fb9-4374-a15b-5e9794372918 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:15.681372 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-424e8032-0fb9-4374-a15b-5e9794372918 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060223 Jul 26 04:43:15.682203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1825/3759] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:15.694266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68c04e2a-a372-4845-9fc3-3e990d7101b8 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38b52d5820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:15.717265 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68c04e2a-a372-4845-9fc3-3e990d7101b8 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137556574" status: 202 len: 0 microversion: 2.1 time: 0.027913 Jul 26 04:43:15.723685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1935/3760] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137556574 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:43:15.730753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a16afc8-32f2-4f32-bfd4-52ad2add0f72 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38b4f04280>, body: {"keypair": {"name": "tempest-keypair-2071651219", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:15.760465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0a16afc8-32f2-4f32-bfd4-52ad2add0f72 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:15.775756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0a16afc8-32f2-4f32-bfd4-52ad2add0f72 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:15.820699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a16afc8-32f2-4f32-bfd4-52ad2add0f72 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.094914 Jul 26 04:43:15.821940 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1826/3761] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:15.836072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-633e3c75-2075-43a6-b89c-5d51a7870403 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38b52b90d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:15.871337 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-633e3c75-2075-43a6-b89c-5d51a7870403 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071651219" status: 202 len: 0 microversion: 2.1 time: 0.040807 Jul 26 04:43:15.874540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1936/3762] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071651219 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:43:15.885801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65358cd3-e60b-429c-ade2-7abb6b7806b3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38b4f04040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-555886264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMxE1LwfS3s6ZZsQ8/cWXzmiJQZ40gfM+ojVz9far8/Fo2BtPHVNDzs6ILMlwEOn63/ihTD+ymORQoruLFxXCu5COI1MAdehQE5DMlPV9wgtZhbggcx43TNjnt86uHBeg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:15.904562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-65358cd3-e60b-429c-ade2-7abb6b7806b3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:15.910979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-65358cd3-e60b-429c-ade2-7abb6b7806b3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:15.940806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65358cd3-e60b-429c-ade2-7abb6b7806b3 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058956 Jul 26 04:43:15.954998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f1e3858-e8b8-4514-a988-dedebc7c18ee tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38baccf160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1626629732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/IB+hftaZsUlZsoE3L6zRqnuUeeN6waIzNrG+h/i3ok3wYQ+au77vWONLJbfc3eibyhE984wHKXkVz0pkdtDvRPpO3o3OJopT+j6YrbyuvdReRdQsq3pDx0pKj3H7UQw=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:15.962923 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1827/3763] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:15.972990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1f1e3858-e8b8-4514-a988-dedebc7c18ee tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:15.979016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1f1e3858-e8b8-4514-a988-dedebc7c18ee tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:15.982762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:16.014502 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f1e3858-e8b8-4514-a988-dedebc7c18ee tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063261 Jul 26 04:43:16.028459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-948d6cab-b052-41f9-8a1e-21e65ebb88d4 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Action: 'create', calling method: .version_select at 0x7f38b4f71af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1182120585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBENUxVhmntaOmJwKD/mSpp1qoXFXq5xGTVy1eGf6hdRu8wm5VOfQOJ/syyScYbUVBDzoRZXr6quS7tAwLQrtCd5hWa1Cr2JSNNvf85i6nNW9BXEq2Ny7Np+fY3ZtTjo5g=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:16.033488 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1937/3764] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:16.047186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-948d6cab-b052-41f9-8a1e-21e65ebb88d4 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:16.056010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-948d6cab-b052-41f9-8a1e-21e65ebb88d4 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Getting quotas for user 61218df07fdb4824a4dccfd00cffa1b3 and project 455753eb4cf540969852aee8ee2ffa20. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:16.130623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-948d6cab-b052-41f9-8a1e-21e65ebb88d4 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.106169 Jul 26 04:43:16.131787 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1828/3765] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:16.142475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8962de5f-57ba-4d05-b6e1-da6fc77fa6ba tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38b4cb6a60>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.147119 n-d-848886-16 devstack@n-api.service[119488]: WARNING oslo_db.sqlalchemy.utils [None req-8962de5f-57ba-4d05-b6e1-da6fc77fa6ba tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:43:16.153276 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8962de5f-57ba-4d05-b6e1-da6fc77fa6ba tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.015523 Jul 26 04:43:16.160973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1938/3766] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:43:16 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:16.166993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-548fb9df-194b-404d-933d-66102e3ffd45 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38bad7bee0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.233111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-548fb9df-194b-404d-933d-66102e3ffd45 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1182120585" status: 202 len: 0 microversion: 2.1 time: 0.065817 Jul 26 04:43:16.237730 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1829/3767] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Jul 26 04:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1182120585 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:43:16.243823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-518d495e-b0b7-4e87-b83e-7d23bf41c441 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38baccf3a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.264776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.266124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] [instance: 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:16.279476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:16.282086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:16.283455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:16.283596 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-518d495e-b0b7-4e87-b83e-7d23bf41c441 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1626629732" status: 202 len: 0 microversion: 2.1 time: 0.042849 Jul 26 04:43:16.284816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:16.285617 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1939/3768] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Jul 26 04:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1626629732 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:43:16.294309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84da3549-794b-46e1-b158-e630ebae2fa8 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] Calling method '.version_select at 0x7f38b51b48b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.323428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] HTTP exception thrown: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Request method failure captured: Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f HTTP/1.1 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33C4YXBpcP3IGid5BaGJf1kjxuF9j7sbduX1FhXpLC5rzE_zlzessnDvrGlsoN0A5zyi3Poud-dvVsg9ET32540xKLMGLael3QemyURtKhw328w3RLC7HSAJcxS5nelnO_t6KCRQg9WRp-x05o5rAAmIHKf81NDW8xyFO0Gjpy9IxcY Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e20deb2a13034af5bc7146592559d779 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-381304047 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e20deb2a13034af5bc7146592559d779"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20deb2a13034af5bc7146592559d779"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e20deb2a13034af5bc7146592559d779"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e20deb2a13034af5bc7146592559d779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-381304047 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e20deb2a13034af5bc7146592559d779 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-381304047 Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestMultiTenantJSON-381304047-project Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d799d31539654a4b911888fbe57c32ec Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-381304047-project Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4f9edfc9-4a82-42b9-b5c1-cdebc53e011f'} Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:16.325158 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] Returning 404 to user: Instance 4f9edfc9-4a82-42b9-b5c1-cdebc53e011f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ad5b6dd-592d-4087-899d-318aad6c8dd7 tempest-ServersNegativeTestMultiTenantJSON-381304047 tempest-ServersNegativeTestMultiTenantJSON-381304047-project] 10.222.0.43 "GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f" status: 404 len: 111 microversion: 2.1 time: 0.068997 Jul 26 04:43:16.339166 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1830/3769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:16 2022] GET /compute/v2.1/servers/4f9edfc9-4a82-42b9-b5c1-cdebc53e011f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:43:16.345858 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84da3549-794b-46e1-b158-e630ebae2fa8 tempest-KeyPairsV2TestJSON-1133304349 tempest-KeyPairsV2TestJSON-1133304349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-555886264" status: 202 len: 0 microversion: 2.1 time: 0.057174 Jul 26 04:43:16.346445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1940/3770] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-555886264 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:43:16.611719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:16.615723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:16.632765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:16.633560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:16.637160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:16.637955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:17.751241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:17.773341 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4adfa1f4-3c1d-4cd1-bca1-170e706c64a9 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1522 microversion: 2.1 time: 1.164192 Jul 26 04:43:17.774103 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1831/3771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:16 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1522 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:18.801327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:18.802040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:18.822441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:18.823374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:18.825330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:18.827338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:18.958379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:18.979275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dccd0161-17e0-4ebd-8255-3bd640f8b478 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1480 microversion: 2.1 time: 0.183146 Jul 26 04:43:18.982901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1941/3772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:18 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1480 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:19.593555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0c626fd2-f2e7-43f3-a773-9369d766e01c req-514a28b2-84f3-45c2-8d05-0d5d371f2c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6", "name": "network-vif-deleted", "tag": "a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:19.624613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0c626fd2-f2e7-43f3-a773-9369d766e01c req-514a28b2-84f3-45c2-8d05-0d5d371f2c05 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:19.625064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0c626fd2-f2e7-43f3-a773-9369d766e01c req-514a28b2-84f3-45c2-8d05-0d5d371f2c05 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:19.662126 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0c626fd2-f2e7-43f3-a773-9369d766e01c req-514a28b2-84f3-45c2-8d05-0d5d371f2c05 service nova] Creating event network-vif-deleted:a7548f5f-04d2-4a34-9d5c-9ee5b9f4cb35 for instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 on n-h1-848886-16 Jul 26 04:43:19.678204 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0c626fd2-f2e7-43f3-a773-9369d766e01c req-514a28b2-84f3-45c2-8d05-0d5d371f2c05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088155 Jul 26 04:43:19.679541 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1942/3773] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:19.822021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Calling method '.version_select at 0x7f38b4f5f670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:20.012693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:20.014376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:20.031890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:20.032388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:20.039463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:20.039914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:20.100170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:20.100624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:20.101079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lazy-loading 'fault' on Instance uuid 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:43:20.179436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a0f0319d34f9f955e930ef03f3bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4c000482da4440bb1a1a650eda5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:20.189888 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d40db8ab-29da-43b5-bf65-b514166d8408 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 200 len: 1312 microversion: 2.1 time: 0.189216 Jul 26 04:43:20.190509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1943/3774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:19 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:20.217607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:43:20.218529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Neutron security group aa5f720c-6663-455b-a7bd-f8f925324998 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:43:20.219080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] HTTP exception thrown: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.219080 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Request method failure captured: Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/aa5f720c-6663-455b-a7bd-f8f925324998 HTTP/1.1 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33DnCH-gySmXIjMPZ29d4sZcddh-ShcQPC2eRQWFLofO6c9DKlX5PHLKqmpW9Npr_AjH5lWnMCXv_eVVFGMsfHPC2BW8h8wjAWkLlrHUMOVplLPT0eyr8rF5mr_acimiv8DlUDKpyBfilkPuZTnkOLbk4WdVMgVuOMvVlWe-VVVwfWk Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 56b814ed913b41f2b2f3051f457f208f Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'aa5f720c-6663-455b-a7bd-f8f925324998'} Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:43:20.221926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Returning 404 to user: Security group aa5f720c-6663-455b-a7bd-f8f925324998 does not exist Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-7f86543c-e61a-4e0f-af0a-1213cb4c91b6'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9666836b-0700-4e74-9d6e-ed98573478b3 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/aa5f720c-6663-455b-a7bd-f8f925324998" status: 404 len: 194 microversion: 2.1 time: 0.728785 Jul 26 04:43:20.227326 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1832/3775] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:43:19 2022] DELETE /compute/v2.1/os-security-groups/aa5f720c-6663-455b-a7bd-f8f925324998 => generated 194 bytes in 730 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:20.239295 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7dcbefd8-4052-475e-8489-c16bcad7768f tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005889 Jul 26 04:43:20.241920 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1944/3776] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Jul 26 04:43:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 04:43:20.253522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c233f2a9-003d-41c2-93e0-7a236d4185e7 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Calling method '.version_select at 0x7f38b509fe50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:21.085123 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c233f2a9-003d-41c2-93e0-7a236d4185e7 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.835376 Jul 26 04:43:21.086219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1833/3777] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:43:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:21.101955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Calling method '.version_select at 0x7f38b4c18b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:21.215560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:21.216172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] [instance: 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:21.226242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:21.226711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:21.227501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:21.231133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:21.269991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] HTTP exception thrown: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Request method failure captured: Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 HTTP/1.1 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi329FNJHRMOaffp5_R_07b92vbmDEj-FyWGaEWVJTA9x5ab-EHrZpA8OG1bpq_1nCthK0z65CBu_Vy21dh7jsAFcokWOFvcxZe6cpwLxTnkvNnf5d7O3X1WfXO-wGgLjEoaKSiL5OaPINvteQxMn-qGpK5PRQLUBIiTKFnK6EjrpCSnc Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b4c000482da4440bb1a1a650eda5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4b4c000482da4440bb1a1a650eda5b55 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1936346520 Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 338a0f0319d34f9f955e930ef03f3bdf Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1936346520-project Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6'} Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.274683 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] Returning 404 to user: Instance 5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da4ec790-8087-45fe-94a9-10e48b5b6b64 tempest-ServerRescueNegativeTestJSON-1936346520 tempest-ServerRescueNegativeTestJSON-1936346520-project] 10.222.0.43 "GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6" status: 404 len: 111 microversion: 2.1 time: 0.064827 Jul 26 04:43:21.279188 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1834/3778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:21 2022] GET /compute/v2.1/servers/5e1f0ca6-1d3b-400f-b95d-8a4771ae58f6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:21.633752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:43:21.634489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 26 04:43:21.634489 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Request method failure captured: Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-security-groups/3349e619-2b4c-40b5-b9ff-5f64e93a30c1 HTTP/1.1 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33DnCH-gySmXIjMPZ29d4sZcddh-ShcQPC2eRQWFLofO6c9DKlX5PHLKqmpW9Npr_AjH5lWnMCXv_eVVFGMsfHPC2BW8h8wjAWkLlrHUMOVplLPT0eyr8rF5mr_acimiv8DlUDKpyBfilkPuZTnkOLbk4WdVMgVuOMvVlWe-VVVwfWk Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 56b814ed913b41f2b2f3051f457f208f Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: exception: Insufficient rights for removing default security group. Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3349e619-2b4c-40b5-b9ff-5f64e93a30c1'} Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:43:21.636829 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] Jul 26 04:43:21.642519 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.649809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 26 04:43:21.649809 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-20c8701e-6808-4190-b127-3be947d79ff2'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:21.649809 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e10cca4-153e-4265-8834-62834cc8e331 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/3349e619-2b4c-40b5-b9ff-5f64e93a30c1" status: 400 len: 182 microversion: 2.1 time: 0.552719 Jul 26 04:43:21.649809 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1945/3779] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:43:21 2022] DELETE /compute/v2.1/os-security-groups/3349e619-2b4c-40b5-b9ff-5f64e93a30c1 => generated 182 bytes in 554 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:43:21.682989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Calling method '.version_select at 0x7f38b4f04940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:21.928725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:43:21.930137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Neutron security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:43:21.931093 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] HTTP exception thrown: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.931093 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Request method failure captured: Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-security-groups/d296f4e1-72da-4aef-8dce-d6ee20681ee0 HTTP/1.1 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33DnCH-gySmXIjMPZ29d4sZcddh-ShcQPC2eRQWFLofO6c9DKlX5PHLKqmpW9Npr_AjH5lWnMCXv_eVVFGMsfHPC2BW8h8wjAWkLlrHUMOVplLPT0eyr8rF5mr_acimiv8DlUDKpyBfilkPuZTnkOLbk4WdVMgVuOMvVlWe-VVVwfWk Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 56b814ed913b41f2b2f3051f457f208f Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd296f4e1-72da-4aef-8dce-d6ee20681ee0'} Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:43:21.936461 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] Jul 26 04:43:21.943877 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:21.947577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Returning 404 to user: Security group d296f4e1-72da-4aef-8dce-d6ee20681ee0 does not exist Jul 26 04:43:21.947577 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-a406dd68-2a3f-4f0c-ac49-81c6e8e9b82f'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:21.949279 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-35022ef5-f9d2-456f-9bdb-5a9c62202f7c tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/d296f4e1-72da-4aef-8dce-d6ee20681ee0" status: 404 len: 194 microversion: 2.1 time: 0.279327 Jul 26 04:43:21.956952 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1835/3780] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:43:21 2022] GET /compute/v2.1/os-security-groups/d296f4e1-72da-4aef-8dce-d6ee20681ee0 => generated 194 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:21.968324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Action: 'update', calling method: .version_select at 0x7f38b4cb6700>, body: {"security_group": {"name": "tempest-sg-2115800871", "description": "tempest-description-1520086585"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:22.072373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:43:22.074579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Neutron security group ac5952fa-8451-4dbd-9c86-f981792c58cc not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:43:22.075559 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] HTTP exception thrown: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.075559 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Request method failure captured: Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/os-security-groups/ac5952fa-8451-4dbd-9c86-f981792c58cc HTTP/1.1 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 102 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33DnCH-gySmXIjMPZ29d4sZcddh-ShcQPC2eRQWFLofO6c9DKlX5PHLKqmpW9Npr_AjH5lWnMCXv_eVVFGMsfHPC2BW8h8wjAWkLlrHUMOVplLPT0eyr8rF5mr_acimiv8DlUDKpyBfilkPuZTnkOLbk4WdVMgVuOMvVlWe-VVVwfWk Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8565202f5a044eb1a9ee030878bdbce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8565202f5a044eb1a9ee030878bdbce5 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-5815062 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 56b814ed913b41f2b2f3051f457f208f Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-5815062-project Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: {"security_group": {"name": "tempest-sg-2115800871", "description": "tempest-description-1520086585"}} Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ac5952fa-8451-4dbd-9c86-f981792c58cc', 'body': {'security_group': {'name': 'tempest-sg-2115800871', 'description': 'tempest-description-1520086585'}}} Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:43:22.078856 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] Jul 26 04:43:22.086089 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:43:22.096669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] Returning 404 to user: Security group ac5952fa-8451-4dbd-9c86-f981792c58cc does not exist Jul 26 04:43:22.096669 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-89e85928-145d-4408-bf50-1c81d086692f'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:22.096669 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1d58a1e-51e1-493b-97d5-23a718f34b73 tempest-SecurityGroupsNegativeTestJSON-5815062 tempest-SecurityGroupsNegativeTestJSON-5815062-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/ac5952fa-8451-4dbd-9c86-f981792c58cc" status: 404 len: 194 microversion: 2.1 time: 0.134521 Jul 26 04:43:22.096669 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1946/3781] 10.222.0.43 () {60 vars in 1290 bytes} [Tue Jul 26 04:43:21 2022] PUT /compute/v2.1/os-security-groups/ac5952fa-8451-4dbd-9c86-f981792c58cc => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:27.657078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:27.658523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:27.666090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:27.682002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:27.682889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:27.685930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:27.687078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.314804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:28.336434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:28.341323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:28.347221 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0db8d8db-e428-4f70-a8ba-c105b765f393 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2943 microversion: 2.32 time: 0.695715 Jul 26 04:43:28.352539 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1836/3782] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:27 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2943 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:28.378669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:28.384961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:28.386190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:28.414879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.429109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.429981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.430463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.671623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:28.683370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:28.695489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Searching by: {'deleted': False, 'project_id': '88aa32dea95442aa966324952618081b'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:43:28.719517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.720263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.721243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.721850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.782692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:43:28.840662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9db46658-c2df-4b97-ae91-7e631e5b870e tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.173347 Jul 26 04:43:28.850580 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1837/3783] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:43:28 2022] GET /compute/v2.1/servers => generated 333 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:28.856135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:28.862503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:28.875386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Searching by: {'deleted': False, 'project_id': '88aa32dea95442aa966324952618081b'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:43:28.881308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.882065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.883077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:28.883698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:28.934966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:43:29.002139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:29.016277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:29.016736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:29.041639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0955f7c6-0368-4504-a085-4f9e1ffce11e tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.665771 Jul 26 04:43:29.042260 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1947/3784] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:43:28 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4/os-interface => generated 1830 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:43:29.403334 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2588bad9-f264-4470-b3fa-c51e9cb5faee tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.550994 Jul 26 04:43:29.406186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1838/3785] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:43:28 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:43:29.427437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a71f71a-a631-4c65-ba71-41ec071629ba tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:29.437650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a71f71a-a631-4c65-ba71-41ec071629ba tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013969 Jul 26 04:43:29.439013 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1948/3786] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:43:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:29.757131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:29.758398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:29.781163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:29.781627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:29.782456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:29.782903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:29.838577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:43:30.050199 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4571cf55-aead-442e-b4c1-d2e70e615864 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 204 len: 0 microversion: 2.1 time: 0.303849 Jul 26 04:43:30.052151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1839/3787] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:43:29 2022] DELETE /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:43:30.062663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:30.063523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:30.080194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:30.080859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:30.085303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:30.087350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:30.934094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:30.947332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43b10e5d-e8ac-4fc3-9037-35b24e96d7e8 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1699 microversion: 2.1 time: 0.890429 Jul 26 04:43:30.948465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1949/3788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:30 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1699 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:31.977173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:31.979357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:32.003381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:32.004220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:32.005342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:32.006731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:32.970402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:32.989173 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ef5ec32-cc66-4187-9ad3-f2b4b01057bc tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1699 microversion: 2.1 time: 1.020921 Jul 26 04:43:32.989876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1840/3789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:31 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1699 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:34.015500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:34.016917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:34.028087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:34.029098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:34.031002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:34.032765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:34.698478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8da12faa-5f37-4de9-94a4-dcb6ddccbe2c req-2b200887-730d-4e61-9909-211d4b5d818d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f0f602-36e3-4868-b093-2a3ff12dfee9", "name": "network-vif-deleted", "tag": "8cb810b2-89a9-4fad-9fc5-8cb19f34c094"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:34.726485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8da12faa-5f37-4de9-94a4-dcb6ddccbe2c req-2b200887-730d-4e61-9909-211d4b5d818d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:34.727234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8da12faa-5f37-4de9-94a4-dcb6ddccbe2c req-2b200887-730d-4e61-9909-211d4b5d818d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:34.756926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8da12faa-5f37-4de9-94a4-dcb6ddccbe2c req-2b200887-730d-4e61-9909-211d4b5d818d service nova] Creating event network-vif-deleted:8cb810b2-89a9-4fad-9fc5-8cb19f34c094 for instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 on n-h2-848886-16 Jul 26 04:43:34.762813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8da12faa-5f37-4de9-94a4-dcb6ddccbe2c req-2b200887-730d-4e61-9909-211d4b5d818d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068831 Jul 26 04:43:34.764423 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1841/3790] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:34.880316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6a2b6400ca4c86be7d888d66c87fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa32dea95442aa966324952618081b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:34.891208 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0073d53-9823-4fc0-b707-fc678c409227 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 200 len: 1631 microversion: 2.1 time: 0.884655 Jul 26 04:43:34.906449 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1950/3791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:34 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 1631 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:35.918222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:35.919042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] [instance: 41f0f602-36e3-4868-b093-2a3ff12dfee9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:35.940114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:35.941927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:35.944873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:35.945517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:35.987169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] HTTP exception thrown: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Request method failure captured: Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 HTTP/1.1 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33CLA0Zjk-9QznhmgYn6SNNbzgLJUDBs76mf1aVHxDQTXCdhRIWfqCKLDK0bObyemiwrhXyZ1T_kSb4i9pBVXutR9VI6zKjvWs2wGEBx3N6T018YEs3ejZC-r2UMR-flESFICICl2unUEzw0hVxRxa5UzwrSNpZZiMKsz2t0o4ACNMg Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 88aa32dea95442aa966324952618081b Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-1669142300 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88aa32dea95442aa966324952618081b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88aa32dea95442aa966324952618081b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88aa32dea95442aa966324952618081b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88aa32dea95442aa966324952618081b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-1669142300 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 88aa32dea95442aa966324952618081b Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-1669142300 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-1669142300-project Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: ae6a2b6400ca4c86be7d888d66c87fa3 Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-1669142300-project Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '41f0f602-36e3-4868-b093-2a3ff12dfee9'} Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:35.993381 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. Jul 26 04:43:35.999363 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:43:36.003120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Returning 404 to user: Instance 41f0f602-36e3-4868-b093-2a3ff12dfee9 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:43:36.004399 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c345d29e-c606-450b-8f42-3195bd30dcc5 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9" status: 404 len: 111 microversion: 2.1 time: 0.095724 Jul 26 04:43:36.007581 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1842/3792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:35 2022] GET /compute/v2.1/servers/41f0f602-36e3-4868-b093-2a3ff12dfee9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:43:36.017893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8ea50a0-d737-49cc-b82b-95ec1e4738f6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] Calling method '.version_select at 0x7f38b52d55e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:36.087765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e8ea50a0-d737-49cc-b82b-95ec1e4738f6 tempest-ServersTestJSON-1669142300 tempest-ServersTestJSON-1669142300-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113116270" status: 202 len: 0 microversion: 2.1 time: 0.076030 Jul 26 04:43:36.088367 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1951/3793] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113116270 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:43:38.890344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:38.989022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:39.136125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b384e868-26f3-4bbc-be39-23649b780cda tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b4f04e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1313268996", "description": "tempest-description-43800790"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:40.122216 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b384e868-26f3-4bbc-be39-23649b780cda tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.495086 Jul 26 04:43:40.124076 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1843/3794] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:43:38 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:40.141429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4df47983-779d-4d61-9d3b-77b243e9f865 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b4efe5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1486598626", "description": "tempest-description-1147308016"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:40.680541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:40.681057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:40.691268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:40.691734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:40.692539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:40.692991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:40.757881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:43:40.928873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41e820df-d51a-4089-b455-5b2fbc9f4edf tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 204 len: 0 microversion: 2.42 time: 1.012476 Jul 26 04:43:40.930234 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1952/3795] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:43:39 2022] DELETE /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:43:40.943237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:40.947902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:40.969880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:40.970535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:40.971428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:40.971967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:41.523094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:41.538718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:41.556191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:41.559044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14326f68-bf34-4e7e-8c0a-c6033eec8ad8 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2957 microversion: 2.42 time: 0.624510 Jul 26 04:43:41.559461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1953/3796] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:40 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2957 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:41.679723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4df47983-779d-4d61-9d3b-77b243e9f865 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.545548 Jul 26 04:43:41.693507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1844/3797] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:43:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:41.980768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1761425550", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "5649b135-c948-4460-8abf-b356a8926a2b"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:42.078129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] validate_networks() for [('5649b135-c948-4460-8abf-b356a8926a2b', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:43:42.587568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:42.588306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:42.590399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:42.604707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:42.605311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:42.606430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:42.607020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:43.716919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:43:43.719638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:43:43.720531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:43:43.722470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:43:43.723782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:43:43.741683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:43.742549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:43.743975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:43.745432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:43.758831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:43.778471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Getting quotas for project 5d85fb5d3ba24b7292829e7cf1e3373c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:43.791665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Getting quotas for user 055ef33e960e457897c7ab8fb77d44da and project 5d85fb5d3ba24b7292829e7cf1e3373c. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:43.820310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:43:43.824463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:43:43.858816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:43.878201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:43.881740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:43.886209 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-447d53ab-a1c4-4698-b012-7621e5b8add9 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2957 microversion: 2.42 time: 1.302869 Jul 26 04:43:43.891168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1845/3798] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:42 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2957 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:43:43.951150 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45f403e1-3d62-48d2-bc16-6ad6315decb4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975033 Jul 26 04:43:43.959115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1954/3799] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:43:43.964676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41a24177-2387-4800-bc37-3643e905b09b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:43.965221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41a24177-2387-4800-bc37-3643e905b09b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:44.396115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41a24177-2387-4800-bc37-3643e905b09b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:44.405560 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41a24177-2387-4800-bc37-3643e905b09b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1216 microversion: 2.1 time: 0.444988 Jul 26 04:43:44.406633 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1846/3800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:43 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1216 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:44.918246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:44.922564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:44.933138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:44.934044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:44.935055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:44.936546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:45.389362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:45.404062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:45.405884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:45.407218 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63df6941-2f33-4068-a147-6a34d769a080 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2957 microversion: 2.42 time: 0.493337 Jul 26 04:43:45.407794 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1955/3801] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:44 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2957 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:45.439978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:45.442003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:45.495617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:45.495994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:45.501003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:45.501460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:45.519398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:45.927124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:45.937269 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a1d9cd6-eb26-44ac-9320-eca08262a8f3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1268 microversion: 2.1 time: 0.510768 Jul 26 04:43:45.941533 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1847/3802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:45 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1268 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:46.434802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:46.436151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:46.442236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:46.455439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:46.455773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:46.456620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:46.457066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:46.973820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:46.979415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:46.996297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:46.996754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:46.997544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:47.021820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:47.659799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:47.675997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:47.677618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:47.678966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f59d6209-77c5-43e3-9609-78a8453266f0 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2957 microversion: 2.42 time: 1.248878 Jul 26 04:43:47.688837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:47.696438 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79094e24-d99c-4d3c-aff3-7310fac40b3a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1274 microversion: 2.1 time: 0.726386 Jul 26 04:43:47.709570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1848/3804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:46 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1274 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:47.709838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1956/3804] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:46 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2957 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:47.728150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b49b1704-de6e-46b5-9b46-3931c1c3db6b req-c3c01467-08d1-4fb8-a33f-6a04da3c389d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "0b317ddc-d069-4f82-adae-d1c6e5f4802b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:47.751512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b49b1704-de6e-46b5-9b46-3931c1c3db6b req-c3c01467-08d1-4fb8-a33f-6a04da3c389d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:47.751960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b49b1704-de6e-46b5-9b46-3931c1c3db6b req-c3c01467-08d1-4fb8-a33f-6a04da3c389d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:47.787884 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b49b1704-de6e-46b5-9b46-3931c1c3db6b req-c3c01467-08d1-4fb8-a33f-6a04da3c389d service nova] Creating event network-vif-unplugged:0b317ddc-d069-4f82-adae-d1c6e5f4802b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:47.806887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b49b1704-de6e-46b5-9b46-3931c1c3db6b req-c3c01467-08d1-4fb8-a33f-6a04da3c389d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095328 Jul 26 04:43:47.807421 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1957/3805] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:48.713980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:48.715388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:48.737591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:48.738334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:48.751415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:48.751967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:48.752810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:48.753251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:48.774310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:48.777244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:48.788343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:48.789522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:49.386300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:49.396765 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92458f77-2cde-4ec6-9b6e-d12c15198dc7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1274 microversion: 2.1 time: 0.664903 Jul 26 04:43:49.399887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1958/3806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:48 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1274 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:49.879421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "2ae64922-ff5d-44c7-89c5-d34c8e95b633"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c3d498-1a9e-4939-a012-995cbbff985b"}, {"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "2b593d86-fde5-4581-9219-47464ec7f35d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:49.898247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:49.898641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:49.939574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Creating event network-vif-unplugged:2ae64922-ff5d-44c7-89c5-d34c8e95b633 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:49.944034 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Creating event network-vif-unplugged:e6c3d498-1a9e-4939-a012-995cbbff985b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:49.945033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] Creating event network-vif-unplugged:2b593d86-fde5-4581-9219-47464ec7f35d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:49.955575 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0ceca1d8-ab2c-4cf3-b88f-f5d600b321df req-1ada9516-ea70-4e8a-85bd-30f01c2bbbfc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.081311 Jul 26 04:43:49.958956 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1959/3807] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:50.420158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:50.421183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:50.431570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:50.442984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:50.444147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:50.444849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:50.664230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:50.684221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:50.689128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:50.693897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18f44c62-8833-4eb0-a158-484cd6af22b5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2936 microversion: 2.42 time: 1.987103 Jul 26 04:43:50.695346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1849/3808] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:48 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2936 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:51.140201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:51.155654 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e54a267d-3c90-41c5-8fc4-e1493f6e745f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.740057 Jul 26 04:43:51.170777 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1960/3809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:50 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:51.728761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:51.730853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:51.749574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:51.761241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:51.762863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:51.764661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:52.124931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a15dc5dc-5876-44da-a62e-93d4dc6d5af3 req-c6c350bb-901c-4e8e-a18b-ec5792ee42fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e068a4-8613-4ae4-8def-afe0aa160eb2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:52.145504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a15dc5dc-5876-44da-a62e-93d4dc6d5af3 req-c6c350bb-901c-4e8e-a18b-ec5792ee42fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:52.146200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a15dc5dc-5876-44da-a62e-93d4dc6d5af3 req-c6c350bb-901c-4e8e-a18b-ec5792ee42fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:52.168685 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a15dc5dc-5876-44da-a62e-93d4dc6d5af3 req-c6c350bb-901c-4e8e-a18b-ec5792ee42fc service nova] Creating event network-vif-unplugged:e7e068a4-8613-4ae4-8def-afe0aa160eb2 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:52.177216 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a15dc5dc-5876-44da-a62e-93d4dc6d5af3 req-c6c350bb-901c-4e8e-a18b-ec5792ee42fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056021 Jul 26 04:43:52.177894 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1961/3810] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:52.183582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:52.184301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:52.191683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:52.192243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:52.193133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:52.193585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:52.531053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:52.553704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:52.555882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:52.557560 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b42a4cae-9abd-437f-9340-7504261892ef tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2915 microversion: 2.42 time: 0.837349 Jul 26 04:43:52.558500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1850/3811] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:51 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2915 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:52.962934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-18455774-7a45-496d-92c1-c8022ebff543 req-1864797b-cd19-47c0-b447-d8b1e3bda880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de686873-929f-42f0-8216-f8bb2f60aa3f", "tag": "91542f90-eb10-4b2b-9787-9dc3e19cf385"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:52.987350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-18455774-7a45-496d-92c1-c8022ebff543 req-1864797b-cd19-47c0-b447-d8b1e3bda880 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:52.987811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-18455774-7a45-496d-92c1-c8022ebff543 req-1864797b-cd19-47c0-b447-d8b1e3bda880 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:53.020811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-18455774-7a45-496d-92c1-c8022ebff543 req-1864797b-cd19-47c0-b447-d8b1e3bda880 service nova] Creating event network-changed:91542f90-eb10-4b2b-9787-9dc3e19cf385 for instance de686873-929f-42f0-8216-f8bb2f60aa3f on n-h2-848886-16 Jul 26 04:43:53.036069 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-18455774-7a45-496d-92c1-c8022ebff543 req-1864797b-cd19-47c0-b447-d8b1e3bda880 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077907 Jul 26 04:43:53.036848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1851/3812] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:53.201692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7cb25bff-5e37-492d-8ad2-4e04bf65b54e req-edba7718-d27b-4749-8498-65385d88b825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-deleted", "tag": "0b317ddc-d069-4f82-adae-d1c6e5f4802b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:53.227762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7cb25bff-5e37-492d-8ad2-4e04bf65b54e req-edba7718-d27b-4749-8498-65385d88b825 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:53.228315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7cb25bff-5e37-492d-8ad2-4e04bf65b54e req-edba7718-d27b-4749-8498-65385d88b825 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:53.254498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7cb25bff-5e37-492d-8ad2-4e04bf65b54e req-edba7718-d27b-4749-8498-65385d88b825 service nova] Creating event network-vif-deleted:0b317ddc-d069-4f82-adae-d1c6e5f4802b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:53.264127 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7cb25bff-5e37-492d-8ad2-4e04bf65b54e req-edba7718-d27b-4749-8498-65385d88b825 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067900 Jul 26 04:43:53.294892 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1852/3813] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:53.324426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:53.334630 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2c129285-7aa6-4bd1-af7b-924c37465e32 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 1.154723 Jul 26 04:43:53.335554 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1962/3814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:52 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:53.588494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:53.590189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:53.618773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:53.620403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:53.621374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:53.627628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:54.182875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:54.207626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:54.210756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:54.214489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a1c939a-0b34-48e3-84cb-8431c396a47f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2755 microversion: 2.42 time: 0.634066 Jul 26 04:43:54.218137 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1853/3815] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:53 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2755 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:54.356962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:54.359091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:54.361241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:54.363280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:54.410650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:54.411409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:54.412266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:54.412713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:54.554309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:54.838233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97911e63-8af0-47a3-b9b2-56181f06eb64 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: .version_select at 0x7f38b4f0f3a0>, body: {"keypair": {"name": "tempest-keypair-1120005778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBorKDkjgZxoAiYIwRa6+1yeTVHmsnh3puxawtpzEaLGS1w34vhlv46nbdmRMQDNLPKrpPK+2tVYfyf1FMRO/qu+HXbU/j4s9G119GDVNirXQmXpMs4Hvz7MWVfnO2YO2w=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:54.865554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-97911e63-8af0-47a3-b9b2-56181f06eb64 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:54.875408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-97911e63-8af0-47a3-b9b2-56181f06eb64 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for user f4a7bc18117240aeb6ef844585458f38 and project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:54.926502 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97911e63-8af0-47a3-b9b2-56181f06eb64 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376681 Jul 26 04:43:54.927588 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1854/3816] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:43:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:43:55.246771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:55.249020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:55.269209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:55.270195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:55.271823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:55.274079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:56.538172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:56.553649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a16c465-3417-4cd1-8516-fc697ef21ab3 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 2.200589 Jul 26 04:43:56.567372 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1963/3817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:54 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:56.577625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ac71d536-1469-47db-b7af-c3e049371868 req-a747775a-d605-46df-9582-027ccc042f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-deleted", "tag": "e6c3d498-1a9e-4939-a012-995cbbff985b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:56.606250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ac71d536-1469-47db-b7af-c3e049371868 req-a747775a-d605-46df-9582-027ccc042f81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:56.612300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ac71d536-1469-47db-b7af-c3e049371868 req-a747775a-d605-46df-9582-027ccc042f81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:56.655551 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ac71d536-1469-47db-b7af-c3e049371868 req-a747775a-d605-46df-9582-027ccc042f81 service nova] Creating event network-vif-deleted:e6c3d498-1a9e-4939-a012-995cbbff985b for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:43:56.668012 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ac71d536-1469-47db-b7af-c3e049371868 req-a747775a-d605-46df-9582-027ccc042f81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098979 Jul 26 04:43:56.670675 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1964/3818] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:43:57.592552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:57.593281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:57.606182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:57.606667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:57.607527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:57.608049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:58.217754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:58.226972 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-643fceb5-ef26-4d0a-a4ff-1a98e666d9c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.639362 Jul 26 04:43:58.240024 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1965/3819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:57 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:43:58.349251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:58.389767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:58.398764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:43:58.400441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b19c85f9-8495-4a71-81ce-9a5273a1a383 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2663 microversion: 2.42 time: 3.158762 Jul 26 04:43:58.401211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1855/3820] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:55 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2663 bytes in 3160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:43:59.083065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-277649910", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:43:59.206777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:43:59.207625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:43:59.208548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:43:59.209799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:43:59.210540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:43:59.226813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.227476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:59.229224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.230704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:59.260810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:59.261439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:59.277826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.281738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:59.282646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.283790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Getting quotas for project 3181a6f3fff04ce78e5000c1fb4822ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:43:59.285351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:59.302690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Getting quotas for user 52464a395ee44111956360c64672bac1 and project 3181a6f3fff04ce78e5000c1fb4822ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:43:59.325401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:43:59.329790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:43:59.461353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1924b87d-fd60-48ec-b23e-deda344c59b5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.748492 Jul 26 04:43:59.462990 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1966/3821] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:43:59.476489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:43:59.479987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:43:59.499500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.503231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:43:59.505742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:43:59.506920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:00.169299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.178565 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dafdd3fb-3b73-4255-ab73-07697710a544 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.918911 Jul 26 04:44:00.179914 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1856/3822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:43:59 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:00.189088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:00.190531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:00.300502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.332472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.334585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.339587 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-108b939f-854b-4286-be26-0e952746d9da tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2549 microversion: 2.42 time: 0.875454 Jul 26 04:44:00.340685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1967/3823] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:43:59 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2549 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:00.360274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6131ddcd-8966-47aa-b8e0-ea2f723793bd req-aeac4169-c93f-4297-8243-602ba10e1212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-deleted", "tag": "2b593d86-fde5-4581-9219-47464ec7f35d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:00.391316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6131ddcd-8966-47aa-b8e0-ea2f723793bd req-aeac4169-c93f-4297-8243-602ba10e1212 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:00.392313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6131ddcd-8966-47aa-b8e0-ea2f723793bd req-aeac4169-c93f-4297-8243-602ba10e1212 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:00.429790 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6131ddcd-8966-47aa-b8e0-ea2f723793bd req-aeac4169-c93f-4297-8243-602ba10e1212 service nova] Creating event network-vif-deleted:2b593d86-fde5-4581-9219-47464ec7f35d for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:44:00.441121 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6131ddcd-8966-47aa-b8e0-ea2f723793bd req-aeac4169-c93f-4297-8243-602ba10e1212 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095465 Jul 26 04:44:00.469015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1968/3824] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:00.614823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.643231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.649177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:00.658595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8f46cd0-bd07-4f0b-8f87-c360a10c75c1 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 200 len: 1280 microversion: 2.47 time: 0.472526 Jul 26 04:44:00.672326 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1857/3825] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:00 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 1280 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:01.205140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:01.206060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:01.216345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.220677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.223895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.224618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.374908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:01.375827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:01.406476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.407026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.418038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.419232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.774556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:01.788544 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef6c9c72-6fdb-42b5-98f6-fcc24906dcaf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.591043 Jul 26 04:44:01.790846 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1969/3826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:01 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:01.809184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:01.810280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:01.840322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.840787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.844582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:01.845075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:01.991478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.008891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.015133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.017077 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b5b3051-2484-423d-8a5e-c4488ee8bc99 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 200 len: 1338 microversion: 2.47 time: 0.222503 Jul 26 04:44:02.019923 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1970/3827] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:01 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 1338 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:02.047989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.064578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.067928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:02.071647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db0f4f36-8a0b-4e3d-88f0-436bd82aef1b tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 2390 microversion: 2.42 time: 0.705936 Jul 26 04:44:02.074771 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1858/3828] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:01 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 2390 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:02.465775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-63824917", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:02.587084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b85b3c36-2d7b-4565-bdd7-9a20a5a59894 req-72430b18-8679-4890-ae60-f7d05f253cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-deleted", "tag": "e7e068a4-8613-4ae4-8def-afe0aa160eb2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:02.591098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:02.622448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b85b3c36-2d7b-4565-bdd7-9a20a5a59894 req-72430b18-8679-4890-ae60-f7d05f253cda service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:02.625738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b85b3c36-2d7b-4565-bdd7-9a20a5a59894 req-72430b18-8679-4890-ae60-f7d05f253cda service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:02.652212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b85b3c36-2d7b-4565-bdd7-9a20a5a59894 req-72430b18-8679-4890-ae60-f7d05f253cda service nova] Creating event network-vif-deleted:e7e068a4-8613-4ae4-8def-afe0aa160eb2 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:44:02.660944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b85b3c36-2d7b-4565-bdd7-9a20a5a59894 req-72430b18-8679-4890-ae60-f7d05f253cda service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078627 Jul 26 04:44:02.662792 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1859/3829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:02.814654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:02.816725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:02.847526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:02.847526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:02.850998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:02.852757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:03.385318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:03.400082 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3024ac84-dcd4-44e5-974a-4483e50ccaf8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.587758 Jul 26 04:44:03.403759 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1860/3830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:02 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:03.432042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1853320616", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc1ee214-e96f-4789-b811-84b33c5dd5ec"}], "security_groups": [{"name": "tempest-securitygroup--1510641518"}], "key_name": "tempest-keypair-1120005778", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:03.658381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:03.658893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:03.659538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:03.660470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:03.661124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:03.692998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:03.693463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:03.697363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:03.697836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:03.772597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:03.779429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:03.800838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:03.804395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:03.896386 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0847331b-7a7e-43ef-9c27-d195c8ac0189 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872954 Jul 26 04:44:03.898520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] validate_networks() for [('bc1ee214-e96f-4789-b811-84b33c5dd5ec', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:03.899553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1971/3831] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:44:03.915815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:03.921456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:03.934788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:03.939323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:03.945143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:03.946333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:04.109353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.123349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.128217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.131979 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18b8157b-f7d9-465d-9db7-23fd9e8f16e7 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 200 len: 1359 microversion: 2.47 time: 0.230970 Jul 26 04:44:04.135842 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1972/3832] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:03 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:04.145351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:04.147428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:04.163627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:04.164965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:04.166428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:04.167207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:04.366502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.380122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.381849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.383098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8e52e17-417f-4b6f-a99e-e6dc29c4a1c5 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.246107 Jul 26 04:44:04.384556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1973/3833] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:04 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:04.393180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4801e70d-cefe-454d-9397-de52353407a2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:04.393809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4801e70d-cefe-454d-9397-de52353407a2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:04.583113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4801e70d-cefe-454d-9397-de52353407a2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:04.605374 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4801e70d-cefe-454d-9397-de52353407a2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1213 microversion: 2.1 time: 0.219275 Jul 26 04:44:04.606964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1974/3834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:04 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:04.618412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1416741220"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:04.627388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:04.648806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:04.649604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:04.657784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:04.658743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.041825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:05.042476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:05.044833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:05.045329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:05.047104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:05.075047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.077112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.078743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.081075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.148526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:05.149219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:05.167030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for user f4a7bc18117240aeb6ef844585458f38 and project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:05.172069 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-72aa41c7-3e2c-4aed-9d0f-f9586d286dda tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "POST /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd/action" status: 202 len: 52 microversion: 2.47 time: 0.562889 Jul 26 04:44:05.174906 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1975/3835] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:44:04 2022] POST /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd/action => generated 52 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:44:05.187743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:05.189982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:05.208063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.208608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.209433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.209886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.220099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:05.224773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:05.342656 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-878846b4-d9ff-4c5c-b483-41951af97643 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.936471 Jul 26 04:44:05.344119 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1861/3836] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:44:05.350062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7c17d34c-3e17-46b3-ada1-fb6375e3b807 req-605a27a3-ff62-48ec-8b10-7a66c8915667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de686873-929f-42f0-8216-f8bb2f60aa3f", "name": "network-vif-plugged", "status": "completed", "tag": "91542f90-eb10-4b2b-9787-9dc3e19cf385"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:05.362198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7c17d34c-3e17-46b3-ada1-fb6375e3b807 req-605a27a3-ff62-48ec-8b10-7a66c8915667 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.363063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7c17d34c-3e17-46b3-ada1-fb6375e3b807 req-605a27a3-ff62-48ec-8b10-7a66c8915667 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.386836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7c17d34c-3e17-46b3-ada1-fb6375e3b807 req-605a27a3-ff62-48ec-8b10-7a66c8915667 service nova] Creating event network-vif-plugged:91542f90-eb10-4b2b-9787-9dc3e19cf385 for instance de686873-929f-42f0-8216-f8bb2f60aa3f on n-h2-848886-16 Jul 26 04:44:05.404745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7c17d34c-3e17-46b3-ada1-fb6375e3b807 req-605a27a3-ff62-48ec-8b10-7a66c8915667 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058026 Jul 26 04:44:05.405669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1862/3837] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:05.412715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-04872a87-ceb5-4c31-ad71-90137c463768 req-ba0ad181-ebc6-4e59-a1d4-add95bbd49aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec", "name": "network-vif-deleted", "tag": "2ae64922-ff5d-44c7-89c5-d34c8e95b633"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:05.439473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-04872a87-ceb5-4c31-ad71-90137c463768 req-ba0ad181-ebc6-4e59-a1d4-add95bbd49aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.440100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-04872a87-ceb5-4c31-ad71-90137c463768 req-ba0ad181-ebc6-4e59-a1d4-add95bbd49aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.453367 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-04872a87-ceb5-4c31-ad71-90137c463768 req-ba0ad181-ebc6-4e59-a1d4-add95bbd49aa service nova] Creating event network-vif-deleted:2ae64922-ff5d-44c7-89c5-d34c8e95b633 for instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec on n-h2-848886-16 Jul 26 04:44:05.460838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-04872a87-ceb5-4c31-ad71-90137c463768 req-ba0ad181-ebc6-4e59-a1d4-add95bbd49aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053325 Jul 26 04:44:05.461851 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1863/3838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:05.482253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:05.483262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:05.491350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.492307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.493575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.494844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.532334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:44:05.717384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:05.733923 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1576e4e7-8ada-4bcd-b1f9-d7ff27f56c08 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.557538 Jul 26 04:44:05.740096 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1976/3839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:05 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:05.756242 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-631d3fd7-016f-4399-8a18-a04348978400 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 204 len: 0 microversion: 2.47 time: 0.292269 Jul 26 04:44:05.760631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1864/3840] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:44:05 2022] DELETE /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:44:05.767696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9714fcdd-0b03-4f78-8608-830e429333b0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:05.769636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:05.773110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9714fcdd-0b03-4f78-8608-830e429333b0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:05.782662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:05.814442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.816502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:05.817514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:05.819486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.086534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.110199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.116378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.124912 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-163da629-63af-4348-bccb-985a6b24a287 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.355630 Jul 26 04:44:06.126412 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1865/3841] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:05 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:06.153270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:06.159326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:06.187727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.190241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.195748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.196712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.250904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9714fcdd-0b03-4f78-8608-830e429333b0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.266420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9714fcdd-0b03-4f78-8608-830e429333b0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1238 microversion: 2.1 time: 0.520064 Jul 26 04:44:06.269562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1977/3842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:05 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1238 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:06.296384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:06.301516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:06.327768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.328623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.329869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.332057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.467494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.486224 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c98ec8c-3cb3-43b4-a5e3-4642c42e0e3b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1271 microversion: 2.1 time: 0.354053 Jul 26 04:44:06.496051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1866/3843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:06 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:06.766936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:06.767557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:06.778691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.779784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.781169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:06.781783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:06.924080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.932316 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74915ae0-f8b7-4bf8-bbdd-3edc68d7dbe2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.170353 Jul 26 04:44:06.932995 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1867/3844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:06 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:06.962992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.971867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.973670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:06.974855 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6fe21fb-ec6e-4c99-917e-9e4dac7a12fc tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 200 len: 1365 microversion: 2.47 time: 0.686165 Jul 26 04:44:06.975405 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1978/3845] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:06 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 1365 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:07.153858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:07.156664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:07.171327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.173045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.175210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.177141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.196185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:07.299216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:07.300036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:07.337601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:07.346997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.348367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.351051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.351856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.356061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:07.366516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:07.375513 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c953cec1-6c9d-4f29-baf3-ac70d69db454 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.225445 Jul 26 04:44:07.376475 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1868/3846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:07 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:07.472654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:07.489082 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4344f39-5ef4-407f-8f98-2a6c41450c01 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1234 microversion: 2.1 time: 0.198434 Jul 26 04:44:07.494144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1979/3847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:07 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1234 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:07.513082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:07.514722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:07.533867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.534946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.536483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.537024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.956968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:07.958217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:07.975316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.977136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:07.978711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:07.979536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.013150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.026644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96198f71-4284-409d-ab91-9376e944bb86 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1271 microversion: 2.1 time: 0.518655 Jul 26 04:44:08.027790 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1869/3848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:07 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1271 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:08.035185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:08.041151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:08.062764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.063519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.064474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.065081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.285529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.301505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.303222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52464a395ee44111956360c64672bac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3181a6f3fff04ce78e5000c1fb4822ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.304754 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c0d4490-04f6-4897-a277-b6e9a6015fe4 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 200 len: 1365 microversion: 2.47 time: 0.273309 Jul 26 04:44:08.305444 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1870/3849] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:08 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:08.412927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:08.414344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:08.430652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.431563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.443867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.444576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.484191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.515886 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2990a1d9-49cb-44eb-af22-eedb6046c5f2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1505 microversion: 2.1 time: 0.565604 Jul 26 04:44:08.516491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1980/3850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:07 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:08.536070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:08.536704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:08.558950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.559441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.561358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.561674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.718201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.748956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.756402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.757602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17fce912-f475-44bc-85a1-46b39b58a65d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.361488 Jul 26 04:44:08.776955 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1871/3851] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:08 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:08.778997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:08.798090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1313268996"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:08.798887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:08.805298 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02d1f801-2661-47e7-af38-d3b17bb16c4b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1234 microversion: 2.1 time: 0.287684 Jul 26 04:44:08.808849 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1981/3852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:08 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1234 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:08.820344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.821103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:08.822064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:08.822815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:09.050967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:09.051505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:09.060418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:09.061358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:09.062423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:09.063041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:09.244270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Adding security group bfdde7b9-7555-4095-9a44-253937a66524 to port 91542f90-eb10-4b2b-9787-9dc3e19cf385 Jul 26 04:44:09.969531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:09.978937 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9ccd599-0f6f-4890-8794-53f7d257e938 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 0.931858 Jul 26 04:44:09.983571 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1982/3853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:09 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:10.001652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:10.002579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] [instance: cd78a418-50fa-4546-814b-6961584e60fd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:10.009371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.010099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.011130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.011747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.031577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] HTTP exception thrown: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Request method failure captured: Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd HTTP/1.1 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EOuziQ5i_aP5LjAu4iUAg_IV9O_VDPdqodktXqdt9kTuiIiwiNpVGLcuQKgVy3cCJ59KPRJIIdPE3M6cbWPcAUzy91g4bc_7V1WpXK0qNxDzt6M5MxX5Uvyd8P9azTdVYybQfvIRjLXb2rUqn-HqmZ6KqgvIxMWmMaMiOUqWCXJQo Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 3181a6f3fff04ce78e5000c1fb4822ab Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAaction247Test-752235171 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3181a6f3fff04ce78e5000c1fb4822ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3181a6f3fff04ce78e5000c1fb4822ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3181a6f3fff04ce78e5000c1fb4822ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3181a6f3fff04ce78e5000c1fb4822ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAaction247Test-752235171 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 3181a6f3fff04ce78e5000c1fb4822ab Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAaction247Test-752235171 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAaction247Test-752235171-project Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 52464a395ee44111956360c64672bac1 Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAaction247Test-752235171-project Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cd78a418-50fa-4546-814b-6961584e60fd'} Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:10.033544 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. Jul 26 04:44:10.039594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:10.041603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] Returning 404 to user: Instance cd78a418-50fa-4546-814b-6961584e60fd could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:10.042880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e877cbe-2ce8-4ea5-8b62-b92683631ff5 tempest-ServersAaction247Test-752235171 tempest-ServersAaction247Test-752235171-project] 10.222.0.43 "GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd" status: 404 len: 111 microversion: 2.47 time: 0.045201 Jul 26 04:44:10.043637 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1983/3854] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:09 2022] GET /compute/v2.1/servers/cd78a418-50fa-4546-814b-6961584e60fd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:44:10.050132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:10.051516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:10.058970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.059736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.061170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.061795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.201872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:10.239675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:10.252067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:10.255370 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab0af135-5633-4d94-84d7-da5e5df1ba71 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.210197 Jul 26 04:44:10.258015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1984/3855] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:10 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:10.272789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:10.275499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:10.316149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.317206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.320173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:10.320669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:10.524149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:10.534980 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e6c3910-36a6-407e-b7f6-dd9d3dd4d072 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1296 microversion: 2.1 time: 0.274848 Jul 26 04:44:10.539066 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1985/3856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:10 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1296 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:11.004137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:11.004759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:11.019309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.019765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:11.020695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.021141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:11.104065 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c71d14f-f1e8-4f73-8062-d51db20111c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/action" status: 202 len: 0 microversion: 2.1 time: 2.326081 Jul 26 04:44:11.105224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1872/3857] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:44:08 2022] POST /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/action => generated 0 bytes in 2328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:11.114221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1486598626"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:11.115051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:11.138055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.139959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:11.141392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.143885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:11.617577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Adding security group 05de6727-0fc2-4cb1-b4a8-a4eca36bef36 to port 91542f90-eb10-4b2b-9787-9dc3e19cf385 Jul 26 04:44:11.863103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:11.871784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b60f0032-5b8c-40e2-be69-2687b5bbf331 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 0.871326 Jul 26 04:44:11.888515 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1986/3858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:10 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:11.896904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:11.897518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:11.924465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.924866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:11.925957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:11.928232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:12.106145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:12.120586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:12.123188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:12.124616 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0358a8fd-082d-41b8-950e-93a031f065e6 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.234259 Jul 26 04:44:12.125710 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1987/3859] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:11 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:12.132060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-befb0b01-30ba-41c9-afbd-a72f15189cf9 req-5b3cf843-2cbb-4867-9038-a67a4535e020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de686873-929f-42f0-8216-f8bb2f60aa3f", "tag": "91542f90-eb10-4b2b-9787-9dc3e19cf385"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:12.144556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-befb0b01-30ba-41c9-afbd-a72f15189cf9 req-5b3cf843-2cbb-4867-9038-a67a4535e020 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:12.145350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-befb0b01-30ba-41c9-afbd-a72f15189cf9 req-5b3cf843-2cbb-4867-9038-a67a4535e020 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:12.162924 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-befb0b01-30ba-41c9-afbd-a72f15189cf9 req-5b3cf843-2cbb-4867-9038-a67a4535e020 service nova] Creating event network-changed:91542f90-eb10-4b2b-9787-9dc3e19cf385 for instance de686873-929f-42f0-8216-f8bb2f60aa3f on n-h2-848886-16 Jul 26 04:44:12.171062 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-befb0b01-30ba-41c9-afbd-a72f15189cf9 req-5b3cf843-2cbb-4867-9038-a67a4535e020 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042511 Jul 26 04:44:12.172418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1988/3860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:12.195287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:12.195743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:12.209858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:12.210563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:12.211759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:12.212422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:12.941365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:12.952315 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f5be69a-c895-467e-a33e-23c995450001 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.777616 Jul 26 04:44:12.955829 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1989/3861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:12 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:12.969591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5389a058-deaa-4deb-accc-fc3df3051257 req-14b180c6-efe6-436c-83f7-fc7752e93192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6568b36c-d024-4bca-b977-933bc21751c0", "tag": "60bbbd78-226c-4c41-bc10-012db0f7d51d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:12.985746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:12.996940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5389a058-deaa-4deb-accc-fc3df3051257 req-14b180c6-efe6-436c-83f7-fc7752e93192 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:12.999280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5389a058-deaa-4deb-accc-fc3df3051257 req-14b180c6-efe6-436c-83f7-fc7752e93192 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.030199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5389a058-deaa-4deb-accc-fc3df3051257 req-14b180c6-efe6-436c-83f7-fc7752e93192 service nova] Creating event network-changed:60bbbd78-226c-4c41-bc10-012db0f7d51d for instance 6568b36c-d024-4bca-b977-933bc21751c0 on n-h2-848886-16 Jul 26 04:44:13.043743 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5389a058-deaa-4deb-accc-fc3df3051257 req-14b180c6-efe6-436c-83f7-fc7752e93192 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084597 Jul 26 04:44:13.047423 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1990/3862] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:13.070891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:13.071911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:13.084028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.085092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.086124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.086832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.146534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca2dc4cb-184f-417c-a824-d7889e11be47 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/action" status: 202 len: 0 microversion: 2.1 time: 2.036387 Jul 26 04:44:13.147152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1873/3863] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:44:11 2022] POST /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/action => generated 0 bytes in 2038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:13.155871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:13.156704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:13.179845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:13.185619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.186402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.188936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.194199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.495648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:13.523980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:13.525675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:13.527070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd39d8c1-5085-4273-817e-2ab1cf099e98 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.376085 Jul 26 04:44:13.554708 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1874/3864] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:13 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:13.559820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:13.560422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:13.577565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.578027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.578851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.579294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.747393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:13.872465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:13.883422 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2cebfeb9-19c4-4fff-8c42-1a3d6815dcea tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 0.834564 Jul 26 04:44:13.884023 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1991/3865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:13 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:13.979911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:13.984170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:13.996446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.996906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:13.998290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:13.998731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:14.630729 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-359fe044-112f-4970-9b2a-f4cf14cf5e27 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.074703 Jul 26 04:44:14.633674 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1875/3866] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Jul 26 04:44:13 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f/os-security-groups => generated 1157 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:14.647290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7ec289e6-5253-4b02-a59d-6a6fe1c6cf38 req-f59a584f-fccc-4c5f-b5fc-3fb18236c870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de686873-929f-42f0-8216-f8bb2f60aa3f", "tag": "91542f90-eb10-4b2b-9787-9dc3e19cf385"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:14.669781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7ec289e6-5253-4b02-a59d-6a6fe1c6cf38 req-f59a584f-fccc-4c5f-b5fc-3fb18236c870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:14.671040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7ec289e6-5253-4b02-a59d-6a6fe1c6cf38 req-f59a584f-fccc-4c5f-b5fc-3fb18236c870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:14.715756 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7ec289e6-5253-4b02-a59d-6a6fe1c6cf38 req-f59a584f-fccc-4c5f-b5fc-3fb18236c870 service nova] Creating event network-changed:91542f90-eb10-4b2b-9787-9dc3e19cf385 for instance de686873-929f-42f0-8216-f8bb2f60aa3f on n-h2-848886-16 Jul 26 04:44:14.729945 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7ec289e6-5253-4b02-a59d-6a6fe1c6cf38 req-f59a584f-fccc-4c5f-b5fc-3fb18236c870 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092659 Jul 26 04:44:14.746850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1876/3867] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:14.764347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:14.767658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:14.787832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:14.788748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:14.789817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:14.790534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:14.852426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:14.871837 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7dfb6217-8ceb-46fe-a81b-0c2ba43f6e43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.895849 Jul 26 04:44:14.874516 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1992/3868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:13 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:14.881572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21cfe934-0186-4f27-bb04-9bf43ee8843e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b6190af0>, body: {"security_group": {"name": " tempest-securitygroup -2064175477 ", "description": "tempest-description-984497898"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:14.929582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:14.939785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:14.941400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:14.942730 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6f4399b8-813c-480b-8703-a8e5089193e2 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.193363 Jul 26 04:44:14.943400 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1877/3869] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:14 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:14.957003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:14.957915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:14.969057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:14.969701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:14.971676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:14.973866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:15.128518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:15.206471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:15.317881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:15.330748 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-925037fd-4e13-4704-b481-d20a57c952d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 0.380666 Jul 26 04:44:15.334493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1878/3870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:14 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:15.821155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21cfe934-0186-4f27-bb04-9bf43ee8843e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.944690 Jul 26 04:44:15.829696 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1993/3871] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:14 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:15.835754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f134bf44-f5b3-47e4-8b4b-3d76149966eb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b4ed4670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:15.893950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:15.894810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:15.908376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:15.908830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:15.909686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:15.910053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:16.194432 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f134bf44-f5b3-47e4-8b4b-3d76149966eb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9" status: 200 len: 223 microversion: 2.1 time: 0.363157 Jul 26 04:44:16.195465 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1879/3872] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:44:15 2022] GET /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 => generated 223 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:16.200328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:16.201601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:16.209669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:16.210002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:16.211246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:16.211757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:16.257232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:16.425130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:16.448478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:16.455532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:16.457282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f5ae4bfe-039b-4c21-bf95-ac416e481891 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.260669 Jul 26 04:44:16.460795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1880/3873] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:16 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:16.467451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-12683436-2edc-49c9-98a1-39f32e815133 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b4ed4940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:16.895930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:16.904708 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-82dd02e5-4a60-40d9-8cfc-9a8d0ce8020b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 1.014249 Jul 26 04:44:16.907938 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1994/3874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:15 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:16.924726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:16.925658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:16.939640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:16.941489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:16.942519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:16.943136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:17.658672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-12683436-2edc-49c9-98a1-39f32e815133 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9" status: 202 len: 0 microversion: 2.1 time: 1.196553 Jul 26 04:44:17.660152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1881/3875] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:44:16 2022] DELETE /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:17.665551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-02484a4b-8689-4238-8b4a-a9acc57c62e7 req-790e0115-17e3-427f-bb8e-3caa7cccc145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04ec941-3381-4c35-87f8-c8fab9a27640", "tag": "d7190e4a-96bd-460b-8852-24f4fbc72812"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:17.694081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-02484a4b-8689-4238-8b4a-a9acc57c62e7 req-790e0115-17e3-427f-bb8e-3caa7cccc145 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:17.694706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-02484a4b-8689-4238-8b4a-a9acc57c62e7 req-790e0115-17e3-427f-bb8e-3caa7cccc145 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:17.731532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-02484a4b-8689-4238-8b4a-a9acc57c62e7 req-790e0115-17e3-427f-bb8e-3caa7cccc145 service nova] Creating event network-changed:d7190e4a-96bd-460b-8852-24f4fbc72812 for instance e04ec941-3381-4c35-87f8-c8fab9a27640 on n-h1-848886-16 Jul 26 04:44:17.741033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-02484a4b-8689-4238-8b4a-a9acc57c62e7 req-790e0115-17e3-427f-bb8e-3caa7cccc145 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079385 Jul 26 04:44:17.742095 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1882/3876] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:17.749715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:17.763666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:17.771551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:17.772410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:17.773492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:17.774201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:17.972075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:17.987221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:17.993684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:17.995593 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99264f70-6296-4af3-ae1c-ce54e2fab926 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.251410 Jul 26 04:44:17.996249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1883/3877] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:17 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:18.007966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b4ed43a0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:18.437283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:18.451776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef0bdc48-7566-4cef-b15e-33ece3dd0a28 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 1.538185 Jul 26 04:44:18.453704 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1995/3878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:16 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:18.465095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:18.466047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:18.480610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:18.481722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:18.484596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:18.485577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:44:18.486324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:18.486458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:44:18.486941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.486941 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 HTTP/1.1 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0aa8a6e3-7a5a-452c-85d6-eb973f4248f9'} Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:44:18.489545 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] Jul 26 04:44:18.494969 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:18.502213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:44:18.502213 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6c7791e9-8344-43c2-bc10-5762cce88634'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:18.502213 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a20ae0c7-5eee-47ec-95ff-ccbdc1980795 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9" status: 404 len: 194 microversion: 2.1 time: 0.503574 Jul 26 04:44:18.504300 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1884/3879] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:44:17 2022] GET /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 => generated 194 bytes in 507 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:44:18.518245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-727a8d37-1ac0-4716-ab01-5842d0989734 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b4f5c1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2107085901", "description": "tempest-description-1799809170"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:18.581973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:19.271190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:19.290251 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21cec121-85fa-4134-a52f-7fc0c1243d8b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.831108 Jul 26 04:44:19.293225 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1996/3880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:18 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:19.315705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:19.318105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:19.328355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:19.331915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:19.333685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:19.335437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:19.366309 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-727a8d37-1ac0-4716-ab01-5842d0989734 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.856659 Jul 26 04:44:19.373891 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1885/3881] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:19.380771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ea25b61-e4e9-4dda-8354-908f77e40306 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b4efe9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1525865993", "description": "tempest-description-980560946"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:19.568165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:19.589907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:19.592193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:19.593723 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45a3b1ac-a33c-42bb-bc96-8f25aa16b305 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.299517 Jul 26 04:44:19.594594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1997/3882] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:19 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:19.611891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:19.612739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:19.621271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:19.625622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:19.626612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:19.627188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:20.046314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ea25b61-e4e9-4dda-8354-908f77e40306 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.669187 Jul 26 04:44:20.048229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1886/3883] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:20.054451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-150d8037-17d1-4662-98cf-d65c4c11d583 req-0f1beddc-a5ce-41d2-a76b-3c1b4c2c5146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6568b36c-d024-4bca-b977-933bc21751c0", "name": "network-vif-plugged", "status": "completed", "tag": "60bbbd78-226c-4c41-bc10-012db0f7d51d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:20.096019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-150d8037-17d1-4662-98cf-d65c4c11d583 req-0f1beddc-a5ce-41d2-a76b-3c1b4c2c5146 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:20.096526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-150d8037-17d1-4662-98cf-d65c4c11d583 req-0f1beddc-a5ce-41d2-a76b-3c1b4c2c5146 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:20.128633 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-150d8037-17d1-4662-98cf-d65c4c11d583 req-0f1beddc-a5ce-41d2-a76b-3c1b4c2c5146 service nova] Creating event network-vif-plugged:60bbbd78-226c-4c41-bc10-012db0f7d51d for instance 6568b36c-d024-4bca-b977-933bc21751c0 on n-h2-848886-16 Jul 26 04:44:20.144414 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-150d8037-17d1-4662-98cf-d65c4c11d583 req-0f1beddc-a5ce-41d2-a76b-3c1b4c2c5146 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093113 Jul 26 04:44:20.146595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1887/3884] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:20.161694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce7a5fdf-0558-4694-8140-d3e781619702 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b4f19700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-148298801", "description": "tempest-description-1516264582"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:20.728142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:20.737176 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aef7e004-8b74-4ccc-b0ab-3358a0940ab7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 1.141288 Jul 26 04:44:20.742458 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1998/3885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:19 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:20.759094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:20.764162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:20.781680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:20.786752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:20.787771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:20.788316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:21.281747 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce7a5fdf-0558-4694-8140-d3e781619702 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.133854 Jul 26 04:44:21.282568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1888/3886] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:21.289433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:21.290679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:21.333940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:21.334743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:21.339787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:21.340499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:21.438876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:21.449260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-174cb2f9-bc18-42b5-b482-d66f658ffe13 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.705409 Jul 26 04:44:21.455808 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 1999/3887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:20 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:21.487085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb38ef85-7f19-4063-a43b-c3209231330b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b4c18430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:21.532240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:21.550063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:21.558234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:21.559509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61847bf9-afc7-48e3-9cb1-a8b90f52afec tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.275554 Jul 26 04:44:21.561236 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1889/3888] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:21 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:21.761897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:21.763053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:21.777826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:21.778812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:21.781669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:21.782417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:22.253883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb38ef85-7f19-4063-a43b-c3209231330b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.800313 Jul 26 04:44:22.254492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2000/3889] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:44:21 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:22.271770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90fcea30-541f-44a5-9074-fa34f736bdfc tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5f5eaf0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:22.381750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:22.416605 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b13b151-9dc4-4f10-bc93-77386dd7a8db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1313 microversion: 2.1 time: 0.636644 Jul 26 04:44:22.436043 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1890/3890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:21 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:22.481135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:22.482185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:22.492491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:22.493249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:22.495117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:22.495782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.071311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90fcea30-541f-44a5-9074-fa34f736bdfc tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665" status: 202 len: 0 microversion: 2.1 time: 0.805218 Jul 26 04:44:23.071910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2001/3891] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:44:22 2022] DELETE /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:23.076885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:23.077511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:23.093637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.094118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.100006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.100483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.133492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:23.145325 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c192a3e-3a50-4cf2-bba8-fe8ed5178330 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.674916 Jul 26 04:44:23.145918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1891/3892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:22 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:23.163369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-177c9a84-137e-48c1-b90b-77c212cc3555 req-a03cd5d4-4b5f-4493-ba2e-0a42f94d50ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04ec941-3381-4c35-87f8-c8fab9a27640", "name": "network-vif-plugged", "status": "completed", "tag": "d7190e4a-96bd-460b-8852-24f4fbc72812"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:23.178878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-177c9a84-137e-48c1-b90b-77c212cc3555 req-a03cd5d4-4b5f-4493-ba2e-0a42f94d50ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.182310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-177c9a84-137e-48c1-b90b-77c212cc3555 req-a03cd5d4-4b5f-4493-ba2e-0a42f94d50ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.201824 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-177c9a84-137e-48c1-b90b-77c212cc3555 req-a03cd5d4-4b5f-4493-ba2e-0a42f94d50ab service nova] Creating event network-vif-plugged:d7190e4a-96bd-460b-8852-24f4fbc72812 for instance e04ec941-3381-4c35-87f8-c8fab9a27640 on n-h1-848886-16 Jul 26 04:44:23.208240 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-177c9a84-137e-48c1-b90b-77c212cc3555 req-a03cd5d4-4b5f-4493-ba2e-0a42f94d50ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060897 Jul 26 04:44:23.209134 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1892/3893] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:23.215498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b4ef1b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:23.269066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:23.282853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:23.285260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:23.286755 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c2302ff-e326-4b7a-95a4-99347b948439 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.213904 Jul 26 04:44:23.287821 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2002/3894] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:23 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:23.439557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:23.440440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:23.448069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.448925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.449976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.450646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.737433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:23.746299 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d08931d7-f317-4f7c-a7d1-b647b23cfcd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1500 microversion: 2.1 time: 0.311157 Jul 26 04:44:23.746892 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2003/3895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:23 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1500 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:23.775133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:23.779867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:23.798645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.801871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.807685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:23.808924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:23.865147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:44:23.901006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:44:23.901609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:44:23.902133 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.902133 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665 HTTP/1.1 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '6443e11d-1ead-44e2-9c43-a35bd09f2665'} Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:44:23.904720 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-bb0ea118-1d40-4d02-a95e-d5117752ab58'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-518be948-edcc-491c-9bda-4b36af79cbef tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665" status: 404 len: 194 microversion: 2.1 time: 0.696094 Jul 26 04:44:23.913131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1893/3896] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:44:23 2022] GET /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665 => generated 194 bytes in 698 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:44:23.919390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81007d3e-158d-45e7-bfda-691d01d6788a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b529e430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:24.036560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bd0247e-331e-491d-883b-0d50d39387e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 204 len: 0 microversion: 2.1 time: 0.264212 Jul 26 04:44:24.038615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2004/3897] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:44:23 2022] DELETE /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:44:24.052260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:24.053088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:24.061385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.061827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.062798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.063245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.340136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:24.349897 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e7b9f50-06aa-445d-8c97-9899e075466f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1506 microversion: 2.1 time: 0.303930 Jul 26 04:44:24.351220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2005/3898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:24 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:24.356259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:24.358761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:24.371764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.372214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.373454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.374134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.546845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:24.559160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b870db7-4a97-4469-a286-ead4793ddebb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1364 microversion: 2.1 time: 0.206577 Jul 26 04:44:24.566789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2006/3899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:24 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:24.580706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:24.583269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:24.590474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.591152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.593575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:24.594186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:24.679624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:24.706300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:24.711444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:24.734523 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15f1cdd0-3d82-4570-b8b0-e612b4c017ce tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1605 microversion: 2.42 time: 0.148841 Jul 26 04:44:24.735974 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2007/3900] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:24 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:25.040160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81007d3e-158d-45e7-bfda-691d01d6788a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f" status: 202 len: 0 microversion: 2.1 time: 1.127943 Jul 26 04:44:25.041662 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1894/3901] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:44:23 2022] DELETE /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:44:25.052738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b58bd790>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:25.137190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:44:25.138110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group cc286996-a285-4bee-a08d-4b836a81af7f not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:44:25.139233 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.139233 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f HTTP/1.1 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cc286996-a285-4bee-a08d-4b836a81af7f'} Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:44:25.141820 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-1e7c22ce-f3d0-422a-9a74-115bf1e10be7'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef9a1eaf-99cb-42ee-bd33-7ead37a03a85 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f" status: 404 len: 194 microversion: 2.1 time: 0.097142 Jul 26 04:44:25.146989 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2008/3902] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:44:25 2022] GET /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:44:25.153509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90ce41da-b58b-487f-8612-fda8b6d9ded1 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b51833a0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:25.372599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:25.373763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:25.399240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:25.400247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:25.401366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:25.402713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.098739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:26.112544 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1584dbf3-1287-40e0-9fd1-ddec8c80b233 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1506 microversion: 2.1 time: 0.744429 Jul 26 04:44:26.115025 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2009/3903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:25 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:26.135117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:26.136030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:26.164661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.167228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.170166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.179712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.240403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90ce41da-b58b-487f-8612-fda8b6d9ded1 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c" status: 202 len: 0 microversion: 2.1 time: 1.091401 Jul 26 04:44:26.242206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1895/3904] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:44:25 2022] DELETE /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:26.251943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:26.253019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:26.277909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.278653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.283374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.284064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.358898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.359354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.359812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lazy-loading 'fault' on Instance uuid 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:44:26.468968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:26.486264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:26.488256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30724f41927d42b78babcf9b382d31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1618901939a44ef2b44d98dbc2a821b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:26.495480 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58e7d6e0-dd34-43db-92dd-7c0411999725 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 200 len: 1372 microversion: 2.42 time: 0.247938 Jul 26 04:44:26.496756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1896/3905] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:26 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:44:26.515821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5183e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:26.597236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:44:26.607743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:44:26.611430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.611430 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c HTTP/1.1 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ff9bbc49-a6ae-43e8-bf69-11f2581d052c'} Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:44:26.618827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] Jul 26 04:44:26.626739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:26.640700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:44:26.640700 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6104e45b-a588-4838-8629-65644533d976'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:26.642725 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0f9adb9-5add-49f9-8ad0-c9033dca4180 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c" status: 404 len: 194 microversion: 2.1 time: 0.144218 Jul 26 04:44:26.644611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1897/3906] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:44:26 2022] GET /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:44:26.658241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b129760b-6f25-4363-84e5-3108b4954f56 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b51464c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:26.687425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:26.699652 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1512f5f5-b593-4629-827c-fcfefb6f0685 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1549 microversion: 2.1 time: 0.581936 Jul 26 04:44:26.704291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2010/3907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:26 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1549 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:26.726521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:26.727114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:26.746450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.747223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.749233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:26.749904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:26.877408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cacdac33-364a-4092-bc0a-4330e87c3ff1 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155308 Jul 26 04:44:26.879440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2011/3908] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:44:26 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:27.143945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:27.144901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:27.153272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:27.155471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:27.156540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:27.157300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:27.449241 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b129760b-6f25-4363-84e5-3108b4954f56 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.798447 Jul 26 04:44:27.459104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1898/3909] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Jul 26 04:44:26 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:27.472977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fab3156-2735-44ad-9d52-46758b13d9b2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b60da280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-669182055", "description": "tempest-description-264465731"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:27.597471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:27.644767 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-702428ed-7830-4336-9d30-9ac06c218ba0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 200 len: 1506 microversion: 2.1 time: 0.510131 Jul 26 04:44:27.647491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2012/3910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:27 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:27.660766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:27.661836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:27.690358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:27.691680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:27.692682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:27.693344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:27.763204 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] HTTP exception thrown: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Request method failure captured: Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec HTTP/1.1 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi32-MbMiSe3J2R2kHx3ddv6OkeVmDiIZDoKSAyCgEpbs0feiavgUpo5SYsmxiMQF0VVd8bDpm8mI5bdyaqdt1dccPEMb7HR9wYRRgl4IoI4cYS7TWcQIkLsR3Z9ey7KjKxoqeF6jwJefwAIorYi9AdJsw3X8U_-F5TTP6eZyMU8E2U0U Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 30724f41927d42b78babcf9b382d31e9 Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec'} Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:27.768661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:27.773914 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:27.783809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Returning 404 to user: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:27.787139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efe8f35c-f6ba-44b9-89be-1da84c0e5a6f tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 404 len: 111 microversion: 2.42 time: 0.138032 Jul 26 04:44:27.796568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2013/3911] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:27 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:44:27.816423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-22fd5219-2bec-4b7d-aefd-e7d5892f476d req-ee5af255-93a6-4f63-9382-c5196a5a66e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6568b36c-d024-4bca-b977-933bc21751c0", "name": "network-vif-deleted", "tag": "60bbbd78-226c-4c41-bc10-012db0f7d51d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:27.842958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-22fd5219-2bec-4b7d-aefd-e7d5892f476d req-ee5af255-93a6-4f63-9382-c5196a5a66e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:27.844166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-22fd5219-2bec-4b7d-aefd-e7d5892f476d req-ee5af255-93a6-4f63-9382-c5196a5a66e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:27.858225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-22fd5219-2bec-4b7d-aefd-e7d5892f476d req-ee5af255-93a6-4f63-9382-c5196a5a66e0 service nova] Creating event network-vif-deleted:60bbbd78-226c-4c41-bc10-012db0f7d51d for instance 6568b36c-d024-4bca-b977-933bc21751c0 on n-h2-848886-16 Jul 26 04:44:27.881350 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-22fd5219-2bec-4b7d-aefd-e7d5892f476d req-ee5af255-93a6-4f63-9382-c5196a5a66e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065054 Jul 26 04:44:27.882291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2014/3912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:27.898783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af031a38-5a38-40b1-8de7-77916ff16671 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '.version_select at 0x7f38b4c18ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:27.956157 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af031a38-5a38-40b1-8de7-77916ff16671 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858168389" status: 204 len: 0 microversion: 2.42 time: 0.068402 Jul 26 04:44:27.958666 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2015/3913] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858168389 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:44:28.673354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:28.674460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:28.688947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:28.692059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:28.695156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:28.695651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:28.713101 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 HTTP/1.1 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6568b36c-d024-4bca-b977-933bc21751c0'} Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:28.715383 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:44:28.720954 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:28.724358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:28.725650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e8af932f-9074-4907-bf06-f2a95acdb7ce tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 404 len: 111 microversion: 2.1 time: 0.057506 Jul 26 04:44:28.750906 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2016/3914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:28 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:44:28.869812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1861968064", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:28.948158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:29.310890 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fab3156-2735-44ad-9d52-46758b13d9b2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.849072 Jul 26 04:44:29.320955 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1899/3915] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:29.327899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-586ef5e3-7a00-4977-8bef-bda45d34912a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b51b2e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-683109481", "description": "tempest-description-348185309"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:30.160441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-586ef5e3-7a00-4977-8bef-bda45d34912a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.834751 Jul 26 04:44:30.161153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1900/3916] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:44:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:30.480207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-506381913", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "5649b135-c948-4460-8abf-b356a8926a2b"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:30.524803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:30.525322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:30.526004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:30.527693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:30.528333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:30.551597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:30.553624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:30.555001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:30.555511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:30.598286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:30.610814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] validate_networks() for [('5649b135-c948-4460-8abf-b356a8926a2b', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:30.621579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:30.648197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:30.650918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:30.715171 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1aeb107b-a526-44bf-b9f7-f6956302e13d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.849519 Jul 26 04:44:30.723093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2017/3917] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:44:30.745152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33c41d7b-5bc2-44e5-b7fe-bf3a7038d1b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:30.746386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33c41d7b-5bc2-44e5-b7fe-bf3a7038d1b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:30.928036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33c41d7b-5bc2-44e5-b7fe-bf3a7038d1b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:30.948102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33c41d7b-5bc2-44e5-b7fe-bf3a7038d1b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1215 microversion: 2.1 time: 0.223451 Jul 26 04:44:30.960992 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2018/3918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:30 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:31.795621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b75541a6-0c77-4b78-965e-9f735b52a1fc req-940dea14-fbbe-4460-a3e0-18e07c28c937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04ec941-3381-4c35-87f8-c8fab9a27640", "tag": "d7190e4a-96bd-460b-8852-24f4fbc72812"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:31.807344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b75541a6-0c77-4b78-965e-9f735b52a1fc req-940dea14-fbbe-4460-a3e0-18e07c28c937 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:31.808029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b75541a6-0c77-4b78-965e-9f735b52a1fc req-940dea14-fbbe-4460-a3e0-18e07c28c937 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:31.824603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b75541a6-0c77-4b78-965e-9f735b52a1fc req-940dea14-fbbe-4460-a3e0-18e07c28c937 service nova] Creating event network-changed:d7190e4a-96bd-460b-8852-24f4fbc72812 for instance e04ec941-3381-4c35-87f8-c8fab9a27640 on n-h1-848886-16 Jul 26 04:44:31.831988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b75541a6-0c77-4b78-965e-9f735b52a1fc req-940dea14-fbbe-4460-a3e0-18e07c28c937 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040275 Jul 26 04:44:31.833259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2019/3919] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:31.864497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:31.865517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:31.866281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:31.866866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:31.868576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:31.899720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:31.900092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:31.900913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:31.902191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:31.928458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:31.960061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Getting quotas for project 5d85fb5d3ba24b7292829e7cf1e3373c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:31.970672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:31.971718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:32.046649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:32.047597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:32.049800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Getting quotas for user 055ef33e960e457897c7ab8fb77d44da and project 5d85fb5d3ba24b7292829e7cf1e3373c. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:32.052289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:32.052946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:32.119645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:32.127141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:32.128377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:32.274733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec7b69c3-5322-4589-b7b5-4f88f6f64f14 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793675 Jul 26 04:44:32.285340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1901/3920] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:44:32.312838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-292d26ba-2b71-49d0-bbb5-a23e7b6598a4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:32.317185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-292d26ba-2b71-49d0-bbb5-a23e7b6598a4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:32.491285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:32.504886 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77de3559-190c-4a51-a3f5-a0dbf43e8702 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1267 microversion: 2.1 time: 0.539588 Jul 26 04:44:32.508881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2020/3921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:31 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1267 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:32.599050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-292d26ba-2b71-49d0-bbb5-a23e7b6598a4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:32.614473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-292d26ba-2b71-49d0-bbb5-a23e7b6598a4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1215 microversion: 2.1 time: 0.327010 Jul 26 04:44:32.621877 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1902/3922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:32 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:32.777714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1659016254", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:32.899681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:33.533041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:33.535001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:33.549246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:33.553431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:33.554519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:33.554970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:33.731137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:33.739608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-597a9d05-0d55-4017-bc3a-f84736f25d92 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1273 microversion: 2.1 time: 0.214523 Jul 26 04:44:33.740195 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1903/3923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:33 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:33.762568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:33.763719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:33.784007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:33.785918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:33.787029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:33.789171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:33.939595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:33.950044 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e3e1cce-528d-48c4-8917-9af1962c45c7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1267 microversion: 2.1 time: 0.208695 Jul 26 04:44:33.953627 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1904/3924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:33 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:34.764297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:34.770482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:34.800889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:34.807263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:34.808346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:34.808941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:34.963276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:34.980175 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d266364-aba9-4548-96d2-9cdbe8c8d751 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1273 microversion: 2.1 time: 0.219892 Jul 26 04:44:34.994306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1905/3925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:34 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:35.003130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:35.005321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:35.020629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:35.022840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:35.023823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:35.025512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:35.159475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:35.167953 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a05a7b7-c84a-45a0-82da-06be3c38fe36 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1273 microversion: 2.1 time: 0.172194 Jul 26 04:44:35.186398 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1906/3926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:34 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:36.001935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:36.003239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:36.019761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.020429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.021397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.021991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.205442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:36.215101 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9e4e7cc-3222-4bc2-a660-7d2f306c4d5b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1273 microversion: 2.1 time: 0.215299 Jul 26 04:44:36.215698 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1907/3927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:35 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:36.223697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:36.245873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:36.272247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.272914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.273977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.274583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.729349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:36.729817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:36.730698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:36.731129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:36.731531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:36.744207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.749431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.750638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:36.752021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:36.777371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:36.786193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:36.815160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:36.819038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:36.921801 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f5e6bc2-12ea-4ea5-8445-d662cf967bea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.411388 Jul 26 04:44:36.929330 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2021/3928] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:44:36.943623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5a42d0d-f4a0-4553-8abc-9b8f669d2d6e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:36.954685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5a42d0d-f4a0-4553-8abc-9b8f669d2d6e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:37.138103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5a42d0d-f4a0-4553-8abc-9b8f669d2d6e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:37.149795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5a42d0d-f4a0-4553-8abc-9b8f669d2d6e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1193 microversion: 2.1 time: 0.209992 Jul 26 04:44:37.154720 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2022/3929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:36 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1193 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:37.237515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:37.238139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:37.264388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:37.265575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:37.271549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:37.272035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:37.476875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:37.485653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-076269f4-b13d-42b4-93a9-bcbef961cbba tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 1.265634 Jul 26 04:44:37.503432 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1908/3930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:36 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:37.898548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:37.915403 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b8bae15-c62e-4568-9af1-c629658391f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.681567 Jul 26 04:44:37.916154 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2023/3931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:37 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:38.193736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:38.196049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:38.217557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.218351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.219532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.220253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.440042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:38.456879 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-903f9c04-2658-4481-b813-13237cc54f22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1245 microversion: 2.1 time: 0.276149 Jul 26 04:44:38.458731 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1909/3932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:38 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1245 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:38.508969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:38.509590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:38.511962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:38.528997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.529668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.530547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.531129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.577532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:38.578608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:38.590071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.592004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.597807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.598529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.629992 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] HTTP exception thrown: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Request method failure captured: Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec HTTP/1.1 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-MbMiSe3J2R2kHx3ddv6OkeVmDiIZDoKSAyCgEpbs0feiavgUpo5SYsmxiMQF0VVd8bDpm8mI5bdyaqdt1dccPEMb7HR9wYRRgl4IoI4cYS7TWcQIkLsR3Z9ey7KjKxoqeF6jwJefwAIorYi9AdJsw3X8U_-F5TTP6eZyMU8E2U0U Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 30724f41927d42b78babcf9b382d31e9 Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec'} Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:38.632128 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.635245 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.637369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Returning 404 to user: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:38.638805 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-106621b7-f1a3-4e46-a815-015ef40ac777 tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 404 len: 111 microversion: 2.42 time: 0.065952 Jul 26 04:44:38.639594 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1910/3933] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:44:38 2022] DELETE /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:44:38.647970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:38.648907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] [instance: 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:38.656364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.656956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.657995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.658832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.680996 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] HTTP exception thrown: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Request method failure captured: Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec HTTP/1.1 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi32-MbMiSe3J2R2kHx3ddv6OkeVmDiIZDoKSAyCgEpbs0feiavgUpo5SYsmxiMQF0VVd8bDpm8mI5bdyaqdt1dccPEMb7HR9wYRRgl4IoI4cYS7TWcQIkLsR3Z9ey7KjKxoqeF6jwJefwAIorYi9AdJsw3X8U_-F5TTP6eZyMU8E2U0U Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1618901939a44ef2b44d98dbc2a821b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 1618901939a44ef2b44d98dbc2a821b7 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1214643664 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 30724f41927d42b78babcf9b382d31e9 Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1214643664-project Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec'} Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.682898 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. Jul 26 04:44:38.686056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:38.688011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] Returning 404 to user: Instance 2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:38.689198 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-101b7669-bf5f-4087-8b21-33c015e24c7d tempest-TaggedBootDevicesTest_v242-1214643664 tempest-TaggedBootDevicesTest_v242-1214643664-project] 10.222.0.43 "GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec" status: 404 len: 111 microversion: 2.42 time: 0.045103 Jul 26 04:44:38.693113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1911/3934] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:44:38 2022] GET /compute/v2.1/servers/2d02883f-2fb4-4b1c-93aa-2e68ec7b85ec => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:44:38.938252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:38.938981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:38.949879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.954803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:38.956280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:38.958651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:39.587952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:39.596692 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18078e18-0e75-4212-b856-8c0ac9d7d808 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.662428 Jul 26 04:44:39.597286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1912/3935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:38 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:39.616300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-69e59d4f-af77-4ea8-ac00-f22daa7d72f5 req-668abaef-0943-4c7a-a3d6-0ba6fb3d9257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70498d2-dd33-43f1-a55c-68fd4c04f689", "tag": "b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:39.633110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:39.643467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-69e59d4f-af77-4ea8-ac00-f22daa7d72f5 req-668abaef-0943-4c7a-a3d6-0ba6fb3d9257 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:39.643922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-69e59d4f-af77-4ea8-ac00-f22daa7d72f5 req-668abaef-0943-4c7a-a3d6-0ba6fb3d9257 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:39.658328 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a7963b2-7008-4394-a860-606f9ea8cf9d tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 1.147848 Jul 26 04:44:39.662638 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2024/3936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:38 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:39.676842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:39.677738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:39.691602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-69e59d4f-af77-4ea8-ac00-f22daa7d72f5 req-668abaef-0943-4c7a-a3d6-0ba6fb3d9257 service nova] Creating event network-changed:b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b for instance d70498d2-dd33-43f1-a55c-68fd4c04f689 on n-h2-848886-16 Jul 26 04:44:39.694770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:39.698527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:39.700120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:39.701400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:39.705454 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-69e59d4f-af77-4ea8-ac00-f22daa7d72f5 req-668abaef-0943-4c7a-a3d6-0ba6fb3d9257 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105114 Jul 26 04:44:39.707709 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1913/3937] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:39.864733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:39.876769 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e73c9eb5-3566-4562-b27c-d59eb1ab847c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1251 microversion: 2.1 time: 0.212721 Jul 26 04:44:39.896305 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2025/3938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:39 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1251 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:40.605279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dde2ac37-4e4e-4306-94cd-43c6c40a260e req-a52e94c3-8e47-482c-ad9e-0a11a34d12fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a68b05-b5fb-4da1-b99c-8691f57754ef", "tag": "008d2b5a-d3ff-47d5-989e-d8601eecad83"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:40.620385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:40.621764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:40.645034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:40.645643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:40.646302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:40.646745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:40.655552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dde2ac37-4e4e-4306-94cd-43c6c40a260e req-a52e94c3-8e47-482c-ad9e-0a11a34d12fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:40.655992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dde2ac37-4e4e-4306-94cd-43c6c40a260e req-a52e94c3-8e47-482c-ad9e-0a11a34d12fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:40.722661 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dde2ac37-4e4e-4306-94cd-43c6c40a260e req-a52e94c3-8e47-482c-ad9e-0a11a34d12fb service nova] Creating event network-changed:008d2b5a-d3ff-47d5-989e-d8601eecad83 for instance 28a68b05-b5fb-4da1-b99c-8691f57754ef on n-h2-848886-16 Jul 26 04:44:40.753816 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dde2ac37-4e4e-4306-94cd-43c6c40a260e req-a52e94c3-8e47-482c-ad9e-0a11a34d12fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154016 Jul 26 04:44:40.764820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1914/3939] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:40.781172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:40.785668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:40.804338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:40.805024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:40.807278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:40.807905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:41.313604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:41.321894 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5152349-760a-4366-8d6d-5358ff2e6387 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.705466 Jul 26 04:44:41.342513 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2026/3940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:40 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:41.352516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:41.355346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:41.375923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:41.376393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:41.377193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:41.383621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:41.752129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:41.773169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53b2f289-50a3-4bfd-99c5-dc763be74051 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 1.006591 Jul 26 04:44:41.775152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1915/3941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:40 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:42.097459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:42.112505 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10c18250-cbf6-4ff9-be7e-f05e92763aa6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.768368 Jul 26 04:44:42.113401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2027/3942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:41 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:42.348932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:42.349557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:42.352022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:42.362034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:42.362550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:42.363345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:42.363876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:42.614367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:42.798012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:42.798933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:42.808950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:42.809610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:42.811154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:42.811828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:42.868718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:42.881212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad37e0c0-e8b6-4b86-9bb1-142db96952b0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.537196 Jul 26 04:44:42.894240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1916/3943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:42 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:43.135927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:43.136765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:43.144560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:43.145292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:43.146270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:43.147593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:43.371939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:43.383832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57180eac-25fc-45b7-9572-7472d5cff420 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.590702 Jul 26 04:44:43.386607 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2028/3944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:42 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:43.599231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:43.614611 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea33a20a-682f-4d2a-8362-9d32426fbab5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.482434 Jul 26 04:44:43.632397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1917/3945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:43 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:43.902356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:43.903215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:43.925750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:43.927942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:43.930085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:43.930761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:43.951333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a7171b1e-2826-4f8a-addb-af0fce04e008 req-d63a97ff-0fee-437b-a559-31beb2b8e67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1596193d-0329-4198-90bb-9e354125d6bc", "tag": "15cc71c2-34ea-4ddf-a1b6-f920d81b596f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:43.964231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:43.972256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a7171b1e-2826-4f8a-addb-af0fce04e008 req-d63a97ff-0fee-437b-a559-31beb2b8e67e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:43.972711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a7171b1e-2826-4f8a-addb-af0fce04e008 req-d63a97ff-0fee-437b-a559-31beb2b8e67e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:44.010821 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a7171b1e-2826-4f8a-addb-af0fce04e008 req-d63a97ff-0fee-437b-a559-31beb2b8e67e service nova] Creating event network-changed:15cc71c2-34ea-4ddf-a1b6-f920d81b596f for instance 1596193d-0329-4198-90bb-9e354125d6bc on n-h1-848886-16 Jul 26 04:44:44.018456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a7171b1e-2826-4f8a-addb-af0fce04e008 req-d63a97ff-0fee-437b-a559-31beb2b8e67e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071519 Jul 26 04:44:44.019861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1918/3946] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:44.304399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:44.314785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fb7f04f-267a-4005-8603-c2dec5cc60c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.414279 Jul 26 04:44:44.315414 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2029/3947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:43 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:44.406752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:44.407668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:44.424225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:44.424880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:44.425890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:44.426513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:44.652774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:44.653392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:44.663410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:44.671390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:44.673651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:44.674581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:44.706094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:44.717768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e370f24-ce54-47ef-a2d5-c0358f8658bb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.315242 Jul 26 04:44:44.733386 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1919/3948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:44 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:45.335854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:45.337238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:45.351532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:45.352288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:45.354923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:45.355612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:45.380303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:45.395384 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a3b9de3-cce7-4d66-bed5-e398befc94c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.746784 Jul 26 04:44:45.409336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2030/3949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:44 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:45.722423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:45.730957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4dc95b63-a390-4b51-9bb1-54e0bb734ac8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.399010 Jul 26 04:44:45.742623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1920/3950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:45 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:45.753377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:45.754616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:45.775696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:45.776299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:45.777213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:45.777766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:45.992361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:46.001577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2fbe214-c26e-4f4b-ac86-efa81e3e0262 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.264808 Jul 26 04:44:46.002879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2031/3951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:45 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:46.417078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:46.418435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:46.426604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:46.438302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:46.439395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:46.439993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:46.770034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:46.771803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:46.782892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:46.785358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:46.786279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:46.790701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:46.791413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:46.992168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:47.011980 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b627d4a-9e0e-4fba-a80a-2401f7d57c5f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.246838 Jul 26 04:44:47.013927 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2032/3952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:46 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:47.033793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:47.034661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:47.042543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:47.043206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:47.044164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:47.045551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:47.151636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:47.223279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:47.234698 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d5f91a6-5226-4a0d-b79d-aeec185c84c4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.206274 Jul 26 04:44:47.236233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2033/3953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:47 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:47.282350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:47.306340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b34bbeb-7393-4903-a956-67d64946699e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.892499 Jul 26 04:44:47.308212 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1921/3954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:46 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:47.721643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9e347f8e-2ff6-40f1-afd4-d811c43e535a req-90281623-4092-4a52-987a-a3512a908f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70498d2-dd33-43f1-a55c-68fd4c04f689", "name": "network-vif-plugged", "status": "completed", "tag": "b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:47.759039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9e347f8e-2ff6-40f1-afd4-d811c43e535a req-90281623-4092-4a52-987a-a3512a908f9c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:47.761676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9e347f8e-2ff6-40f1-afd4-d811c43e535a req-90281623-4092-4a52-987a-a3512a908f9c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:47.795326 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9e347f8e-2ff6-40f1-afd4-d811c43e535a req-90281623-4092-4a52-987a-a3512a908f9c service nova] Creating event network-vif-plugged:b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b for instance d70498d2-dd33-43f1-a55c-68fd4c04f689 on n-h2-848886-16 Jul 26 04:44:47.821791 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9e347f8e-2ff6-40f1-afd4-d811c43e535a req-90281623-4092-4a52-987a-a3512a908f9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106062 Jul 26 04:44:47.825701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2034/3955] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:48.036027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:48.036701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:48.043781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.049695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.050833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.054004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.257841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:48.258837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:48.270975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.276828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.278085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.278630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.559280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:48.568917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-084df7b0-5797-4d62-b43f-7502b9f43599 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.315422 Jul 26 04:44:48.569968 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2035/3956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:48 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:48.574833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:48.575654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:48.583195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.583933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.584947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:48.585610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:48.820729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:48.830783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86f1a0d3-ea13-4092-8b42-44bcfdf30bfa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.259381 Jul 26 04:44:48.831634 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2036/3957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:48 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:48.900151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:48.906855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:48.911644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee3ad5ee-3ab7-4819-9fc4-6bf47abf29db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.879355 Jul 26 04:44:48.912232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1922/3958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:48 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:49.594573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:49.595368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:49.622027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:49.623231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:49.625043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:49.631873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:49.855016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:49.855764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:49.871387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:49.871980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:49.872982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:49.882936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:50.162276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:50.170935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3f150d1-50bd-4b85-8bcb-7a05b809a23b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.320289 Jul 26 04:44:50.171651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1923/3959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:49 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:50.176550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d74718fa-998a-4318-a4f9-eb9c4fe6714a req-2453e229-8f10-4515-b034-f38de61e6bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a68b05-b5fb-4da1-b99c-8691f57754ef", "name": "network-vif-plugged", "status": "completed", "tag": "008d2b5a-d3ff-47d5-989e-d8601eecad83"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:50.191149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d74718fa-998a-4318-a4f9-eb9c4fe6714a req-2453e229-8f10-4515-b034-f38de61e6bbd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:50.191945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d74718fa-998a-4318-a4f9-eb9c4fe6714a req-2453e229-8f10-4515-b034-f38de61e6bbd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:50.216012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d74718fa-998a-4318-a4f9-eb9c4fe6714a req-2453e229-8f10-4515-b034-f38de61e6bbd service nova] Creating event network-vif-plugged:008d2b5a-d3ff-47d5-989e-d8601eecad83 for instance 28a68b05-b5fb-4da1-b99c-8691f57754ef on n-h2-848886-16 Jul 26 04:44:50.226600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d74718fa-998a-4318-a4f9-eb9c4fe6714a req-2453e229-8f10-4515-b034-f38de61e6bbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053156 Jul 26 04:44:50.229382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1924/3960] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:50.241465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:50.242597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:50.252974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:50.262874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46f7a2d1-f739-4fbe-a178-9d34d4e56b8f tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1315 microversion: 2.1 time: 0.672827 Jul 26 04:44:50.267404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2037/3961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:49 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:50.269749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:50.270403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:50.271491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:50.272000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:50.848696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:50.857434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9f1dc1c4-46b8-4dc8-ae04-5f41f7a3bdef tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.625570 Jul 26 04:44:50.858051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1925/3962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:50 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:51.197728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:51.199690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:51.215175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.216907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.217903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.219271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.285179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:51.286029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:51.301004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.301704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.302787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.303401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.644275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:51.657861 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-298897fe-18e2-43b3-8411-0c47d0184ce7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1503 microversion: 2.1 time: 0.372359 Jul 26 04:44:51.658714 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1926/3963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:51 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:51.660730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:51.674738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55a1352c-c0c5-4830-b236-d4befaa69358 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.485363 Jul 26 04:44:51.676654 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2038/3964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:51 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:51.682527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-669182055"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:51.683080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:51.692988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.693463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.694347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.694805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.881245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:51.882521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:51.897005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.900255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.901297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:51.903277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:51.910058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:52.018095 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Adding security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 to port b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b Jul 26 04:44:52.153081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:52.170387 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89423ab3-a4d1-4020-aad8-1bc6ae7295a5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1315 microversion: 2.1 time: 0.294683 Jul 26 04:44:52.171332 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2039/3965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:51 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:44:52.359914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-919e3e8a-1951-4cdf-89a4-1b0c103e35c6 req-254ff209-aa3c-489a-a154-5e1cae109e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1596193d-0329-4198-90bb-9e354125d6bc", "name": "network-vif-plugged", "status": "completed", "tag": "15cc71c2-34ea-4ddf-a1b6-f920d81b596f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:52.382714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-919e3e8a-1951-4cdf-89a4-1b0c103e35c6 req-254ff209-aa3c-489a-a154-5e1cae109e13 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:52.383586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-919e3e8a-1951-4cdf-89a4-1b0c103e35c6 req-254ff209-aa3c-489a-a154-5e1cae109e13 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:52.405512 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-919e3e8a-1951-4cdf-89a4-1b0c103e35c6 req-254ff209-aa3c-489a-a154-5e1cae109e13 service nova] Creating event network-vif-plugged:15cc71c2-34ea-4ddf-a1b6-f920d81b596f for instance 1596193d-0329-4198-90bb-9e354125d6bc on n-h1-848886-16 Jul 26 04:44:52.413824 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-919e3e8a-1951-4cdf-89a4-1b0c103e35c6 req-254ff209-aa3c-489a-a154-5e1cae109e13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058678 Jul 26 04:44:52.415077 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2040/3966] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:52.708767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:52.711188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:52.737245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:52.739210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:52.741951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:52.742921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:53.202802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:53.222421 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e200ae0a-5fc0-435c-a5f5-f67cd2d0c5b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1293 microversion: 2.1 time: 0.512912 Jul 26 04:44:53.223414 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2041/3967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:52 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1293 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:53.229145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:53.232293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:53.249499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:53.255265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:53.257022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:53.257824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:53.384550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74f931bc-f071-401f-a4c2-fd01566b9149 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action" status: 202 len: 0 microversion: 2.1 time: 1.706030 Jul 26 04:44:53.386042 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1927/3968] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:44:51 2022] POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:44:53.396952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b516cb80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:53.602070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:53.637278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3df28deb-9527-4067-b0f1-9e9a5c1c8428 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1503 microversion: 2.1 time: 0.397627 Jul 26 04:44:53.640459 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2042/3969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:53 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:53.649393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2725ac01-4de1-4170-83dd-c26b9fdf786d req-4619ef21-f31f-4c1c-9872-dfb33988afc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70498d2-dd33-43f1-a55c-68fd4c04f689", "tag": "b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:53.695978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2725ac01-4de1-4170-83dd-c26b9fdf786d req-4619ef21-f31f-4c1c-9872-dfb33988afc4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:53.702576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2725ac01-4de1-4170-83dd-c26b9fdf786d req-4619ef21-f31f-4c1c-9872-dfb33988afc4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:53.742692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2725ac01-4de1-4170-83dd-c26b9fdf786d req-4619ef21-f31f-4c1c-9872-dfb33988afc4 service nova] Creating event network-changed:b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b for instance d70498d2-dd33-43f1-a55c-68fd4c04f689 on n-h2-848886-16 Jul 26 04:44:53.756691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2725ac01-4de1-4170-83dd-c26b9fdf786d req-4619ef21-f31f-4c1c-9872-dfb33988afc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113315 Jul 26 04:44:53.757321 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2043/3970] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:44:54.247496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:54.248824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:54.257753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use.", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:44:54.259392 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.259392 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328 HTTP/1.1 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: exception: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '04aa7ef5-7924-4f43-8c8d-629fbb066328'} Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:44:54.262403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] Jul 26 04:44:54.267046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:44:54.273559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.273559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:54.273559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.273559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:54.279020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 400 to user: Security Group 04aa7ef5-7924-4f43-8c8d-629fbb066328 in use. Jul 26 04:44:54.279020 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-ef2c5240-184f-481f-86ee-fb098a3f539f'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:54.279935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b02c754-b5ab-42a0-b792-f55560d03639 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328" status: 400 len: 185 microversion: 2.1 time: 0.888795 Jul 26 04:44:54.283712 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1928/3971] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:44:53 2022] DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328 => generated 185 bytes in 891 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:44:54.293809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:54.310531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:54.344578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.347455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:54.348344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.348805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:54.620344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-319c0cce-2080-48d6-a43b-6dc631bce4da tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action" status: 202 len: 0 microversion: 2.1 time: 0.334220 Jul 26 04:44:54.623338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1929/3972] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:44:54 2022] POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:44:54.660504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:54.661973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:54.684126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.685122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:54.687083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:54.687758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:55.188579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:55.202363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47a2627b-39ce-401b-9500-7b4e9401b7c4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1474 microversion: 2.1 time: 0.958828 Jul 26 04:44:55.203233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2044/3973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:54 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1474 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:55.551001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-778406354", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:55.637735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:55.940599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:55.949901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-984fac0b-eafb-487e-90dd-02b49d908ba4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1573 microversion: 2.1 time: 1.305921 Jul 26 04:44:55.962574 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1930/3974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:54 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1573 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:56.514647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5d5538a-2044-40fc-ade4-abcd281c5147"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:56.526621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:56.549603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:56.550414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:56.554094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:56.555766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:56.556221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:56.557268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:56.558164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:56.559668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:56.560927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:56.577218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:56.580710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:56.584641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:56.585435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:56.618794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:56.649232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:56.667426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:56.670537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:56.766496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-702a3bb3-1097-4a85-af63-6d2591eacbfb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220829 Jul 26 04:44:56.767815 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2045/3975] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:44:56.789897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:56.792129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:56.831004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:44:57.136074 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f909759-2206-423f-b730-575929d4dd63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627924 Jul 26 04:44:57.149344 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1931/3976] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:44:56 2022] POST /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:44:57.188624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:57.189811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:57.213474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:57.216376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:57.217838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:57.219847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:57.658047 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.scheduler.client.report [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Deleted allocations for instance cc66bf19-056f-4bdb-9850-03939740b1bf Jul 26 04:44:57.669030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Instance Mapping does not exist while attempting local delete cleanup. Jul 26 04:44:57.681326 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e75b58da-e363-4073-93ee-f3e4607429bf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf" status: 204 len: 0 microversion: 2.1 time: 0.898661 Jul 26 04:44:57.682660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2046/3977] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:44:56 2022] DELETE /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf => generated 0 bytes in 906 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:44:57.697905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:57.698772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:57.727834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf HTTP/1.1 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cc66bf19-056f-4bdb-9850-03939740b1bf'} Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:44:57.730131 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:44:57.734024 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:44:57.734024 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:44:57.734024 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:44:57.734024 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:44:57.736821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:44:57.737899 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c00e9144-2926-4560-964c-d3e461155a01 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf" status: 404 len: 111 microversion: 2.1 time: 0.050158 Jul 26 04:44:57.739045 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2047/3978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:57 2022] GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:44:57.867314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1680583697", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:44:57.962692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:44:58.124541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:58.134323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98cf0c71-2395-431c-aac1-29eaaf8940cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1573 microversion: 2.1 time: 0.981495 Jul 26 04:44:58.137586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1932/3979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:57 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1573 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:59.158982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:44:59.160436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:44:59.178390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:59.179223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:59.180269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:59.180931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:59.726585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:44:59.728319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:44:59.729744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:44:59.730400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:44:59.731082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:44:59.754313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:59.755151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:59.759197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:44:59.759986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:44:59.773067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:44:59.790832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2ef79c1-fb29-440c-8eca-f092a9451453 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1578 microversion: 2.1 time: 0.635624 Jul 26 04:44:59.829273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1933/3980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:44:59 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1578 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:44:59.857803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:44:59.866970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:44:59.894878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:44:59.897993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:44:59.998796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-74993524-05b0-4544-96d0-4a05dea946a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137210 Jul 26 04:45:00.005204 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2048/3981] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:00.017947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63fe5b66-0f53-402f-a8c4-cb6c55ded1a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:00.020297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63fe5b66-0f53-402f-a8c4-cb6c55ded1a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:00.144001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-63fe5b66-0f53-402f-a8c4-cb6c55ded1a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:00.193696 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63fe5b66-0f53-402f-a8c4-cb6c55ded1a8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1221 microversion: 2.1 time: 0.181052 Jul 26 04:45:00.194321 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1934/3982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:00 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:00.830077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:00.831724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:00.858386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:00.859200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:00.860243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:00.860925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:01.184167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:01.198040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5becb4a-8b95-413f-92a3-8c53024d82df tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1571 microversion: 2.1 time: 0.377199 Jul 26 04:45:01.217561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2049/3983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:00 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1571 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:01.218088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:01.218750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:01.225255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-683109481"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:01.226147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:01.234064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:01.235059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:01.235802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:01.236467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:01.237368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:01.237466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:01.237800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:01.240766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:01.374435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:01.401521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3967dd3-e335-4c1c-b11d-56b426360088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1273 microversion: 2.1 time: 0.186415 Jul 26 04:45:01.404519 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1935/3984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:01 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:01.630783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.network.security_group_api [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Adding security group 03c8a561-3b72-4609-b654-c87e50c801db to port b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b Jul 26 04:45:02.260486 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c89fe41a-bbac-4d32-bfea-6c96ec8f1ca7 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action" status: 202 len: 0 microversion: 2.1 time: 1.039968 Jul 26 04:45:02.265779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2050/3985] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:45:01 2022] POST /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689/action => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:02.269970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5386550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:02.282378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-987ba612-3ee5-4079-96e3-91d169a461b4 req-57398591-963f-43b8-aa71-21d7b63cc7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70498d2-dd33-43f1-a55c-68fd4c04f689", "tag": "b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:02.323395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-987ba612-3ee5-4079-96e3-91d169a461b4 req-57398591-963f-43b8-aa71-21d7b63cc7f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:02.324305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-987ba612-3ee5-4079-96e3-91d169a461b4 req-57398591-963f-43b8-aa71-21d7b63cc7f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:02.373935 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-987ba612-3ee5-4079-96e3-91d169a461b4 req-57398591-963f-43b8-aa71-21d7b63cc7f6 service nova] Creating event network-changed:b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b for instance d70498d2-dd33-43f1-a55c-68fd4c04f689 on n-h2-848886-16 Jul 26 04:45:02.392612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-987ba612-3ee5-4079-96e3-91d169a461b4 req-57398591-963f-43b8-aa71-21d7b63cc7f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118987 Jul 26 04:45:02.394791 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2051/3986] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:02.451306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:02.452718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:02.461523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:02.463015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:02.464671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:02.465940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:02.603616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:02.617325 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b632841b-917d-4b73-839e-04747e210c82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1279 microversion: 2.1 time: 0.186873 Jul 26 04:45:02.618285 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2052/3987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:02 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:02.881293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use.", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:02.882006 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.882006 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db HTTP/1.1 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: exception: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '03c8a561-3b72-4609-b654-c87e50c801db'} Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:02.884040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 400 to user: Security Group 03c8a561-3b72-4609-b654-c87e50c801db in use. Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c863da3a-91bc-4f35-921c-f03123e31bce'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51a55f09-2d0e-474f-a3d1-2160676dbfc5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db" status: 400 len: 185 microversion: 2.1 time: 0.619614 Jul 26 04:45:02.887748 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1936/3988] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:02 2022] DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db => generated 185 bytes in 621 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:45:02.896002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:02.896659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:02.909306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:02.909760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:02.910559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:02.910994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:02.972234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:03.124645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:03.146856 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77fef929-039b-4af3-913b-0ed9898473af tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 204 len: 0 microversion: 2.1 time: 0.255679 Jul 26 04:45:03.148433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2053/3989] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:02 2022] DELETE /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:03.157088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:03.157956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:03.173766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.174445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:03.178950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.180576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:03.550232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:03.551279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:03.570082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.570846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:03.594007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.594744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:03.675109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8fe95063-1175-4921-8776-43df4fd2b8ce tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/ips" status: 200 len: 145 microversion: 2.1 time: 0.130461 Jul 26 04:45:03.676761 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2054/3990] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:45:03 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/ips => generated 145 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:45:03.688217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:03.689202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:03.698990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.699814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:03.702507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:03.703457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:04.005905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:04.016612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0239c6b8-7113-4949-ad55-74aa10be9557 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1279 microversion: 2.1 time: 0.338589 Jul 26 04:45:04.017779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2055/3991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:03 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:04.113852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:04.124229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d296fb8-b251-442c-a80b-32bb5143defb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1645 microversion: 2.1 time: 0.970028 Jul 26 04:45:04.139299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1937/3992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:03 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1645 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:05.049851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:05.051272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:05.071597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:05.072482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:05.075468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:05.080786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:05.145696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:05.148208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:05.164577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:05.165049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:05.165854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:05.166359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:06.107719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:06.121977 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e55dfe6-6073-41d5-a13c-a15e10816936 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 1.073504 Jul 26 04:45:06.124343 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2056/3993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:05 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:06.156332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:06.170939 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce589149-277f-4e24-8217-cc3cb57b057c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1645 microversion: 2.1 time: 1.029202 Jul 26 04:45:06.174092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1938/3994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:05 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1645 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:06.856735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1e906f97-d106-4dbb-946f-60a32892716a req-b584f32e-384c-449f-8329-b7ea3c67679e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafbe996-3238-48ef-a03a-74931d433a59", "tag": "06f07077-70bd-4f22-aa66-3a1e3b8362ed"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:06.887190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1e906f97-d106-4dbb-946f-60a32892716a req-b584f32e-384c-449f-8329-b7ea3c67679e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:06.887653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1e906f97-d106-4dbb-946f-60a32892716a req-b584f32e-384c-449f-8329-b7ea3c67679e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:06.922671 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1e906f97-d106-4dbb-946f-60a32892716a req-b584f32e-384c-449f-8329-b7ea3c67679e service nova] Creating event network-changed:06f07077-70bd-4f22-aa66-3a1e3b8362ed for instance dafbe996-3238-48ef-a03a-74931d433a59 on n-h2-848886-16 Jul 26 04:45:06.930393 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1e906f97-d106-4dbb-946f-60a32892716a req-b584f32e-384c-449f-8329-b7ea3c67679e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077152 Jul 26 04:45:06.932282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2057/3995] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:06.974305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-435bd812-d73a-4e8e-974f-eac1f3713f0e req-f1a58092-d882-41dd-9cf7-5afcfa4236ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70498d2-dd33-43f1-a55c-68fd4c04f689", "name": "network-vif-deleted", "tag": "b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:07.004754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-435bd812-d73a-4e8e-974f-eac1f3713f0e req-f1a58092-d882-41dd-9cf7-5afcfa4236ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.005230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-435bd812-d73a-4e8e-974f-eac1f3713f0e req-f1a58092-d882-41dd-9cf7-5afcfa4236ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.022933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-435bd812-d73a-4e8e-974f-eac1f3713f0e req-f1a58092-d882-41dd-9cf7-5afcfa4236ab service nova] Creating event network-vif-deleted:b8cfe2b2-33ba-47fb-8eb9-6b9dcef8d26b for instance d70498d2-dd33-43f1-a55c-68fd4c04f689 on n-h2-848886-16 Jul 26 04:45:07.035793 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-435bd812-d73a-4e8e-974f-eac1f3713f0e req-f1a58092-d882-41dd-9cf7-5afcfa4236ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065122 Jul 26 04:45:07.048952 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1939/3996] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:07.155083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:07.156890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:07.179827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.180287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.185457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.191836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.198066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:07.199379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:07.208910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.218466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.219692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.220364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.289868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.290422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.290947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lazy-loading 'fault' on Instance uuid d70498d2-dd33-43f1-a55c-68fd4c04f689 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:07.370761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:07.380342 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ebd96ed-2adc-4a40-ae50-9d5d9f022c24 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 200 len: 1305 microversion: 2.1 time: 0.188077 Jul 26 04:45:07.382282 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1940/3997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:07 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 1305 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:07.460321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4342eab9-32f7-43f0-8a70-5cbd216adf70"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:07.464176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:07.485935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.486722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.489656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:07.490464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:07.524445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:08.016274 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb266813-80cf-43d3-908c-cd62e499b371 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561218 Jul 26 04:45:08.017152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1941/3998] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:45:07 2022] POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:08.118591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:08.127680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c913d9f1-1796-43f5-bb3c-7fd89dc6243f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.983639 Jul 26 04:45:08.128263 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2058/3999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:07 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:08.406315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:08.407096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:08.414845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:08.415393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:08.416419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:08.416928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:08.440165 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 HTTP/1.1 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd70498d2-dd33-43f1-a55c-68fd4c04f689'} Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:08.442119 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:08.446299 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:08.449112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:08.451576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d1e0599-a8be-4337-9ea7-7c519e39e5d4 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 404 len: 111 microversion: 2.1 time: 0.051027 Jul 26 04:45:08.456107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1942/4000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:08 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:08.467479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69f34f2c-2c54-4e3f-bc5e-d166c79d8da2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b62d71f0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:09.149226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:09.149849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:09.168266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:09.168781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:09.169956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:09.171057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:09.351821 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69f34f2c-2c54-4e3f-bc5e-d166c79d8da2 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328" status: 202 len: 0 microversion: 2.1 time: 0.889352 Jul 26 04:45:09.352410 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2059/4001] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:08 2022] DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328 => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:09.360199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46edf8d9-749d-4e35-9914-0639265793a0 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b59b84c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:09.400933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:09.412178 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f215883e-aa2b-4ee1-9ff9-df7eb2e26fcc tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.266732 Jul 26 04:45:09.428318 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1943/4002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:09 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:09.833692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:09.878679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=14 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:10.370884 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46edf8d9-749d-4e35-9914-0639265793a0 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db" status: 202 len: 0 microversion: 2.1 time: 1.014096 Jul 26 04:45:10.372769 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2060/4003] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:09 2022] DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:45:10.387689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c956021-32b6-43bd-a62e-6fe9fdfe9b7e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'create', calling method: .version_select at 0x7f38b6074d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1323822638", "description": "tempest-description-1662189936"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:10.394820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:10.440501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:10.442267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:10.453757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:10.455959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:10.458252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:10.458849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:10.722465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:10.744338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43f04b01-1d64-40b7-a32b-6bb993b15922 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.312717 Jul 26 04:45:10.747290 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2061/4004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:10 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:11.166528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c956021-32b6-43bd-a62e-6fe9fdfe9b7e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.784736 Jul 26 04:45:11.173103 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1944/4005] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Jul 26 04:45:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:11.184099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c0e3df86-4e7e-453c-8b04-ce71c9e03db5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Action: 'update', calling method: .version_select at 0x7f38b5936790>, body: {"security_group": {"name": "tempest-sg-hth-1445196722", "description": "tempest-description-hth-1543609188"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:11.768918 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c0e3df86-4e7e-453c-8b04-ce71c9e03db5 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f" status: 200 len: 218 microversion: 2.1 time: 0.588736 Jul 26 04:45:11.769917 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2062/4006] 10.222.0.43 () {60 vars in 1290 bytes} [Tue Jul 26 04:45:11 2022] PUT /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f => generated 218 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:11.772718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:11.773743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:11.784280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb554122-ce07-4152-a668-f9a3355cae2e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b59b8670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:11.787120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:11.787875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:11.789037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:11.790004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:12.078831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb554122-ce07-4152-a668-f9a3355cae2e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f" status: 200 len: 218 microversion: 2.1 time: 0.298283 Jul 26 04:45:12.079620 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2063/4007] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 04:45:11 2022] GET /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f => generated 218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:12.085692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:12.086683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:12.109126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:12.109947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:12.110998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:12.111669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:12.178632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:12.189239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:12.376510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b1062d3-c45b-491b-bd09-26a3f68d3caf tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 204 len: 0 microversion: 2.1 time: 0.294903 Jul 26 04:45:12.381834 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2064/4008] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:12 2022] DELETE /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:12.390024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4281e514-4d10-4935-b82e-6552ca793ca8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b828b4c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:12.966114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4281e514-4d10-4935-b82e-6552ca793ca8 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f" status: 202 len: 0 microversion: 2.1 time: 0.581860 Jul 26 04:45:12.968862 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2065/4009] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:12 2022] DELETE /compute/v2.1/os-security-groups/c51fde7b-832f-471d-95d2-2d6a95b64d9f => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:12.975422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:12.986059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b3806d37-4025-4492-94e0-f8fed539a13f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 1.219887 Jul 26 04:45:12.994328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1945/4010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:11 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:13.007694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.008456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:13.014382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.015764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:13.018189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.027671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.029567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.030859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.046102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.046811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.047910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.048985 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.049278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 HTTP/1.1 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd70498d2-dd33-43f1-a55c-68fd4c04f689'} Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:13.059199 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.065402 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-94fec244-c39b-4082-bc0f-11525298418e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 404 len: 111 microversion: 2.1 time: 0.069666 Jul 26 04:45:13.069862 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1946/4011] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:12 2022] DELETE /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.073895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.074537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: d70498d2-dd33-43f1-a55c-68fd4c04f689] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:13.099889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.100345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.101133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:13.101577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:13.116545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 HTTP/1.1 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd70498d2-dd33-43f1-a55c-68fd4c04f689'} Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.118097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Instance d70498d2-dd33-43f1-a55c-68fd4c04f689 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.121307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c61e1216-4c9a-4de4-8cfd-e46a5cbc90ec tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689" status: 404 len: 111 microversion: 2.1 time: 0.049716 Jul 26 04:45:13.126343 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1947/4012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:13 2022] GET /compute/v2.1/servers/d70498d2-dd33-43f1-a55c-68fd4c04f689 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.131462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b51b2040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.243238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:13.245092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 03c8a561-3b72-4609-b654-c87e50c801db not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:13.245792 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.245792 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db HTTP/1.1 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '03c8a561-3b72-4609-b654-c87e50c801db'} Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:13.250747 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] Jul 26 04:45:13.254767 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.259531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 03c8a561-3b72-4609-b654-c87e50c801db does not exist Jul 26 04:45:13.259531 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-6b5a2def-817a-40f1-a132-c049a1aff448'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.260744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e630f5b-01ba-4b74-9bfc-fdf1ce08f72c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db" status: 404 len: 194 microversion: 2.1 time: 0.132990 Jul 26 04:45:13.265877 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1948/4013] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/03c8a561-3b72-4609-b654-c87e50c801db => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.311597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:13.313831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b529e5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.333208 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c77876e7-b204-48d5-a367-c2a4c421070f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1555 microversion: 2.1 time: 0.361773 Jul 26 04:45:13.335635 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2066/4014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:12 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1555 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:13.452236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:13.452847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:13.453371 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.453371 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328 HTTP/1.1 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '04aa7ef5-7924-4f43-8c8d-629fbb066328'} Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:13.455824 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 04aa7ef5-7924-4f43-8c8d-629fbb066328 does not exist Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-c4cee40d-ea4b-4153-93a6-b4a225001ebb'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f141799-c6c8-4ed1-9a5d-0bb56c263b8e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328" status: 404 len: 194 microversion: 2.1 time: 0.186557 Jul 26 04:45:13.459436 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1949/4015] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/04aa7ef5-7924-4f43-8c8d-629fbb066328 => generated 194 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.468937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b828b4c0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.744578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:13.745627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:13.746738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.746738 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c HTTP/1.1 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ff9bbc49-a6ae-43e8-bf69-11f2581d052c'} Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:13.758465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group ff9bbc49-a6ae-43e8-bf69-11f2581d052c does not exist Jul 26 04:45:13.761997 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-473d2707-2b8c-4008-8bfe-0003353a66e6'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.764835 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21bddefe-1cf2-4e91-be0d-16995d391d15 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c" status: 404 len: 194 microversion: 2.1 time: 0.300753 Jul 26 04:45:13.768039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2067/4016] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/ff9bbc49-a6ae-43e8-bf69-11f2581d052c => generated 194 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.777312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5a42280>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.853600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:13.854481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group cc286996-a285-4bee-a08d-4b836a81af7f not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:13.855213 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.855213 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f HTTP/1.1 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'cc286996-a285-4bee-a08d-4b836a81af7f'} Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:13.858295 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group cc286996-a285-4bee-a08d-4b836a81af7f does not exist Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-cf217813-e21f-4dd1-bba9-aaeb69efe5a1'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.861376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61d5da8b-a102-404f-8072-fc3f9b3ad6fb tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f" status: 404 len: 194 microversion: 2.1 time: 0.088159 Jul 26 04:45:13.866713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1950/4017] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/cc286996-a285-4bee-a08d-4b836a81af7f => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:13.875993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5085d30>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.935908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG neutronclient.v2_0.client [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist", "detail": ""}} {{(pid=119488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:13.936541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.security_group_api [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 not found {{(pid=119488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:13.938113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.938113 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665 HTTP/1.1 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: exception: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6443e11d-1ead-44e2-9c43-a35bd09f2665'} Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:13.940262 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 6443e11d-1ead-44e2-9c43-a35bd09f2665 does not exist Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: Neutron server returns request_ids: ['req-5151d581-18cc-40b9-b437-ba247452042d'] {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:13.943822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cac78aa-cafc-4106-abba-a0c04060cb5e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665" status: 404 len: 194 microversion: 2.1 time: 0.075594 Jul 26 04:45:13.953107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b5386550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:13.957673 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2068/4018] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/6443e11d-1ead-44e2-9c43-a35bd09f2665 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:14.020636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:14.021470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:14.040116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.040785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.041931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.042667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.228633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG neutronclient.v2_0.client [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist", "detail": ""}} {{(pid=119487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 04:45:14.229178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Neutron security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 not found {{(pid=119487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 04:45:14.229703 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.229703 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 HTTP/1.1 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: exception: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0aa8a6e3-7a5a-452c-85d6-eb973f4248f9'} Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 04:45:14.238144 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] Jul 26 04:45:14.241788 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:14.246905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Security group 0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 does not exist Jul 26 04:45:14.246905 n-d-848886-16 devstack@n-api.service[119487]: Neutron server returns request_ids: ['req-f9e459d4-8188-45aa-b231-fd95640942e5'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:14.248755 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f3af9f6f-e130-491d-ab62-82b46739d56c tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9" status: 404 len: 194 microversion: 2.1 time: 0.301671 Jul 26 04:45:14.253041 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1951/4019] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:13 2022] DELETE /compute/v2.1/os-security-groups/0aa8a6e3-7a5a-452c-85d6-eb973f4248f9 => generated 194 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:14.267516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2595cf50-a472-4480-ae47-9f29e4cd0d1b req-906597bd-41a4-410a-9f92-126e96108e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafbe996-3238-48ef-a03a-74931d433a59", "name": "network-vif-plugged", "status": "completed", "tag": "06f07077-70bd-4f22-aa66-3a1e3b8362ed"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:14.293370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2595cf50-a472-4480-ae47-9f29e4cd0d1b req-906597bd-41a4-410a-9f92-126e96108e46 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.295736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2595cf50-a472-4480-ae47-9f29e4cd0d1b req-906597bd-41a4-410a-9f92-126e96108e46 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.332423 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2595cf50-a472-4480-ae47-9f29e4cd0d1b req-906597bd-41a4-410a-9f92-126e96108e46 service nova] Creating event network-vif-plugged:06f07077-70bd-4f22-aa66-3a1e3b8362ed for instance dafbe996-3238-48ef-a03a-74931d433a59 on n-h2-848886-16 Jul 26 04:45:14.350056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:14.358657 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2595cf50-a472-4480-ae47-9f29e4cd0d1b req-906597bd-41a4-410a-9f92-126e96108e46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090687 Jul 26 04:45:14.360939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1952/4020] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:14.362250 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e0c0327-ed29-40ba-99c6-db5aeecdf9d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.349715 Jul 26 04:45:14.370553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:14.371485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:14.375399 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2069/4021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:14 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:14.383006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:14.383627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:14.392119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.393215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.394552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.395002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.395554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.395772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.396209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.398921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.442135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:14.547667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=62 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:14.574511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea5aa425-e674-4041-9dc9-be8fc95bdf1e tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 204 len: 0 microversion: 2.1 time: 0.211362 Jul 26 04:45:14.576232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1953/4022] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:14 2022] DELETE /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:14.584869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:14.586740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:14.596981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.598065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.605231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:14.606014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:14.718084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:14.732524 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a892d44-9b7b-4a75-9258-e3c1d258b0f4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1555 microversion: 2.1 time: 0.354558 Jul 26 04:45:14.734057 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2070/4023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:14 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:15.387546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:15.389661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:15.397515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:15.398283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:15.400480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:15.401181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:15.603107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:15.618623 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32d709cb-e149-4faa-807e-b54877905e41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.235034 Jul 26 04:45:15.620186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2071/4024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:15 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:15.624728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:15.633191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1271625d-b23a-4e47-b963-920a6d2fbb9b tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1649 microversion: 2.1 time: 1.052621 Jul 26 04:45:15.646474 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1954/4025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:14 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1649 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:15.765327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:15.765901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:15.780037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:15.780487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:15.781292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:15.781701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:16.474025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:16.486070 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61bed8bc-bbf9-4e54-bd75-66675c170fbb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1555 microversion: 2.1 time: 0.734535 Jul 26 04:45:16.487436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-42067226-b023-44a4-88f4-87daeda08a01 req-d9d792ce-b250-467c-b958-ed02067aa016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a68b05-b5fb-4da1-b99c-8691f57754ef", "name": "network-vif-deleted", "tag": "008d2b5a-d3ff-47d5-989e-d8601eecad83"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:16.500827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2072/4026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:15 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1555 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:16.511364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-42067226-b023-44a4-88f4-87daeda08a01 req-d9d792ce-b250-467c-b958-ed02067aa016 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:16.512654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-42067226-b023-44a4-88f4-87daeda08a01 req-d9d792ce-b250-467c-b958-ed02067aa016 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:16.540490 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-42067226-b023-44a4-88f4-87daeda08a01 req-d9d792ce-b250-467c-b958-ed02067aa016 service nova] Creating event network-vif-deleted:008d2b5a-d3ff-47d5-989e-d8601eecad83 for instance 28a68b05-b5fb-4da1-b99c-8691f57754ef on n-h2-848886-16 Jul 26 04:45:16.548477 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-42067226-b023-44a4-88f4-87daeda08a01 req-d9d792ce-b250-467c-b958-ed02067aa016 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066256 Jul 26 04:45:16.550004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1955/4027] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:16.641366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:16.641973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:16.661784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:16.662562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:16.665906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:16.666390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:16.676107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:16.676576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:16.679441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:16.679897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:16.680688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:16.681134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:17.300741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:17.309352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce9b7927-3af7-47ec-81be-f0aabd42984a tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1649 microversion: 2.1 time: 0.652934 Jul 26 04:45:17.315793 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1956/4028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:16 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1649 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:17.414932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:17.424587 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d01bcd1-035c-4b94-a554-9d67cd7ec9cb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1321 microversion: 2.1 time: 0.788016 Jul 26 04:45:17.429228 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2073/4029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:16 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:17.509700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:17.510347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:17.523103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:17.525471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:17.526319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:17.527011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:17.785605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:17.798299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f14c9ac4-ca22-43aa-bb47-6aeb02b0fc74 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1346 microversion: 2.1 time: 0.292875 Jul 26 04:45:17.801219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1957/4030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:17 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1346 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:18.343776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:18.345195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:18.375960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.377325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.379482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.381879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.450987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:18.452132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:18.462489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.463687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.464767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.465548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.514662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:18.522839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2bf41256-eeae-45c8-ba8f-9dca744af833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1469 microversion: 2.1 time: 0.187077 Jul 26 04:45:18.534479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2074/4031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:18 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:18.821069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:18.821913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:18.835151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.835872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.837570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:18.839443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:18.989553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:19.005888 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4946d209-42f0-44cf-824b-bad4dd66fbc4 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1346 microversion: 2.1 time: 0.188637 Jul 26 04:45:19.006847 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2075/4032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:18 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:19.063766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-61242580-dbfe-462d-8513-1487446fbd55 req-3f6eb2dc-612f-488e-a381-76092ecb159f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de686873-929f-42f0-8216-f8bb2f60aa3f", "name": "network-vif-deleted", "tag": "91542f90-eb10-4b2b-9787-9dc3e19cf385"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:19.080801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-61242580-dbfe-462d-8513-1487446fbd55 req-3f6eb2dc-612f-488e-a381-76092ecb159f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.083851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-61242580-dbfe-462d-8513-1487446fbd55 req-3f6eb2dc-612f-488e-a381-76092ecb159f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.107301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-61242580-dbfe-462d-8513-1487446fbd55 req-3f6eb2dc-612f-488e-a381-76092ecb159f service nova] Creating event network-vif-deleted:91542f90-eb10-4b2b-9787-9dc3e19cf385 for instance de686873-929f-42f0-8216-f8bb2f60aa3f on n-h2-848886-16 Jul 26 04:45:19.118474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:19.129516 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-56f8da86-1ab8-468f-bb08-7622b2839a6f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1502 microversion: 2.1 time: 0.684334 Jul 26 04:45:19.131469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-61242580-dbfe-462d-8513-1487446fbd55 req-3f6eb2dc-612f-488e-a381-76092ecb159f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072845 Jul 26 04:45:19.134471 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2076/4033] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:45:19.137216 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1958/4034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:18 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1502 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:19.165869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:19.167373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:19.186045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.198075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.199131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.199663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.548305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:19.549170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:19.562998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.563651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.567197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.567845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.641058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.641831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.642485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lazy-loading 'fault' on Instance uuid de686873-929f-42f0-8216-f8bb2f60aa3f {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:19.767643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:19.777383 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e2796445-e02f-441e-a69a-aa07f8a7e1d6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1502 microversion: 2.1 time: 0.616002 Jul 26 04:45:19.778489 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2077/4035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:19 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1502 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:19.797134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ef33e960e457897c7ab8fb77d44da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85fb5d3ba24b7292829e7cf1e3373c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:19.805477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:19.807223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:19.812723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4bd794bb-8319-4aa3-b9e5-6455209cd833 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 200 len: 1306 microversion: 2.1 time: 0.269065 Jul 26 04:45:19.813309 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1959/4036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:19 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:19.851227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.853166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.854621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:19.855636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:19.922935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:20.032259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:20.032891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:20.046989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.047768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.048721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.049381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.167893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4572861a-14ae-4181-98d6-139cb51c8615 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 204 len: 0 microversion: 2.1 time: 0.368647 Jul 26 04:45:20.174063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2078/4037] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:19 2022] DELETE /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:20.182013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:20.183208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:20.195798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.197236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.198308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.198974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.236672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:20.256849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2c9ab8f2-a16d-4020-b453-515dfeca28b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1346 microversion: 2.1 time: 0.218732 Jul 26 04:45:20.257826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1960/4038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:20 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:20.834542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:20.835168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] [instance: de686873-929f-42f0-8216-f8bb2f60aa3f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:20.850866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.852399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.855912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:20.857096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:20.864285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:20.873622 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e23baa8a-3197-4aa1-a7a7-f29954551f83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1508 microversion: 2.1 time: 0.697179 Jul 26 04:45:20.880806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2079/4039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:20 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:20.890192 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] HTTP exception thrown: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Request method failure captured: Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f HTTP/1.1 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33D69-UhJic6smpdofEXnhsS-D-QG14f2dhYIpTFcn7aJ7y7AfWGIal468reipd3xFZysINIh138mTws-2g1cNiD_DT7FIcC9Nq_5Rq8uLMpHaRPrW-Uhb4nq1dxUCBPWREaLZ9g836GAqPVzX1VcCU2q9-Ssu4Ovu3564MxYifMbuQ Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d85fb5d3ba24b7292829e7cf1e3373c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5d85fb5d3ba24b7292829e7cf1e3373c Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1556346988 Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 055ef33e960e457897c7ab8fb77d44da Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-SecurityGroupsTestJSON-1556346988-project Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'de686873-929f-42f0-8216-f8bb2f60aa3f'} Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:20.893941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:45:20.897129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Returning 404 to user: Instance de686873-929f-42f0-8216-f8bb2f60aa3f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:20.903071 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-385a732d-bfea-42dc-9975-f41d44e317cf tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f" status: 404 len: 111 microversion: 2.1 time: 0.073396 Jul 26 04:45:20.904286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1961/4040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:20 2022] GET /compute/v2.1/servers/de686873-929f-42f0-8216-f8bb2f60aa3f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:45:20.912491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2f0150b-463c-4dc2-9035-927201c4ba29 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38bad240d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:21.280536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:21.282015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:21.295854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:21.296358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:21.301380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:21.301978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:21.466849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:21.484716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-038508a0-01d3-49c0-86ff-6770035ea7dc tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1346 microversion: 2.1 time: 0.209689 Jul 26 04:45:21.499233 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1962/4041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:21 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:21.549381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e99e9e5a-f67c-4251-a426-9b8ebc6b5299 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:21.560491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99e9e5a-f67c-4251-a426-9b8ebc6b5299 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:21.561475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99e9e5a-f67c-4251-a426-9b8ebc6b5299 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:21.610930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e99e9e5a-f67c-4251-a426-9b8ebc6b5299 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:45:21.692026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:21.750806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e99e9e5a-f67c-4251-a426-9b8ebc6b5299 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action" status: 202 len: 0 microversion: 2.1 time: 0.211199 Jul 26 04:45:21.752130 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1963/4042] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:45:21 2022] POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:21.764348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:21.771541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:21.783288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:21.784166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:21.785178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:21.785983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:21.986439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2f0150b-463c-4dc2-9035-927201c4ba29 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/05de6727-0fc2-4cb1-b4a8-a4eca36bef36" status: 202 len: 0 microversion: 2.1 time: 1.078148 Jul 26 04:45:21.987833 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2080/4043] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:20 2022] DELETE /compute/v2.1/os-security-groups/05de6727-0fc2-4cb1-b4a8-a4eca36bef36 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:45:21.994588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:21.996639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:22.020541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:22.021355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:22.024628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:22.026695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:22.317940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:22.330859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c8494d9-059b-4f84-adf3-7e1849802a9f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1508 microversion: 2.1 time: 0.340871 Jul 26 04:45:22.345878 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2081/4044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:21 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:22.349422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ff65007c-00c9-4f1e-887f-9169fc8041a0 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] Calling method '.version_select at 0x7f38b51b48b0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:22.415422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:22.430537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5cdb41f4-2a69-4064-b21b-76b6a9de7dfc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1724 microversion: 2.1 time: 0.674173 Jul 26 04:45:22.444576 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1964/4045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:21 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1724 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:22.769865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-137028632", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "44649c16-ad29-4721-af8b-446cd0dd3de1"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:22.865420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ff65007c-00c9-4f1e-887f-9169fc8041a0 tempest-SecurityGroupsTestJSON-1556346988 tempest-SecurityGroupsTestJSON-1556346988-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/bfdde7b9-7555-4095-9a44-253937a66524" status: 202 len: 0 microversion: 2.1 time: 0.524704 Jul 26 04:45:22.866240 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2082/4046] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 04:45:22 2022] DELETE /compute/v2.1/os-security-groups/bfdde7b9-7555-4095-9a44-253937a66524 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:22.871057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:22.875014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:22.886661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] validate_networks() for [('44649c16-ad29-4721-af8b-446cd0dd3de1', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:22.895490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:22.897513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:22.898517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:22.902307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:23.275239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:23.277531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:23.303489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17362a46-6eb6-4161-ae4d-af8d88e8d072 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 200 len: 1346 microversion: 2.1 time: 0.435920 Jul 26 04:45:23.304601 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2083/4047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:22 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 1346 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:23.355008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:23.355695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:23.369050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:23.373724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:23.374839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:23.375450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:23.531966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:23.546335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43eacca6-9e04-4e95-b9dd-1ee759fdb82e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 200 len: 1466 microversion: 2.1 time: 0.192716 Jul 26 04:45:23.547486 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2084/4048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:23 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:23.553546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:23.554400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:23.563482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:23.564279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:23.565423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:23.566028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.535403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:24.544521 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f389ca09-304f-4fe3-a440-9386e7f8a15e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1724 microversion: 2.1 time: 0.995574 Jul 26 04:45:24.545142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2085/4049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:23 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1724 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:24.552272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4f3de6c8-b65b-4a1b-99ba-2611afe1ba9e req-a952fa81-5b92-4438-865d-48621e8c3a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafbe996-3238-48ef-a03a-74931d433a59", "name": "network-vif-deleted", "tag": "06f07077-70bd-4f22-aa66-3a1e3b8362ed"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:24.567670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4f3de6c8-b65b-4a1b-99ba-2611afe1ba9e req-a952fa81-5b92-4438-865d-48621e8c3a8d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.568158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4f3de6c8-b65b-4a1b-99ba-2611afe1ba9e req-a952fa81-5b92-4438-865d-48621e8c3a8d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.582978 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4f3de6c8-b65b-4a1b-99ba-2611afe1ba9e req-a952fa81-5b92-4438-865d-48621e8c3a8d service nova] Creating event network-vif-deleted:06f07077-70bd-4f22-aa66-3a1e3b8362ed for instance dafbe996-3238-48ef-a03a-74931d433a59 on n-h2-848886-16 Jul 26 04:45:24.588685 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4f3de6c8-b65b-4a1b-99ba-2611afe1ba9e req-a952fa81-5b92-4438-865d-48621e8c3a8d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Jul 26 04:45:24.589813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2086/4050] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:24.595895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:24.596606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:24.603568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.604303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.605056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.605507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.621852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef HTTP/1.1 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '28a68b05-b5fb-4da1-b99c-8691f57754ef'} Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:24.624370 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:24.627795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf61b5f0-995d-4648-ae07-fa44412a6bf2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 404 len: 111 microversion: 2.1 time: 0.034994 Jul 26 04:45:24.639404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2087/4051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:24 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:24.652369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:24.656469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:24.664558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:24.665738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:24.666434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:24.666997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:24.667257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.667728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:24.667860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.668670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.669899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.683502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.684728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.686583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.687358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.691768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 HTTP/1.1 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'dafbe996-3238-48ef-a03a-74931d433a59'} Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.696008 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:24.699927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8910e39e-ea8b-4bbc-bb84-a4b216d24b31 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 404 len: 111 microversion: 2.1 time: 0.056977 Jul 26 04:45:24.726392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2088/4052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:24 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:24.727641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42b57808-48a2-4394-870e-166a7a5236d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: .version_select at 0x7f38b51ae280>, body: {"keypair": {"name": "tempest-key-906067856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPxggUTnetWhyUfIrn+Me2Z9/ab+D2byBUAgHTMJsXs0vlBoaZ4IR23R34OZcD6enU1jz2GMBIgHkB0qiFARYo5xvrACLq1Ky3bAGgvWle4Uc2UWqwLMOdCm2Ase0tB2A=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:24.745574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:24.755976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-42b57808-48a2-4394-870e-166a7a5236d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:24.757867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for user 855168c8fff940c39c68ce8ad5318e71 and project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:24.770250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-42b57808-48a2-4394-870e-166a7a5236d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:24.779346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:24.782854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:24.827810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42b57808-48a2-4394-870e-166a7a5236d2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.103998 Jul 26 04:45:24.834804 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2089/4053] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:45:24 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:24.842863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-74de9dc5-a5c9-4e33-9d74-24e336df3a41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '.version_select at 0x7f38b5123670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:24.852743 n-d-848886-16 devstack@n-api.service[119488]: WARNING oslo_db.sqlalchemy.utils [None req-74de9dc5-a5c9-4e33-9d74-24e336df3a41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 04:45:24.855623 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-74de9dc5-a5c9-4e33-9d74-24e336df3a41 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019074 Jul 26 04:45:24.856465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2090/4054] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:45:24 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:24.868174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-526d791a-e3db-48c2-ae3c-3b4862344e54 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432312 Jul 26 04:45:24.869496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1965/4055] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:24.880905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:24.913600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:24.942603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.943065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.943863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:24.952621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:24.982912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-694202107", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "44649c16-ad29-4721-af8b-446cd0dd3de1"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:24.985593 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef/os-volume_attachments HTTP/1.1 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '28a68b05-b5fb-4da1-b99c-8691f57754ef'} Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:24.998518 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97f5a4c7-452f-4e73-90eb-ac1837b03104 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.132442 Jul 26 04:45:25.002780 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2091/4056] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:45:24 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef/os-volume_attachments => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:25.101573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] validate_networks() for [('44649c16-ad29-4721-af8b-446cd0dd3de1', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:25.119411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1104537378", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-key-906067856", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:25.235134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:26.021701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:26.022197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:26.022645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:26.023060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:26.023484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:26.048085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:26.048556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:26.049383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:26.049836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:26.113897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:26.126320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for user 855168c8fff940c39c68ce8ad5318e71 and project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:26.167031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:26.170121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:26.270963 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d25d732e-6d02-4784-b5db-cee9811d1da9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292336 Jul 26 04:45:26.272292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1966/4057] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:45:26.296621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1662908425", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:26.426992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:27.193191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:27.193766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:27.194089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:27.194532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:27.194945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:27.208850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:27.210527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:27.212031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:27.212724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:27.233309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:27.239746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:27.254304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:27.257032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:27.280786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:27.314433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad4c5445-7806-4030-96ce-37ab0eaa5112 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.199265 Jul 26 04:45:27.315836 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2092/4058] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:27.322405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:27.323474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:27.330655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:27.331487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:27.332570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:27.333284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:27.733338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:27.764784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f61b3d9-7d53-48a3-9b83-4d3cd525d4e2 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1724 microversion: 2.1 time: 0.444155 Jul 26 04:45:27.767202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2093/4059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:27 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:27.780107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2114742752", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "451", "networks": [{"uuid": "44649c16-ad29-4721-af8b-446cd0dd3de1"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:27.901481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] validate_networks() for [('44649c16-ad29-4721-af8b-446cd0dd3de1', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:28.138578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:28.139932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:28.141590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:28.142289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:28.143885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:28.163475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.164344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.165384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.166142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.197355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:28.205752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:28.225846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:28.230509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:28.326580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cecf33c-2614-47e4-9b3b-d535810fc08e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052740 Jul 26 04:45:28.331151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1967/4060] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:28.336148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:28.340548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:28.357991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.358564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.359406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.360678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.543633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:28.557524 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d70b9d49-223e-4e82-a22c-fa956c915851 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1224 microversion: 2.1 time: 0.225012 Jul 26 04:45:28.561929 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1968/4061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:28 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1224 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:28.574080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-356cdfd9-3dfd-4b19-baf8-00c3e8f8f943 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:28.575054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-356cdfd9-3dfd-4b19-baf8-00c3e8f8f943 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:28.789229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-356cdfd9-3dfd-4b19-baf8-00c3e8f8f943 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:28.803831 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-356cdfd9-3dfd-4b19-baf8-00c3e8f8f943 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1215 microversion: 2.1 time: 0.240342 Jul 26 04:45:28.817680 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1969/4062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:28 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:28.843647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:28.853115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:28.870752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.871271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.872809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.873645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.967958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:28.968464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:28.969723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:28.970426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:28.970932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:28.985789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.989162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:28.990115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:28.994517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.037972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:29.053099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Getting quotas for user 855168c8fff940c39c68ce8ad5318e71 and project b6affcf44ce346e5be76399909c4f1a7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:29.091339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:29.094649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:29.153398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ff7881f-2154-4e11-97dd-dcfce36bdd12 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384852 Jul 26 04:45:29.162319 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2094/4063] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:29.171197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:29.172518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:29.180097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.181500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.184177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.185584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.239609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:29.253235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.253950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.336153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'flavor' on Instance uuid 7becc74d-3ca2-481e-a221-44dc034b793b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:29.354274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'system_metadata' on Instance uuid 7becc74d-3ca2-481e-a221-44dc034b793b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:29.432294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'metadata' on Instance uuid 7becc74d-3ca2-481e-a221-44dc034b793b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:29.628487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.628959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.862945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cf727bd-5007-4e9c-970e-d9499be4bba9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 204 len: 0 microversion: 2.1 time: 0.694408 Jul 26 04:45:29.867268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2095/4064] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:29 2022] DELETE /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:29.873690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41858084-c960-42b0-a457-7d78c18a1688 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:29.874778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41858084-c960-42b0-a457-7d78c18a1688 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:29.876978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:29.899673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9553a163-eba2-4468-b69e-564a193e0fa3 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1724 microversion: 2.1 time: 1.080533 Jul 26 04:45:29.900609 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1970/4065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:28 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1724 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:29.906089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:29.907078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:29.920409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.921163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:29.922446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:29.925745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:30.163913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:30.166030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41858084-c960-42b0-a457-7d78c18a1688 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:30.178318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41858084-c960-42b0-a457-7d78c18a1688 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1221 microversion: 2.1 time: 0.312518 Jul 26 04:45:30.190652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2096/4066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:29 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1221 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:30.191595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-385367d7-df98-4b56-a02e-40e5c6ae57c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1286 microversion: 2.1 time: 0.288835 Jul 26 04:45:30.192910 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1971/4067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:29 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1286 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:30.210235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:30.211031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:30.229411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:30.232815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:30.235002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:30.235764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:30.387598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:30.400314 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30dc4d54-9289-4059-a924-36f0ca9e7e62 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1217 microversion: 2.1 time: 0.203115 Jul 26 04:45:30.401457 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2097/4068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:30 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:30.923929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:30.925239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:30.933319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:30.934009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:30.935595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:30.936222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.204148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:31.213927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:31.222773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.227258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.228672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.229381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.306522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:31.316749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1f2eef5-a90a-4211-8c93-3e7d15f7ea09 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1724 microversion: 2.1 time: 0.397454 Jul 26 04:45:31.317644 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1972/4069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:30 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:31.323746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:31.324559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:31.333952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.334659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.336931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.337496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.511750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:31.525759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-82051f43-4f99-4fcf-b88c-e1835476cde4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1286 microversion: 2.1 time: 0.206839 Jul 26 04:45:31.527835 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1973/4070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:31 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:31.533562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:31.534540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:31.545841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.546446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.547308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:31.547824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:31.570108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:31.579786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1978181-a87c-4cf5-afc8-af85e6d67793 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1279 microversion: 2.1 time: 0.380196 Jul 26 04:45:31.590295 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2098/4071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:31 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1279 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:31.657662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:31.668183 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75329c6f-0703-4acf-af70-1bea40f88c4c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1217 microversion: 2.1 time: 0.138068 Jul 26 04:45:31.668856 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1974/4072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:31 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:32.345607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:32.346079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:32.365536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:32.366440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:32.367394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:32.368861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:32.552416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:32.553022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:32.568870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:32.570411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:32.573398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:32.573859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.235525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:33.249391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e9630c2-a88a-4b16-8fd2-afd6dc7d23fd tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1701 microversion: 2.1 time: 0.909264 Jul 26 04:45:33.269490 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2099/4073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:32 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1701 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:33.277197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:33.278286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:33.286816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.287646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.288652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.289315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.457481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:33.474040 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c04e7a27-0bbe-4813-b90e-ef4cf0b2178e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.926544 Jul 26 04:45:33.476958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1975/4074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:32 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:33.496641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:33.497395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:33.503770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.504450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.505404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.506002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.580094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:33.606056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9177d6bb-4757-409c-9355-036eaaecac8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1279 microversion: 2.1 time: 0.334862 Jul 26 04:45:33.607621 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2100/4075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:33 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:33.650715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:33.687854 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22ffc33c-fa31-47bd-b70f-ed7ae7e3e35d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1219 microversion: 2.1 time: 0.202685 Jul 26 04:45:33.688514 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1976/4076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:33 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:33.706416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9d1c592-68b8-4bd6-882a-1d3ff07c3a4d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:33.719646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d1c592-68b8-4bd6-882a-1d3ff07c3a4d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.730920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9d1c592-68b8-4bd6-882a-1d3ff07c3a4d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.778206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9d1c592-68b8-4bd6-882a-1d3ff07c3a4d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Going to try to start instance {{(pid=119487) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 04:45:33.832758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:33.833270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:33.843873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.846131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.847061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.848607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.867248 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9d1c592-68b8-4bd6-882a-1d3ff07c3a4d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action" status: 202 len: 0 microversion: 2.1 time: 0.175346 Jul 26 04:45:33.868896 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1977/4077] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:45:33 2022] POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:45:33.883441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-91909de1-7576-492e-8dd7-57f0a338318b req-b832334b-0461-49f2-8fbb-12f29fbe8ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ccceb2-d548-474e-afad-ae1cb617202e", "tag": "94acb6f6-3ba1-434a-acd6-8bb84e1277f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:33.921968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:33.927013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:33.927564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-91909de1-7576-492e-8dd7-57f0a338318b req-b832334b-0461-49f2-8fbb-12f29fbe8ca8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.928348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-91909de1-7576-492e-8dd7-57f0a338318b req-b832334b-0461-49f2-8fbb-12f29fbe8ca8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.949916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-91909de1-7576-492e-8dd7-57f0a338318b req-b832334b-0461-49f2-8fbb-12f29fbe8ca8 service nova] Creating event network-changed:94acb6f6-3ba1-434a-acd6-8bb84e1277f6 for instance b6ccceb2-d548-474e-afad-ae1cb617202e on n-h2-848886-16 Jul 26 04:45:33.956738 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-91909de1-7576-492e-8dd7-57f0a338318b req-b832334b-0461-49f2-8fbb-12f29fbe8ca8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086211 Jul 26 04:45:33.957453 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1978/4078] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:33.969474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:33.971189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:33.982651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:33.992496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.992961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:33.993761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:33.994489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.093838 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37b72f4a-9830-43fd-aef6-9d55a013252f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "DELETE /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 204 len: 0 microversion: 2.32 time: 0.484618 Jul 26 04:45:34.094700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2101/4079] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:45:33 2022] DELETE /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:45:34.107528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:34.108986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:34.117538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.118667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.119573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.120096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.518959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:34.535353 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-604723a2-27d8-473e-96b3-87521c6b548a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1710 microversion: 2.1 time: 0.574737 Jul 26 04:45:34.536153 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1979/4080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:33 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1710 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:34.541149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:34.544522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:34.555446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.556130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.558788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.559712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.876576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:34.898843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:34.898843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:34.899701 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-499fe713-69be-4055-bdf1-fc8fd923c8bd tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2949 microversion: 2.32 time: 0.800437 Jul 26 04:45:34.900971 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2102/4081] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:34 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2949 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:34.907031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:34.907983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:34.919006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.922867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.923786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:34.925541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.926315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.937138 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77e60e29-82b5-44c3-8e9b-2b1a02d7d3f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.399585 Jul 26 04:45:34.937963 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1980/4082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:34 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:34.943001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:34.943887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:34.952477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.953573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:34.954683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:34.955148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:35.034481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:35.042782 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65ef8c41-7590-46ba-870a-e74879f18a6b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1219 microversion: 2.1 time: 0.103538 Jul 26 04:45:35.046651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1981/4083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:34 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:35.057000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:35.066398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-345abe00-4fdf-4630-9776-2e48051a9943 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1279 microversion: 2.1 time: 0.163977 Jul 26 04:45:35.066982 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2103/4084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:34 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:35.559578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:35.560889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:35.582130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:35.582693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:35.584250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:35.584685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:35.597332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a83ea21a-47c7-4e88-9db7-ce88b443e981 req-7b826092-8ee5-4a29-83cf-1a596dcc1160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072f84ef-4568-498a-9ad8-8f061554487a", "tag": "23462d03-26ad-4d77-85af-e76c6dba661f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:35.612664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:35.632647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a83ea21a-47c7-4e88-9db7-ce88b443e981 req-7b826092-8ee5-4a29-83cf-1a596dcc1160 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:35.634218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a83ea21a-47c7-4e88-9db7-ce88b443e981 req-7b826092-8ee5-4a29-83cf-1a596dcc1160 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:35.656934 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a83ea21a-47c7-4e88-9db7-ce88b443e981 req-7b826092-8ee5-4a29-83cf-1a596dcc1160 service nova] Creating event network-changed:23462d03-26ad-4d77-85af-e76c6dba661f for instance 072f84ef-4568-498a-9ad8-8f061554487a on n-h2-848886-16 Jul 26 04:45:35.669901 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a83ea21a-47c7-4e88-9db7-ce88b443e981 req-7b826092-8ee5-4a29-83cf-1a596dcc1160 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071258 Jul 26 04:45:35.670768 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2104/4085] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:35.927126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:35.927919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:35.935409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:35.935875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:35.936861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:35.937335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.318662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:36.330813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:36.332413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:36.333683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-98aac263-5a32-40bf-bb51-b208bfd06eab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2949 microversion: 2.32 time: 0.412195 Jul 26 04:45:36.334563 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2105/4086] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:35 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2949 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:36.340005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:36.341536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:36.357955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.358449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.359306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.359754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.401943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:36.417175 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e13f85d-654a-4497-ad39-e11785046fd9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1710 microversion: 2.1 time: 0.862362 Jul 26 04:45:36.418525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1982/4087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:35 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1710 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:36.424704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:36.425608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:36.438754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.440002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.441785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.442543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.507915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.508378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.508836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'fault' on Instance uuid 7becc74d-3ca2-481e-a221-44dc034b793b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:45:36.624378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:36.631212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7adc3939-924b-4b92-a274-89f42b544534 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 200 len: 1221 microversion: 2.1 time: 0.210861 Jul 26 04:45:36.650547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1983/4088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:36 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:36.657840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:36.659675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:36.666024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.666747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:36.667690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:36.668278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.186986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:37.194611 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c28d8275-6b68-4762-9eee-a07815b90429 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.542685 Jul 26 04:45:37.209524 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1984/4089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:36 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:37.216453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d1e6c7e5-1c47-46f7-bf76-5de64659c247 req-2cda6119-c79b-4b8f-8f16-f17b378d0400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f311811-dcc0-4f47-83df-98a0f4361481", "tag": "1db94b1f-e3bc-4140-88a5-2ef945ed4d51"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:37.228003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d1e6c7e5-1c47-46f7-bf76-5de64659c247 req-2cda6119-c79b-4b8f-8f16-f17b378d0400 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.228749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d1e6c7e5-1c47-46f7-bf76-5de64659c247 req-2cda6119-c79b-4b8f-8f16-f17b378d0400 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.240838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d1e6c7e5-1c47-46f7-bf76-5de64659c247 req-2cda6119-c79b-4b8f-8f16-f17b378d0400 service nova] Creating event network-changed:1db94b1f-e3bc-4140-88a5-2ef945ed4d51 for instance 5f311811-dcc0-4f47-83df-98a0f4361481 on n-h1-848886-16 Jul 26 04:45:37.246079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d1e6c7e5-1c47-46f7-bf76-5de64659c247 req-2cda6119-c79b-4b8f-8f16-f17b378d0400 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035062 Jul 26 04:45:37.247030 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1985/4090] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:37.249186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:37.269131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e6c63d57-37bb-4813-8ae0-942d9996bb1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.933064 Jul 26 04:45:37.269730 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2106/4091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:36 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:37.360367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:37.361724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:37.370658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.371429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.373265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.374221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.443716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:37.444542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:37.455870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.457494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.458614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.459244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.969855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:37.977907 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d4c391d-4730-46cf-a29c-b514a5c3f31c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1710 microversion: 2.1 time: 0.538056 Jul 26 04:45:37.979050 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2107/4092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:37 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1710 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:37.985137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:37.986111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:37.994839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.995518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:37.996494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:37.997080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:38.025958 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b HTTP/1.1 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7becc74d-3ca2-481e-a221-44dc034b793b'} Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:45:38.027662 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:45:38.031554 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:45:38.039278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:45:38.040922 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e40cf3ec-4bc0-42b0-b09b-90ebdf43984c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 404 len: 111 microversion: 2.1 time: 0.060700 Jul 26 04:45:38.041719 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2108/4093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:37 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:38.046738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:38.072033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:38.074661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:38.077576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7eb44cd-7790-4d69-af16-a0f75c0f9090 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2949 microversion: 2.32 time: 0.722166 Jul 26 04:45:38.078772 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1986/4094] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:37 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2949 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:38.201743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1803509854", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:38.216344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:38.218222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:38.233473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:38.235980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:38.236890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:38.238573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:38.239351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:38.279373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:38.801108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=20 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:38.971571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:38.985979 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44d63e28-3b99-4bd7-9a99-75663617975e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.773700 Jul 26 04:45:39.004004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1987/4095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:38 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:39.015040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:39.015863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:39.016176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:39.041139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:39.041612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:39.042448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:39.042901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:39.644494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:39.662975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a7b5f488-b3de-48df-9924-7723cffdd096 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.657207 Jul 26 04:45:39.663477 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1988/4096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:39 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:39.670454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:39.671933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:39.696345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:39.696819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:39.697864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:39.698172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.171673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=18 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:40.267203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:40.289892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b85613f2-9c9e-4673-96bc-4ec898602b7c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1714 microversion: 2.1 time: 0.619942 Jul 26 04:45:40.291055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1989/4097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:39 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1714 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:40.331264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:40.333847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:40.347822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.348543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.350117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.350682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.801016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:40.801733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:40.802440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:40.803962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:40.804617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:40.815847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.816389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.817248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.817755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.838248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:40.844831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:40.859902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:40.862518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:40.923221 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4fe1aa0-406e-44ab-8a74-b412b1e4839c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.725919 Jul 26 04:45:40.924437 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2109/4098] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:40.929268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b14eeb47-2445-4b26-8453-2f23cf1720db req-0f6f022e-4524-40e2-a4ad-3aef421da627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bae3a64-daf3-4bde-93de-d7b4f45e9fb9", "tag": "f7116bfa-917a-4218-8cc6-1633908d61c4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:40.940438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b14eeb47-2445-4b26-8453-2f23cf1720db req-0f6f022e-4524-40e2-a4ad-3aef421da627 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.941147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b14eeb47-2445-4b26-8453-2f23cf1720db req-0f6f022e-4524-40e2-a4ad-3aef421da627 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.953568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b14eeb47-2445-4b26-8453-2f23cf1720db req-0f6f022e-4524-40e2-a4ad-3aef421da627 service nova] Creating event network-changed:f7116bfa-917a-4218-8cc6-1633908d61c4 for instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 on n-h1-848886-16 Jul 26 04:45:40.960047 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b14eeb47-2445-4b26-8453-2f23cf1720db req-0f6f022e-4524-40e2-a4ad-3aef421da627 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Jul 26 04:45:40.974537 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2110/4099] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:40.984929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:40.986291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:40.997542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:40.998935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:40.999925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:41.000517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:41.042233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:41.063917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:41.066334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:41.069121 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e31f833c-7bc3-41d3-9183-c4deb6d9c131 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2928 microversion: 2.32 time: 0.767657 Jul 26 04:45:41.090577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1990/4100] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:40 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2928 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:41.099311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:41.100264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:41.109553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:41.110379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:41.111513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:41.112111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:41.840006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:41.858868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8b6780d-1642-4dba-8392-5df9d5415376 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.882696 Jul 26 04:45:41.868639 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2111/4101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:40 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:41.883090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:41.884439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:41.900915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:41.903921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:41.905162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:41.905816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:42.030407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:42.031697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:42.042812 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a08c53aa-f996-4c10-9c65-33e1d654256a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1219 microversion: 2.1 time: 0.172452 Jul 26 04:45:42.043357 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dcb8c08b-f783-4a96-a561-cc7abd0b5f0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.950056 Jul 26 04:45:42.055324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1991/4102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:41 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:42.058834 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2112/4103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:41 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:42.063984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-223a51ea-ffd2-4f81-9da1-f9d6fe63d240 req-f7083033-ad07-409f-ad64-431feddc4483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "5bdf322f-6bb6-4bc4-85f1-17a21627fc1e"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:42.074461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-223a51ea-ffd2-4f81-9da1-f9d6fe63d240 req-f7083033-ad07-409f-ad64-431feddc4483 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:42.075210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-223a51ea-ffd2-4f81-9da1-f9d6fe63d240 req-f7083033-ad07-409f-ad64-431feddc4483 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:42.089155 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-223a51ea-ffd2-4f81-9da1-f9d6fe63d240 req-f7083033-ad07-409f-ad64-431feddc4483 service nova] Creating event network-vif-unplugged:5bdf322f-6bb6-4bc4-85f1-17a21627fc1e for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:42.096735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-223a51ea-ffd2-4f81-9da1-f9d6fe63d240 req-f7083033-ad07-409f-ad64-431feddc4483 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036599 Jul 26 04:45:42.098093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1992/4104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:42.100349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:42.100969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:42.109542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:42.110001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:42.110845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:42.111338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:42.567803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:42.578850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:42.580734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:42.582851 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1eccd7e-d803-4919-a04d-c7f27215d589 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2907 microversion: 2.32 time: 0.487432 Jul 26 04:45:42.604870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2113/4105] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:42 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2907 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:42.882472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:42.883168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:42.898867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:42.899346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:42.900175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:42.900619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.077856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:43.079260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:43.094827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.095799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.100327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.101311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.259480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:43.270698 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0efe3f26-1cba-4df5-b82a-bd75dfb099c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1267 microversion: 2.1 time: 0.203263 Jul 26 04:45:43.271667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2114/4106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:43 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:43.288914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:43.289871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:43.304574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.306531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.308555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.310215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.540749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:43.554910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e0788ba-c9a2-4057-a938-d55721062d1f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.677466 Jul 26 04:45:43.555445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1993/4107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:42 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:43.611313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:43.611843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:43.632295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.632768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:43.633581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:43.634053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.035037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:44.047693 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb6240ef-c7f9-4c95-a3af-fd39629db38e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.773412 Jul 26 04:45:44.049187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2115/4108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:43 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:44.145900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "edce5445-4999-467e-b597-faf7ab02f1b9"}, {"server_uuid": "b6ccceb2-d548-474e-afad-ae1cb617202e", "name": "network-vif-plugged", "status": "completed", "tag": "94acb6f6-3ba1-434a-acd6-8bb84e1277f6"}, {"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "262230a9-8aaa-4c4d-a757-1ee3d0b98f6f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:44.148163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:44.169926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.170557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.172391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:44.174678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:44.180283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-76a38544-de15-4669-b045-be1856a299ab tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2907 microversion: 2.32 time: 0.571898 Jul 26 04:45:44.183979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1994/4109] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:43 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2907 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:44.212904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Creating event network-vif-unplugged:edce5445-4999-467e-b597-faf7ab02f1b9 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:44.213983 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Creating event network-vif-plugged:94acb6f6-3ba1-434a-acd6-8bb84e1277f6 for instance b6ccceb2-d548-474e-afad-ae1cb617202e on n-h2-848886-16 Jul 26 04:45:44.214697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] Creating event network-vif-unplugged:262230a9-8aaa-4c4d-a757-1ee3d0b98f6f for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:44.226708 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0423d310-79cd-4130-82d0-a0b2badbc0a7 req-7b6f30e0-88e3-4abc-9356-706fb151bcc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.084379 Jul 26 04:45:44.228247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2116/4110] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:44.248552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8ac34850-7ec7-4b63-a07f-e9f413f28218 req-e368c981-4826-4892-9a1a-62363795be15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-deleted", "tag": "271c850f-38eb-489c-973b-4f26b89eebff"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:44.275294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8ac34850-7ec7-4b63-a07f-e9f413f28218 req-e368c981-4826-4892-9a1a-62363795be15 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.276819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8ac34850-7ec7-4b63-a07f-e9f413f28218 req-e368c981-4826-4892-9a1a-62363795be15 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.294742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:44.296245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:44.305344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.306373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.307708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.308666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.319280 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8ac34850-7ec7-4b63-a07f-e9f413f28218 req-e368c981-4826-4892-9a1a-62363795be15 service nova] Creating event network-vif-deleted:271c850f-38eb-489c-973b-4f26b89eebff for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:44.344796 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8ac34850-7ec7-4b63-a07f-e9f413f28218 req-e368c981-4826-4892-9a1a-62363795be15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101676 Jul 26 04:45:44.345445 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1995/4111] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:44.507328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:44.522452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7074dfb6-459c-474d-a2a5-26fd929e9c20 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1273 microversion: 2.1 time: 0.233240 Jul 26 04:45:44.532627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2117/4112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:44 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:44.576636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:44.577343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:44.589372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.589831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:44.596761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:44.597327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.077277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:45.078254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:45.080622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:45.101437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.109043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.115274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.116659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.272972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:45.302426 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de2b253a-47e6-4a54-9b4d-690532b80c79 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.719285 Jul 26 04:45:45.312720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1996/4113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:44 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:45.320627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:45.322513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:45.339532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.340314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.342781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.343465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.642668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:45.668086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:45.670416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:45.676512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4256663d-fee8-4263-825f-5c6467ae9de4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2747 microversion: 2.32 time: 0.361648 Jul 26 04:45:45.692577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1997/4114] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:45 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2747 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:45.712095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:45.713064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:45.753459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.770562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:45.771944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:45.779198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.147931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:46.160046 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7dfcaa27-4cf8-42e2-a0bc-220eff8df11b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1273 microversion: 2.1 time: 0.464776 Jul 26 04:45:46.175383 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1998/4115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:45 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:46.255625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "43b505ac-e909-4dd1-9dcb-4438bb257348"}, {"server_uuid": "5f311811-dcc0-4f47-83df-98a0f4361481", "name": "network-vif-plugged", "status": "completed", "tag": "1db94b1f-e3bc-4140-88a5-2ef945ed4d51"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:46.278346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.278931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.307233 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] Creating event network-vif-unplugged:43b505ac-e909-4dd1-9dcb-4438bb257348 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:46.307955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] Creating event network-vif-plugged:1db94b1f-e3bc-4140-88a5-2ef945ed4d51 for instance 5f311811-dcc0-4f47-83df-98a0f4361481 on n-h1-848886-16 Jul 26 04:45:46.339000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-15e72ceb-3232-4ff0-a9b0-a50ef5df6a71 req-4fca3326-f428-4506-afd1-631c73224e50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.069343 Jul 26 04:45:46.340607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 1999/4116] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:45:46.353549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:46.354306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:46.367681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.368130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.368920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.373224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.484123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:46.497910 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3504472-7c4b-4dda-a54b-bd81e59e95a9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 1.429515 Jul 26 04:45:46.499110 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2118/4117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:45 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:46.620300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-91b932e1-3b0c-4809-87eb-cc4b8d163d59 req-f1a1e28b-4c3d-457e-b8b1-0c4f69c906f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-deleted", "tag": "edce5445-4999-467e-b597-faf7ab02f1b9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:46.645430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-91b932e1-3b0c-4809-87eb-cc4b8d163d59 req-f1a1e28b-4c3d-457e-b8b1-0c4f69c906f4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.645893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-91b932e1-3b0c-4809-87eb-cc4b8d163d59 req-f1a1e28b-4c3d-457e-b8b1-0c4f69c906f4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.689159 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-91b932e1-3b0c-4809-87eb-cc4b8d163d59 req-f1a1e28b-4c3d-457e-b8b1-0c4f69c906f4 service nova] Creating event network-vif-deleted:edce5445-4999-467e-b597-faf7ab02f1b9 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:46.702833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-91b932e1-3b0c-4809-87eb-cc4b8d163d59 req-f1a1e28b-4c3d-457e-b8b1-0c4f69c906f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087905 Jul 26 04:45:46.704486 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2119/4118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:45:46.729763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:46.733111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:46.754644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.755333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:46.759081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:46.759807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:47.069304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:47.082954 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d1b72490-cfb4-44bb-8248-d1012df57639 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.739698 Jul 26 04:45:47.085051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2000/4119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:46 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:47.183071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:47.183691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:47.193577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:47.194029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:47.197617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:47.198263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:47.216490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:47.311399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:47.324087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:47.326106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:47.327577 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef22bc19-3e13-4d2e-984f-3b62776a28da tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2588 microversion: 2.32 time: 0.608863 Jul 26 04:45:47.348578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2120/4120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:46 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2588 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:47.522915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:47.524496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:47.539961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:47.540830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:47.542581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:47.546340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:47.601435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:48.103737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:48.127984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-858dc4ed-c04d-4192-bc0d-cff40f9a109a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.942409 Jul 26 04:45:48.133901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2001/4121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:47 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:48.148268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:48.151786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:48.170201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:48.171001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:48.171969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:48.174687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:48.780054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:48.800680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15f272b6-20d4-41d2-a296-f2e6543f8b83 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 1.281190 Jul 26 04:45:48.816930 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2121/4122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:47 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:48.824171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:48.825070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:48.835151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:48.835901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:48.837631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:48.838453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:49.107278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:49.127033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9f4047a3-4fa5-48bb-a4dd-c18fc5bb3696 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.991751 Jul 26 04:45:49.128204 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2002/4123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:48 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:49.136432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8e434ad9-2ad8-4bb0-ab02-ca9608d9e311 req-5a314fa8-9e55-4df7-8d1e-98a219a37fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bae3a64-daf3-4bde-93de-d7b4f45e9fb9", "name": "network-vif-plugged", "status": "completed", "tag": "f7116bfa-917a-4218-8cc6-1633908d61c4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:49.152234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8e434ad9-2ad8-4bb0-ab02-ca9608d9e311 req-5a314fa8-9e55-4df7-8d1e-98a219a37fd1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:49.154070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8e434ad9-2ad8-4bb0-ab02-ca9608d9e311 req-5a314fa8-9e55-4df7-8d1e-98a219a37fd1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:49.174411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8e434ad9-2ad8-4bb0-ab02-ca9608d9e311 req-5a314fa8-9e55-4df7-8d1e-98a219a37fd1 service nova] Creating event network-vif-plugged:f7116bfa-917a-4218-8cc6-1633908d61c4 for instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 on n-h1-848886-16 Jul 26 04:45:49.182443 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8e434ad9-2ad8-4bb0-ab02-ca9608d9e311 req-5a314fa8-9e55-4df7-8d1e-98a219a37fd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052430 Jul 26 04:45:49.208692 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2003/4124] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:49.226754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:49.227571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:49.248240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:49.248719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:49.252338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:49.252810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:49.379377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:49.405589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:49.412673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:49.416205 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2723e9c2-d642-4dab-b8b5-dc2c4a8e65d3 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2542 microversion: 2.32 time: 0.597828 Jul 26 04:45:49.417235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2122/4125] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:48 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2542 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:49.831004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:49.832338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:49.843576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:49.850070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:49.852219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:49.853074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.310563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:50.323435 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0dd6c050-270d-465e-b0dc-cdfb72f774bb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 1.113001 Jul 26 04:45:50.333015 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2004/4126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:49 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:50.337880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-deleted", "tag": "43b505ac-e909-4dd1-9dcb-4438bb257348"}, {"name": "network-changed", "server_uuid": "2c3f9552-e2be-42d8-bb97-af523fb06472", "tag": "d619a941-4a83-4725-8066-26290c387b9c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:50.359115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:50.368089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:50.370566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.387360 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4022516a-2b9c-4d5e-b3a5-6571e4d0e248 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.563003 Jul 26 04:45:50.388335 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2123/4127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:49 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:50.395911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:50.396820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:50.409384 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] Creating event network-vif-deleted:43b505ac-e909-4dd1-9dcb-4438bb257348 for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:50.409891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] Creating event network-changed:d619a941-4a83-4725-8066-26290c387b9c for instance 2c3f9552-e2be-42d8-bb97-af523fb06472 on n-h2-848886-16 Jul 26 04:45:50.418430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:50.420604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.423710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:50.425944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.428762 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a2ee2cb0-1edd-43f8-b575-1d766cdc3a98 req-1f6436bc-3e70-4383-b6f5-3b47ae50ff23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093589 Jul 26 04:45:50.431727 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2005/4128] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:50.446775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:50.447478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:50.468087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:50.468466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.469270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:50.469713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:50.829030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:50.852338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:50.942676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:50.964854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:50.970600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:50.975312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dab012b4-2d08-4ff5-af42-5510f77370d4 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2542 microversion: 2.32 time: 0.532906 Jul 26 04:45:50.980504 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2006/4129] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:50 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2542 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:51.002031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:51.015211 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29b76487-5427-410f-8364-fa22f8544412 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1321 microversion: 2.1 time: 0.625691 Jul 26 04:45:51.016047 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2124/4130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:50 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:51.217308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3e9b5a8e-54ee-4817-95b2-9c641e6ada1d req-b646c982-9876-487c-aea3-f96240d39753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072f84ef-4568-498a-9ad8-8f061554487a", "name": "network-vif-plugged", "status": "completed", "tag": "23462d03-26ad-4d77-85af-e76c6dba661f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:51.233131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3e9b5a8e-54ee-4817-95b2-9c641e6ada1d req-b646c982-9876-487c-aea3-f96240d39753 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:51.234001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3e9b5a8e-54ee-4817-95b2-9c641e6ada1d req-b646c982-9876-487c-aea3-f96240d39753 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:51.252696 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3e9b5a8e-54ee-4817-95b2-9c641e6ada1d req-b646c982-9876-487c-aea3-f96240d39753 service nova] Creating event network-vif-plugged:23462d03-26ad-4d77-85af-e76c6dba661f for instance 072f84ef-4568-498a-9ad8-8f061554487a on n-h2-848886-16 Jul 26 04:45:51.270743 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3e9b5a8e-54ee-4817-95b2-9c641e6ada1d req-b646c982-9876-487c-aea3-f96240d39753 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059073 Jul 26 04:45:51.279516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2007/4131] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:51.359716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:51.360789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:51.377701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:51.378411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:51.379385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:51.379977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:51.412831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:51.414260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:51.424855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:51.428231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:51.431341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:51.432018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:51.895236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:51.905439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f59646eb-343f-4cf1-9105-e36db60e860f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.498235 Jul 26 04:45:51.906031 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2008/4132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:51 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:52.009503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:52.010137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:52.023161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.029091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.034391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.035654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.264801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:52.286506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-11edd13d-42df-47e9-bd1a-8b38c5c3a67a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.932154 Jul 26 04:45:52.299352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2125/4133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:51 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:52.308899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:52.311254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:52.319037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.320299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.321692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.322440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.404616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:52.415409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:52.417231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:52.418869 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92754dd7-0288-4e55-802c-1b9a6d520448 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2211 microversion: 2.32 time: 0.413558 Jul 26 04:45:52.421132 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2009/4134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:52 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2211 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:45:52.578955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d7df7319-a351-4625-83d6-996ea7e874dc req-89fb7677-a028-4aa1-8973-4ffa0c2904e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-deleted", "tag": "262230a9-8aaa-4c4d-a757-1ee3d0b98f6f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:52.596639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d7df7319-a351-4625-83d6-996ea7e874dc req-89fb7677-a028-4aa1-8973-4ffa0c2904e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.597288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d7df7319-a351-4625-83d6-996ea7e874dc req-89fb7677-a028-4aa1-8973-4ffa0c2904e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.627514 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d7df7319-a351-4625-83d6-996ea7e874dc req-89fb7677-a028-4aa1-8973-4ffa0c2904e7 service nova] Creating event network-vif-deleted:262230a9-8aaa-4c4d-a757-1ee3d0b98f6f for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:52.645087 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d7df7319-a351-4625-83d6-996ea7e874dc req-89fb7677-a028-4aa1-8973-4ffa0c2904e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071305 Jul 26 04:45:52.645882 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2010/4135] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:45:52.929993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:52.930733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:52.938401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.938828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:52.939665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:52.940282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.078003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.085747 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-56e144fa-350e-4278-b4f9-24716dfeb9f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1513 microversion: 2.1 time: 0.781358 Jul 26 04:45:53.086372 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2126/4136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:52 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1513 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:53.108573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:53.108573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:53.115587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.116239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.117228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.117999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.302669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.317566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6141a32c-5ab2-4712-97ce-7908ad8fc539 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.392361 Jul 26 04:45:53.318295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2011/4137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:52 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:53.323381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:53.324060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:53.332715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.333269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.334120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.334652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.432502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.458816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6426276e-5d05-4385-8967-ced7c83a487a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1511 microversion: 2.1 time: 0.356417 Jul 26 04:45:53.475071 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2127/4138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:53 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:53.485801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:53.486644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:53.494761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.495473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.496488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.497172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.597822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.615118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.618289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.620650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4748e1d-0ab4-4555-abe0-7a1d45d6fa9f tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 2031 microversion: 2.32 time: 0.145366 Jul 26 04:45:53.621473 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2128/4139] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:53 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 2031 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:53.629116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:53.629990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:53.637394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.638001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.639025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:53.640454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:53.987664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:53.998578 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10f63ab6-5666-4137-99b3-57d396f800eb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.678890 Jul 26 04:45:53.999523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2012/4140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:53 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:54.203266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:54.218921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af754e3e-1f68-4f1e-8df0-12f0e6227e97 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1512 microversion: 2.1 time: 0.589193 Jul 26 04:45:54.219924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2129/4141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:53 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1512 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:54.243647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:54.249064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:54.249950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:54.285080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:54.286424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:54.287375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:54.291660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1056804430", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "48fe09c0-a434-4479-b267-8b132ef7bfa6"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:54.292472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:54.402607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] validate_networks() for [('48fe09c0-a434-4479-b267-8b132ef7bfa6', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:45:54.508746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:54.671378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:54.685325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:54.685956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.354066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba7c8605-6dd4-45a4-8d5a-0d27c6e559a2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 1.114123 Jul 26 04:45:55.365787 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2130/4142] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:45:54 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:55.380364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:55.383948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:55.401269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.401937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.402926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.403920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.492996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:45:55.494009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:45:55.494842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:45:55.495464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:45:55.496174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:45:55.507864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.508736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.509765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.510451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.530815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Getting quotas for project 4bd76a36040e4cc58f503bbb7183e98f. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:45:55.537087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Getting quotas for user 8c1b9fa094d24ca4ab78e41964f86201 and project 4bd76a36040e4cc58f503bbb7183e98f. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:45:55.554593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:45:55.559412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:45:55.680547 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a43bd048-fc72-49b5-9d2d-b81cb13e2cdf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679786 Jul 26 04:45:55.687507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2013/4143] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:45:55.697725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:55.698740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:55.710669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.714332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.715454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.719623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.790173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:55.805481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32041e17-d1bc-487c-b94e-63680a4f9633 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1328 microversion: 2.1 time: 0.432158 Jul 26 04:45:55.806187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2131/4144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:55 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1328 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:55.817680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b415ea7b-fc78-41ee-b136-3d9a15446951 req-25170b46-891e-41e0-89ce-61f81968f843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e605a-8da8-4e43-837f-0ddd3bcaf8d4", "name": "network-vif-deleted", "tag": "5bdf322f-6bb6-4bc4-85f1-17a21627fc1e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:55.862185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b415ea7b-fc78-41ee-b136-3d9a15446951 req-25170b46-891e-41e0-89ce-61f81968f843 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.862648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b415ea7b-fc78-41ee-b136-3d9a15446951 req-25170b46-891e-41e0-89ce-61f81968f843 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.887526 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b415ea7b-fc78-41ee-b136-3d9a15446951 req-25170b46-891e-41e0-89ce-61f81968f843 service nova] Creating event network-vif-deleted:5bdf322f-6bb6-4bc4-85f1-17a21627fc1e for instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 on n-h1-848886-16 Jul 26 04:45:55.906594 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b415ea7b-fc78-41ee-b136-3d9a15446951 req-25170b46-891e-41e0-89ce-61f81968f843 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098845 Jul 26 04:45:55.907235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2132/4145] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:55.929714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:55.930466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:55.945734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:55.956619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.959041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:55.960811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:55.962296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c401bcde-9fe9-46e6-83e9-83bf23a085fa tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.273448 Jul 26 04:45:55.966882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.967989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:55.968586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:55.983052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2014/4146] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:55 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:55.989786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:55.996136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:55.997766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-137028632', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:56.009545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.010117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.011058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.011605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.218837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:56.356970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:56.371285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.379639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.739591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:56.776510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eedce195-b340-45fb-b8e7-310039f0bd97 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.863449 Jul 26 04:45:56.796313 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2133/4147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:55 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:56.810695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:56.813892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:56.830021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.830605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.831562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.832072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.905342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:56.918248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3553a3d-310e-4c3f-a979-6c3494b0df17 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1221 microversion: 2.1 time: 0.120654 Jul 26 04:45:56.922692 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2134/4148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:56 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:56.930864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:56.932827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:56.946014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.948401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:56.949358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:56.949988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.142550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cfd9a5d-9bcf-4db2-b31d-4b8098926c03 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-137028632" status: 200 len: 1514 microversion: 2.1 time: 1.156972 Jul 26 04:45:57.143166 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2015/4149] 10.222.0.43 () {58 vars in 1261 bytes} [Tue Jul 26 04:45:55 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-137028632 => generated 1514 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:57.154197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:57.158223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:57.184472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.187127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.188851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.191718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.317124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.345036 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d01a6297-bc04-4faa-85db-b9face0eb0aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1508 microversion: 2.1 time: 0.421125 Jul 26 04:45:57.345520 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2135/4150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:56 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:57.347155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.350103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:57.358824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.369027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:57.370987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.375666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.387085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.387829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.389566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8073f80-4cf4-4ece-86bb-fd83e99131a8 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.232365 Jul 26 04:45:57.390675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.390854 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2016/4151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:57 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:57.391449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.398542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:57.399405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:57.408293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.409003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.409982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.410624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.548437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:57.638105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.651673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.652493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.838748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:57.852827 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e748d21b-8804-497b-bb5c-d614be629396 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1508 microversion: 2.1 time: 0.460286 Jul 26 04:45:57.857929 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2017/4152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:57 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:57.865681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:57.871034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:57.906218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.906697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:57.907516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:57.907966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.245090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.258703 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2b5718e-2e78-4ea4-af22-eb2d8c658dff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.399443 Jul 26 04:45:58.259950 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2018/4153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:57 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:58.291001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:58.297240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:58.320971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:58.323983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.324711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.326533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.327207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.366777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:45:58.429327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:58.517194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d749d63-69b7-4c2f-9ee1-a4fb9c91a9f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 204 len: 0 microversion: 2.1 time: 0.238213 Jul 26 04:45:58.518469 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2019/4154] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:45:58 2022] DELETE /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:45:58.530731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:58.531435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:58.548874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.549514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.550651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.551206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.606133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3de256de-944f-42c8-b786-848a7d592e52 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.259322 Jul 26 04:45:58.607702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2136/4155] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Jul 26 04:45:57 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:58.621814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-af1e838c-1a1b-46f0-8301-ada82c12bda9 req-dd2d0682-ab33-4c72-bedc-aafad9e481f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3f9552-e2be-42d8-bb97-af523fb06472", "name": "network-vif-plugged", "status": "completed", "tag": "d619a941-4a83-4725-8066-26290c387b9c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:45:58.634036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-af1e838c-1a1b-46f0-8301-ada82c12bda9 req-dd2d0682-ab33-4c72-bedc-aafad9e481f2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.638625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-af1e838c-1a1b-46f0-8301-ada82c12bda9 req-dd2d0682-ab33-4c72-bedc-aafad9e481f2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.650640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-af1e838c-1a1b-46f0-8301-ada82c12bda9 req-dd2d0682-ab33-4c72-bedc-aafad9e481f2 service nova] Creating event network-vif-plugged:d619a941-4a83-4725-8066-26290c387b9c for instance 2c3f9552-e2be-42d8-bb97-af523fb06472 on n-h2-848886-16 Jul 26 04:45:58.657308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-af1e838c-1a1b-46f0-8301-ada82c12bda9 req-dd2d0682-ab33-4c72-bedc-aafad9e481f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048391 Jul 26 04:45:58.658284 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2137/4156] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:45:58.664714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:58.665682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:58.672489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.673231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.674292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.674955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.679712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:58.680601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.688562 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-909c22c9-b0ec-475f-bc83-d7a96b8bf216 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1283 microversion: 2.1 time: 0.165121 Jul 26 04:45:58.689169 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2020/4157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:58 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:58.708595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:58.709429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:58.717042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.717841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.719991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.720605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.794795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.809367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.811663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.813762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c47fc877-303e-4388-a65d-a873309d328a tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.153987 Jul 26 04:45:58.815605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2138/4158] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:45:58 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:45:58.824899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:58.831786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.832605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.servers [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Removing options 'limit' from query {{(pid=119488) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 04:45:58.833850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:58.842676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.844937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.846208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.846959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:58.890327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:58.899572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:58.900215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.160786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1ffe426-ef40-4e8c-998e-fe0c1ff5f595 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.342813 Jul 26 04:45:59.161584 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2139/4159] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 04:45:58 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:59.183264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.193280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.194034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:59.215571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.216657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.219716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.220163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.276423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:59.345679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c5d210c-5187-4865-95d1-607d7721c18f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.166222 Jul 26 04:45:59.346403 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2140/4160] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:45:59.360359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.362023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:59.369605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.370387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.371172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.371647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.497138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.507310 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54323d7b-5f1d-4937-a96a-d1dfb71cfa3a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1514 microversion: 2.1 time: 0.803449 Jul 26 04:45:59.508151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2021/4161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:58 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1514 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:59.518721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.528611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.529379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.servers [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Removing options 'limit' from query {{(pid=119487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 04:45:59.530358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:59.536984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.537411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.538454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.539046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.570021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:59.621099 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c57b0689-fb93-4490-ab7c-cb5bb78416c1 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.111664 Jul 26 04:45:59.623053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2022/4162] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:59.637054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.642673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.643811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:59.659785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.660309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.662065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.662581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.701871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.720399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe530928-7af4-4231-8974-ac5dbea57058 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.367108 Jul 26 04:45:59.721684 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2141/4163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:59.727510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.731198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:45:59.747874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.748317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:45:59.750571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.751649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.753839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.808733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a6e488f-2f61-46d0-8956-e96dbc4c5591 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.175993 Jul 26 04:45:59.820198 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2023/4164] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers => generated 1010 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:45:59.833680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:45:59.849433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:45:59.850202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:45:59.875488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.876061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.877045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:45:59.877591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:45:59.985927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:00.080992 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e13a14df-8e15-4c9d-9c56-777eef786b58 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.251237 Jul 26 04:46:00.082083 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2024/4165] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:00.087730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:00.088358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:00.095645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.101225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.102093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.102744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.367526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.383923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.386244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.387655 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-639b95cd-3e34-4c0d-822c-d053dffc0ff6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.304214 Jul 26 04:46:00.388967 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2025/4166] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:00 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:00.402008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:00.408009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.408475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.servers [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Removing options 'limit' from query {{(pid=119487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 04:46:00.409148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:00.415321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.415795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.416662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.417109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.446759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-369f60d9-6477-48ef-9c4b-0013c5789420 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.056589 Jul 26 04:46:00.447846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2026/4167] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Jul 26 04:46:00 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:00.471248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:00.481181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.484327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-137028632', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:00.494658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.500355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.501344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.501875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.589982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:00.600226 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-83285f38-01ec-438f-b5f1-ef11a39a957f tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.877310 Jul 26 04:46:00.602665 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2142/4168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:45:59 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:00.619591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:00.620386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:00.630832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.631611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.632738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.635033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.656359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:00.773720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d884a3eb-739e-4fbe-80a5-a709e96d9960 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-137028632" status: 200 len: 345 microversion: 2.1 time: 0.315296 Jul 26 04:46:00.775027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2027/4169] 10.222.0.43 () {58 vars in 1240 bytes} [Tue Jul 26 04:46:00 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-137028632 => generated 345 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:00.782059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:00.783022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:00.791230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.791723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:00.793443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:00.794199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.179588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.193939 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43b649e3-06fa-4e7f-a782-ea81ab66ccdd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1315 microversion: 2.1 time: 0.413293 Jul 26 04:46:01.206186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2028/4170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:00 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:01.209958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.210607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c81a758-8ee1-4e63-b6d3-1e2918fd346e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:01.219829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c81a758-8ee1-4e63-b6d3-1e2918fd346e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.220280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c81a758-8ee1-4e63-b6d3-1e2918fd346e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.226227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3aca067e-51e4-48c1-ab24-40cca1cb554d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 200 len: 1514 microversion: 2.1 time: 0.617760 Jul 26 04:46:01.227036 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2143/4171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:00 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 1514 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:01.246208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c753f0f7-5d43-45a6-a6d9-5283d110d737 req-37c4ec26-808e-4104-897c-7eaf0250c9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072f84ef-4568-498a-9ad8-8f061554487a", "name": "network-vif-deleted", "tag": "23462d03-26ad-4d77-85af-e76c6dba661f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:01.258655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c753f0f7-5d43-45a6-a6d9-5283d110d737 req-37c4ec26-808e-4104-897c-7eaf0250c9bd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.265307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c753f0f7-5d43-45a6-a6d9-5283d110d737 req-37c4ec26-808e-4104-897c-7eaf0250c9bd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.281026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2c81a758-8ee1-4e63-b6d3-1e2918fd346e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:46:01.305816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c753f0f7-5d43-45a6-a6d9-5283d110d737 req-37c4ec26-808e-4104-897c-7eaf0250c9bd service nova] Creating event network-vif-deleted:23462d03-26ad-4d77-85af-e76c6dba661f for instance 072f84ef-4568-498a-9ad8-8f061554487a on n-h2-848886-16 Jul 26 04:46:01.312061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c753f0f7-5d43-45a6-a6d9-5283d110d737 req-37c4ec26-808e-4104-897c-7eaf0250c9bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083721 Jul 26 04:46:01.319445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2144/4172] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:01.352583 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2c81a758-8ee1-4e63-b6d3-1e2918fd346e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "POST /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e/action" status: 202 len: 0 microversion: 2.1 time: 0.156256 Jul 26 04:46:01.353543 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2029/4173] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:01 2022] POST /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:01.382074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:01.384184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:01.411285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.411752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.412549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.412996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.413632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:01.414444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:01.441146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.443339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.444935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.445541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.586383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.596278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.597979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.599466 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-246cad1a-8571-4c1e-9872-c470d28102d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.190682 Jul 26 04:46:01.613237 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2030/4174] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:01 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:46:01.624087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:01.624821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:01.632417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.632902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.633751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:01.634347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:01.854393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.864360 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-180909a3-9fe6-45c8-9c5a-3758556234c9 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.502994 Jul 26 04:46:01.869654 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2145/4175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:01 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:01.942346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:01.955059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e23307c4-a131-4172-be28-e51e1b59b7cf tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.335389 Jul 26 04:46:01.955847 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2031/4176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:01 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:02.220665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:02.223419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:02.232123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.233074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.234138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.234972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.253393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:02.255386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:02.275998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.278926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.281513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.283401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.305683 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a HTTP/1.1 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '072f84ef-4568-498a-9ad8-8f061554487a'} Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:02.315391 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:46:02.319463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:02.323118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:02.324278 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3cfdfa59-505a-45e5-9930-a9be194db14f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 404 len: 111 microversion: 2.1 time: 0.076635 Jul 26 04:46:02.329232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2032/4177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:02 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:46:02.336195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d559315e-cd8e-412f-97c3-da9afa033855 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '.version_select at 0x7f38b6087820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:02.362123 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d559315e-cd8e-412f-97c3-da9afa033855 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-key-906067856" status: 202 len: 0 microversion: 2.1 time: 0.030515 Jul 26 04:46:02.376868 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2033/4178] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Jul 26 04:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-906067856 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:02.515185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1720241012", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:02.585867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:46:02.741077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:02.749188 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7bd4e384-e5a8-46ee-9dcd-3e844e6479c2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1503 microversion: 2.1 time: 0.536019 Jul 26 04:46:02.757914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2146/4179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:02 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:02.774580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:02.775678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:02.792090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.792745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.794513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:02.797183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:02.970895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:02.983520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:02.986092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:02.987373 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a52183c-d4a5-4e43-a420-d800fe9597d0 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.228113 Jul 26 04:46:02.988184 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2147/4180] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:02 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:03.002544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5bbf8327-e7df-4f49-875e-073e7819ede4 req-d2de291f-cd60-4711-8799-d781900ecaeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46e22e2-ef66-4660-bc3e-d8ffd494a95e", "tag": "80cbb559-1b95-4918-a4b8-298c0a5e0430"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:03.014777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5bbf8327-e7df-4f49-875e-073e7819ede4 req-d2de291f-cd60-4711-8799-d781900ecaeb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.015222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5bbf8327-e7df-4f49-875e-073e7819ede4 req-d2de291f-cd60-4711-8799-d781900ecaeb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.029570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5bbf8327-e7df-4f49-875e-073e7819ede4 req-d2de291f-cd60-4711-8799-d781900ecaeb service nova] Creating event network-changed:80cbb559-1b95-4918-a4b8-298c0a5e0430 for instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e on n-h1-848886-16 Jul 26 04:46:03.035062 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5bbf8327-e7df-4f49-875e-073e7819ede4 req-d2de291f-cd60-4711-8799-d781900ecaeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041914 Jul 26 04:46:03.035958 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2148/4181] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:03.041618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:03.042325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:03.049951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.050438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.051267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.051879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.143737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bc89c31-6b07-4c06-9cc6-f03ce5ecd955 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472/action" status: 202 len: 0 microversion: 2.1 time: 0.106080 Jul 26 04:46:03.145418 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2149/4182] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:03 2022] POST /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:03.154082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:03.155033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:03.163074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.164002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.165025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.165815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.409012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:03.424351 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3b5b3e7-de02-4a50-8735-052b5a2a805c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.277153 Jul 26 04:46:03.425680 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2150/4183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:03 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:03.431260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:03.432101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:03.441298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.442550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.443513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.444858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.645248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:03.647503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:46:03.648863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:46:03.649771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:46:03.650562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:46:03.651471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:46:03.659295 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d8d17ea-a004-44fd-8e89-eac4149e9e4a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.231985 Jul 26 04:46:03.661531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2151/4184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:03 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:03.666607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.667232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.668034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.668476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.677931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:03.679078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:03.688864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.689322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.690472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:03.690916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:03.719420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:46:03.737008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:46:03.763313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:46:03.765781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:46:03.826371 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e7e58533-8e8b-4b79-b5b6-8711a1d0baf4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315473 Jul 26 04:46:03.833835 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2034/4185] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:46:03.840488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-060b0b4d-7bd8-4961-a464-827ff1a511a7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:03.841729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-060b0b4d-7bd8-4961-a464-827ff1a511a7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:03.943827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:03.962510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0053d369-10ce-489e-b234-80078bf4445e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1488 microversion: 2.1 time: 0.291376 Jul 26 04:46:03.963784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2152/4186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:03 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1488 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:03.986954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:03.987446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:04.004207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.004663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.007067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.007537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.034978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-060b0b4d-7bd8-4961-a464-827ff1a511a7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.044807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-060b0b4d-7bd8-4961-a464-827ff1a511a7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1209 microversion: 2.1 time: 0.208425 Jul 26 04:46:04.056193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2035/4187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:03 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1209 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:04.068070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:04.068363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:04.069044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:04.081682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.082183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.083016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.083467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.210551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:04.289526 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2dd800d9-4e2f-4771-bac5-1e7b29f59c29 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 204 len: 0 microversion: 2.1 time: 0.305872 Jul 26 04:46:04.290992 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2153/4188] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:03 2022] DELETE /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:04.305584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:04.307887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:04.321603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.322410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.323410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.324009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.448700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.455280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:04.477920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.482476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.486557 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21d2666f-0666-4dd0-bcf7-9d3d87e5478c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.428457 Jul 26 04:46:04.489596 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2036/4189] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:04 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:04.514963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:04.516325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:04.540881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.541586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.542693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.543452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.562439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.573311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6205f233-2e48-4f75-bb44-12a9e57e4ce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1494 microversion: 2.1 time: 0.276843 Jul 26 04:46:04.574449 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2154/4190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:04 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1494 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:04.683511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:04.684282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:04.692301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.699394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.701125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:04.701863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:04.883564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:04.898917 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ecf608c-288f-40c3-aa2a-3e18e6032a8a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.407571 Jul 26 04:46:04.900170 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2037/4191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:04 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:05.075212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:05.075923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:05.085630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.086129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.087115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.087573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.186190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:05.197265 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd453635-0c41-44d1-b3d6-b3590fa35b46 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1213 microversion: 2.1 time: 0.129678 Jul 26 04:46:05.212219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2038/4192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:05 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:05.352359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:05.361247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2df368cc-20c4-49fa-9da6-3c2a0817090a tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.681720 Jul 26 04:46:05.375026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2155/4193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:04 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:05.518924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:05.520073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:05.533279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.535955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.536978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.537601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.597034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:05.597664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:05.604278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.604741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.605534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.617264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.648017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:05.660265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:05.661794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:05.682677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af24b4cd-eaf5-4cc7-aee3-4e7c5d5dab67 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.167585 Jul 26 04:46:05.683315 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2039/4194] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:05 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:05.927440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:05.928169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:05.938163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.938653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.939450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:05.939905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:05.990091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.000987 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-60f3452a-c80d-4c8f-9aeb-fc20dc023354 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1494 microversion: 2.1 time: 0.408591 Jul 26 04:46:06.018325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2156/4195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:05 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1494 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:06.221318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:06.222382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:06.232369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.235734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.239212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.240396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.251187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.265154 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90b4e8e3-57ba-44c2-abfa-6d0dc7cbe461 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.342923 Jul 26 04:46:06.278779 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2040/4196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:05 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:06.386241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:06.387035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:06.400469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.401112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.402741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.406473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.460679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.475516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12107825-4b22-4c84-a4dd-3d5d8184e1a5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1261 microversion: 2.1 time: 0.259423 Jul 26 04:46:06.486185 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2157/4197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:06 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:06.711512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:06.712225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:06.729379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.730256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.732102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:06.732867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:06.854227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.873590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.875420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:06.876648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b25059e-a435-4e51-92c2-3b89c36cd6e2 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.169080 Jul 26 04:46:06.877212 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2158/4198] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:06 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:46:07.025890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:07.026531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:07.035421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.036077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.036629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.037064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.120146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:07.151727 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26aa6e3b-ec46-4fdb-91d5-a75ab81ed036 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.770564 Jul 26 04:46:07.158820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2041/4199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:06 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:07.291525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:07.292090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:07.303460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.304293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.305515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.306130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.445243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:07.457956 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68e0f3e1-1559-448b-aa9e-275acb27fb38 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 200 len: 1494 microversion: 2.1 time: 0.436156 Jul 26 04:46:07.461296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2159/4200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:07 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 1494 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:07.471826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8e1512d6-7395-4711-a053-9da5f44f4e34 req-30fd9817-bef0-4fa3-849c-6dee9b9347c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3f9552-e2be-42d8-bb97-af523fb06472", "name": "network-vif-deleted", "tag": "d619a941-4a83-4725-8066-26290c387b9c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:07.504465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8e1512d6-7395-4711-a053-9da5f44f4e34 req-30fd9817-bef0-4fa3-849c-6dee9b9347c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.507000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8e1512d6-7395-4711-a053-9da5f44f4e34 req-30fd9817-bef0-4fa3-849c-6dee9b9347c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.532430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8e1512d6-7395-4711-a053-9da5f44f4e34 req-30fd9817-bef0-4fa3-849c-6dee9b9347c1 service nova] Creating event network-vif-deleted:d619a941-4a83-4725-8066-26290c387b9c for instance 2c3f9552-e2be-42d8-bb97-af523fb06472 on n-h2-848886-16 Jul 26 04:46:07.548663 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8e1512d6-7395-4711-a053-9da5f44f4e34 req-30fd9817-bef0-4fa3-849c-6dee9b9347c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085852 Jul 26 04:46:07.550281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2160/4201] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:07.557443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:07.559000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:07.563370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:07.567953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.568615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.570410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.571011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.601664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:07.610442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-828cf422-b455-4d50-a5f4-198c16d0996c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.325305 Jul 26 04:46:07.611040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2042/4202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:07 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:07.677492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:07.685048 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a966d088-d8cf-4c34-87bc-d8f763f036f0 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1267 microversion: 2.1 time: 0.132604 Jul 26 04:46:07.686069 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2161/4203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:07 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:07.902000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:07.906211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:07.919926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.920824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:07.922622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:07.924867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.013740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:08.030128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:08.032188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:08.033828 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dde6fa01-f325-4a05-b555-431c63f7a07c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.136402 Jul 26 04:46:08.034955 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2043/4204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:07 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:08.175543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:08.176819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:08.184022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.185678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.187097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.187811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.478650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:08.479272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:08.494646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.495113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.495912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.496364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.529352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 HTTP/1.1 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2c3f9552-e2be-42d8-bb97-af523fb06472'} Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:08.532481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:46:08.536771 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:08.540562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:08.541680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-49c4c528-5069-409f-8b21-82c72c8db4af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 404 len: 111 microversion: 2.1 time: 0.066928 Jul 26 04:46:08.546250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2044/4205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:08 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:46:08.604533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:08.614583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa9dfead-7025-47fd-a828-1de9c54a4877 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.442840 Jul 26 04:46:08.615166 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2162/4206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:08 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:08.635483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:08.636116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:08.648675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.649143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.652484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.653810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.707141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:08.707751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:08.718949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.719435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.722551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:08.725228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:08.889539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:09.105487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:09.126314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37be0fbb-7435-4016-88fe-38cd053b7ab2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.485384 Jul 26 04:46:09.127603 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2045/4207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:08 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:09.145773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-468543742", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:09.226457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:09.231831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:46:09.293460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:09.303737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88c66475-774e-493c-9237-aa1b9f5ddd08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.601474 Jul 26 04:46:09.309879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2163/4208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:08 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:09.314960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:09.315979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:09.336956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:09.337687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:09.340123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:09.341552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:09.454566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:09.465055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:09.471116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:09.474990 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-82f14287-1595-42b5-a84f-fe1813aaedeb tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.161620 Jul 26 04:46:09.491375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2164/4209] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:09 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:09.535493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-97eeb237-a0e3-4d90-991b-688dd0da35e8 req-a392bf0e-67f0-4ea1-83d7-1cc45cd1c1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46e22e2-ef66-4660-bc3e-d8ffd494a95e", "name": "network-vif-plugged", "status": "completed", "tag": "80cbb559-1b95-4918-a4b8-298c0a5e0430"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:09.550890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-97eeb237-a0e3-4d90-991b-688dd0da35e8 req-a392bf0e-67f0-4ea1-83d7-1cc45cd1c1ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:09.551340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-97eeb237-a0e3-4d90-991b-688dd0da35e8 req-a392bf0e-67f0-4ea1-83d7-1cc45cd1c1ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:09.582519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-97eeb237-a0e3-4d90-991b-688dd0da35e8 req-a392bf0e-67f0-4ea1-83d7-1cc45cd1c1ce service nova] Creating event network-vif-plugged:80cbb559-1b95-4918-a4b8-298c0a5e0430 for instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e on n-h1-848886-16 Jul 26 04:46:09.599804 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-97eeb237-a0e3-4d90-991b-688dd0da35e8 req-a392bf0e-67f0-4ea1-83d7-1cc45cd1c1ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068224 Jul 26 04:46:09.600594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2165/4210] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:46:09.642428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:09.643144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:09.660692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:09.661738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:09.662799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:09.663464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.233751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:46:10.235129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:46:10.235839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:46:10.239261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:46:10.240131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:46:10.254354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.255243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.256433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.257247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.305743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:46:10.318705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:46:10.341360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:46:10.344045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:46:10.428398 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-079d2aeb-5314-40d4-9ff6-a9b0885ad013 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298304 Jul 26 04:46:10.429382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2046/4211] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:46:10.434593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:10.440613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:10.462416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.466870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.467863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.471538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.513889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:10.522459 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-892fb67e-ff7d-4642-9e18-9b70aaaac185 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1325 microversion: 2.1 time: 0.885168 Jul 26 04:46:10.527762 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2166/4212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:09 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1325 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:10.541979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:10.542861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:10.554117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.554864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.555829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.556413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.841632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:10.850798 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3900695b-6f46-4ba4-b7cb-e8d384572789 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.420345 Jul 26 04:46:10.856014 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2047/4213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:10 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:10.860968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21263804-9886-4691-ba8a-fe5bc3a3a078 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:10.861799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21263804-9886-4691-ba8a-fe5bc3a3a078 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:10.898691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:10.953762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:10.961353 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8230582f-1d6c-4b63-8a5c-c20c17f4b090 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.432235 Jul 26 04:46:10.961936 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2167/4214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:10 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:10.978865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:10.979679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:10.991506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.996048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:10.997735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:10.998547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.056185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21263804-9886-4691-ba8a-fe5bc3a3a078 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:11.075666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21263804-9886-4691-ba8a-fe5bc3a3a078 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1214 microversion: 2.1 time: 0.212280 Jul 26 04:46:11.076330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2048/4215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:10 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:11.150263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:11.165110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:11.167149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:11.171309 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1425bd48-47df-4947-bd04-384a7dfec810 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.196008 Jul 26 04:46:11.173757 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2168/4216] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:10 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:11.291336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fc1d1a8a-cf21-4d04-9ef0-877f4d2bf803 req-6e0059c3-0678-4f46-87a9-7b3680fcfcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e33df39-59f2-4fb6-9829-3c625766287e", "tag": "8cc586bd-cf07-4658-941c-487eed48a2e3"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:11.317016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fc1d1a8a-cf21-4d04-9ef0-877f4d2bf803 req-6e0059c3-0678-4f46-87a9-7b3680fcfcef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.318232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fc1d1a8a-cf21-4d04-9ef0-877f4d2bf803 req-6e0059c3-0678-4f46-87a9-7b3680fcfcef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.333445 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fc1d1a8a-cf21-4d04-9ef0-877f4d2bf803 req-6e0059c3-0678-4f46-87a9-7b3680fcfcef service nova] Creating event network-changed:8cc586bd-cf07-4658-941c-487eed48a2e3 for instance 4e33df39-59f2-4fb6-9829-3c625766287e on n-h2-848886-16 Jul 26 04:46:11.346246 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fc1d1a8a-cf21-4d04-9ef0-877f4d2bf803 req-6e0059c3-0678-4f46-87a9-7b3680fcfcef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077581 Jul 26 04:46:11.349293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2049/4217] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:11.554832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:11.556663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:11.580931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.582654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.584998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.585917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.877894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:11.878878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:11.897021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.897489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.898320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.898767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.922221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:11.936904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b199faa7-3b58-4e06-8ea6-b439691c4f8e tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1522 microversion: 2.1 time: 0.390336 Jul 26 04:46:11.938043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2169/4218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:11 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:11.962502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:11.963275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:11.974562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.975051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:11.977067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:11.977564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.064598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] HTTP exception thrown: Action 999 not found Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Request method failure captured: Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e/os-instance-actions/999 HTTP/1.1 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33GBOk1Y_3G8C_fyf-ARbkTsGlzm0s9KZK1dL6qD-xl-OOnXaxfSVH2Bx2VLyGl4sV7qy00Cqcn0uOGuKiGAZL7PBY20fLy_93YOz-DCrUUGeKbaP6qH0kgqocLQjhO16lo_w7_XE4Pr-MwazgpXwmbHCKxp_c97VytI59bxFKL29XU Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8c1b9fa094d24ca4ab78e41964f86201 Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: exception: Action 999 not found Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': 'a46e22e2-ef66-4660-bc3e-d8ffd494a95e', 'id': '999'} Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 26 04:46:12.071737 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.076449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Returning 404 to user: Action 999 not found {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:12.077527 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-756d84c0-6ca4-4e69-9153-588f829d05e6 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.118824 Jul 26 04:46:12.078795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2170/4219] 10.222.0.43 () {58 vars in 1308 bytes} [Tue Jul 26 04:46:11 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e/os-instance-actions/999 => generated 66 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:46:12.090177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.090766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.097985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.104252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.105257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.105797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.150039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:12.336553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.352232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e57327b2-8dd1-4680-8b28-0469bdd2990b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.269509 Jul 26 04:46:12.352999 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2171/4220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:12 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:12.372919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '.version_select at 0x7f38b49923a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.373404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.373906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: 0878623f-57c3-4666-9d12-bb804a39763f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.388648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] HTTP exception thrown: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Request method failure captured: Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/0878623f-57c3-4666-9d12-bb804a39763f/os-instance-actions HTTP/1.1 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33GBOk1Y_3G8C_fyf-ARbkTsGlzm0s9KZK1dL6qD-xl-OOnXaxfSVH2Bx2VLyGl4sV7qy00Cqcn0uOGuKiGAZL7PBY20fLy_93YOz-DCrUUGeKbaP6qH0kgqocLQjhO16lo_w7_XE4Pr-MwazgpXwmbHCKxp_c97VytI59bxFKL29XU Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8c1b9fa094d24ca4ab78e41964f86201 Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '0878623f-57c3-4666-9d12-bb804a39763f'} Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:12.390439 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Returning 404 to user: Instance 0878623f-57c3-4666-9d12-bb804a39763f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:12.396252 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e6019b8-d673-4b14-b10f-86894f03dea2 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/0878623f-57c3-4666-9d12-bb804a39763f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.035413 Jul 26 04:46:12.398537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-746646f6-a4d1-445c-a7e1-e1d55916971b tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.526527 Jul 26 04:46:12.402549 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2050/4222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:11 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:12.409497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2172/4222] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Jul 26 04:46:12 2022] GET /compute/v2.1/servers/0878623f-57c3-4666-9d12-bb804a39763f/os-instance-actions => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:46:12.413945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.414963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.415584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.415951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.429563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.431171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.431632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.432433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.432881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.436837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.439809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.442239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.557640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.576430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.580469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.584927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe55a96d-b821-4ced-b546-78f821f08bf6 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.171349 Jul 26 04:46:12.588038 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2173/4223] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:12 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:12.594108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.594914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.602751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.603215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.604293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.611517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.647269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:12.652557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:12.673340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65ad15a9-95c6-447a-8795-cca2891e34ae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1274 microversion: 2.1 time: 0.267185 Jul 26 04:46:12.674757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2051/4224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:12 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:12.811737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a6c8a07-8d82-40c6-a27a-5a47eb1d67a5 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 204 len: 0 microversion: 2.1 time: 0.222196 Jul 26 04:46:12.812343 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2174/4225] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:12 2022] DELETE /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:12.824625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:12.831715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:12.846311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.849995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:12.853584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:12.854494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.377990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:13.379142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:13.388587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.389283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.390324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.390949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.557184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:13.571156 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b96f6d24-3c67-4434-a1f7-cf0a205ec9ec tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1528 microversion: 2.1 time: 0.754449 Jul 26 04:46:13.572713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2052/4226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:12 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1528 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:13.578203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:13.579945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:13.604233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.605834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.608036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.608647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.637210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:13.649061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a00a8f6d-3763-4e7d-8a96-03eb09e8a262 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.275521 Jul 26 04:46:13.663548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2175/4227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:13 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:13.670587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:13.671213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:13.683187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.684106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.687825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.688709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.803066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:13.819918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:13.821565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd168d536863c44b3804754cae5757c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857998361fc2488f978c76241a4adaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:13.826691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c955ec36-5666-483a-b140-7ea628ac6060 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 200 len: 1604 microversion: 2.32 time: 0.158731 Jul 26 04:46:13.828933 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2176/4228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:13 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:46:13.839176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:13.842034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:13.853925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.854543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:13.855423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:13.855971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:14.115357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:14.127689 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a75f97b-a65f-45d8-8c24-a45b431d20c6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.294683 Jul 26 04:46:14.132247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2177/4229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:13 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:14.412966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:14.432030 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7cfba54-4a5a-483c-bb6e-e176725033f7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.857947 Jul 26 04:46:14.433740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2053/4230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:13 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:14.593171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:14.594080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:14.600909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:14.601713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:14.602782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:14.603467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:14.673711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:14.675204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:14.682367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:14.683162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:14.684726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:14.685495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.066943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:15.078117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87782521-a8b3-4275-a9fc-d21634f2ed40 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1528 microversion: 2.1 time: 0.488761 Jul 26 04:46:15.078826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2178/4231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:14 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:15.084446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:15.085303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:15.092273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.100890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.101922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.102658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.128289 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] HTTP exception thrown: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Request method failure captured: Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 HTTP/1.1 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Af36n6Nb2bJb_eEFMDRluMP_Um9adVT3xRq_VBTn_gwaUNdwmIc33sMXT0qMQ60qmyOYkpcYYgADvsPPA3czx33UclyLCGnXOvzuE_OOLp0Zbo2UJ1tuL6xC8PA1ysq4c002TZQC1k5tILYx3z_1BcuUHW4sXp_vAmDVgODOmZXTI Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/857998361fc2488f978c76241a4adaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_857998361fc2488f978c76241a4adaf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d168d536863c44b3804754cae5757c58 Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '323e605a-8da8-4e43-837f-0ddd3bcaf8d4'} Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:15.130193 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Returning 404 to user: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:15.133798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb815cad-5f3f-4cf9-b434-e78414f0223c tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 404 len: 111 microversion: 2.32 time: 0.051458 Jul 26 04:46:15.139279 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2179/4232] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:15 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:46:15.167854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-679fdd0c-12a7-4ab9-80d2-531f86782330 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '.version_select at 0x7f38b48e55e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:15.206637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:15.214492 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab5490ac-1224-4569-bf90-0a50a2fc870f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.544939 Jul 26 04:46:15.215091 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2054/4233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:14 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:15.218989 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-679fdd0c-12a7-4ab9-80d2-531f86782330 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000587366" status: 204 len: 0 microversion: 2.32 time: 0.076788 Jul 26 04:46:15.223152 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2180/4234] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Jul 26 04:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000587366 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:46:15.226986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:15.227778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:15.235188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.235891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.236853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.237529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.458752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:15.459623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:15.471837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.472319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.473345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:15.473927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:15.661139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:15.679021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc9020bc-225c-4fd5-b483-7db0f5ccada1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.462234 Jul 26 04:46:15.692268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2055/4235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:15 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:16.100065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:16.101017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:16.120245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.121128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.122566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.123259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.162643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:16.212762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:16.232402 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ed1edce-ec0b-4987-adf0-16bea0498b3f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1521 microversion: 2.1 time: 0.777877 Jul 26 04:46:16.248526 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2181/4236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:15 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:16.253650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:16.255130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:16.262233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.263107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.264188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.264848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.551611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1b9fa094d24ca4ab78e41964f86201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd76a36040e4cc58f503bbb7183e98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:16.560682 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59536d2b-0f58-4e9c-b7cc-d0983aa4103d tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 200 len: 1528 microversion: 2.1 time: 0.464238 Jul 26 04:46:16.572401 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2056/4237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:16 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 1528 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:16.584975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b854839f-e032-4f64-a451-fc8f1539a560 req-b78babf9-11c5-46e0-9fbe-382ebd1d469c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33df39-59f2-4fb6-9829-3c625766287e", "name": "network-vif-plugged", "status": "completed", "tag": "8cc586bd-cf07-4658-941c-487eed48a2e3"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:16.600065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b854839f-e032-4f64-a451-fc8f1539a560 req-b78babf9-11c5-46e0-9fbe-382ebd1d469c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.600768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b854839f-e032-4f64-a451-fc8f1539a560 req-b78babf9-11c5-46e0-9fbe-382ebd1d469c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.617568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b854839f-e032-4f64-a451-fc8f1539a560 req-b78babf9-11c5-46e0-9fbe-382ebd1d469c service nova] Creating event network-vif-plugged:8cc586bd-cf07-4658-941c-487eed48a2e3 for instance 4e33df39-59f2-4fb6-9829-3c625766287e on n-h2-848886-16 Jul 26 04:46:16.624436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b854839f-e032-4f64-a451-fc8f1539a560 req-b78babf9-11c5-46e0-9fbe-382ebd1d469c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050556 Jul 26 04:46:16.625250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2057/4238] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:16.642658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aba0dc4f-fa7c-48f4-ba77-35be3bf740db req-c27c8947-afe3-48e0-8dbc-7638822b63d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46e22e2-ef66-4660-bc3e-d8ffd494a95e", "name": "network-vif-deleted", "tag": "80cbb559-1b95-4918-a4b8-298c0a5e0430"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:16.652928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aba0dc4f-fa7c-48f4-ba77-35be3bf740db req-c27c8947-afe3-48e0-8dbc-7638822b63d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.653388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aba0dc4f-fa7c-48f4-ba77-35be3bf740db req-c27c8947-afe3-48e0-8dbc-7638822b63d7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.670830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aba0dc4f-fa7c-48f4-ba77-35be3bf740db req-c27c8947-afe3-48e0-8dbc-7638822b63d7 service nova] Creating event network-vif-deleted:80cbb559-1b95-4918-a4b8-298c0a5e0430 for instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e on n-h1-848886-16 Jul 26 04:46:16.688645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:16.690517 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aba0dc4f-fa7c-48f4-ba77-35be3bf740db req-c27c8947-afe3-48e0-8dbc-7638822b63d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064019 Jul 26 04:46:16.691673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2058/4239] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:16.702904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:16.704006 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d91d30bf-bc89-4351-bb5e-b2ada33589ad tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.454088 Jul 26 04:46:16.704961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:16.714391 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2182/4240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:16 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:16.717903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.718531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:16.719520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:16.720072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.256884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:17.257801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:17.274513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.279213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.280144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.281274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.367972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:17.381806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de663222-ee5b-4c6a-803f-6a59e27ed630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.685364 Jul 26 04:46:17.385300 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2059/4241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:16 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:17.585532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:17.586416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] [instance: a46e22e2-ef66-4660-bc3e-d8ffd494a95e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:17.594583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.595346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.596340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.596984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.614459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] HTTP exception thrown: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Request method failure captured: Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e HTTP/1.1 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33GBOk1Y_3G8C_fyf-ARbkTsGlzm0s9KZK1dL6qD-xl-OOnXaxfSVH2Bx2VLyGl4sV7qy00Cqcn0uOGuKiGAZL7PBY20fLy_93YOz-DCrUUGeKbaP6qH0kgqocLQjhO16lo_w7_XE4Pr-MwazgpXwmbHCKxp_c97VytI59bxFKL29XU Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bd76a36040e4cc58f503bbb7183e98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4bd76a36040e4cc58f503bbb7183e98f Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-988118592 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8c1b9fa094d24ca4ab78e41964f86201 Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-988118592-project Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'a46e22e2-ef66-4660-bc3e-d8ffd494a95e'} Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:17.616402 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. Jul 26 04:46:17.620012 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:17.622323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] Returning 404 to user: Instance a46e22e2-ef66-4660-bc3e-d8ffd494a95e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:17.623846 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2c87c099-0655-41d0-ab1b-19b3aafffab1 tempest-InstanceActionsNegativeTestJSON-988118592 tempest-InstanceActionsNegativeTestJSON-988118592-project] 10.222.0.43 "GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e" status: 404 len: 111 microversion: 2.1 time: 0.044238 Jul 26 04:46:17.628333 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2060/4242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:17 2022] GET /compute/v2.1/servers/a46e22e2-ef66-4660-bc3e-d8ffd494a95e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:46:17.711917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:17.729975 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b622469-83fc-437e-a63e-c1d7b6d0992c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1498 microversion: 2.1 time: 0.478198 Jul 26 04:46:17.738053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2183/4243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:17 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1498 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:17.755559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:17.756355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:17.766668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:17.770899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.771363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.774334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.774938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.783010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:17.783894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:17.792349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.796436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.801542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.805016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:17.866470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:17.915628 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52285c86-7068-4d1b-aee0-b3a6069702c7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.158480 Jul 26 04:46:17.917512 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2184/4244] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jul 26 04:46:17 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:17.940378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39e1f704-b17b-4bb0-a77e-849a786ce91e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:17.959329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39e1f704-b17b-4bb0-a77e-849a786ce91e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:17.959965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39e1f704-b17b-4bb0-a77e-849a786ce91e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.086954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39e1f704-b17b-4bb0-a77e-849a786ce91e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Going to try to start instance {{(pid=119488) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 04:46:18.177525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39e1f704-b17b-4bb0-a77e-849a786ce91e tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "POST /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e/action" status: 202 len: 0 microversion: 2.1 time: 0.248546 Jul 26 04:46:18.180277 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2185/4245] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:17 2022] POST /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:46:18.197301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:18.198752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:18.207803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:18.208890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.210347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:18.211807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.557704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:18.567912 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee0d48df-8c57-48bd-990c-5195b85edbd4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1309 microversion: 2.1 time: 0.833825 Jul 26 04:46:18.568876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2061/4246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:17 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1309 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:18.573735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:18.574768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:18.587876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:18.588331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.589300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:18.590130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.750553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:18.764384 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9cd2c959-66ee-4a05-b656-77051ab751a0 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1507 microversion: 2.1 time: 0.574487 Jul 26 04:46:18.765002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2186/4247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:18 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:18.775724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b7b3c912-5b46-45f2-b175-df5388e84cdb req-4c9b7d59-1742-4550-b732-f7237de96f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f78cb3-ded8-4fa4-888f-bd0ea2b669d4", "tag": "3bfbfffe-4ebb-4571-8c39-b48cebd8cb39"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:18.788401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b7b3c912-5b46-45f2-b175-df5388e84cdb req-4c9b7d59-1742-4550-b732-f7237de96f86 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:18.789273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b7b3c912-5b46-45f2-b175-df5388e84cdb req-4c9b7d59-1742-4550-b732-f7237de96f86 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:18.802449 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b7b3c912-5b46-45f2-b175-df5388e84cdb req-4c9b7d59-1742-4550-b732-f7237de96f86 service nova] Creating event network-changed:3bfbfffe-4ebb-4571-8c39-b48cebd8cb39 for instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 on n-h1-848886-16 Jul 26 04:46:18.807634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b7b3c912-5b46-45f2-b175-df5388e84cdb req-4c9b7d59-1742-4550-b732-f7237de96f86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036534 Jul 26 04:46:18.808461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2187/4248] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:19.314632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:19.324106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9a3ef78-b9a9-4f7d-a3a3-6d4231bc4190 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.753989 Jul 26 04:46:19.324685 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2062/4249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:18 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:19.420063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:19.420911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:19.429030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.429827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.430811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.432185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.448896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:19.534573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lazy-loading 'services' on Instance uuid e04ec941-3381-4c35-87f8-c8fab9a27640 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:46:19.591166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:19.592900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:19.602942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.604304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.613889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.615048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.628474 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bc441b9-661c-432f-aa02-dfa31e595aa4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments/4342eab9-32f7-43f0-8a70-5cbd216adf70" status: 202 len: 0 microversion: 2.1 time: 0.212487 Jul 26 04:46:19.633969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2188/4250] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:46:19 2022] DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments/4342eab9-32f7-43f0-8a70-5cbd216adf70 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:19.787515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:19.788229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:19.795584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.796185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.796975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:19.797420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:19.948433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:19.959070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6fbc82b-0270-4a8d-8102-cd47d278b985 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1489 microversion: 2.1 time: 0.373398 Jul 26 04:46:19.978207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2063/4251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:19 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1489 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:20.153985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1720241012", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:20.276918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=18 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:20.295962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:46:21.037706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:21.055671 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f8d19cc-6b13-4e0c-afa4-53277435f3b3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1507 microversion: 2.1 time: 1.272507 Jul 26 04:46:21.062066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=24 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:21.076121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2189/4252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:19 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1507 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:21.086746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:21.087667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:21.096567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:21.097355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:21.098518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:21.099696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:21.985880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:46:21.986558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:46:21.987333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:46:21.987968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:46:21.988570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:46:22.004701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:22.009679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:22.010873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:22.011562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:22.057376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:46:22.070252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:46:22.107713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:46:22.110114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:46:22.203538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db47377c-f5a4-436c-bd9a-28a087b981a6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053639 Jul 26 04:46:22.205763 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2064/4253] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:46:22.219473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:22.220111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:22.235974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:22.240912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:22.241894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:22.242553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:22.288489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:22.312469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7a4ecef-5d42-4a00-acc3-569855f9450b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 1.234210 Jul 26 04:46:22.331713 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2190/4254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:21 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:22.348985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4d5673c-f0e0-449a-9438-c7ba086d4dc1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:22.349855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4d5673c-f0e0-449a-9438-c7ba086d4dc1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:22.662649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e4d5673c-f0e0-449a-9438-c7ba086d4dc1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:22.675551 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4d5673c-f0e0-449a-9438-c7ba086d4dc1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1209 microversion: 2.1 time: 0.342449 Jul 26 04:46:22.692198 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2191/4255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:22 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1209 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:23.047640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:23.057157 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cefa009a-70ed-4580-82be-73640e85d3b4 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1507 microversion: 2.1 time: 0.844754 Jul 26 04:46:23.062847 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2065/4256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:22 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:23.340503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:23.342886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:23.364054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:23.365255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:23.367871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:23.368571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:23.696578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:23.701280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:23.715178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:23.720630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:23.723078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:23.724731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:23.987558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:24.011218 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95568fac-abbb-4b83-9200-6b378be04612 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1261 microversion: 2.1 time: 0.310908 Jul 26 04:46:24.012046 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2066/4257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:23 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1261 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:24.086411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:24.087703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:24.094678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:24.100194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:24.102009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:24.104909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:24.105901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:24.124794 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c154076b-7df0-4253-bf4e-f98c071c522e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.789385 Jul 26 04:46:24.125409 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2192/4258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:23 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:25.040623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:25.042555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:25.056163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.067678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.073147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.073612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.256113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:25.272418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-845f0bef-0a5b-46ef-9261-a36473febbb2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1511 microversion: 2.1 time: 1.187042 Jul 26 04:46:25.273771 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2067/4259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:24 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1511 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:25.286361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:25.310597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:25.329443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.331198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.335427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.336091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.669498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:25.680496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2717d4fb-b2b5-415e-8f3a-d2b99c83e905 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1267 microversion: 2.1 time: 0.647519 Jul 26 04:46:25.681904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2193/4260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:25 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1267 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:25.693927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9544b1da-d66c-46af-8177-440fe5782da2 req-1afe2626-41ed-4c8b-b992-fa1562d17af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f78cb3-ded8-4fa4-888f-bd0ea2b669d4", "name": "network-vif-plugged", "status": "completed", "tag": "3bfbfffe-4ebb-4571-8c39-b48cebd8cb39"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:25.711200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9544b1da-d66c-46af-8177-440fe5782da2 req-1afe2626-41ed-4c8b-b992-fa1562d17af6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.711982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9544b1da-d66c-46af-8177-440fe5782da2 req-1afe2626-41ed-4c8b-b992-fa1562d17af6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.774214 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9544b1da-d66c-46af-8177-440fe5782da2 req-1afe2626-41ed-4c8b-b992-fa1562d17af6 service nova] Creating event network-vif-plugged:3bfbfffe-4ebb-4571-8c39-b48cebd8cb39 for instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 on n-h1-848886-16 Jul 26 04:46:25.787149 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9544b1da-d66c-46af-8177-440fe5782da2 req-1afe2626-41ed-4c8b-b992-fa1562d17af6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099882 Jul 26 04:46:25.788897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2194/4261] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:25.835822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:25.860152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:25.862043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.servers [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Removing options 'limit' from query {{(pid=119488) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 04:46:25.865411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:25.869980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.872218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.874933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.875634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.877372 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea70f328-b3a7-44a5-a442-3294b0b660f8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.087114 Jul 26 04:46:25.878241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2195/4262] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Jul 26 04:46:25 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:46:25.900205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:25.902536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:25.919230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.919967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:25.921511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:25.922305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.105436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:26.121440 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3625363b-7221-4822-b460-17311e5f6630 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.846202 Jul 26 04:46:26.124134 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2068/4263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:25 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:26.204814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:26.222046 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71738d52-8995-4fe3-8951-3e21625e5ea3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1511 microversion: 2.1 time: 0.328437 Jul 26 04:46:26.234183 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2196/4264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:25 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:26.253198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:26.253720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:26.280113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.281212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.282061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.282534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.705504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:26.706427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:26.720131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.720880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.721908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.722555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.870130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:26.884898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61911b3e-ce28-4014-a63b-4c443751390f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1512 microversion: 2.1 time: 0.636353 Jul 26 04:46:26.885958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2069/4265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:26 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1512 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:26.921246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:26.922312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:26.939834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.940673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:26.941719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:26.942398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.153785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:27.161912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10ffe0e5-3fa3-4502-b7d1-002a25b1e69b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.460071 Jul 26 04:46:27.162525 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2197/4266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:26 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:27.174106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:27.174740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:27.196452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.196909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.197678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.210663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.446061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:27.454729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c035c7e4-744b-48e3-affa-a9614a0fe8e2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1314 microversion: 2.1 time: 0.291116 Jul 26 04:46:27.458872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2198/4267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:27 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:27.709908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:27.718828 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5dbf5a77-5edb-463b-99ca-b6bbf01129ae tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1513 microversion: 2.1 time: 0.801872 Jul 26 04:46:27.727608 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2070/4268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:26 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1513 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:27.757650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:27.770730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:27.786188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:27.826249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:27.839803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:27.840480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:27.867209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.867670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.878507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.879657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.898247 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] HTTP exception thrown: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Request method failure captured: Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 HTTP/1.1 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Af36n6Nb2bJb_eEFMDRluMP_Um9adVT3xRq_VBTn_gwaUNdwmIc33sMXT0qMQ60qmyOYkpcYYgADvsPPA3czx33UclyLCGnXOvzuE_OOLp0Zbo2UJ1tuL6xC8PA1ysq4c002TZQC1k5tILYx3z_1BcuUHW4sXp_vAmDVgODOmZXTI Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/857998361fc2488f978c76241a4adaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_857998361fc2488f978c76241a4adaf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d168d536863c44b3804754cae5757c58 Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '323e605a-8da8-4e43-837f-0ddd3bcaf8d4'} Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:27.900229 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.904136 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.906920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Returning 404 to user: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:27.908009 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89f6f854-83be-44ac-a4ea-30da7599fc95 tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "DELETE /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 404 len: 111 microversion: 2.32 time: 0.096445 Jul 26 04:46:27.912580 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2071/4269] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:46:27 2022] DELETE /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:46:27.919332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:27.920280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] [instance: 323e605a-8da8-4e43-837f-0ddd3bcaf8d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:27.930795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.931576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.932608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:27.933313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:27.950666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] HTTP exception thrown: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Request method failure captured: Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 HTTP/1.1 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Af36n6Nb2bJb_eEFMDRluMP_Um9adVT3xRq_VBTn_gwaUNdwmIc33sMXT0qMQ60qmyOYkpcYYgADvsPPA3czx33UclyLCGnXOvzuE_OOLp0Zbo2UJ1tuL6xC8PA1ysq4c002TZQC1k5tILYx3z_1BcuUHW4sXp_vAmDVgODOmZXTI Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/857998361fc2488f978c76241a4adaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857998361fc2488f978c76241a4adaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_857998361fc2488f978c76241a4adaf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 857998361fc2488f978c76241a4adaf7 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1297677636 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d168d536863c44b3804754cae5757c58 Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TaggedBootDevicesTest-1297677636-project Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '323e605a-8da8-4e43-837f-0ddd3bcaf8d4'} Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:27.952732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. Jul 26 04:46:27.956152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:27.958777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] Returning 404 to user: Instance 323e605a-8da8-4e43-837f-0ddd3bcaf8d4 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:27.959857 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d45a8326-50f5-48b7-83cc-f8414b0eb5df tempest-TaggedBootDevicesTest-1297677636 tempest-TaggedBootDevicesTest-1297677636-project] 10.222.0.43 "GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4" status: 404 len: 111 microversion: 2.32 time: 0.045766 Jul 26 04:46:27.964691 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2072/4270] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:46:27 2022] GET /compute/v2.1/servers/323e605a-8da8-4e43-837f-0ddd3bcaf8d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:46:28.189742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:28.190766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:28.215082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.216496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.217683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.218485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.547714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.548989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.550323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.551698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.702698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:28.712961 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-194a2792-f44e-4be7-9b22-2feb449842da tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.527286 Jul 26 04:46:28.739589 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2073/4271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:28 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:28.753740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:28.760800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:28.763947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:28.784743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.785423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.786543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.787150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.873509 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36297cad-4dcb-4f7b-a827-8d0597f36c30 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 1.122032 Jul 26 04:46:28.875848 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2199/4272] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jul 26 04:46:27 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:28.891461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:28.892533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:28.916211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.916814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:28.917743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:28.919922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:29.173674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:29.191252 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c623efee-1627-4767-b7d5-a032c5430d4f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1502 microversion: 2.1 time: 0.450233 Jul 26 04:46:29.194861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2074/4273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:28 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1502 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:29.225420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:29.226131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:29.258695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:29.260569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:29.267816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:29.268537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:29.369929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'flavor' on Instance uuid 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:46:29.583868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:29.706739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:29.721031 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27bf6adb-8cb3-4932-8a38-c3657b1dbcac tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1511 microversion: 2.1 time: 0.831168 Jul 26 04:46:29.722652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2200/4274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:28 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1511 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:29.761864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:29.765715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:29.793926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:29.796944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:29.800484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:29.805137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:29.953931 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5503fd2-4305-439e-a78c-8cc0e4e6f00f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4/action" status: 202 len: 0 microversion: 2.1 time: 0.731569 Jul 26 04:46:29.956383 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2075/4275] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:29 2022] POST /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:29.996937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:30.006282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:30.025742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.026436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.027341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.029321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.646624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:30.660039 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85189d93-3aa0-4b4d-b260-8c82e5c2a06b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.911352 Jul 26 04:46:30.675720 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2201/4276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:29 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:30.681032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c455652-873e-4048-ac6d-0d34bd565a3a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:30.690668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c455652-873e-4048-ac6d-0d34bd565a3a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.693274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c455652-873e-4048-ac6d-0d34bd565a3a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.729584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8c455652-873e-4048-ac6d-0d34bd565a3a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Going to try to stop instance {{(pid=119488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:46:30.823185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8c455652-873e-4048-ac6d-0d34bd565a3a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action" status: 202 len: 0 microversion: 2.1 time: 0.145593 Jul 26 04:46:30.827043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2202/4277] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:30 2022] POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:30.834353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:30.835426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:30.844467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.845209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.846523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.847944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.899945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:30.916692 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8d29f86-bca1-4517-94b2-45627e77d87f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1512 microversion: 2.1 time: 0.945871 Jul 26 04:46:30.930194 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2076/4278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:29 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1512 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:30.930738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fb010f6a-cb73-4431-b540-f97bc6495f23 req-82b3dd7b-b484-40ad-bb4e-19bd1359863b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b9dccc-78d0-4d3c-9fb6-690f0f6df77f", "tag": "ecd4fbed-0e27-46da-a4e6-6cc0b36b292c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:30.957772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fb010f6a-cb73-4431-b540-f97bc6495f23 req-82b3dd7b-b484-40ad-bb4e-19bd1359863b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:30.959019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fb010f6a-cb73-4431-b540-f97bc6495f23 req-82b3dd7b-b484-40ad-bb4e-19bd1359863b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:30.986535 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fb010f6a-cb73-4431-b540-f97bc6495f23 req-82b3dd7b-b484-40ad-bb4e-19bd1359863b service nova] Creating event network-changed:ecd4fbed-0e27-46da-a4e6-6cc0b36b292c for instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f on n-h2-848886-16 Jul 26 04:46:30.995182 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fb010f6a-cb73-4431-b540-f97bc6495f23 req-82b3dd7b-b484-40ad-bb4e-19bd1359863b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075239 Jul 26 04:46:30.996055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2077/4279] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:31.002088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:31.011053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:31.025420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.033296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.034594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.035197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.409997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:31.424390 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db379e42-9bc2-4570-9ac8-0cbc7ddb80de tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.425419 Jul 26 04:46:31.426010 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2078/4280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:30 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:31.433695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:31.434813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:31.442467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.443170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.444202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.444870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.471741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:31.494551 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46582fc3-5993-4245-8170-d56a5c3a4b05 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.652241 Jul 26 04:46:31.495633 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2203/4281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:30 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:31.684542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:31.685369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:31.699005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.700303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.700944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:31.701387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:31.936947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:31.952081 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6eecc74b-cde9-4285-bc03-f07ba7f4ae9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.271143 Jul 26 04:46:31.953870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2204/4282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:31 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:31.990074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:32.004580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16825b63-7902-4f90-8a40-3fb282e58251 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1513 microversion: 2.1 time: 0.577099 Jul 26 04:46:32.014798 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2079/4283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:31 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1513 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:32.042543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:32.051088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:32.056285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:32.064836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.065373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.066385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.067113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.118256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:32.123880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:32.184339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:32.213025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.213908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.452761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:32.453868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:32.465551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:32.469744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:32.473968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.477261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.481660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.483135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.795866 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45400643-9555-45f9-ad17-abec30a27d8c tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.759892 Jul 26 04:46:32.797031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2205/4284] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:46:32 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:32.802930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:32.803897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:32.822782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.823834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.829989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:32.830691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:32.897769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:32.915585 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11b44bb0-349d-4f08-9a3f-08e3658bfea0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.469853 Jul 26 04:46:32.916180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2080/4285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:32 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:32.927717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:32.933194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:32.938402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:33.179936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:33.182038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:33.183383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:33.184214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:33.429601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:33.536428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf1d7c1b-ecf9-4201-af23-73807e7903ca tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.618807 Jul 26 04:46:33.537392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2081/4286] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Jul 26 04:46:32 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:33.545263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:33.546042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:33.554727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:33.555441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:33.556393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:33.556984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.153939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:34.170335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b9d8c17f-39ba-4f7f-a062-2be969ddcab8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 1.371539 Jul 26 04:46:34.173304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2206/4287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:32 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:34.205256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:34.216989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:34.220007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:34.231031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:34.242032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.242789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.245291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.248859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.415793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:34.526432 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4c9ec0a-8d70-43f5-a29f-d1c998a88bf6 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.344963 Jul 26 04:46:34.532644 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2207/4288] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Jul 26 04:46:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:34.547766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:34.550787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:34.571435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:34.581815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.583136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.584912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.586669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.587998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df694aef-c791-43f0-89f7-3ac9bf4bc05d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 1.047225 Jul 26 04:46:34.589110 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2082/4289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:33 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:34.606208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:34.617663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:34.621566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:34.636319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.636646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.643877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:34.646500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:34.890944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:35.034198 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f7c239f4-1020-448c-93b2-61706bbda7f5 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.441105 Jul 26 04:46:35.035496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2083/4290] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Jul 26 04:46:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:35.058194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:35.075343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:35.076351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': '-137028632', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:35.087932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.088477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.090059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.090059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.247600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:35.265412 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de4a54ac-46a5-41af-8095-86b83d232e9a tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.731144 Jul 26 04:46:35.268379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2208/4291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:34 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:35.282933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:35.287345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:35.299045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.301076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.305076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.306371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.369736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:35.514075 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dabd2fd0-42a4-4aa6-a9a4-3fa8a769a148 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-137028632" status: 200 len: 345 microversion: 2.1 time: 0.465383 Jul 26 04:46:35.515440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2084/4292] 10.222.0.43 () {58 vars in 1156 bytes} [Tue Jul 26 04:46:35 2022] GET /compute/v2.1/servers?name=-137028632 => generated 345 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:46:35.529100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:35.534936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:35.535950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:35.541558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.542349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.543904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.544565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.646363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:35.713706 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71fddd89-41f8-4883-8e48-5fe6a6177656 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.189167 Jul 26 04:46:35.714757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2085/4293] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jul 26 04:46:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:35.721253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:35.722271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:35.730268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.731630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:35.732954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:35.733640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.046038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:36.064355 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e228def-9119-4641-8f73-b3b8f5295ce8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.347426 Jul 26 04:46:36.071203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2086/4294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:35 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:36.089341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:36.101737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:36.107164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-13702863', 'deleted': False, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7'} {{(pid=119487) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:46:36.131734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.134651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.137216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.137216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.155938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:36.165946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e29a2681-d8b7-4122-bafa-d99ee6e39b12 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.896452 Jul 26 04:46:36.171996 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2209/4295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:35 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:36.290647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:36.291966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:36.301889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.310396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.311486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.312693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.341738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.multi_cell_list [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:46:36.457648 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42ede410-a517-47ec-bf34-b26b7f63d030 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-13702863" status: 200 len: 345 microversion: 2.1 time: 0.385124 Jul 26 04:46:36.466957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2087/4296] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 26 04:46:36 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-13702863 => generated 345 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:36.473072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:36.473931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:36.480673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.481448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.482521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.483196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.513207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:36.616055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88b09f29-f5fe-4642-a7e9-0e37f8c0ff3a tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 204 len: 0 microversion: 2.1 time: 0.146235 Jul 26 04:46:36.617986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2088/4297] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:36 2022] DELETE /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:36.633776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:36.635141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:36.644563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:36.647593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.649101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.650460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:36.650951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:36.663198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:36.672846 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24aec682-37aa-4340-afa7-5dd0adc1c69c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.386182 Jul 26 04:46:36.675091 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2210/4298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:36 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:36.693326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:36.965267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:36.976491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59921c1d-f807-474e-9e1b-9b250a03948f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1519 microversion: 2.1 time: 0.350636 Jul 26 04:46:36.977434 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2089/4299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:36 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:37.097159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:37.097769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:37.104865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.105588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:37.107535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.107979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:37.196708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:37.197322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:37.207698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.208153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:37.208938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.209378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:37.440341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:37.448654 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7569c54e-08f6-4b9d-a453-e6173ab26bae tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.256489 Jul 26 04:46:37.462186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2090/4300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:37 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:37.517539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:37.531895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3da6346-8324-46bb-9d85-5a166abcaea9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.438521 Jul 26 04:46:37.533410 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2211/4301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:37 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:37.696540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:37.697779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:37.705496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.706235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:37.707242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:37.707871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.003842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:38.004829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:38.016036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.016814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.018983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.019718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.063998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:38.075300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29924419-eb67-410b-a8db-858a0b98056b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.382052 Jul 26 04:46:38.076586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2091/4302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:37 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:38.413826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:38.422991 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a9fbdcf-0512-4897-88e1-1a8c4a740bea tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1519 microversion: 2.1 time: 0.426784 Jul 26 04:46:38.433376 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2212/4303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:37 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:38.478630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:38.479617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:38.487916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.488581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.489582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.490206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.553261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:38.554567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:38.569547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.570006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.570828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:38.571264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:38.909172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:38.921870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce87feee-1ed2-4100-be75-92a08d93bd3a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.453765 Jul 26 04:46:38.924342 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2092/4304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:38 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:39.070069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-41e8772c-e5c6-41f6-85ae-3dabba23ec02 req-67af9198-d426-4aa6-b218-fd917cbe877b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b9dccc-78d0-4d3c-9fb6-690f0f6df77f", "name": "network-vif-plugged", "status": "completed", "tag": "ecd4fbed-0e27-46da-a4e6-6cc0b36b292c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:39.092624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-41e8772c-e5c6-41f6-85ae-3dabba23ec02 req-67af9198-d426-4aa6-b218-fd917cbe877b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:39.096538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-41e8772c-e5c6-41f6-85ae-3dabba23ec02 req-67af9198-d426-4aa6-b218-fd917cbe877b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:39.120361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-41e8772c-e5c6-41f6-85ae-3dabba23ec02 req-67af9198-d426-4aa6-b218-fd917cbe877b service nova] Creating event network-vif-plugged:ecd4fbed-0e27-46da-a4e6-6cc0b36b292c for instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f on n-h2-848886-16 Jul 26 04:46:39.136515 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-41e8772c-e5c6-41f6-85ae-3dabba23ec02 req-67af9198-d426-4aa6-b218-fd917cbe877b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070859 Jul 26 04:46:39.138519 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2093/4305] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:46:39.143906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:39.145289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:39.156693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:39.164957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:39.175508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:39.176303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:39.412770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:39.426263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c033a5a-5163-4768-80a2-6d0c82d33731 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.285870 Jul 26 04:46:39.429131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2094/4306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:39 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:39.454038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:39.454938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:39.462738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:39.463194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:39.463983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:39.464474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:39.951276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:39.973014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:39.974776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fd6e9de-f771-4cb3-abcd-a4d8d41f5e63 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 1.410169 Jul 26 04:46:39.975472 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2213/4307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:38 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:39.983457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:39.985609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:39.994339 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79d0b094-7570-46e1-82bd-6c322c39ec47 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1519 microversion: 2.1 time: 0.544912 Jul 26 04:46:39.995511 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2095/4308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:39 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:39.998993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:40.007592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:40.014482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:40.015251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:40.451011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:40.451907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:40.460000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:40.462921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:40.463913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:40.471025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:40.815790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:40.836569 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9441fd47-1a51-4fe4-bfa5-7d71dcc4850c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1678 microversion: 2.1 time: 0.390059 Jul 26 04:46:40.838196 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2096/4309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:40 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:40.999701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:41.001263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:41.016255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.017049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.018842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.019767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.229143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:41.256199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c40ca4fa-c716-4a40-a9bb-1f55d2987731 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 1.276807 Jul 26 04:46:41.273236 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2214/4310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:39 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:41.288617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:41.292660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:41.310608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.311464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.312672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.313397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.416764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.418832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.429504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lazy-loading 'fault' on Instance uuid 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:46:41.479788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:41.488343 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca68c59e-8ace-4b2b-9380-f99f4fc13aca tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1309 microversion: 2.1 time: 0.494421 Jul 26 04:46:41.499108 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2097/4311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:40 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:41.504042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-fa2db9e9-c93c-4d37-9dfe-1f017b98518f req-843fe536-bd58-42ba-8d2b-1d7aa302fd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bae3a64-daf3-4bde-93de-d7b4f45e9fb9", "name": "network-vif-deleted", "tag": "f7116bfa-917a-4218-8cc6-1633908d61c4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:41.524142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fa2db9e9-c93c-4d37-9dfe-1f017b98518f req-843fe536-bd58-42ba-8d2b-1d7aa302fd73 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.524595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-fa2db9e9-c93c-4d37-9dfe-1f017b98518f req-843fe536-bd58-42ba-8d2b-1d7aa302fd73 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.550958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-fa2db9e9-c93c-4d37-9dfe-1f017b98518f req-843fe536-bd58-42ba-8d2b-1d7aa302fd73 service nova] Creating event network-vif-deleted:f7116bfa-917a-4218-8cc6-1633908d61c4 for instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 on n-h1-848886-16 Jul 26 04:46:41.576704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:41.577070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-fa2db9e9-c93c-4d37-9dfe-1f017b98518f req-843fe536-bd58-42ba-8d2b-1d7aa302fd73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071223 Jul 26 04:46:41.578353 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2098/4312] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:41.600331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69355d0d-d5e3-477c-b833-69cb295a9249 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 200 len: 1311 microversion: 2.1 time: 0.312927 Jul 26 04:46:41.601391 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2215/4313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:41 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:41.863697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:41.864404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:41.882332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.883570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:41.889423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:41.891809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.175775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:42.186363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59c691f5-7068-4cce-8d86-815a0a8743c4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1655 microversion: 2.1 time: 0.328908 Jul 26 04:46:42.188215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2099/4314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:41 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1655 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:42.208950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2720ea1b-1932-443a-a2ed-d34ce74a9570 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:42.226124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:42.250314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2720ea1b-1932-443a-a2ed-d34ce74a9570 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.252761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2720ea1b-1932-443a-a2ed-d34ce74a9570 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.281328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:42.282343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:42.293049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.295566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.296619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.300182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.308456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2720ea1b-1932-443a-a2ed-d34ce74a9570 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Going to try to start instance {{(pid=119488) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 04:46:42.447967 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2720ea1b-1932-443a-a2ed-d34ce74a9570 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action" status: 202 len: 0 microversion: 2.1 time: 0.244029 Jul 26 04:46:42.454431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2216/4315] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:46:42 2022] POST /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:46:42.468073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:42.470131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:42.487372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.488093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.490189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.492040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.661323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:42.670873 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3a41730-5d5f-45ae-a2c0-cce24859fa32 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.394732 Jul 26 04:46:42.680443 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2100/4316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:42 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:42.695574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:42.696317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:42.708562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.709016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.712349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:42.715531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:42.948021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:42.963074 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8be3dac8-627d-4421-8655-e0235462bb58 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1664 microversion: 2.1 time: 0.506553 Jul 26 04:46:42.985097 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2217/4317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:42 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1664 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:43.002671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.007850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.022140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.022907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.023908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.024550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.046813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] HTTP exception thrown: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Request method failure captured: Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 HTTP/1.1 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33FhW1mn5t_F6IyRqmnNmCB2z3eCpHfze2NSPFMzYQz3v4NjRF96KFfhgveguWmx361fbquE6NSs74Xss7dW4f8kVY_f_NvoIVm6Z16nxu_e2ZEjKfndcn-LGYlpu1o5o_ehl9WzRInujJzQB6LGuNBm7cpN-W9PcRXmu_wPvtSNNQg Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 855168c8fff940c39c68ce8ad5318e71 Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '5bae3a64-daf3-4bde-93de-d7b4f45e9fb9'} Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:43.050831 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. Jul 26 04:46:43.054994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:43.057811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Returning 404 to user: Instance 5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:43.059257 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1ab2b06-1a7f-4c44-a6e3-b36df1f87d85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9" status: 404 len: 111 microversion: 2.1 time: 0.072705 Jul 26 04:46:43.060412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2218/4318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:42 2022] GET /compute/v2.1/servers/5bae3a64-daf3-4bde-93de-d7b4f45e9fb9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:46:43.075971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.076714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.096834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.097568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.099762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.109057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.157961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:43.245619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:43.330783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-732813b5-7afd-4948-8e70-43d452833ca3 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 204 len: 0 microversion: 2.1 time: 0.262867 Jul 26 04:46:43.335865 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2219/4319] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:43 2022] DELETE /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:43.346455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.347578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.356669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.357482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.358661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.359308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.421266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:43.431964 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-be96fde8-57ee-470a-8d8c-5143cb024252 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1489 microversion: 2.1 time: 0.753441 Jul 26 04:46:43.437201 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2101/4320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:42 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1489 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:43.469785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.470546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.492547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.494673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.497058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.497516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.822366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:43.833649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:43.853922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6f518422-0698-47b8-9da7-fd85f00f4ae5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1489 microversion: 2.1 time: 0.397344 Jul 26 04:46:43.858073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a6bd322-ac23-48e5-a63f-3e400473648f tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1518 microversion: 2.1 time: 0.519575 Jul 26 04:46:43.861744 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2102/4321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:43 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1489 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:43.863162 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2220/4322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:43 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1518 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:43.885749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.890694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:43.895263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.899651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:43.928587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.928797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.930760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.931406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.932537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.933520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:43.937820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:43.939959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.306535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:44.514807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:44.523735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3ddaeea-d9c8-4e02-90cf-eea441675ad3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.659599 Jul 26 04:46:44.537872 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2103/4323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:43 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:44.543627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:44.544743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:44.551905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.552604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.553570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.554188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.671033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:44.687354 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1836ed8d-c465-4a29-b15b-e9627481ed4b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1489 microversion: 2.1 time: 0.809547 Jul 26 04:46:44.705827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2221/4324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:43 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1489 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:44.717228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:44.717747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:44.724572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.725036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.725821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.726466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.768915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:44.921338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59a8e69d-311f-4eff-97ce-376343138a22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 204 len: 0 microversion: 2.1 time: 0.214063 Jul 26 04:46:44.922311 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2222/4325] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:44 2022] DELETE /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:44.930218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:44.931059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:44.940112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.940631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:44.941524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:44.941983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:45.541101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:45.548909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4dcfd7f-f216-47e0-8be6-46d02df18117 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1518 microversion: 2.1 time: 0.625139 Jul 26 04:46:45.549501 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2223/4326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:44 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1518 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:45.562878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:45.563502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:45.583245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:45.583706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:45.584499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:45.584956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:45.749788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:45.769624 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d131be4-b01b-4042-bd8a-8071ff941e07 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1664 microversion: 2.1 time: 1.224206 Jul 26 04:46:45.778732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2104/4327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:44 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1664 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:45.783596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:45.784223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:45.803846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:45.808900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:45.818894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:45.819354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.045614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:46.059849 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20b02ccf-824c-4178-99d4-09528702c1d4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1495 microversion: 2.1 time: 0.508544 Jul 26 04:46:46.061127 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2224/4328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:45 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1495 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:46.239125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:46.375478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:46.409689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e964182-a55a-44b8-922d-20ced7678be7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.629640 Jul 26 04:46:46.410320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2105/4329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:45 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:46.590933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:46.592155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:46.617112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:46.617843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.620779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f3b74cf0-bc67-492a-a4a3-a3188d625468 req-57d992a5-5d0b-4f12-a2bb-97cedc472985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f311811-dcc0-4f47-83df-98a0f4361481", "name": "network-vif-deleted", "tag": "1db94b1f-e3bc-4140-88a5-2ef945ed4d51"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:46.622516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:46.622974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.673486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f3b74cf0-bc67-492a-a4a3-a3188d625468 req-57d992a5-5d0b-4f12-a2bb-97cedc472985 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:46.682475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f3b74cf0-bc67-492a-a4a3-a3188d625468 req-57d992a5-5d0b-4f12-a2bb-97cedc472985 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.707399 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f3b74cf0-bc67-492a-a4a3-a3188d625468 req-57d992a5-5d0b-4f12-a2bb-97cedc472985 service nova] Creating event network-vif-deleted:1db94b1f-e3bc-4140-88a5-2ef945ed4d51 for instance 5f311811-dcc0-4f47-83df-98a0f4361481 on n-h1-848886-16 Jul 26 04:46:46.724180 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f3b74cf0-bc67-492a-a4a3-a3188d625468 req-57d992a5-5d0b-4f12-a2bb-97cedc472985 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111994 Jul 26 04:46:46.725360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2106/4330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:46.798941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:46.800513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:46.807726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:46.808526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.810213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:46.810882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:46.845520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:46.865200 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a04a2513-3f33-4bac-b254-7e39f17095ab tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 200 len: 1305 microversion: 2.1 time: 0.294740 Jul 26 04:46:46.870992 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2225/4331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:46 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 1305 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:47.082213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:47.083714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:47.092808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.093757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.095121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.095716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.270443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:47.275635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:47.285378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca13e426-5618-4d62-9943-459fddf8469f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1668 microversion: 2.1 time: 0.490554 Jul 26 04:46:47.286619 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2107/4332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:46 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1668 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:47.433220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:47.435094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:47.441588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.442338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.443300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.443901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.535285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:47.550988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d04c75d-8dcd-4477-87ce-2b5edf01dc45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 200 len: 1495 microversion: 2.1 time: 0.473578 Jul 26 04:46:47.552485 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2226/4333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:47 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 1495 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:47.900086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:47.900708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: 5f311811-dcc0-4f47-83df-98a0f4361481] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:47.911242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.911926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.912907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.913504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.938450 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] HTTP exception thrown: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Request method failure captured: Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 HTTP/1.1 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33FhW1mn5t_F6IyRqmnNmCB2z3eCpHfze2NSPFMzYQz3v4NjRF96KFfhgveguWmx361fbquE6NSs74Xss7dW4f8kVY_f_NvoIVm6Z16nxu_e2ZEjKfndcn-LGYlpu1o5o_ehl9WzRInujJzQB6LGuNBm7cpN-W9PcRXmu_wPvtSNNQg Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 855168c8fff940c39c68ce8ad5318e71 Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '5f311811-dcc0-4f47-83df-98a0f4361481'} Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:47.940420 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. Jul 26 04:46:47.944593 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:47.945986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Returning 404 to user: Instance 5f311811-dcc0-4f47-83df-98a0f4361481 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:47.947342 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd50286b-1b49-4d9a-9c83-5e2982e26913 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481" status: 404 len: 111 microversion: 2.1 time: 0.061789 Jul 26 04:46:47.952785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2227/4334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:47 2022] GET /compute/v2.1/servers/5f311811-dcc0-4f47-83df-98a0f4361481 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:46:47.959303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:47.960089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:47.967442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.968084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:47.969223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:47.969860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.004435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:48.039388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:48.080734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-23c027e6-aa6b-405b-bb90-a63a02acdcd6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.651594 Jul 26 04:46:48.081363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2108/4335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:47 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:48.159298 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f179c3e-3678-48ff-b0a6-4d8a2b533de7 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 204 len: 0 microversion: 2.1 time: 0.204838 Jul 26 04:46:48.160189 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2228/4336] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:47 2022] DELETE /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:48.168403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:48.169213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:48.175741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.176205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.176990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.177435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.575784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:48.578268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:48.587705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.588342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.589353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.591129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.627863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f HTTP/1.1 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '97b9dccc-78d0-4d3c-9fb6-690f0f6df77f'} Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:48.632981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:48.638407 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c66f8fd9-a32b-4a81-be6a-1504241906e8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 404 len: 111 microversion: 2.1 time: 0.063616 Jul 26 04:46:48.639693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2229/4337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:48 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:46:48.645436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:48.646335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:48.653619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.654453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.655406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.656007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.690882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:46:48.831155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8a4d627-6892-4a46-aca6-5b889ad0d77e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 204 len: 0 microversion: 2.1 time: 0.188020 Jul 26 04:46:48.832888 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2230/4338] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:46:48 2022] DELETE /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:46:48.839789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9efae7c6-04d7-4a6c-b05e-36072de4ae4c req-27119149-242c-446e-9d0e-d91dccb73f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b9dccc-78d0-4d3c-9fb6-690f0f6df77f", "name": "network-vif-deleted", "tag": "ecd4fbed-0e27-46da-a4e6-6cc0b36b292c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:48.858560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9efae7c6-04d7-4a6c-b05e-36072de4ae4c req-27119149-242c-446e-9d0e-d91dccb73f00 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.859021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9efae7c6-04d7-4a6c-b05e-36072de4ae4c req-27119149-242c-446e-9d0e-d91dccb73f00 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.889810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9efae7c6-04d7-4a6c-b05e-36072de4ae4c req-27119149-242c-446e-9d0e-d91dccb73f00 service nova] Creating event network-vif-deleted:ecd4fbed-0e27-46da-a4e6-6cc0b36b292c for instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f on n-h2-848886-16 Jul 26 04:46:48.919726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9efae7c6-04d7-4a6c-b05e-36072de4ae4c req-27119149-242c-446e-9d0e-d91dccb73f00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082713 Jul 26 04:46:48.920926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2231/4339] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:48.934622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:48.935547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:48.943550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.944298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:48.945462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:48.946120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:49.136090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:49.145659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:49.148644 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de585b4d-4dc6-4e8f-b175-73af09222fbe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1495 microversion: 2.1 time: 0.226247 Jul 26 04:46:49.150267 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2232/4340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:48 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1495 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:49.155168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:49.155966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:49.172637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:49.173227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:49.173915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:49.174441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:49.291345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:49.304120 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-483d9508-7ad0-4c81-ac0b-8ea70195cfa8 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1517 microversion: 2.1 time: 1.138350 Jul 26 04:46:49.306740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2109/4341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:48 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1517 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:49.426608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:49.442626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1029101a-5518-4216-9817-6b31b58fdb45 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.290259 Jul 26 04:46:49.443925 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2233/4342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:49 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:50.172390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:50.173251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:50.185200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.185602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.191512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.191974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.332164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:50.333398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:50.343603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.350845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.351913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.352850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.664338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:50.677762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6099d16-2e17-4a14-81d2-58b42442edeb tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1517 microversion: 2.1 time: 0.349324 Jul 26 04:46:50.678192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2234/4343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:50 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:50.700528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:50.701226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:50.724918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.725483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.726359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:50.727625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:50.989531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:51.002719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5fe166bb-f9e6-4046-a2bc-8cd82815f203 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1495 microversion: 2.1 time: 0.835284 Jul 26 04:46:51.003949 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2110/4344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:50 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1495 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:51.297353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:51.314863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e591365f-dfbf-4e8e-ab27-b59155ab3ae5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.635459 Jul 26 04:46:51.315790 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2235/4345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:50 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:51.700222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:51.700954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:51.708762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:51.709649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:51.710725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:51.711415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:52.032596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:52.033356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:52.047079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:52.047539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:52.048338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:52.048790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:52.490959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:52.500152 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9a5ea59-5f71-4e69-91a2-cde27ddcb5f5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1495 microversion: 2.1 time: 0.472457 Jul 26 04:46:52.501373 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2236/4346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:52 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1495 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:52.506566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:52.507506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:52.515556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:52.516365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:52.517350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:52.517802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:52.689958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:52.698684 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1aae17a-5850-4d27-851b-a319f2f29cc2 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1517 microversion: 2.1 time: 1.004057 Jul 26 04:46:52.701545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2111/4347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:51 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1517 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:53.060852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ae82fb19-5352-4dc7-bafa-d76d7bbeb67a req-49d4a8e5-2ba3-41cb-9a00-c9c1d1a5df38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33df39-59f2-4fb6-9829-3c625766287e", "name": "network-vif-deleted", "tag": "8cc586bd-cf07-4658-941c-487eed48a2e3"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:53.088063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ae82fb19-5352-4dc7-bafa-d76d7bbeb67a req-49d4a8e5-2ba3-41cb-9a00-c9c1d1a5df38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.088720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ae82fb19-5352-4dc7-bafa-d76d7bbeb67a req-49d4a8e5-2ba3-41cb-9a00-c9c1d1a5df38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.124021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ae82fb19-5352-4dc7-bafa-d76d7bbeb67a req-49d4a8e5-2ba3-41cb-9a00-c9c1d1a5df38 service nova] Creating event network-vif-deleted:8cc586bd-cf07-4658-941c-487eed48a2e3 for instance 4e33df39-59f2-4fb6-9829-3c625766287e on n-h2-848886-16 Jul 26 04:46:53.132641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ae82fb19-5352-4dc7-bafa-d76d7bbeb67a req-49d4a8e5-2ba3-41cb-9a00-c9c1d1a5df38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076620 Jul 26 04:46:53.135247 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2112/4348] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:46:53.310124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:53.335892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65bd4d4f-d395-4066-bff9-29c5098b6fa0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.831595 Jul 26 04:46:53.338337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2237/4349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:52 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:53.338636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8f4a83b9-5076-4461-a33e-41e9c548a1dd req-20b5298a-b82a-495c-ad18-f5bcbcccb9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ccceb2-d548-474e-afad-ae1cb617202e", "name": "network-vif-deleted", "tag": "94acb6f6-3ba1-434a-acd6-8bb84e1277f6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:53.367066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8f4a83b9-5076-4461-a33e-41e9c548a1dd req-20b5298a-b82a-495c-ad18-f5bcbcccb9d8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.367525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8f4a83b9-5076-4461-a33e-41e9c548a1dd req-20b5298a-b82a-495c-ad18-f5bcbcccb9d8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.394495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8f4a83b9-5076-4461-a33e-41e9c548a1dd req-20b5298a-b82a-495c-ad18-f5bcbcccb9d8 service nova] Creating event network-vif-deleted:94acb6f6-3ba1-434a-acd6-8bb84e1277f6 for instance b6ccceb2-d548-474e-afad-ae1cb617202e on n-h2-848886-16 Jul 26 04:46:53.410519 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8f4a83b9-5076-4461-a33e-41e9c548a1dd req-20b5298a-b82a-495c-ad18-f5bcbcccb9d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074783 Jul 26 04:46:53.413727 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2113/4350] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:46:53.525682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:53.526461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:53.537080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.540574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.541659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.547548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.619579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.620277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.620745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lazy-loading 'fault' on Instance uuid 4e33df39-59f2-4fb6-9829-3c625766287e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:46:53.694377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1963724624", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "67e347fb-1c56-4311-930c-e0b2f9fe1f83"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:53.701912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:53.712193 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd2c3d42-e6cb-4e24-9939-0cba518af5dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 200 len: 1299 microversion: 2.1 time: 0.192091 Jul 26 04:46:53.713333 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2114/4351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:53 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:53.732913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:53.735353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:53.749877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.750542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.752978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.753651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.827497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] validate_networks() for [('67e347fb-1c56-4311-930c-e0b2f9fe1f83', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:46:53.835132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:53.835605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:53.836076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lazy-loading 'fault' on Instance uuid b6ccceb2-d548-474e-afad-ae1cb617202e {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:46:53.902055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855168c8fff940c39c68ce8ad5318e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6affcf44ce346e5be76399909c4f1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:53.912050 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3b01e88-a5b9-4dfb-b7cc-d997e2a6cc59 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 200 len: 1310 microversion: 2.1 time: 0.186680 Jul 26 04:46:53.913295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2115/4352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:53 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:54.370643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:54.374285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:54.400836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.403634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:54.405056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.405721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:54.668545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:54.681123 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-edf08bfb-e90e-4622-a20c-29a3149c2def tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.321581 Jul 26 04:46:54.681899 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2116/4353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:54 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:54.738556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:54.739865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:54.748540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.749013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:54.749815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.750291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:54.804357 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e HTTP/1.1 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4e33df39-59f2-4fb6-9829-3c625766287e'} Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:54.806564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:46:54.811071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:54.812269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:54.813305 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86b5a887-9598-4c47-b74e-8c5b86470f45 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 404 len: 111 microversion: 2.1 time: 0.079451 Jul 26 04:46:54.814426 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2117/4354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:54 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:46:54.939052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:54.939682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] [instance: b6ccceb2-d548-474e-afad-ae1cb617202e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:54.952014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.952489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:54.953284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:54.953733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:55.012717 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] HTTP exception thrown: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Request method failure captured: Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e HTTP/1.1 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33FhW1mn5t_F6IyRqmnNmCB2z3eCpHfze2NSPFMzYQz3v4NjRF96KFfhgveguWmx361fbquE6NSs74Xss7dW4f8kVY_f_NvoIVm6Z16nxu_e2ZEjKfndcn-LGYlpu1o5o_ehl9WzRInujJzQB6LGuNBm7cpN-W9PcRXmu_wPvtSNNQg Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6affcf44ce346e5be76399909c4f1a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b6affcf44ce346e5be76399909c4f1a7 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-355242147 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 855168c8fff940c39c68ce8ad5318e71 Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ListServerFiltersTestJSON-355242147-project Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b6ccceb2-d548-474e-afad-ae1cb617202e'} Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:46:55.014514 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] Returning 404 to user: Instance b6ccceb2-d548-474e-afad-ae1cb617202e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43ac4a93-8be7-41d7-93f2-90b21b128b85 tempest-ListServerFiltersTestJSON-355242147 tempest-ListServerFiltersTestJSON-355242147-project] 10.222.0.43 "GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e" status: 404 len: 111 microversion: 2.1 time: 0.084341 Jul 26 04:46:55.019219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2118/4355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:54 2022] GET /compute/v2.1/servers/b6ccceb2-d548-474e-afad-ae1cb617202e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:46:55.031517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-129234551", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:46:55.139276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:46:55.161752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:46:55.162912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:46:55.163648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:46:55.166330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:46:55.167628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:46:55.202255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:55.202876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:55.204642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:55.205933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:55.237097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Getting quotas for project c978dbd85e70447c801af3c9050985d5. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:46:55.257439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Getting quotas for user 97e8061a10dd43d8b4bb1232bb5f31b2 and project c978dbd85e70447c801af3c9050985d5. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:46:55.290271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:46:55.296668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:46:55.341996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:55.370939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a35e430-6be4-436d-9481-1c4b56fc8c42 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006057 Jul 26 04:46:55.372917 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2238/4356] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:46:55.385510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f11b3142-9a8e-4f5f-9142-61b1b5c7ceb9 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:55.387984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f11b3142-9a8e-4f5f-9142-61b1b5c7ceb9 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:55.552494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f11b3142-9a8e-4f5f-9142-61b1b5c7ceb9 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:55.569913 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f11b3142-9a8e-4f5f-9142-61b1b5c7ceb9 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1217 microversion: 2.1 time: 0.189317 Jul 26 04:46:55.570527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2239/4357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:55 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:55.703463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:55.704432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:55.725610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:55.726078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:55.727011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:55.727710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:56.269879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:46:56.272414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:46:56.272949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:46:56.273564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:46:56.273901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:46:56.295214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:56.295964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:56.301091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:56.302015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:56.322805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:56.332105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d930ba3-c089-4fb9-9d4e-a565b402913d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.633491 Jul 26 04:46:56.340233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2240/4358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:55 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:56.384874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:46:56.398113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:46:56.414847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:46:56.417536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:46:56.484191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb2289ab-eccb-44db-ab86-853bcba88ac8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464362 Jul 26 04:46:56.485234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2119/4359] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:46:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:46:56.496446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd8f726d-5281-4395-8175-2ee9630f002c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:56.497074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd8f726d-5281-4395-8175-2ee9630f002c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:56.596110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:56.596829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:56.609196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:56.611970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:56.612904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:56.613421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:56.801335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd8f726d-5281-4395-8175-2ee9630f002c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:56.835086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd8f726d-5281-4395-8175-2ee9630f002c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1208 microversion: 2.1 time: 0.340188 Jul 26 04:46:56.838427 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2241/4360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:56 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1208 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:56.892805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:56.903100 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e841abec-b6a1-4b43-b5c2-e0021a21b42d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1269 microversion: 2.1 time: 0.312111 Jul 26 04:46:56.909218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2120/4361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:56 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1269 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:57.363852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:57.365433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:57.382720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:57.389402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:57.390716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:57.393456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:57.860394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:57.861007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:57.889273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:57.890909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:57.893168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:57.897026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:58.027882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:58.038442 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15a29b0b-f8fd-40aa-8930-29669ad81a89 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.681421 Jul 26 04:46:58.039031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2242/4362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:57 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:58.074562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:58.075468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:58.082193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:58.091364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:58.097334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:58.097807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:58.136729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:58.148525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-238de128-8294-45b3-b93d-cc56d3dee20f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1260 microversion: 2.1 time: 0.293209 Jul 26 04:46:58.149122 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2121/4363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:57 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:46:58.384760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:58.401653 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1683317f-8e34-41d3-b703-79f8f905aba5 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1275 microversion: 2.1 time: 0.361237 Jul 26 04:46:58.402495 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2243/4364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:58 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:59.062541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:59.063712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:59.080253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.084139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.085403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.086694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.183314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:59.184731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:59.193169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.194108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.196074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.197119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.333056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:59.343909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76cc18e2-f5a3-49dc-b686-dc560c002c48 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1266 microversion: 2.1 time: 0.176103 Jul 26 04:46:59.344515 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2244/4365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:59 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:46:59.424130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:46:59.425441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:46:59.444000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.448954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.450377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:46:59.451149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:46:59.650476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:46:59.659757 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-314374d1-7d91-4430-b401-fa20fe3ab7c5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1508 microversion: 2.1 time: 0.602962 Jul 26 04:46:59.660341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2122/4366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:59 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:00.030852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:00.041705 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b91f7ef1-204f-4840-93b7-59c915fea89a tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.621848 Jul 26 04:47:00.056285 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2245/4367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:46:59 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:00.366640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:00.368151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:00.377854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:00.380050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:00.413768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:00.414973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:00.682615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:00.683245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:00.695360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:00.696216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:00.697508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:00.698187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:00.845930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:00.867340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4b43fab9-47ea-4401-8ad6-d4ac5d676b49 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.505046 Jul 26 04:47:00.878714 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2123/4368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:00 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:01.065469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:01.066482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:01.075309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:01.076343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:01.081949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:01.082847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:01.099662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:01.111823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3188ba3-f59f-4b9e-8845-914c2eaf935d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1529 microversion: 2.1 time: 0.433326 Jul 26 04:47:01.128099 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2246/4369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:00 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1529 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:01.708798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:01.725010 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-695e4a28-3c56-47d0-94c0-7412048ecc9f tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.664979 Jul 26 04:47:01.727670 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2124/4370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:01 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:01.893318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:01.893939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:01.944910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:01.945725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:01.946776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:01.947494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.030169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-17605445-69fd-45d4-ade6-614431f6351d req-8c263e7e-d6ba-457d-b112-f38aa0d0ade5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1d0737-f450-4345-a7ec-52522ded826c", "tag": "42f6fcc2-6973-47f7-af46-948fc2d5318f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:02.053097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-17605445-69fd-45d4-ade6-614431f6351d req-8c263e7e-d6ba-457d-b112-f38aa0d0ade5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:02.053874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-17605445-69fd-45d4-ade6-614431f6351d req-8c263e7e-d6ba-457d-b112-f38aa0d0ade5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.075757 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-17605445-69fd-45d4-ade6-614431f6351d req-8c263e7e-d6ba-457d-b112-f38aa0d0ade5 service nova] Creating event network-changed:42f6fcc2-6973-47f7-af46-948fc2d5318f for instance 1d1d0737-f450-4345-a7ec-52522ded826c on n-h2-848886-16 Jul 26 04:47:02.082223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-17605445-69fd-45d4-ade6-614431f6351d req-8c263e7e-d6ba-457d-b112-f38aa0d0ade5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056903 Jul 26 04:47:02.083501 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2125/4371] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:02.147429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:02.148558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:02.162095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:02.167032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.172811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:02.174423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.677481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:02.693538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a8638b3-0919-45a5-be9f-a3211cff4ce5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.560947 Jul 26 04:47:02.694130 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2126/4372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:02 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:02.749029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:02.749643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:02.768722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:02.769078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.770723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:02.771362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:02.799068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:02.810619 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e89127e8-5b14-48b7-be90-b366c62e89f1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.919866 Jul 26 04:47:02.811849 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2247/4373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:01 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:03.157409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f39e03b0-fbe7-4b18-bc17-e9c1ba298c04 req-5ba04d5c-e60f-426a-a61d-fa5627bf2775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1", "tag": "0df8936c-79af-4601-bb7c-f48024bae809"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:03.182334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:03.189952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:03.203665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b5ca058-6b42-48b4-8197-5d2c8468f140 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.459478 Jul 26 04:47:03.207307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f39e03b0-fbe7-4b18-bc17-e9c1ba298c04 req-5ba04d5c-e60f-426a-a61d-fa5627bf2775 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:03.208016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f39e03b0-fbe7-4b18-bc17-e9c1ba298c04 req-5ba04d5c-e60f-426a-a61d-fa5627bf2775 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:03.215898 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2127/4374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:02 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:03.228015 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f39e03b0-fbe7-4b18-bc17-e9c1ba298c04 req-5ba04d5c-e60f-426a-a61d-fa5627bf2775 service nova] Creating event network-changed:0df8936c-79af-4601-bb7c-f48024bae809 for instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 on n-h2-848886-16 Jul 26 04:47:03.237762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f39e03b0-fbe7-4b18-bc17-e9c1ba298c04 req-5ba04d5c-e60f-426a-a61d-fa5627bf2775 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085334 Jul 26 04:47:03.240631 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2248/4375] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:03.716179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:03.716796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:03.733547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:03.734687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:03.737427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:03.738694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:03.833752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:03.834493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:03.845078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:03.851617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:03.852959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:03.853684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:04.509841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:04.518430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db722874-5710-4058-8be3-68a7e3e6cd39 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.807157 Jul 26 04:47:04.519026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2128/4376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:03 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:04.542465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:04.543635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:04.576883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:04.577350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:04.578167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:04.578621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:04.978757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:04.990971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ccd5086-3d0f-4e94-95bd-231ce25c5b25 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.470828 Jul 26 04:47:05.008988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2129/4377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:04 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:05.204053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:05.232247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-036d344e-e0ec-4816-81f6-644f402e7c04 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 1.402854 Jul 26 04:47:05.232861 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2249/4378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:03 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:05.377294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c14ac6f4-4f88-4039-a4d8-cd7eed0da1c8 req-5eb84094-bc5e-41b4-904b-ee898e11c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f78cb3-ded8-4fa4-888f-bd0ea2b669d4", "name": "network-vif-plugged", "status": "completed", "tag": "3bfbfffe-4ebb-4571-8c39-b48cebd8cb39"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:05.388125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:05.404050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c14ac6f4-4f88-4039-a4d8-cd7eed0da1c8 req-5eb84094-bc5e-41b4-904b-ee898e11c2a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:05.407306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c14ac6f4-4f88-4039-a4d8-cd7eed0da1c8 req-5eb84094-bc5e-41b4-904b-ee898e11c2a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:05.446644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c14ac6f4-4f88-4039-a4d8-cd7eed0da1c8 req-5eb84094-bc5e-41b4-904b-ee898e11c2a2 service nova] Creating event network-vif-plugged:3bfbfffe-4ebb-4571-8c39-b48cebd8cb39 for instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 on n-h1-848886-16 Jul 26 04:47:05.462421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c14ac6f4-4f88-4039-a4d8-cd7eed0da1c8 req-5eb84094-bc5e-41b4-904b-ee898e11c2a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448878 Jul 26 04:47:05.470452 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2130/4379] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:05.548381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:05.549323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:05.561470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:05.563463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:05.565869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:05.566887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:05.567486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:06.017403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:06.018130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:06.045177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:06.045756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:06.050373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:06.053347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:06.344344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:06.353339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:06.370366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04e3789c-8195-4c4d-8cdb-e97ab5ee3fdb tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.833100 Jul 26 04:47:06.371711 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2250/4380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:05 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:06.391192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:06.395911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:06.409213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:06.410856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:06.413001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:06.413001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:06.413001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:06.821842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:06.947614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:06.962762 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac795fc7-fd4d-4409-8530-bc8cf1cfc6d2 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.951218 Jul 26 04:47:06.967721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2131/4381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:06 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:07.071171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:07.081749 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4abcde5-dabe-4e87-b9aa-cbff35fa6572 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.694757 Jul 26 04:47:07.092864 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2251/4382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:06 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:07.394385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:07.395927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:07.409937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:07.412643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:07.415906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:07.416618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:07.988351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:07.989623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:08.030784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:08.030784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:08.030784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:08.030784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:08.275369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:08.287072 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78286b3f-195f-4801-bc9a-d5a7373764d7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.897583 Jul 26 04:47:08.289251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2132/4383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:07 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:08.304108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:08.305897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:08.314824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:08.316395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:08.317434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:08.318093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:08.963087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:08.979723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f7fc14bf-4e67-4280-a413-80d523de3727 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.688505 Jul 26 04:47:08.999404 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2133/4384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:08 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:09.316774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:09.318378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:09.335333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:09.336375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:09.338023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:09.344769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:09.422906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:09.440761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:09.443489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f872e279-1fb3-4279-a800-5f83f91fd3ad tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 1.459943 Jul 26 04:47:09.457574 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2252/4385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:07 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:10.004737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:10.005432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:10.021202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:10.021877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:10.024161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:10.028977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:10.695148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:10.708926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4dc1b3c4-62c6-4913-b46f-099f0f028729 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.709322 Jul 26 04:47:10.713054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2253/4386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:09 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:10.720439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:10.727732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:10.752085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:10.752836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:10.753794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:10.775347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:10.837550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:10.852527 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8eeed1e-504f-4d42-91cf-bd0fa7c71c71 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 1.540943 Jul 26 04:47:10.853051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2134/4387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:09 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:11.307098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:11.320783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3812791d-3ec1-4e9c-bf51-f8906df012cf tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.606334 Jul 26 04:47:11.321693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2254/4388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:10 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:11.539154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-65a5acbf-adbf-486d-be94-d5fa3a4c04b6 req-ee54f923-83de-4bb0-951d-fd6783c91e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1d0737-f450-4345-a7ec-52522ded826c", "name": "network-vif-plugged", "status": "completed", "tag": "42f6fcc2-6973-47f7-af46-948fc2d5318f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:11.570863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65a5acbf-adbf-486d-be94-d5fa3a4c04b6 req-ee54f923-83de-4bb0-951d-fd6783c91e70 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:11.570863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65a5acbf-adbf-486d-be94-d5fa3a4c04b6 req-ee54f923-83de-4bb0-951d-fd6783c91e70 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:11.594318 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-65a5acbf-adbf-486d-be94-d5fa3a4c04b6 req-ee54f923-83de-4bb0-951d-fd6783c91e70 service nova] Creating event network-vif-plugged:42f6fcc2-6973-47f7-af46-948fc2d5318f for instance 1d1d0737-f450-4345-a7ec-52522ded826c on n-h2-848886-16 Jul 26 04:47:11.606805 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-65a5acbf-adbf-486d-be94-d5fa3a4c04b6 req-ee54f923-83de-4bb0-951d-fd6783c91e70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075907 Jul 26 04:47:11.608055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2135/4389] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:11.744380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:11.744998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:11.769985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:11.775042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:11.775042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:11.775042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:11.874662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:11.875279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:11.893693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:11.894358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:11.895640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:11.896277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:12.481264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:12.489726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b28de52-c66a-47be-a5be-013e05d2963c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.758738 Jul 26 04:47:12.506276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2255/4390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:11 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:12.511752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:12.533748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:12.552592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:12.554753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:12.557298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:12.559384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:12.631896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:12.641345 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-731df53b-c423-4a5c-b870-36c5fe67df59 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.771823 Jul 26 04:47:12.642190 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2136/4391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:11 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:13.343413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:13.365467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ced76d35-fa6a-491b-91c2-1e08fc181240 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1317 microversion: 2.1 time: 0.857723 Jul 26 04:47:13.369713 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2256/4392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:12 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:13.517629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:13.518347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:13.533124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:13.533582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:13.534477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:13.535007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:13.664519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:13.665182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:13.692154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:13.692849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:13.696075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:13.696566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:14.037960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:14.046814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-975d809b-29c4-4324-9d6c-9f93dbd08f1b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.386311 Jul 26 04:47:14.047404 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2257/4393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:13 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:14.065220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7ee62f65-904d-472c-bc59-233f0a1e60c1 req-e25ca7af-4fa2-494e-a2fc-4804855d68fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1", "name": "network-vif-plugged", "status": "completed", "tag": "0df8936c-79af-4601-bb7c-f48024bae809"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:14.095171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7ee62f65-904d-472c-bc59-233f0a1e60c1 req-e25ca7af-4fa2-494e-a2fc-4804855d68fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:14.096087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7ee62f65-904d-472c-bc59-233f0a1e60c1 req-e25ca7af-4fa2-494e-a2fc-4804855d68fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:14.120103 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7ee62f65-904d-472c-bc59-233f0a1e60c1 req-e25ca7af-4fa2-494e-a2fc-4804855d68fb service nova] Creating event network-vif-plugged:0df8936c-79af-4601-bb7c-f48024bae809 for instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 on n-h2-848886-16 Jul 26 04:47:14.135036 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7ee62f65-904d-472c-bc59-233f0a1e60c1 req-e25ca7af-4fa2-494e-a2fc-4804855d68fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072772 Jul 26 04:47:14.136556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2258/4394] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:14.397086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:14.398525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:14.422757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:14.423469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:14.424441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:14.425044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:14.743787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:14.752856 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-063b18e1-a981-4657-903f-215b8658b2bb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 1.239023 Jul 26 04:47:14.778185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2137/4395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:13 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:15.117409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-79616762", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:15.120370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:15.133294 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9637d3a1-12e9-4631-adfa-368e244958dd tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1507 microversion: 2.1 time: 0.740682 Jul 26 04:47:15.134102 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2259/4396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:14 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1507 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:15.166698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:15.167330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:15.174682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.175382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.176629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.177304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.260781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:15.261212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:15.262179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:15.262488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:15.262911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:15.287813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.289341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.291230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.293704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.367783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Getting quotas for project c35e0d213a0f4e3b8c2c601049d4bfe9. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:15.392384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Getting quotas for user be1b0e625b1c4ec0b65b214bd0433713 and project c35e0d213a0f4e3b8c2c601049d4bfe9. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:15.407182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:47:15.409940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:47:15.489481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36579bd7-4050-452d-88ca-2d2f70680b5c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.625332 Jul 26 04:47:15.499284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2138/4397] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 04:47:15.508896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:15.510012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:15.518118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.519362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.520802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.521412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.561444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22401347-757f-48bd-9ad9-701c58bb964d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips" status: 200 len: 110 microversion: 2.1 time: 0.057954 Jul 26 04:47:15.570912 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2139/4398] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:47:15 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips => generated 110 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:15.584887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:15.585762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:15.711505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:15.730693 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab070e3c-f27d-4ff6-b223-37ac3b887536 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.567194 Jul 26 04:47:15.732039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2260/4399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:15 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:15.740371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:15.760378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:15.781022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.781672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.790671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:15.791212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:15.846075 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e294e2a1-d2ce-4988-8615-045ceb1f7ceb tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips" status: 200 len: 110 microversion: 2.1 time: 0.111629 Jul 26 04:47:15.853566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2261/4400] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:47:15 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips => generated 110 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:15.916248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:15.959471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:15.966707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:15.972002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a1f8454-0568-44f7-9abf-de9dcb28bb1f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1276 microversion: 2.54 time: 0.399505 Jul 26 04:47:15.994122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-596058990", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "82c5124a-d7aa-45ff-8c0a-e910da34714c"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:16.002488 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2140/4401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:15 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1276 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:16.016204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:16.018847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:16.065959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.067335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.070518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.071173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.161861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] validate_networks() for [('82c5124a-d7aa-45ff-8c0a-e910da34714c', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:47:16.374389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:16.384188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f5bc5e17-06d9-4dc3-848e-ecc3c1b72d7e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1308 microversion: 2.1 time: 0.380298 Jul 26 04:47:16.385167 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2141/4402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:16 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:16.405237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:16.405976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:16.413080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.413876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.414913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.415576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.499639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63b9ee23-d305-4696-8cef-9dd5e7d0781d tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips/tempest-ServerAddressesTestJSON-1382117611-network" status: 200 len: 95 microversion: 2.1 time: 0.099772 Jul 26 04:47:16.503363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2142/4403] 10.222.0.43 () {58 vars in 1401 bytes} [Tue Jul 26 04:47:16 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c/ips/tempest-ServerAddressesTestJSON-1382117611-network => generated 95 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:47:16.521498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:16.522598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:16.530610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.531429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.532441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.533114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.564719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:16.729169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-101e4e64-6fce-482a-a68f-0b4a593e78bc tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 204 len: 0 microversion: 2.1 time: 0.218138 Jul 26 04:47:16.737383 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2143/4404] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:47:16 2022] DELETE /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:47:16.746824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:16.751371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:16.774237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.774715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:16.777530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:16.779118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:17.115856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:17.136653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4211a9ed-5700-4561-b320-b190671966e0 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1513 microversion: 2.1 time: 0.389999 Jul 26 04:47:17.140881 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2144/4405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:16 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:17.172626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:17.173287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:17.209541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:17.210083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:17.211525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:17.212125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:17.598906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:17.609717 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d9bce44-c2ca-41e1-8c27-e1b9dac7076a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.467358 Jul 26 04:47:17.611131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2145/4406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:17 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:17.630100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:17.637238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:17.659022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:17.659552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:17.679640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:17.684108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:17.779452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:17.926139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:17.939641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:17.941411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:17.947741 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48f0a53d-5e37-4181-a423-cc4498ec6f41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1336 microversion: 2.54 time: 0.334850 Jul 26 04:47:17.976186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2146/4407] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:17 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:17.997210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:18.000231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:18.019137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.025647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.026673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.028044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.285986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:18.286983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:18.287463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:18.288656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:18.289075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:18.320158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.320623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.321439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.321884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.391733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Getting quotas for project 78faeccd15784966ac61f1902a90a1c8. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:18.412525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Getting quotas for user 94e548594606490f91678f561fe6f19f and project 78faeccd15784966ac61f1902a90a1c8. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:18.416852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:18.426053 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c85835eb-4159-4d8a-b62f-374145432364 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1489 microversion: 2.1 time: 0.446081 Jul 26 04:47:18.439068 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2147/4408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:17 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1489 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:18.444011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:18.444625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:18.453028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:47:18.455275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:47:18.467010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.468808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.472009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.472942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.591288 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ab8ceec-02ea-4190-b49b-78b9564821d6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.735084 Jul 26 04:47:18.593981 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2262/4409] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:47:18.609845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:18.618284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:18.637450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.637962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.640494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:18.640971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:18.808933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2753f1d1-9805-40bc-a0e9-435a42e53d9a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "PUT /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1084 microversion: 2.1 time: 0.213453 Jul 26 04:47:18.821327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2263/4410] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:47:18 2022] PUT /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1084 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:18.840237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:18.841473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:19.391265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e8061a10dd43d8b4bb1232bb5f31b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c978dbd85e70447c801af3c9050985d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:19.398958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fabe076-771c-43df-b974-fa3c643d1506 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 200 len: 1513 microversion: 2.1 time: 0.958514 Jul 26 04:47:19.426181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2148/4411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:18 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 1513 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:19.453218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:19.456605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:19.484808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.488353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:19.493042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.494609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:19.533728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:19.555162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:19.558813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:19.567273 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-03c1b4cd-575f-436c-a90f-fb9ce8abfb81 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1261 microversion: 2.26 time: 0.740793 Jul 26 04:47:19.568136 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2264/4412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:18 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1261 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:19.599961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:19.600578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:19.622556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.638839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:19.641024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.644616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:19.893315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:19.913582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13fa5110-00d3-4294-a60a-5e1fe55a44b7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.476561 Jul 26 04:47:19.922649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2149/4413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:19 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:19.939030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:19.940132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:19.973116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.973581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:19.978114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:19.979157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.165119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.180878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.186475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.188829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-648a0ec6-b095-4e68-8a1b-da6ab351a5f2 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1334 microversion: 2.54 time: 0.264026 Jul 26 04:47:20.190226 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2150/4414] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:19 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1334 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:20.266708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bf1e0471-6291-449f-a97e-2d919ba1abb1 req-7c1cf60a-0af9-4aff-8bd7-78c779ed7467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1d0737-f450-4345-a7ec-52522ded826c", "name": "network-vif-deleted", "tag": "42f6fcc2-6973-47f7-af46-948fc2d5318f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:20.267282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.278441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6f0475f-d2ae-4a85-b729-a81a36d9781f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1510 microversion: 2.1 time: 0.693302 Jul 26 04:47:20.279156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf1e0471-6291-449f-a97e-2d919ba1abb1 req-7c1cf60a-0af9-4aff-8bd7-78c779ed7467 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.280682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf1e0471-6291-449f-a97e-2d919ba1abb1 req-7c1cf60a-0af9-4aff-8bd7-78c779ed7467 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.294195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2265/4415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:19 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1510 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:20.305003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:20.305717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:20.315561 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bf1e0471-6291-449f-a97e-2d919ba1abb1 req-7c1cf60a-0af9-4aff-8bd7-78c779ed7467 service nova] Creating event network-vif-deleted:42f6fcc2-6973-47f7-af46-948fc2d5318f for instance 1d1d0737-f450-4345-a7ec-52522ded826c on n-h2-848886-16 Jul 26 04:47:20.320070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.322693 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bf1e0471-6291-449f-a97e-2d919ba1abb1 req-7c1cf60a-0af9-4aff-8bd7-78c779ed7467 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130459 Jul 26 04:47:20.323502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2151/4416] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:20.331206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.332438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.333218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.443559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:20.445350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] [instance: 1d1d0737-f450-4345-a7ec-52522ded826c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:20.461404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.463584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.465227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.467920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.515284 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] HTTP exception thrown: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Request method failure captured: Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c HTTP/1.1 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33G9BtmzYbh9_VXe7_z0rpJYrkRT5aK0KpHWyv8Y2ezBzKK7RBgCS0PIv2-_kLHBSpIX-lXeihOzSG-NsFvl9UJ4e8kqhlxs_Th4IUrB1BGGeL2f-jq3GJTBJaOFwwPTxp_tVxxr3FJ4D13gIlbRLKmYB5C957lITH3O8ZdHviz39J4 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c978dbd85e70447c801af3c9050985d5 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerAddressesTestJSON-408463084 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c978dbd85e70447c801af3c9050985d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c978dbd85e70447c801af3c9050985d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c978dbd85e70447c801af3c9050985d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c978dbd85e70447c801af3c9050985d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerAddressesTestJSON-408463084 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c978dbd85e70447c801af3c9050985d5 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerAddressesTestJSON-408463084 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerAddressesTestJSON-408463084-project Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 97e8061a10dd43d8b4bb1232bb5f31b2 Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerAddressesTestJSON-408463084-project Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1d1d0737-f450-4345-a7ec-52522ded826c'} Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:20.517876 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. Jul 26 04:47:20.523046 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:20.524091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] Returning 404 to user: Instance 1d1d0737-f450-4345-a7ec-52522ded826c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:20.526051 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-742984f8-f041-4be4-9b64-b11174704654 tempest-ServerAddressesTestJSON-408463084 tempest-ServerAddressesTestJSON-408463084-project] 10.222.0.43 "GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c" status: 404 len: 111 microversion: 2.1 time: 0.087648 Jul 26 04:47:20.529407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2152/4417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:20 2022] GET /compute/v2.1/servers/1d1d0737-f450-4345-a7ec-52522ded826c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:47:20.595330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:20.596253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:20.610033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.611466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.612634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.613680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.800756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.834893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.837509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:20.842069 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40217d52-0f36-449f-9b68-36edc1aace14 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1313 microversion: 2.26 time: 0.250918 Jul 26 04:47:20.847023 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2153/4418] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:20 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:20.905825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:20.908706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:20.916757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.917988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.919329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.919926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.961175 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6ee9576-0159-4236-9845-48779a7d54ba tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070711 Jul 26 04:47:20.961822 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2154/4419] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:47:20 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:47:20.969121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:20.969121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:20.976402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.976911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:20.977899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:20.978292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.083679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:21.097250 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97982872-b038-4682-a28f-01a1df3adc24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1510 microversion: 2.1 time: 0.796586 Jul 26 04:47:21.125153 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2266/4420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:20 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1510 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:21.137550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:21.138559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:21.150847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.151560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.152969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.153574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.217827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:21.436904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec813449-5ca4-4e3f-8a72-6f74db5c9a69 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 204 len: 0 microversion: 2.1 time: 0.308902 Jul 26 04:47:21.438203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2267/4421] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:47:21 2022] DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:47:21.449603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:21.450698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:21.463159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.464827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.469884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.470430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.593601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:21.687460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:21.818088 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7cc902fa-38e8-4f05-adc6-93b94badb8fe tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 204 len: 0 microversion: 2.1 time: 0.375912 Jul 26 04:47:21.818780 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2268/4422] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:47:21 2022] DELETE /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:47:21.837541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:21.838301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:21.857114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.857599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:21.860029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:21.868811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.103981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.125335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.133938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.138623 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1748a4e-70b8-4608-9276-e554cacaaf38 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1355 microversion: 2.54 time: 0.309734 Jul 26 04:47:22.139295 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2269/4423] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:21 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1355 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:22.176125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:22.176752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:22.199216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.202038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.205770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.207219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.214107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.228342 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c67b0b3f-4e39-403d-9a1e-8d9b0f06217c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 1.265424 Jul 26 04:47:22.235846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2155/4424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:20 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:22.240879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:22.241560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:22.262081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.262565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.263551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.264144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.584836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.596433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-906c2d6b-8f6d-4f95-a62d-444e045bd842 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1674 microversion: 2.1 time: 0.434325 Jul 26 04:47:22.600766 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2270/4425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:22 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1674 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:22.613441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:22.614129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:22.623518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:22.634715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.639768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.640330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.641253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.641707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.649694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48610fd7-ac3f-4635-95ff-b90bc3f6ff1a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1516 microversion: 2.1 time: 0.412406 Jul 26 04:47:22.666022 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2156/4426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:22 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1516 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:22.674434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-808efc2b-bb81-44ee-b030-2b5565eca746 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Action: 'create', calling method: .version_select at 0x7f38b509fdc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2139044217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHex56XAt2a3QR5+Kqy5YDcts441Auote16vm20w6O1401oUFtqQsIn73ifgP5dAiE5w/YILDGJ7rwoHKbl8r2kY/Dx9h5Gq9NfcxCYubUfBwOB4JSl+rmAkp0/VThr7wA=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:22.735120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-808efc2b-bb81-44ee-b030-2b5565eca746 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Getting quotas for project c35e0d213a0f4e3b8c2c601049d4bfe9. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:22.762902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-808efc2b-bb81-44ee-b030-2b5565eca746 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Getting quotas for user be1b0e625b1c4ec0b65b214bd0433713 and project c35e0d213a0f4e3b8c2c601049d4bfe9. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:22.780482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.796936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.798610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:22.811178 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c35ca1c-803a-4e39-95d1-846c129fa26b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1331 microversion: 2.26 time: 0.198049 Jul 26 04:47:22.812166 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2271/4427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:22 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:22.854922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-808efc2b-bb81-44ee-b030-2b5565eca746 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.187245 Jul 26 04:47:22.856190 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2157/4428] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:47:22 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:47:22.875756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2139044217", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:22.893010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:22.909419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.911314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:22.913106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:22.913834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.120627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:23.121275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:23.122967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:23.123397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:23.126664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:23.251795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:23.252517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:23.278601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.279206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.285390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.286637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.462896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:23.505098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.511850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.513231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.515837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.607325 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e786f6ee-d03a-4b83-868d-faa050ad39da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "POST /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55/action" status: 202 len: 1138 microversion: 2.54 time: 0.743077 Jul 26 04:47:23.608002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2272/4429] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Jul 26 04:47:22 2022] POST /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55/action => generated 1138 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 26 04:47:23.660651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:23.662247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:23.677175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.683532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:23.684583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:23.687745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:24.077508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:24.090897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bed967aa-52ba-4418-b6a0-124d72a1b3f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.845598 Jul 26 04:47:24.094309 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2158/4430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:23 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:24.099232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:24.109951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:24.120352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:24.121394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:24.122361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:24.122663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:24.519172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:24.553334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:24.554895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:24.556182 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6659b6b-eb99-4127-a7a5-7fe3442b3177 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.460595 Jul 26 04:47:24.561376 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2159/4431] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:24 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:24.597847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:24.598964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:24.636517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:24.644118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:24.645457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:24.646618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.069212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:25.084450 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6bf0b4f4-9247-4d19-83aa-d275e608967d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1674 microversion: 2.1 time: 1.464226 Jul 26 04:47:25.085669 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2273/4432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:23 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1674 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:25.099172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:25.099826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:25.123079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.123540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.124351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.124884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.210569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:25.219841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74f62445-96ed-4363-8ae7-c061bef2d68a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1516 microversion: 2.1 time: 0.657075 Jul 26 04:47:25.229438 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2160/4433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:24 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1516 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:25.246529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:25.246529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:25.254355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.254968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.260523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:25.260870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.262350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.273505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:25.280922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:25.282537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55927141-f7b6-4322-9a6e-a94d5df69c0d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1319 microversion: 2.26 time: 0.193644 Jul 26 04:47:25.285594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2274/4434] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:25 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:25.587501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:25.588390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:25.609112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.612329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.613203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:25.613655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:25.627740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:26.104906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.113570 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74845430-432b-493e-80c1-7161804af044 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.882172 Jul 26 04:47:26.125876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2161/4435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:25 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:26.131444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f48a2255-7f6f-4c6b-a839-8cc68331f7c3 req-13843ab6-e687-40a0-b56c-afc165ac303b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1", "name": "network-vif-deleted", "tag": "0df8936c-79af-4601-bb7c-f48024bae809"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:26.145952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f48a2255-7f6f-4c6b-a839-8cc68331f7c3 req-13843ab6-e687-40a0-b56c-afc165ac303b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.146857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f48a2255-7f6f-4c6b-a839-8cc68331f7c3 req-13843ab6-e687-40a0-b56c-afc165ac303b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.161849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f48a2255-7f6f-4c6b-a839-8cc68331f7c3 req-13843ab6-e687-40a0-b56c-afc165ac303b service nova] Creating event network-vif-deleted:0df8936c-79af-4601-bb7c-f48024bae809 for instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 on n-h2-848886-16 Jul 26 04:47:26.168909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f48a2255-7f6f-4c6b-a839-8cc68331f7c3 req-13843ab6-e687-40a0-b56c-afc165ac303b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041198 Jul 26 04:47:26.170611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2162/4436] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:26.177808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:26.180418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:26.201907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.202677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.203663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.204116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.205545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.229231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.232638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.234075 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76a27b12-aed0-499f-9eae-ec50497b365c tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.651440 Jul 26 04:47:26.236085 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2275/4437] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:25 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:26.270924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:26.272155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:26.279645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.281565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.283287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.288220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.352494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.352494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.352843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lazy-loading 'fault' on Instance uuid 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:26.518069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.544543 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13bcd0cf-bd51-4b94-bfb8-35fed791b101 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1674 microversion: 2.1 time: 0.369352 Jul 26 04:47:26.545981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2163/4438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:26 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1674 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:26.567539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:26.569605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:26.581993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:26.586815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.587761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.588880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:26.603258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:26.881576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:26.897408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c95c8a06-ccd5-4220-9b4e-93ab0ac1c1c2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 200 len: 1319 microversion: 2.1 time: 0.634922 Jul 26 04:47:26.915606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2276/4439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:26 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:27.150962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:27.151590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:27.184671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.185447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.186536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.190038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.288406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.310118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.315923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.317525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b7c0ced-647d-4a8d-98bf-1bd9194cd0ea tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.765954 Jul 26 04:47:27.320150 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2164/4440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:26 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:27.331804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:27.336135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:27.349081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.353079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.354343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.357310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.536227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.552635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.556750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.564285 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2598d426-dc0b-4c9e-b25d-5b801de47d7f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.240192 Jul 26 04:47:27.565510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2165/4441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:27 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:27.583099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:27.584034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:27.606850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.613908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.625066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.625914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.661746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:27.773746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.788770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bfc0da7-9cda-493a-94e6-ce4c702036b5 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1606 microversion: 2.1 time: 0.216654 Jul 26 04:47:27.790123 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2166/4442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:27 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1606 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:27.920166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:27.923895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:27.925104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:27.932206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3f4a1d9-1c2b-4fcb-8853-7b4dd6a0b7a7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.785599 Jul 26 04:47:27.934281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2277/4443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:27 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:27.940241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.941208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.941523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:27.942064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:27.990049 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 HTTP/1.1 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1'} Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:27.999832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:28.006733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d543274-8f60-4474-bcee-ad629c0a16fa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 404 len: 111 microversion: 2.1 time: 0.083511 Jul 26 04:47:28.016046 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2167/4444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:27 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:47:28.201551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1022837134", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "97be05bf-5e6d-4651-b058-056da0538b9f"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:28.346015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:28.347855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:28.361122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:28.361574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:28.362385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] validate_networks() for [('97be05bf-5e6d-4651-b058-056da0538b9f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:47:28.362512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:28.363099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:28.375125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:28.930771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:28.947062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:28.953701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:28.958335 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21f74638-c69b-4bc5-ab9f-b5a93be8ca20 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.613174 Jul 26 04:47:28.973236 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2168/4445] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:28 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:28.981793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:28.983089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:28.997120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:28.997576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:28.998994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:28.999698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:29.213577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:29.229000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:29.231433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:29.233431 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b5077de-c338-4f6b-a8fb-af18e364ed41 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.262539 Jul 26 04:47:29.250561 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2169/4446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:28 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:29.256003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:29.256900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:29.263694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:29.264489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:29.265484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:29.266221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:29.466143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:29.475962 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9ae3dce-7810-4d95-91b6-fec9ff92a936 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 200 len: 1606 microversion: 2.1 time: 0.223896 Jul 26 04:47:29.481550 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2170/4447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:29 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 1606 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:29.491988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:29.498266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:29.523506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:29.525320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:29.527394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:29.529958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:29.538417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:29.875143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:29.885112 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2eddc30-8bfd-429c-ae37-c067b3b6f97f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1524 microversion: 2.1 time: 0.402211 Jul 26 04:47:29.897062 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2171/4448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:29 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1524 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:30.038354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-06be141e-7630-4402-ad9b-9688efe2858f req-ae0d788e-6cba-4a83-9dbb-50551f6dbde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04ec941-3381-4c35-87f8-c8fab9a27640", "name": "network-vif-deleted", "tag": "d7190e4a-96bd-460b-8852-24f4fbc72812"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:30.056292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06be141e-7630-4402-ad9b-9688efe2858f req-ae0d788e-6cba-4a83-9dbb-50551f6dbde3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.058229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06be141e-7630-4402-ad9b-9688efe2858f req-ae0d788e-6cba-4a83-9dbb-50551f6dbde3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.101488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-06be141e-7630-4402-ad9b-9688efe2858f req-ae0d788e-6cba-4a83-9dbb-50551f6dbde3 service nova] Creating event network-vif-deleted:d7190e4a-96bd-460b-8852-24f4fbc72812 for instance e04ec941-3381-4c35-87f8-c8fab9a27640 on n-h1-848886-16 Jul 26 04:47:30.111322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-06be141e-7630-4402-ad9b-9688efe2858f req-ae0d788e-6cba-4a83-9dbb-50551f6dbde3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212454 Jul 26 04:47:30.112353 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2172/4449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:30.125804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:30.126939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:30.141690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.144938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.146381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.147045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.688058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.699703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.702347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.703997 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f089e4cd-f02a-4c3b-8072-a44830d6ad26 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.588457 Jul 26 04:47:30.705757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2173/4450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:30 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:30.711812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:30.712628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:30.722902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.724003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.724977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.726842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.891171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.902186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.905302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:30.907169 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c7350e5-7a61-4469-97c9-cc913ce8850e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.199893 Jul 26 04:47:30.920716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2174/4451] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:30 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:30.936777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:30.937708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:30.950712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.951946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.953012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:30.953676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:30.979372 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 HTTP/1.1 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e04ec941-3381-4c35-87f8-c8fab9a27640'} Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:30.981891 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:47:30.987004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:30.988764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42fe0ec4-8875-4671-8d1c-93038929bf4e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 404 len: 111 microversion: 2.1 time: 0.066687 Jul 26 04:47:30.993409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2175/4452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:30 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:47:31.000336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:31.002291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:31.008900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.010462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.012467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.013599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.083935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:31.084938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:31.085619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:31.086055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:31.086496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:31.097276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.097730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.098570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.099375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.123721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:31.130131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Getting quotas for user 14659647f8cf4386bf91eecd847e8aab and project 12e8c19499ee46cea2e52ec98141c310. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:31.152664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:47:31.153352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:47:31.227589 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c94fb3db-38fc-465e-8018-9bf4b284de61 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.031076 Jul 26 04:47:31.230851 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2278/4453] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:47:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:47:31.242355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e18d644-f9b4-4097-8013-459f7b5d9f1c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '.version_select at 0x7f38b5123430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:31.287453 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e18d644-f9b4-4097-8013-459f7b5d9f1c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120005778" status: 202 len: 0 microversion: 2.1 time: 0.055129 Jul 26 04:47:31.288697 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2279/4454] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:47:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120005778 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:47:31.301371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee72e1cf-9e91-4456-a247-b05dd7b953d8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:31.304214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee72e1cf-9e91-4456-a247-b05dd7b953d8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:31.325038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:31.334834 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5e5405c-6a8a-4904-90ec-4b721acab6bd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1506 microversion: 2.1 time: 0.340240 Jul 26 04:47:31.337657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2176/4455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:30 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:31.491123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee72e1cf-9e91-4456-a247-b05dd7b953d8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:31.505097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee72e1cf-9e91-4456-a247-b05dd7b953d8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1209 microversion: 2.1 time: 0.213483 Jul 26 04:47:31.506579 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2280/4456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:31 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1209 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:31.739834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:31.740506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:31.748104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.748797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.749847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.750544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.937496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:31.938527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:31.957812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.958728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:31.961198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:31.963092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.159564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.183119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.187770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.192663 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad11ea7e-b43d-44a4-9f35-616358f19098 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.258435 Jul 26 04:47:32.194422 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2281/4457] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:31 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:32.284750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.295876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.303201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.304613 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8428167-6e3b-4da5-86a1-909e31e14e00 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.578537 Jul 26 04:47:32.305348 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2177/4458] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:31 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:32.364484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:32.365241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:32.375071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:32.375629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.377050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:32.377580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.528454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:32.529452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:32.548920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:32.568610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.569682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:32.570309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.776202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:32.845837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.860717 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6935aabc-2869-4203-836e-a539d631b033 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1506 microversion: 2.1 time: 0.504640 Jul 26 04:47:32.860717 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2282/4459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:32 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:32.864488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-17dc7595-6773-4f0a-8cc5-c96bc91282ca req-e5b48e74-db45-4e97-b8f0-601162122090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f969b-50ed-48e6-b0a9-cf215214028d", "tag": "cdd31367-e39d-413b-b346-3a34e9faf646"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:32.879536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:32.883291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-17dc7595-6773-4f0a-8cc5-c96bc91282ca req-e5b48e74-db45-4e97-b8f0-601162122090 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:32.883762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-17dc7595-6773-4f0a-8cc5-c96bc91282ca req-e5b48e74-db45-4e97-b8f0-601162122090 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:32.900137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-17dc7595-6773-4f0a-8cc5-c96bc91282ca req-e5b48e74-db45-4e97-b8f0-601162122090 service nova] Creating event network-changed:cdd31367-e39d-413b-b346-3a34e9faf646 for instance 122f969b-50ed-48e6-b0a9-cf215214028d on n-h1-848886-16 Jul 26 04:47:32.908240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-17dc7595-6773-4f0a-8cc5-c96bc91282ca req-e5b48e74-db45-4e97-b8f0-601162122090 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045840 Jul 26 04:47:32.910917 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20038564-cace-4757-8eda-ca3eb4488bcb tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1269 microversion: 2.1 time: 0.388585 Jul 26 04:47:32.911380 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2283/4460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:32.911826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2178/4461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:32 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1269 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:33.019837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c35a660-1217-4a5b-b2f7-60591134d189 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: .version_select at 0x7f38b4992280>, body: {"keypair": {"name": "tempest-keypair-1111097576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELImCNK9iTHuCBHMruYGcsSd2j5nEbwu9vcvDrlsxERMdyPDldulhxJeaGKYNG6ISvYjEvtVQpVE9IE6AWvvVNLR3yGLH/4JEXN0+Lu6uxPsQ0E/cHYOATimx5fwUv5qg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:33.039756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-9c35a660-1217-4a5b-b2f7-60591134d189 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:33.048328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-9c35a660-1217-4a5b-b2f7-60591134d189 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for user f4a7bc18117240aeb6ef844585458f38 and project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:33.085806 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c35a660-1217-4a5b-b2f7-60591134d189 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071479 Jul 26 04:47:33.087094 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2284/4462] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:47:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:33.221463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:33.222247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:33.237395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.239053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.244091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.244851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.332206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:33.334360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:33.343719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.344933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.346405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.347235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.374191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.382912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.388863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.393752 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-62d0f260-6e6b-495c-a24d-ce7f88be88dd tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.176180 Jul 26 04:47:33.394985 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2179/4463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:33 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:33.706317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b9741e06-d50d-48ea-a50b-9e8d5fd30d12 req-f7573ee0-e16d-40f3-8b66-764d8d6e5176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f78cb3-ded8-4fa4-888f-bd0ea2b669d4", "name": "network-vif-unplugged", "status": "completed", "tag": "3bfbfffe-4ebb-4571-8c39-b48cebd8cb39"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:33.723147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.727157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b9741e06-d50d-48ea-a50b-9e8d5fd30d12 req-f7573ee0-e16d-40f3-8b66-764d8d6e5176 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.727157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b9741e06-d50d-48ea-a50b-9e8d5fd30d12 req-f7573ee0-e16d-40f3-8b66-764d8d6e5176 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.738292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.742842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:33.747069 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6ca4cff-e748-4e42-b334-66a9fcb0b9f6 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.418623 Jul 26 04:47:33.748427 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2285/4464] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:33 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:33.767115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b9741e06-d50d-48ea-a50b-9e8d5fd30d12 req-f7573ee0-e16d-40f3-8b66-764d8d6e5176 service nova] Creating event network-vif-unplugged:3bfbfffe-4ebb-4571-8c39-b48cebd8cb39 for instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 on n-h1-848886-16 Jul 26 04:47:33.773589 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b9741e06-d50d-48ea-a50b-9e8d5fd30d12 req-f7573ee0-e16d-40f3-8b66-764d8d6e5176 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070831 Jul 26 04:47:33.774833 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2180/4465] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:33.882967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:33.883677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:33.899467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.900123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.901010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.901606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.932678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:33.935008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:33.943095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:33.947602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.951598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:33.952556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:33.953123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:34.456565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:34.468505 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-718bb04f-96c8-4cc9-b8b3-e6a70e170d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.539792 Jul 26 04:47:34.470124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2181/4466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:33 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:34.487157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:34.487930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:34.500337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:34.501242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:34.502235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:34.503294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:34.563120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:34.571834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ed2f5f0-7e3b-470a-bbc5-c18fee8b0b6f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1506 microversion: 2.1 time: 0.692474 Jul 26 04:47:34.571834 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2286/4467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:33 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:34.654657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:34.684487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:34.693670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:34.694898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8952738b-dc06-4a61-9ea1-30fb12c6cc60 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.223191 Jul 26 04:47:34.698878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2182/4468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:34 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:34.773744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:34.774720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:34.782212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:34.783581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:34.784568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:34.785789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:35.491838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:35.493218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:35.507269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:35.510864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:35.512299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:35.514841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:35.516476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:35.538314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:35.540353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:35.555993 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45ab71e9-6001-4b4a-aba8-c01595b1e07c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.777495 Jul 26 04:47:35.572786 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2287/4469] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:34 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:35.595991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:35.598398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:35.608015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:35.609415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:35.610796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:35.612279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.163702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:36.179968 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0585732-e584-4bdb-af59-ce29ac70f47c tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.692261 Jul 26 04:47:36.201070 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2183/4470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:35 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:36.212394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:36.214199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:36.223232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.224000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.225350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.226120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.288644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:36.297510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2340194-dd0b-4268-ac1d-625cc34287a9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 200 len: 1449 microversion: 2.1 time: 0.708138 Jul 26 04:47:36.298099 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2288/4471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:35 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 1449 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:36.316253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-be6b5ec2-74e4-4073-bc4c-af9026975d93 req-23052bcf-e1d4-4e73-97fb-857b06d9aea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935ee720-e7d0-433b-85bb-df613b0f2bd7", "tag": "643514b8-5577-4579-8e09-d82e404b6985"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:36.338462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-be6b5ec2-74e4-4073-bc4c-af9026975d93 req-23052bcf-e1d4-4e73-97fb-857b06d9aea3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.338947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-be6b5ec2-74e4-4073-bc4c-af9026975d93 req-23052bcf-e1d4-4e73-97fb-857b06d9aea3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.359939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-be6b5ec2-74e4-4073-bc4c-af9026975d93 req-23052bcf-e1d4-4e73-97fb-857b06d9aea3 service nova] Creating event network-changed:643514b8-5577-4579-8e09-d82e404b6985 for instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 on n-h2-848886-16 Jul 26 04:47:36.372361 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-be6b5ec2-74e4-4073-bc4c-af9026975d93 req-23052bcf-e1d4-4e73-97fb-857b06d9aea3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068958 Jul 26 04:47:36.374954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2289/4472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:36.386982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:36.387252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:36.409248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.409710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.410609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.410987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.416343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:36.427231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:36.429185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:36.430807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-764902ce-73b7-4f58-b40c-8059bbbce8b0 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.228350 Jul 26 04:47:36.432224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2184/4473] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:36 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:36.456791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:36.476684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Working on deleting snapshot 73ed42c4-0eca-4a5a-b91e-a6f472699ddc from shelved instance... Jul 26 04:47:36.583965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:36.584585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:36.595719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.596180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.596964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:36.601606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:36.648976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:37.489181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:37.504614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:37.506418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:37.509496 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f02092da-e47f-440b-8d66-98ea59325743 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.929421 Jul 26 04:47:37.526181 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2185/4474] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:36 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:37.526181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:37.526181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:37.538677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:37.541905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:37.547047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:37.547586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:37.624769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Doing local delete in cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119488) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 04:47:37.625601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:37.626102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:37.626783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 04:47:37.631114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] deallocate_for_instance() {{(pid=119488) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 04:47:37.904557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:37.916449 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97ca62f3-d9ac-4f00-9f06-0c722df20c2a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.402153 Jul 26 04:47:37.919306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2186/4475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:37 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:37.934597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:37.936506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:37.951515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:37.952071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:37.952872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:37.953317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:38.060799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:38.071751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:38.074257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:38.075927 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a128da6-b049-4b20-b4d1-52af4a07aefa tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.154277 Jul 26 04:47:38.077417 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2187/4476] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:37 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:38.084014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1953894764", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc1ee214-e96f-4789-b811-84b33c5dd5ec"}], "security_groups": [{"name": "tempest-securitygroup--1177151374"}], "key_name": "tempest-keypair-1111097576", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:38.388513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] validate_networks() for [('bc1ee214-e96f-4789-b811-84b33c5dd5ec', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:47:39.063368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Updating instance_info_cache with network_info: [] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 04:47:39.411629 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c623cce5-47e8-4c90-bb43-aa7b4e9679f3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 204 len: 0 microversion: 2.1 time: 3.034732 Jul 26 04:47:39.412363 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2290/4477] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:47:36 2022] DELETE /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 0 bytes in 3037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:47:39.422774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:39.423414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:39.430999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.431461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.433193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.436522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.499571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:39.500080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:39.502528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:39.503166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:39.503612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:39.534304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.534798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.535638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.536090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.573646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:39.581810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Getting quotas for user f4a7bc18117240aeb6ef844585458f38 and project 92a2fba339a44f20b2a9997ed4eb71e4. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:39.619917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:47:39.625072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:47:39.744045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bedd7cd7-ea6a-40e0-8d45-11c1d5c43ad8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.664991 Jul 26 04:47:39.745062 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2188/4478] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:47:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:47:39.750600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:39.751571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:39.787460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.791065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.793223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.794317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.878432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:39.892368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:39.896186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:39.900766 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88deb94c-ec40-4557-ac63-18f16ec8f73a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.480969 Jul 26 04:47:39.907043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2291/4479] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:39 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:39.912002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-32a307e6-04d7-451b-8899-1deb41bcd53f req-f3467fc5-3750-4902-92fe-7488c63066cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f78cb3-ded8-4fa4-888f-bd0ea2b669d4", "name": "network-vif-deleted", "tag": "3bfbfffe-4ebb-4571-8c39-b48cebd8cb39"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:39.933921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-32a307e6-04d7-451b-8899-1deb41bcd53f req-f3467fc5-3750-4902-92fe-7488c63066cb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.934394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-32a307e6-04d7-451b-8899-1deb41bcd53f req-f3467fc5-3750-4902-92fe-7488c63066cb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.964502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_external_events [req-32a307e6-04d7-451b-8899-1deb41bcd53f req-f3467fc5-3750-4902-92fe-7488c63066cb service nova] Unable to find a host for instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4. Dropping event network-vif-deleted {{(pid=119488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 04:47:39.965737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-32a307e6-04d7-451b-8899-1deb41bcd53f req-f3467fc5-3750-4902-92fe-7488c63066cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057665 Jul 26 04:47:39.967053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2292/4480] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 04:47:39.973059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:39.974424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:39.985853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.986599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:39.993377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:39.995348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:40.169011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:40.184089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:40.188869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:40.192676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d3ade40-9a9d-4afa-844a-c78ce2a832f8 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.222167 Jul 26 04:47:40.195220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2293/4481] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:39 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:40.209621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:40.211912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:40.220548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:40.221010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:40.221984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:40.222465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:40.241137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 HTTP/1.1 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '52f78cb3-ded8-4fa4-888f-bd0ea2b669d4'} Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:40.257669 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:40.264893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-665756cf-83eb-499f-aa7b-adf7732c1533 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 404 len: 111 microversion: 2.1 time: 0.062476 Jul 26 04:47:40.285772 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2294/4482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:40 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:47:40.297636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9282719c-5572-4118-bec7-8b8e66285fad tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:40.300820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9282719c-5572-4118-bec7-8b8e66285fad tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:40.311792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:40.320333 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5e1b7f5-83ab-411d-be31-9a1d271ae7f8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.573405 Jul 26 04:47:40.325103 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2189/4483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:39 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:40.335179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-28a5f359-93af-477d-99a8-cf1f9bdb867d req-dc186102-5c60-4590-9b0e-81af84fdb9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f969b-50ed-48e6-b0a9-cf215214028d", "name": "network-vif-plugged", "status": "completed", "tag": "cdd31367-e39d-413b-b346-3a34e9faf646"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:40.356433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-28a5f359-93af-477d-99a8-cf1f9bdb867d req-dc186102-5c60-4590-9b0e-81af84fdb9a1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:40.357138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-28a5f359-93af-477d-99a8-cf1f9bdb867d req-dc186102-5c60-4590-9b0e-81af84fdb9a1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:40.380391 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-28a5f359-93af-477d-99a8-cf1f9bdb867d req-dc186102-5c60-4590-9b0e-81af84fdb9a1 service nova] Creating event network-vif-plugged:cdd31367-e39d-413b-b346-3a34e9faf646 for instance 122f969b-50ed-48e6-b0a9-cf215214028d on n-h1-848886-16 Jul 26 04:47:40.397481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-28a5f359-93af-477d-99a8-cf1f9bdb867d req-dc186102-5c60-4590-9b0e-81af84fdb9a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068459 Jul 26 04:47:40.398560 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2190/4484] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:40.446999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9282719c-5572-4118-bec7-8b8e66285fad tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:40.469949 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9282719c-5572-4118-bec7-8b8e66285fad tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1238 microversion: 2.1 time: 0.182780 Jul 26 04:47:40.471740 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2295/4485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:40 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:40.487613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1992104456", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:40.582065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:47:40.925777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:40.926466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:40.943029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:40.943525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:40.947181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:40.949005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:41.113717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:41.400680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.413665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.418782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.424014 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d6299452-fe0c-4e8f-b8de-c9f629662f97 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1361 microversion: 2.26 time: 0.503207 Jul 26 04:47:41.426545 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2296/4486] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:40 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:41.440303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:41.442302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:41.461880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:41.464080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:41.465181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:41.468495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:41.736611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.751194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.758696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:41.760049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28db82b6-d7b4-419f-a88a-b19b3e63976e tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.331009 Jul 26 04:47:41.769031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2297/4487] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:41 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:41.778198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:41.778750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:41.792609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:41.797748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:41.798243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:41.799053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:41.799499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.147532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:47:42.148100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:47:42.148424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:47:42.148839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:47:42.149258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:47:42.175315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.175315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.175315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.175315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.208366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:42.218917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:42.240059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:47:42.243325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:47:42.287230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.305142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ac212256-b6b7-4a43-af18-fc2097d04fff tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.534808 Jul 26 04:47:42.308385 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2298/4488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:41 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:42.333366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:42.334283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:42.344112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.344874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.345856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.346568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.376410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6784b48c-dda0-439c-9dad-acc4818717ba tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893992 Jul 26 04:47:42.380365 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2191/4489] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:47:42.392963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f3d00f5b-3768-4844-84c2-c9f3415aefd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:42.398364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f3d00f5b-3768-4844-84c2-c9f3415aefd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:42.548823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f3d00f5b-3768-4844-84c2-c9f3415aefd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.558808 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f3d00f5b-3768-4844-84c2-c9f3415aefd0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1215 microversion: 2.1 time: 0.172645 Jul 26 04:47:42.560841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2192/4490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:42 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:42.567524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:42.568442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:42.570025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.577309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:42.584457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-597a2e2e-a74d-4ea1-99b0-c5a51c04e46d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1296 microversion: 2.1 time: 0.271621 Jul 26 04:47:42.585957 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2299/4491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:42 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1296 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:42.593860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.597850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.600278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.600936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.788048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:42.788658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:42.820151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.827318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.831893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.833001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.856326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.859738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.865210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:42.877021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4caf2ba1-f58e-47a6-a118-690b8674ee72 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1543 microversion: 2.26 time: 0.312518 Jul 26 04:47:42.880089 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2193/4492] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:42 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1543 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:42.910738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38bac9ba60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:42.945341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.946058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.949253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:42.965176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.972209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:42.973550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:42.980408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.052225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.053391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.077560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.078325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.118853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:43.140720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6c7d17a-9cb3-4eef-b9a2-3a182725fae5 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-227195699" status: 201 len: 0 microversion: 2.26 time: 0.236917 Jul 26 04:47:43.143135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2194/4493] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Jul 26 04:47:42 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-227195699 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 04:47:43.157709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eab19562-d6b1-4e69-8087-1750dbbf5ea0 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5256e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.171884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eab19562-d6b1-4e69-8087-1750dbbf5ea0 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.173045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eab19562-d6b1-4e69-8087-1750dbbf5ea0 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.189695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eab19562-d6b1-4e69-8087-1750dbbf5ea0 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-227195699" status: 204 len: 0 microversion: 2.26 time: 0.040222 Jul 26 04:47:43.190957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2195/4494] 10.222.0.43 () {60 vars in 1358 bytes} [Tue Jul 26 04:47:43 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-227195699 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 04:47:43.200837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b52464c0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.217376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.219204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.222231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:43.231045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:43.243293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.243913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.246036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.248046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.321789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.324302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.360022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:43.392013 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4a40dc6-d157-46ce-a87b-52079ae64f4c tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 204 len: 0 microversion: 2.26 time: 0.196271 Jul 26 04:47:43.393280 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2196/4495] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Jul 26 04:47:43 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 04:47:43.399453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.400603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:43.410324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.411020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.411995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.414767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.567896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:43.584684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:43.586987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:43.592571 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f483e527-5fc7-4101-8e5e-063ee6898407 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.809289 Jul 26 04:47:43.593490 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2300/4496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:42 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:43.605675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bea2413a-7f58-443c-859d-afde7b505ee4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5a28ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.629232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bea2413a-7f58-443c-859d-afde7b505ee4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.629694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bea2413a-7f58-443c-859d-afde7b505ee4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.659645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bea2413a-7f58-443c-859d-afde7b505ee4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 12 microversion: 2.26 time: 0.062415 Jul 26 04:47:43.662770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2301/4497] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Jul 26 04:47:43 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:43.672929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.679070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:43.708171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.708879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.711088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.712978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.791216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:43.801652 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3dea63a9-2911-4ee5-be02-82c6b9899909 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 0.407120 Jul 26 04:47:43.803183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2197/4498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:43 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:43.810204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:43.811425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:43.821867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.823072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.824733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:43.825403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:43.965129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:43.982506 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d77e993-29c6-4703-947a-8d8826c209a8 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1296 microversion: 2.1 time: 0.177586 Jul 26 04:47:43.982768 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2198/4499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:43 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:43.988112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b509f790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.019736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.024809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.025535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:44.046851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.056836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.058479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.062010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.129832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.142431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.161893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.162566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.217904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:44.265663 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1845edf7-f7bc-4ee9-b90c-64947d9b741e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-767798653" status: 201 len: 0 microversion: 2.26 time: 0.270484 Jul 26 04:47:44.273801 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2199/4500] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Jul 26 04:47:43 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-767798653 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 04:47:44.284394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9df284d0-efac-44ab-befe-00fe72eeb0a7 req-54ce4c11-d734-4046-a437-1a176f903221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ee720-e7d0-433b-85bb-df613b0f2bd7", "name": "network-vif-plugged", "status": "completed", "tag": "643514b8-5577-4579-8e09-d82e404b6985"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:44.311612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9df284d0-efac-44ab-befe-00fe72eeb0a7 req-54ce4c11-d734-4046-a437-1a176f903221 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.313697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9df284d0-efac-44ab-befe-00fe72eeb0a7 req-54ce4c11-d734-4046-a437-1a176f903221 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.395471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9df284d0-efac-44ab-befe-00fe72eeb0a7 req-54ce4c11-d734-4046-a437-1a176f903221 service nova] Creating event network-vif-plugged:643514b8-5577-4579-8e09-d82e404b6985 for instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 on n-h2-848886-16 Jul 26 04:47:44.441552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9df284d0-efac-44ab-befe-00fe72eeb0a7 req-54ce4c11-d734-4046-a437-1a176f903221 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129989 Jul 26 04:47:44.443082 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2200/4501] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:44.452940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-979a1bb2-1f56-43c8-a10a-e13b5965f31a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5a45c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.488756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-979a1bb2-1f56-43c8-a10a-e13b5965f31a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.494227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-979a1bb2-1f56-43c8-a10a-e13b5965f31a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.514287 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-979a1bb2-1f56-43c8-a10a-e13b5965f31a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 35 microversion: 2.26 time: 0.067323 Jul 26 04:47:44.515847 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2201/4502] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Jul 26 04:47:44 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 35 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:44.530017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b54408b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.540632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.541207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.541807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:44.551200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.551431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.552232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.552678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.579429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.579900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.591521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:44.628122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:44.639921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2691e853-7af8-498d-ac42-03fcb568b021 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1219 microversion: 2.1 time: 0.970775 Jul 26 04:47:44.640525 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2302/4503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:43 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1219 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:44.649292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:44.656554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.659965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:44.685484 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f943c184-830e-443e-bdfc-9161607bda6a tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-767798653" status: 204 len: 0 microversion: 2.26 time: 0.161482 Jul 26 04:47:44.685903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.690033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.690278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2202/4504] 10.222.0.43 () {60 vars in 1361 bytes} [Tue Jul 26 04:47:44 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-767798653 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:44.691102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.691944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.695446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26f32074-4ea0-4099-84ca-569e463e9458 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5ec6700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.709340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26f32074-4ea0-4099-84ca-569e463e9458 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.709863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26f32074-4ea0-4099-84ca-569e463e9458 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.743107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26f32074-4ea0-4099-84ca-569e463e9458 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 12 microversion: 2.26 time: 0.051607 Jul 26 04:47:44.747738 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2203/4505] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Jul 26 04:47:44 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:44.764066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5246e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.782273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.790697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.791538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:44.809600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.810059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.819027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.819673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.873075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:44.874862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:44.905121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:44.957282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c8fb935-c61d-49f8-8b36-5aafdd8e85de tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 204 len: 0 microversion: 2.26 time: 0.204884 Jul 26 04:47:44.964504 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2204/4506] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Jul 26 04:47:44 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:44.972855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:44.973013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:44.987957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:45.002794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:45.005118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.006908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:45.008023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.008895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.009350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.017946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b449c422-0e84-4aaf-97c3-396137baa401 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.375790 Jul 26 04:47:45.034374 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2303/4507] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:44 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:45.053128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5f5e5e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:45.090832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.093259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.093934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:45.133894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.138781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.139659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.142677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.227850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.236242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.249848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.250776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.344968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:45.384300 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd0fde64-6205-44e8-81b2-35e180e00f89 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-665070929" status: 201 len: 0 microversion: 2.26 time: 0.346985 Jul 26 04:47:45.389086 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2304/4508] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Jul 26 04:47:45 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-665070929 => generated 0 bytes in 354 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 04:47:45.405209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:45.406184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:45.420959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.426059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.428607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:45.429082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:45.958114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:45.966896 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d178430-65ba-4dff-bda5-9247bdf07ad0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.576442 Jul 26 04:47:45.976511 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2305/4509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:45 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:45.993441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5a5a670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.022464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.028554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.030902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.055069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.055534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.056347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.058735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.116123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:46.136998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43d43ee1-63d3-4ec5-b12a-6b0f26632a24 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1309 microversion: 2.1 time: 1.172992 Jul 26 04:47:46.137627 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2205/4510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:44 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1309 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:46.153218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.154357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.173703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.174418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.176429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.177117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.198300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.198648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.199773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.200229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.242467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:46.282079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2c499da-7fd5-48a6-a1e6-8e724203dcf3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-682393304" status: 201 len: 0 microversion: 2.26 time: 0.304109 Jul 26 04:47:46.283026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2306/4511] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Jul 26 04:47:45 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-682393304 => generated 0 bytes in 306 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 04:47:46.288229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.291961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.311527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.312148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.313032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.313579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.434444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:46.458233 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ae658d1-24aa-4699-aefa-e5825e6e5765 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1273 microversion: 2.1 time: 0.303745 Jul 26 04:47:46.459790 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2206/4512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:46 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:46.466013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b661d040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.476602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.477833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.478551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.487310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.488400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.489484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.490110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.525221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.525981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.567694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:46.611494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:46.618091 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ef3bb51-1d10-4268-9577-93d3a1ee0de9 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 204 len: 0 microversion: 2.26 time: 0.156783 Jul 26 04:47:46.620288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2207/4513] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Jul 26 04:47:46 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:46.631410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a3c00d7-9368-483e-82ba-4a382355a091 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5245ca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.631684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:46.635232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:46.636832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b526b5b-48dc-487d-81fd-b60837a0f81f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.352628 Jul 26 04:47:46.639851 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2307/4514] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:46 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:46.677507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a3c00d7-9368-483e-82ba-4a382355a091 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.678146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a3c00d7-9368-483e-82ba-4a382355a091 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.724832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a3c00d7-9368-483e-82ba-4a382355a091 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 12 microversion: 2.26 time: 0.096820 Jul 26 04:47:46.733624 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2208/4515] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Jul 26 04:47:46 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 12 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:46.742916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5a28dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.770320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.770890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.771892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.795844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.807487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.808446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.809008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.861453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.862182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.890736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:46.922773 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ea9a058-39b0-479d-b98d-77a79b2f566b tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 204 len: 0 microversion: 2.26 time: 0.187299 Jul 26 04:47:46.923406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2308/4516] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Jul 26 04:47:46 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:46.935575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38bac9b790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.946040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.946776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.947342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:46.954053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.954823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.955827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:46.956480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:46.997741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:46.998762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.008671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.009452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.010239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.011260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.015680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.016444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.038712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.039580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.096828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:47.128001 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae5e0d6f-870d-4d3e-bc3a-982d56d9f8e4 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-1787493215" status: 201 len: 0 microversion: 2.26 time: 0.195634 Jul 26 04:47:47.134830 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2209/4517] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Jul 26 04:47:46 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-1787493215 => generated 0 bytes in 200 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 26 04:47:47.141411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b5a45820>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:47.165299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.165762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.166276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.181485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.181854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.182780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.183365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.214571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.215256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.225721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.225922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.268027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:47.303639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8e5de394-f249-485b-a6cc-8afdc1b149a3 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-2142637223" status: 201 len: 0 microversion: 2.26 time: 0.166713 Jul 26 04:47:47.319604 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2210/4518] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Jul 26 04:47:47 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags/tempest-tag-2142637223 => generated 0 bytes in 184 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 26 04:47:47.334056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:47.336397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.365660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.366286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.367373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.368449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.459699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:47.467999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-969a0058-0a40-40c8-a52c-c3f456f9a44b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.475248 Jul 26 04:47:47.474854 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2309/4519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:46 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:47.484479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Action: 'update_all', calling method: .version_select at 0x7f38b5ee85e0>, body: {"tags": ["tempest-tag-1731865066", "tempest-tag-804563567"]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:47.507504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.507504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.511113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.527156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.533661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.534662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.535119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.587475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.588143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.640908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:47.693774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c39f360-085f-4276-9ef2-9396e882003e tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 61 microversion: 2.26 time: 0.217505 Jul 26 04:47:47.703306 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2310/4520] 10.222.0.43 () {62 vars in 1312 bytes} [Tue Jul 26 04:47:47 2022] PUT /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 61 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:47.711848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:47.712619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.740947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.741418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.743161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.749772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.912185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:47.928065 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfd354f6-1b13-4919-ac15-092c50ab984f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1489 microversion: 2.1 time: 0.606158 Jul 26 04:47:47.928652 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2211/4521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:47 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1489 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:47.947570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:47.948937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:47.961168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.961616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:47.962637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:47.963255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.155086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:48.180898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:48.183563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:48.186295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c58438f-1a9d-43f5-8d77-ca3b89392321 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.253559 Jul 26 04:47:48.187398 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2212/4522] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:47 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:48.193106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb287a25-0bfb-4164-bdae-7e7bf5f03719 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38bac9bdc0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:48.204047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb287a25-0bfb-4164-bdae-7e7bf5f03719 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.205122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb287a25-0bfb-4164-bdae-7e7bf5f03719 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.220435 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb287a25-0bfb-4164-bdae-7e7bf5f03719 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 200 len: 61 microversion: 2.26 time: 0.031472 Jul 26 04:47:48.230430 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2213/4523] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Jul 26 04:47:48 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 61 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:48.239250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1705125020"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:48.242760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:48.251730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.252385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.253723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.254850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.269298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:48.271980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:48.285302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-348b2e6a-db60-48bc-8c31-d40ada5aecc0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.585968 Jul 26 04:47:48.291716 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2311/4524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:47 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:48.338739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:48.364862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ecae5890-85b6-47e1-bf86-1181f76cc446 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "PUT /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1074 microversion: 2.1 time: 0.132768 Jul 26 04:47:48.365879 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2214/4525] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:47:48 2022] PUT /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1074 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:48.380566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '.version_select at 0x7f38b54a2550>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:48.391291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.391777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.392261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:48.399173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.399776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.400551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.400997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.432244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.433477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.469651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lazy-loading 'flavor' on Instance uuid 122f969b-50ed-48e6-b0a9-cf215214028d {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:47:48.499358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68b82756-10c7-4cd9-bf7d-b1ba885fb34f tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags" status: 204 len: 0 microversion: 2.26 time: 0.129284 Jul 26 04:47:48.504599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2215/4526] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Jul 26 04:47:48 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d/tags => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:48.513683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:48.514363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:48.527834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.534176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.535225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.535684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.706651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Action: 'create', calling method: .version_select at 0x7f38b51b9790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:48.773590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Getting quotas for project 40f1ccb8cdd04dcaae0e798f5dde408f. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:48.788116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Getting quotas for user 2682d09f68514c1dabdc0583f32f4ddc and project 40f1ccb8cdd04dcaae0e798f5dde408f. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:48.882006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Getting quotas for project 40f1ccb8cdd04dcaae0e798f5dde408f. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:47:48.888414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Getting quotas for user 2682d09f68514c1dabdc0583f32f4ddc and project 40f1ccb8cdd04dcaae0e798f5dde408f. Resources: {'server_groups'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:47:48.912377 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6a94aa5-5917-415e-a840-7a565f1be062 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.613356 Jul 26 04:47:48.919686 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2312/4527] 10.222.0.43 () {62 vars in 1214 bytes} [Tue Jul 26 04:47:48 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:47:48.925566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:48.931874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:48.940136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.940867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:48.941814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:48.946059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.153734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.166350 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f929f460-52d9-4984-9957-9c0b17a8722d tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.241841 Jul 26 04:47:49.167967 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2313/4528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:48 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:49.184920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.185696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:49.198803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.199808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.200813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.201461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.268547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:49.269228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.280105 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0bfdab27-589b-49f4-8f9b-285f76c71005 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1500 microversion: 2.1 time: 0.774315 Jul 26 04:47:49.286501 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2216/4529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:48 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1500 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:49.291677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6c6ee819-f28b-4a9c-848e-dc53e4528edc req-5ee8ec1e-fa4d-4293-8ba6-4abe0360c48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bceb5e2-f458-4ca6-b746-c85ab51ba1ee", "tag": "504a5ae3-a563-4cf5-85e8-590a1b7723e4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:49.317158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6c6ee819-f28b-4a9c-848e-dc53e4528edc req-5ee8ec1e-fa4d-4293-8ba6-4abe0360c48f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.317608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6c6ee819-f28b-4a9c-848e-dc53e4528edc req-5ee8ec1e-fa4d-4293-8ba6-4abe0360c48f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.353772 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6c6ee819-f28b-4a9c-848e-dc53e4528edc req-5ee8ec1e-fa4d-4293-8ba6-4abe0360c48f service nova] Creating event network-changed:504a5ae3-a563-4cf5-85e8-590a1b7723e4 for instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee on n-h2-848886-16 Jul 26 04:47:49.366783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6c6ee819-f28b-4a9c-848e-dc53e4528edc req-5ee8ec1e-fa4d-4293-8ba6-4abe0360c48f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078895 Jul 26 04:47:49.367717 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2217/4530] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:49.391814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-82b457d9-2f52-4c0d-9f6e-1b989767e947 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.410628 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-82b457d9-2f52-4c0d-9f6e-1b989767e947 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.041566 Jul 26 04:47:49.411610 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2218/4531] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:47:49.444282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.445022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:49.457248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d736f4ff-b663-453a-980b-666be8c91531 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 204 len: 0 microversion: 2.26 time: 0.284338 Jul 26 04:47:49.457878 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2314/4532] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:47:49 2022] DELETE /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:49.476439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.477311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.482758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.483731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.502905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.503591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:49.545449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.546490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.551191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.551891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.830601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.847782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9ecb955d-bc60-427f-93d5-ed612a4cc20d tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1500 microversion: 2.1 time: 0.379191 Jul 26 04:47:49.855783 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2315/4533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:49.861414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.867582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:49.877067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.879800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.880454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.883063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.883688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.886029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.887573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:49.896296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee6b42e9-21c0-4514-9c13-dd83373d0440 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.483451 Jul 26 04:47:49.921121 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2219/4534] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:49.926202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc303fba-dbc6-4122-8e46-1af7d7444ec9 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.947725 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc303fba-dbc6-4122-8e46-1af7d7444ec9 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998" status: 200 len: 235 microversion: 2.64 time: 0.025408 Jul 26 04:47:49.954644 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2220/4535] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 => generated 235 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:47:49.973333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:49.974507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:49.985810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.986292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:49.987290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:49.987893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.216484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:50.228917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c98e88eb-1bee-4a2d-864a-ccdd34660466 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.371718 Jul 26 04:47:50.230360 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2316/4536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:50.236849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-06bd83f4-f443-4d83-8780-5c98ee600ee1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:50.248093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06bd83f4-f443-4d83-8780-5c98ee600ee1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.248809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06bd83f4-f443-4d83-8780-5c98ee600ee1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.308957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-06bd83f4-f443-4d83-8780-5c98ee600ee1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Going to try to stop instance {{(pid=119488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:47:50.378755 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-06bd83f4-f443-4d83-8780-5c98ee600ee1 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "POST /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7/action" status: 202 len: 0 microversion: 2.1 time: 0.146387 Jul 26 04:47:50.380263 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2317/4537] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:47:50 2022] POST /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:47:50.388890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6cc5348-2ba5-4a25-905b-f3517506e7e5 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:50.426309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:50.427330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6cc5348-2ba5-4a25-905b-f3517506e7e5 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998" status: 204 len: 0 microversion: 2.64 time: 0.045688 Jul 26 04:47:50.428182 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2318/4538] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Jul 26 04:47:50 2022] DELETE /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:50.435921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:50.437155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:50.445496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:50.447035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:50.448889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4651413-4b66-4b73-94fd-0ef7ff561baa tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1549 microversion: 2.26 time: 0.492387 Jul 26 04:47:50.462179 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2221/4539] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:49 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1549 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:50.462423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.462423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.462423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.462423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.463057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:50.463355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:50.478616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.479396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.480344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.480942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.627660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:50.638016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-527f444c-fc18-4f34-88c5-a47aca2be5a0 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.207800 Jul 26 04:47:50.656685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2319/4540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:50 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:50.662915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cd5447d-918b-4cc3-a556-c822a90c0584 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:50.670227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2cd5447d-918b-4cc3-a556-c822a90c0584 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] HTTP exception thrown: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cd5447d-918b-4cc3-a556-c822a90c0584 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Request method failure captured: Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 HTTP/1.1 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33HzfVAs9ZP7DHVMbEIl20j_H9NLuR35H5rHWNiBTTIAfi4G2g0B2OxkuqCcGljDWlPmazoGZU1CfdTS9YebUe5m43T2CjDUCh0wjCXTg8VNAB5IKwOqO9iUzdc_f09DEmQ90jmrfywPkeFydJcXsM2kCduRiKkoyeQZO41yplF2BZg Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.64 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 40f1ccb8cdd04dcaae0e798f5dde408f Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerGroup264TestJSON-778519314 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40f1ccb8cdd04dcaae0e798f5dde408f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40f1ccb8cdd04dcaae0e798f5dde408f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40f1ccb8cdd04dcaae0e798f5dde408f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40f1ccb8cdd04dcaae0e798f5dde408f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerGroup264TestJSON-778519314 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 40f1ccb8cdd04dcaae0e798f5dde408f Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerGroup264TestJSON-778519314 Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerGroup264TestJSON-778519314-project Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2682d09f68514c1dabdc0583f32f4ddc Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerGroup264TestJSON-778519314-project Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6a8e9dc8-15f8-4944-bab6-16f0c2cf2998'} Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:50.672157 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2cd5447d-918b-4cc3-a556-c822a90c0584 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] Returning 404 to user: Instance group 6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2cd5447d-918b-4cc3-a556-c822a90c0584 tempest-ServerGroup264TestJSON-778519314 tempest-ServerGroup264TestJSON-778519314-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998" status: 404 len: 117 microversion: 2.64 time: 0.015336 Jul 26 04:47:50.676177 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2320/4541] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Jul 26 04:47:50 2022] DELETE /compute/v2.1/os-server-groups/6a8e9dc8-15f8-4944-bab6-16f0c2cf2998 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:47:50.929079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:50.929687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:50.944774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.950100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:50.950100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:50.950100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:51.195222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:51.220519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:51.230923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:51.234899 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ebd1a7b-11b2-49fa-b4e1-b021f2ac47b4 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1407 microversion: 2.54 time: 0.310043 Jul 26 04:47:51.238870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2321/4542] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:50 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:51.258542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5440539c-10d0-499f-b2a1-490786b96d35 req-201bd10a-f16a-4d78-b4ab-2b52a3851c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25de728e-64fe-4ae8-b3a5-0234ca2e0fbd", "tag": "47529a09-27f0-4ee4-9663-6fc680fec526"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:51.284675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5440539c-10d0-499f-b2a1-490786b96d35 req-201bd10a-f16a-4d78-b4ab-2b52a3851c7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:51.285234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5440539c-10d0-499f-b2a1-490786b96d35 req-201bd10a-f16a-4d78-b4ab-2b52a3851c7a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:51.333939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5440539c-10d0-499f-b2a1-490786b96d35 req-201bd10a-f16a-4d78-b4ab-2b52a3851c7a service nova] Creating event network-changed:47529a09-27f0-4ee4-9663-6fc680fec526 for instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd on n-h2-848886-16 Jul 26 04:47:51.346832 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5440539c-10d0-499f-b2a1-490786b96d35 req-201bd10a-f16a-4d78-b4ab-2b52a3851c7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104467 Jul 26 04:47:51.351563 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2322/4543] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:51.363385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:51.365407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:51.382513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:51.383135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:51.384027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:51.389447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:51.719372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:51.737719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a1f617a-3c32-44db-8f7a-cd83699d4f98 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 1.284483 Jul 26 04:47:51.739417 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2222/4544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:50 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:51.757008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:51.757911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:51.773939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:51.774843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:51.776422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:51.778375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.179274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.189444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.201717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.208454 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c20110b-7522-48b0-b07a-c7fda6011050 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1549 microversion: 2.26 time: 0.463064 Jul 26 04:47:52.210371 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2223/4545] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:51 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1549 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:52.218283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:52.219127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:52.226123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:52.232368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.233111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.238496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.239300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.493796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.508246 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99b73c56-2891-42c2-bb12-5251f105206f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 1.155029 Jul 26 04:47:52.509091 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2323/4546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:51 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:52.517580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:52.518623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:52.532891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.533602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.534668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.535615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.556701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=14 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:52.822894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.835710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.844616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:52.845936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95207e2a-60a7-4b4c-81c2-472abb8c7568 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1413 microversion: 2.54 time: 0.334178 Jul 26 04:47:52.846731 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2324/4547] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:52 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1413 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:52.869524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:52.870864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:52.876872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:52.878632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.879243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:52.882016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:52.882016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:53.004532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:53.026911 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6bff0cfa-ee58-40ea-b77c-bbbbef395ac7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.815249 Jul 26 04:47:53.030905 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2224/4548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:52 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:53.233924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:53.234792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:53.241550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:53.249610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:53.250800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:53.253739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:53.454193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:53.468073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:53.473442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e548594606490f91678f561fe6f19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78faeccd15784966ac61f1902a90a1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:53.482882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-356f5633-f9a2-4c83-abd5-32301346d42d tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 200 len: 1507 microversion: 2.26 time: 0.253523 Jul 26 04:47:53.492094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2225/4549] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:53 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:53.530196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:53.530957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:53.537836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:53.538520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:53.539439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:53.539987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:53.985706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:53.996820 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4d7f99f5-c5c1-4309-b3bc-76e6530727dd tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 1.132063 Jul 26 04:47:54.012223 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2325/4550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:52 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:54.021524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.038814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.040166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:54.053106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.054696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.055636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.056664 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad5be93c-19ef-4e88-a49c-38acca920eec tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.529375 Jul 26 04:47:54.057348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.075393 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2226/4551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:53 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:54.090102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5dfe9406-dc57-4fe7-97e6-7f4d93d72aa4 req-d7b56c49-5d42-42ad-8d34-0b378b2a4ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f969b-50ed-48e6-b0a9-cf215214028d", "name": "network-vif-deleted", "tag": "cdd31367-e39d-413b-b346-3a34e9faf646"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:54.116897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5dfe9406-dc57-4fe7-97e6-7f4d93d72aa4 req-d7b56c49-5d42-42ad-8d34-0b378b2a4ea8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.117351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5dfe9406-dc57-4fe7-97e6-7f4d93d72aa4 req-d7b56c49-5d42-42ad-8d34-0b378b2a4ea8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.164911 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5dfe9406-dc57-4fe7-97e6-7f4d93d72aa4 req-d7b56c49-5d42-42ad-8d34-0b378b2a4ea8 service nova] Creating event network-vif-deleted:cdd31367-e39d-413b-b346-3a34e9faf646 for instance 122f969b-50ed-48e6-b0a9-cf215214028d on n-h1-848886-16 Jul 26 04:47:54.171614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5dfe9406-dc57-4fe7-97e6-7f4d93d72aa4 req-d7b56c49-5d42-42ad-8d34-0b378b2a4ea8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094646 Jul 26 04:47:54.173101 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2227/4552] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:54.178972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.179936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:54.187311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.188017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.188970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.189643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.210338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.221129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.232098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.233445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-edaa06f9-df15-4480-9104-98deed90d884 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1398 microversion: 2.54 time: 0.219788 Jul 26 04:47:54.233879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2326/4553] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:54 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1398 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:54.258368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6fd879e1-73f5-43ed-92cf-ef0d8a458eb3 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '.version_select at 0x7f38b5a5a040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.285307 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6fd879e1-73f5-43ed-92cf-ef0d8a458eb3 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2139044217" status: 204 len: 0 microversion: 2.54 time: 0.031705 Jul 26 04:47:54.290969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2327/4554] 10.222.0.43 () {60 vars in 1319 bytes} [Tue Jul 26 04:47:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2139044217 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 04:47:54.303306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.303813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:54.310122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.310825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.312366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.312979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.346802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:47:54.409897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:54.451641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d3433cb-1a86-48f5-a3d3-145a6bbbaa5f tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 204 len: 0 microversion: 2.54 time: 0.151875 Jul 26 04:47:54.453093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2328/4555] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:47:54 2022] DELETE /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:47:54.468991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.470437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:54.479741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.480768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.481935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.483272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.668563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.679485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.682888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.684399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52a5b9a6-aadd-471a-994b-356df6cb22cf tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1404 microversion: 2.54 time: 0.225929 Jul 26 04:47:54.698421 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2329/4556] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:54 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:47:54.698421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:54.698421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] [instance: 122f969b-50ed-48e6-b0a9-cf215214028d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:54.705631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:54.721954 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4aa3be4d-7194-475a-8b66-b786f8b4fc5b tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.547367 Jul 26 04:47:54.722592 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2228/4557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:54 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:54.748821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.748821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.749474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:54.749929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:54.780986 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] HTTP exception thrown: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Request method failure captured: Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d HTTP/1.1 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33HTVeCgo5MDfQyYHCVD-99yoMQnuhdU1idleeDFWk0BeDYljOYhnjrPiaP7_-qNKYUPcHs6EkdJFnWoMng877HxSNisnDR9YaGuYwugQZAAepIw1tQE2hL5czlIu_f5CJq4Cyk-NkhlVHMeOQCcATJpGmRoGrc5LZiOyuLRr7NX6kI Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.26 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 78faeccd15784966ac61f1902a90a1c8 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerTagsTestJSON-303593247 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78faeccd15784966ac61f1902a90a1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78faeccd15784966ac61f1902a90a1c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78faeccd15784966ac61f1902a90a1c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78faeccd15784966ac61f1902a90a1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerTagsTestJSON-303593247 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 78faeccd15784966ac61f1902a90a1c8 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerTagsTestJSON-303593247 Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerTagsTestJSON-303593247-project Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 94e548594606490f91678f561fe6f19f Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerTagsTestJSON-303593247-project Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '122f969b-50ed-48e6-b0a9-cf215214028d'} Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:54.783018 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] Returning 404 to user: Instance 122f969b-50ed-48e6-b0a9-cf215214028d could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c00f42c4-c822-4d9a-ae79-aadcc7cce558 tempest-ServerTagsTestJSON-303593247 tempest-ServerTagsTestJSON-303593247-project] 10.222.0.43 "GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d" status: 404 len: 111 microversion: 2.26 time: 0.098553 Jul 26 04:47:54.787062 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2330/4558] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:54 2022] GET /compute/v2.1/servers/122f969b-50ed-48e6-b0a9-cf215214028d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:47:55.022111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:55.023802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:55.044525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.045300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.046537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.048454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.090172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:55.090920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:55.101435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.107825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.111954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.111954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.512357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:55.522376 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d73c29c-70d5-457e-8829-b7e9e298948a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.437978 Jul 26 04:47:55.538993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2331/4559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:55 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:55.549096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-29b7fb03-4f15-4856-80c3-748dab91ad27 req-d8167d3b-0103-40d0-99ce-2363c1ea4375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bceb5e2-f458-4ca6-b746-c85ab51ba1ee", "name": "network-vif-plugged", "status": "completed", "tag": "504a5ae3-a563-4cf5-85e8-590a1b7723e4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:47:55.561201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29b7fb03-4f15-4856-80c3-748dab91ad27 req-d8167d3b-0103-40d0-99ce-2363c1ea4375 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.562470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29b7fb03-4f15-4856-80c3-748dab91ad27 req-d8167d3b-0103-40d0-99ce-2363c1ea4375 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.581612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-29b7fb03-4f15-4856-80c3-748dab91ad27 req-d8167d3b-0103-40d0-99ce-2363c1ea4375 service nova] Creating event network-vif-plugged:504a5ae3-a563-4cf5-85e8-590a1b7723e4 for instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee on n-h2-848886-16 Jul 26 04:47:55.588762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-29b7fb03-4f15-4856-80c3-748dab91ad27 req-d8167d3b-0103-40d0-99ce-2363c1ea4375 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044924 Jul 26 04:47:55.589461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2332/4560] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:47:55.712857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:55.713619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:55.741635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.749314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.753666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.755078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.840901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:55.849799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3439289e-8cc3-4245-8c51-8682ce031a82 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.835614 Jul 26 04:47:55.862278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2229/4561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:55 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:55.879278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:55.879908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:55.905109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.906912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:55.911147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:55.911863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:56.382522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:56.402841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc68bd8a-f3ed-4183-a532-a088f47807dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.529335 Jul 26 04:47:56.403859 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2230/4562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:55 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:56.439769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:56.451131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:56.456912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1b0e625b1c4ec0b65b214bd0433713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35e0d213a0f4e3b8c2c601049d4bfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:56.463076 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a20bf424-1883-49d2-89b1-d53a697077da tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 200 len: 1404 microversion: 2.54 time: 0.754656 Jul 26 04:47:56.464641 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2333/4563] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:55 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 1404 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:47:56.546492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:56.547634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:56.556736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:56.557775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:56.558851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:56.559549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:56.908650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:56.909496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:56.926742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:56.929795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:56.930284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:56.931242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:56.931842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:56.949955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17115f1c-efe3-4cc3-b617-4c9b180810c7 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.409470 Jul 26 04:47:56.977235 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2231/4564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:56 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:57.383423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:57.391495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-447ff747-f0f4-421e-a3a7-82dd23926d53 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.498932 Jul 26 04:47:57.392069 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2334/4565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:56 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:57.424074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:57.425211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:57.442374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:57.443133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:57.444069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:57.444669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:57.491048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:57.491648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] [instance: 38ade86c-ce9a-4cf7-88c4-ecc18a222f55] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:57.502112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:57.509156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:57.515697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:57.516763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:57.567417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] HTTP exception thrown: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Request method failure captured: Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 HTTP/1.1 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33HSTCOjKRCdLYJMyWOmA1gMEWNLIIVqLyxuzz5OY54xgMgaIVlbAEtPGsXuS8OUyA8PkV6jBdS6GF-K2dtVRTL7gee-5vyiDqGz3iXLI_oJL9D8IW6mroT0beZ1MoKylZdwhG-m2ogOX88l0_NkoV1VXIcZdn_2TNhfwoigCVeH7z4 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.54 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c35e0d213a0f4e3b8c2c601049d4bfe9 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerShowV254Test-1224863052 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c35e0d213a0f4e3b8c2c601049d4bfe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c35e0d213a0f4e3b8c2c601049d4bfe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c35e0d213a0f4e3b8c2c601049d4bfe9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c35e0d213a0f4e3b8c2c601049d4bfe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerShowV254Test-1224863052 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c35e0d213a0f4e3b8c2c601049d4bfe9 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerShowV254Test-1224863052 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerShowV254Test-1224863052-project Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: be1b0e625b1c4ec0b65b214bd0433713 Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerShowV254Test-1224863052-project Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '38ade86c-ce9a-4cf7-88c4-ecc18a222f55'} Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:47:57.569356 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. Jul 26 04:47:57.573810 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:47:57.574989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] Returning 404 to user: Instance 38ade86c-ce9a-4cf7-88c4-ecc18a222f55 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:47:57.575862 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e041fe1-5403-4c7e-8739-8e9935713068 tempest-ServerShowV254Test-1224863052 tempest-ServerShowV254Test-1224863052-project] 10.222.0.43 "GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55" status: 404 len: 111 microversion: 2.54 time: 0.088706 Jul 26 04:47:57.576444 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2335/4566] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:47:57 2022] GET /compute/v2.1/servers/38ade86c-ce9a-4cf7-88c4-ecc18a222f55 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:47:57.712453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:57.728774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-edc0ee84-864a-4d18-a7fb-69d6d6a22080 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1364 microversion: 2.1 time: 0.308568 Jul 26 04:47:57.742209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2232/4567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:57 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:57.998083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:57.998887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:58.008388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.014092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.015392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.016083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.414418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:58.415045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:58.432259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.434059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.434059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.434059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.562338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:58.576114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c096ccf-dca7-4094-b0ab-5fee029ad598 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.582861 Jul 26 04:47:58.576716 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2336/4568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:57 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:58.755037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:58.755832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:58.767976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.768435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.796909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:58.797641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:58.906583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=22 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:58.942696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:58.951646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b7379b7-cada-448e-be1d-dac7ed150088 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.542125 Jul 26 04:47:58.954469 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2233/4569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:58 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:47:59.597835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:59.600644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:59.632100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:59.638751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:59.644016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:59.646373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:59.659826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:59.767323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:47:59.789484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32485c43-1ea1-4eee-a0a1-a2d2f6798bb9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1549 microversion: 2.1 time: 1.034003 Jul 26 04:47:59.801265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2337/4570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:58 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1549 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:47:59.815697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:47:59.816956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:47:59.833848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:59.834334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:47:59.835129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:47:59.835572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:00.193347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:00.211792 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-821bb861-a1d8-4ab8-9f89-f8be3e8501b1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.618005 Jul 26 04:48:00.231973 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2234/4571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:47:59 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:00.242672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:00.248761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:00.255637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:00.256465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:00.258428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:00.259106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:00.430084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bc2297c-25cc-46d6-89f5-407cdc4aadcb tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.622364 Jul 26 04:48:00.430907 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2338/4572] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:47:59 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-interface => generated 284 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:00.572206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:00.582299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf4ddaa6-556a-4775-b9bf-b562488fe3b6 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.348685 Jul 26 04:48:00.595320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2235/4573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:00 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:01.250769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:01.253324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:01.290055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:01.294001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:01.296369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:01.302183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:01.462887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-df51c778-c0f2-4ee0-b325-e190970a71a9 req-7db9dc74-ae3e-45e7-b9ad-7e602f678870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de728e-64fe-4ae8-b3a5-0234ca2e0fbd", "name": "network-vif-plugged", "status": "completed", "tag": "47529a09-27f0-4ee4-9663-6fc680fec526"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:01.490357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df51c778-c0f2-4ee0-b325-e190970a71a9 req-7db9dc74-ae3e-45e7-b9ad-7e602f678870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:01.491880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df51c778-c0f2-4ee0-b325-e190970a71a9 req-7db9dc74-ae3e-45e7-b9ad-7e602f678870 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:01.537321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-df51c778-c0f2-4ee0-b325-e190970a71a9 req-7db9dc74-ae3e-45e7-b9ad-7e602f678870 service nova] Creating event network-vif-plugged:47529a09-27f0-4ee4-9663-6fc680fec526 for instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd on n-h2-848886-16 Jul 26 04:48:01.574530 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-df51c778-c0f2-4ee0-b325-e190970a71a9 req-7db9dc74-ae3e-45e7-b9ad-7e602f678870 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099374 Jul 26 04:48:01.576109 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2236/4574] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:01.626339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:01.628138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:01.643269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:01.645272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:01.648625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:01.651618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:02.015545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:02.036653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4df8185-7262-4357-b558-666553831d4e tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.417276 Jul 26 04:48:02.039471 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2237/4575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:01 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:02.884202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:02.910879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73163cd7-4fce-4ce6-bbc5-8dc0021d2140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 1.674924 Jul 26 04:48:02.928241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2339/4576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:01 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:03.091004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:03.092816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:03.105120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:03.105764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:03.107199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:03.108055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:03.404861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:03.418866 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-523b6418-086d-4a33-b09d-d2850309a445 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.333561 Jul 26 04:48:03.419950 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2238/4577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:03 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:03.939011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:03.941315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:03.971309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:03.976213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:03.977172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:03.977726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:04.440798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:04.442047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:04.445678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:04.464488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:04.486638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:04.487849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:04.493905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:04.638749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:04.651069 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-367682aa-aa3c-4e2c-baf3-10f2a9ac8c9d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1315 microversion: 2.1 time: 0.721163 Jul 26 04:48:04.652196 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2340/4578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:03 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:04.663504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e035e843-5e7d-479b-93d4-aa7ca2dcaa14 req-e6dab848-7beb-47c0-8314-09aefd4a6b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bceb5e2-f458-4ca6-b746-c85ab51ba1ee", "tag": "504a5ae3-a563-4cf5-85e8-590a1b7723e4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:04.679626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e035e843-5e7d-479b-93d4-aa7ca2dcaa14 req-e6dab848-7beb-47c0-8314-09aefd4a6b47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:04.682823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e035e843-5e7d-479b-93d4-aa7ca2dcaa14 req-e6dab848-7beb-47c0-8314-09aefd4a6b47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:04.701960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e035e843-5e7d-479b-93d4-aa7ca2dcaa14 req-e6dab848-7beb-47c0-8314-09aefd4a6b47 service nova] Creating event network-changed:504a5ae3-a563-4cf5-85e8-590a1b7723e4 for instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee on n-h2-848886-16 Jul 26 04:48:04.725126 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e035e843-5e7d-479b-93d4-aa7ca2dcaa14 req-e6dab848-7beb-47c0-8314-09aefd4a6b47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065096 Jul 26 04:48:04.726259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2341/4579] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:48:04.905548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:04.918894 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-422b4181-b21c-4460-b62c-26460c01445b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.482392 Jul 26 04:48:04.920116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2239/4580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:04 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:05.674892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:05.675743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:05.695481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:05.706630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:05.707645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:05.708102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:05.943149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:05.943790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:05.968535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:05.975069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:05.975069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:05.975069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:06.061746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:06.072153 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e724d875-9ddf-4a95-a72a-f9259cdd33af tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1503 microversion: 2.1 time: 0.402429 Jul 26 04:48:06.073335 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2342/4581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:05 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:06.102023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0808f06-7c8f-44b0-b71a-454e59211870 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:06.112679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0808f06-7c8f-44b0-b71a-454e59211870 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:06.113541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0808f06-7c8f-44b0-b71a-454e59211870 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:06.146748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0808f06-7c8f-44b0-b71a-454e59211870 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Going to try to stop instance {{(pid=119488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:48:06.266904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0808f06-7c8f-44b0-b71a-454e59211870 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd/action" status: 202 len: 0 microversion: 2.1 time: 0.175776 Jul 26 04:48:06.267969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2343/4582] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:48:06 2022] POST /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:48:06.285144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:06.287913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:06.303318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:06.304028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:06.305085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:06.305594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:06.358645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:06.374335 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.435724 Jul 26 04:48:06.375266 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2240/4583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:05 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:06.556709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:06.569735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.296842 Jul 26 04:48:06.575558 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2344/4584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:06 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:06.818621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:06.819790 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001663 Jul 26 04:48:06.820441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2241/4585] 10.222.0.43 () {56 vars in 886 bytes} [Tue Jul 26 04:48:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 04:48:06.829204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:06.830974 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002271 Jul 26 04:48:06.831841 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2345/4586] 10.222.0.43 () {54 vars in 1035 bytes} [Tue Jul 26 04:48:06 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 26 04:48:06.839427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:06.841955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2332306a-0239-4584-8336-a2d8343d8a62 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003579 Jul 26 04:48:06.843279 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2242/4587] 10.222.0.43 () {54 vars in 1041 bytes} [Tue Jul 26 04:48:06 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:06.853784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:06.855478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f27a9a08-3a9b-411c-b1df-28056ee5a9f0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002207 Jul 26 04:48:06.865338 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2346/4588] 10.222.0.43 () {56 vars in 886 bytes} [Tue Jul 26 04:48:06 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 04:48:07.403266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:07.413722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:07.443046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.444351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.447265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.450912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.675798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:07.684995 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d8b326e-b112-4772-a63e-800133caae5b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.289195 Jul 26 04:48:07.687077 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2347/4589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:07 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:07.698500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:07.700191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:07.718022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.718681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-572776423", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:07.719192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.719931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.720375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.848134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:07.848578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:07.849066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:07.850069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:07.850725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:07.861771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.862252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.863273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:07.863721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:07.886374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Getting quotas for project f2c376112ba6492ba93e645726a5e838. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:07.894365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Getting quotas for user 0b2e91ea872f4e08b5c7b3bec65656cc and project f2c376112ba6492ba93e645726a5e838. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:07.923883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:48:07.926448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:48:08.006603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5aec4d18-f458-4361-b2a8-2514bfaa47bd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.616063 Jul 26 04:48:08.008399 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2243/4590] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 04:48:08.033856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:08.035735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:08.080538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:08.094185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0965d1f7-8cd2-41eb-a67c-581e9a037889 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.405851 Jul 26 04:48:08.094791 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2348/4591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:07 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:08.178566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:08.189829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:08.191459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:08.192675 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6725325-8636-4160-ab44-53c5463e1f56 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 200 len: 1277 microversion: 2.47 time: 0.175836 Jul 26 04:48:08.193388 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2244/4592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:08 2022] GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:08.388289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1827705957", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": "none"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:08.504857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:08.505586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:08.506433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:08.507463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:08.508478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:08.536777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:08.538309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:08.539341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:08.540176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:08.652709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Getting quotas for project f2c376112ba6492ba93e645726a5e838. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:08.662525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Getting quotas for user 0b2e91ea872f4e08b5c7b3bec65656cc and project f2c376112ba6492ba93e645726a5e838. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:08.688468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:48:08.691685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:48:08.712963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:08.713899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:08.741480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:08.744163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:08.745686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:08.748310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:08.859139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bbf3ee9c-d7f5-4d5d-aaf9-32279bb02e45 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.477323 Jul 26 04:48:08.871108 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2349/4593] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 04:48:08.892503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef31cfa7-be52-42fc-ae18-f5743d0516bf tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:08.898503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef31cfa7-be52-42fc-ae18-f5743d0516bf tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:09.051754 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef31cfa7-be52-42fc-ae18-f5743d0516bf tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "PUT /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 992 microversion: 2.47 time: 0.178707 Jul 26 04:48:09.053643 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2350/4594] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Jul 26 04:48:08 2022] PUT /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 992 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:48:09.077370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:09.078392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:09.253687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:09.269964 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee75e795-f6fa-4642-8de9-a74fb671acc7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.558000 Jul 26 04:48:09.270522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2245/4595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:08 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:09.288587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:09.292048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:09.309493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:09.313498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:09.314803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:09.315468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:09.323627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:09.337637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:09.342139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:09.351986 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be894efe-1156-4bba-84f8-226690fa86d7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1278 microversion: 2.47 time: 0.277419 Jul 26 04:48:09.355707 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2351/4596] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:09 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:09.649221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:09.660359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93dd9a9a-f449-4a41-9394-0cbd70c8d4d3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.388726 Jul 26 04:48:09.674957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2246/4597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:09 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:10.297431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:10.298471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:10.317011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.317895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.319101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.319752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.343452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:10.386401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:10.387332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:10.404310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.405042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.405808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.406355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.552495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:10.563484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:10.578445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:10.583984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91bf5f57-9e5d-43b6-a84f-a0c82733ab7f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1274 microversion: 2.47 time: 0.205751 Jul 26 04:48:10.587191 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2247/4598] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:10 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:10.690655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:10.693354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:10.711148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.711659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.712485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:10.714699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:10.904790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:10.920932 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67e896b9-3f6f-4e9f-8c60-910462a44b6a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.627333 Jul 26 04:48:10.923840 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2352/4599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:10 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:10.976182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:10.990418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4d4848f-a135-421f-bc90-186e473e91ff tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.312618 Jul 26 04:48:11.003976 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2248/4600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:10 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:11.613888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:11.614629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:11.644182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:11.644406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:11.645198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:11.651082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:11.859408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:11.876361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:11.879806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:11.899712 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c0973bb-2aef-41f6-ad53-496aa42fe501 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1330 microversion: 2.47 time: 0.286526 Jul 26 04:48:11.920942 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2353/4601] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:11 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1330 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:11.945233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:11.945909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:11.960050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:11.960511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:11.970010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:11.970501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:12.015785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:12.016808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:12.025606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:12.026627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:12.027813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:12.028484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:12.455210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:12.474751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8d535c5-4f74-49a6-8aa1-64e614eeec56 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.530632 Jul 26 04:48:12.477469 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2249/4602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:11 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:12.837947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:12.854220 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a36a1909-cb34-4ad1-984a-f9cb364b9330 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.842557 Jul 26 04:48:12.856911 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2354/4603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:12 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:12.926661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:12.927590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:12.937657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:12.940521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:12.944174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:12.944913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:13.103153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:13.128254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:13.134333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:13.137289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-76ad3ce8-6d02-4b97-bd58-eb8f327fddb7 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1336 microversion: 2.47 time: 0.215474 Jul 26 04:48:13.140346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2250/4604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:12 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:13.501666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:13.502494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:13.522898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:13.523510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:13.524884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:13.525606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:13.757492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:13.775167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-565a479d-db8a-4542-8962-55e362e41d08 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.279494 Jul 26 04:48:13.786237 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2355/4605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:13 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:13.993055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:13.993559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:14.004943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.005399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:14.006212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.006661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:14.165674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:14.167350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:14.183245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.183602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:14.184812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.184936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:14.313216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:14.324603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:14.326129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:14.336312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdae7586-f8cd-4456-8319-7f823d30e5fc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1336 microversion: 2.47 time: 0.167783 Jul 26 04:48:14.341892 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2356/4606] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:14 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1336 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:14.769053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:14.784919 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc8ffad3-bf8a-4fac-a904-2f1559c43ac9 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.795628 Jul 26 04:48:14.800528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:14.800981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2251/4607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:13 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:14.801229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:14.815583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.816316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:14.817266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:14.817865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.021737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:15.030733 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-199a7941-2741-4ebb-9d16-929ac801b407 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.236006 Jul 26 04:48:15.031883 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2357/4608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:14 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:15.363570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:15.364531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:15.373780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.374596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.375577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.376222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.556074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:15.572032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:15.578178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:15.581896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dbda78f0-d588-458e-97e4-246bb9853821 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1357 microversion: 2.47 time: 0.222188 Jul 26 04:48:15.604215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2252/4609] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:15 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:15.615652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:15.629600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:15.648178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.649201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.650313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.651608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.801786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:15.803609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:15.806988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:15.807106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:15.807950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:15.812311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:15.813611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:15.824523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.825047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.825881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.826361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.961709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:15.974879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.977471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:15.978472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:15.979946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:16.090893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-609fac2e-a355-4da9-941a-9fccfdec7314 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "POST /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41/action" status: 202 len: 1079 microversion: 2.47 time: 0.485941 Jul 26 04:48:16.092648 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2358/4610] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:48:15 2022] POST /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41/action => generated 1079 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 04:48:16.112102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:16.113345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:16.139993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:16.140835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:16.141885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:16.143044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:16.527909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:16.546873 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b13ac97-8971-4c67-87bc-562297f338b3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.742975 Jul 26 04:48:16.563988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2253/4611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:15 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:16.585483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:16.586424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:16.594371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:16.595517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:16.596505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:16.597153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:16.701427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:16.722990 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4cb18633-c86b-48e7-81e7-c6f9656a571a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1510 microversion: 2.1 time: 0.613883 Jul 26 04:48:16.727034 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2359/4612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:16 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:16.871315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:16.892721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:16.894727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:16.902432 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f35c06bc-3d04-4410-ab1e-fd5a0d6209e8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.333486 Jul 26 04:48:16.903063 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2254/4613] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:16 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:17.570065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:17.570744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:17.580797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:17.594486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:17.602901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:17.604379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:17.605191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:17.746545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:17.747632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:17.765972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:17.769153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:17.773123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:17.773798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:17.782316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:17.872716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:18.183261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:18.538691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:18.552623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-04218d66-cab2-44dd-bc16-404fb706cccf tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1487 microversion: 2.1 time: 0.808556 Jul 26 04:48:18.556120 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2255/4614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:17 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1487 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:18.564809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:18.565772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:18.598863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:18.599793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:18.604949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:18.605664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:18.636888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:18.797108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:18.811310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:18.814136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:18.816359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9afc2080-b627-4525-8757-a6f6617839a1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.258521 Jul 26 04:48:18.817750 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2256/4615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:18 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:18.823983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1486161706"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:18.827505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:18.847912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:18.857719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:18.858717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:18.860852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:18.864291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:18.868808 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8dc632fc-412a-47f6-8a81-36df91ead99e tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 1.301360 Jul 26 04:48:18.872230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2360/4616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:17 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:18.988968 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d198befa-9cb2-48b3-b83d-6cf1d392fd84 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "PUT /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1060 microversion: 2.1 time: 0.169270 Jul 26 04:48:18.990270 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2257/4617] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:48:18 2022] PUT /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1060 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:19.014398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:19.015149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:19.022682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.023270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.024171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.024866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.280579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:19.293825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4246a8b4-7840-48cb-8069-415260afc419 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1487 microversion: 2.1 time: 0.285087 Jul 26 04:48:19.296176 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2361/4618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:19 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1487 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:19.315071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:19.316203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:19.327174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.328879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.329691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.330143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.693556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:19.702195 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c0e5daa-c59b-4b7f-bf81-6ffb0528a808 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1487 microversion: 2.1 time: 0.391496 Jul 26 04:48:19.725867 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2258/4619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:19 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:19.740875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:19.741413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:19.744052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:19.770300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.780729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.783157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.789365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.843724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:19.844310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:19.858901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.859368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.862447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:19.862940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:19.879173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:48:20.147593 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d8da7d5-e2a7-490a-b32b-8da155ac2d0a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 204 len: 0 microversion: 2.1 time: 0.419003 Jul 26 04:48:20.155954 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2362/4620] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:19 2022] DELETE /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:48:20.171792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:20.172915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:20.196150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:20.196800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:20.198798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:20.199393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:20.512221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:20.532069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:20.533925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:20.535203 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1968258e-ad10-4d38-a197-88b51627807c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.695516 Jul 26 04:48:20.535761 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2259/4621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:19 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:20.540479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:20.542677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:20.556033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:20.556491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:20.557938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:20.558416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:20.610005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:20.623970 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01e81cf8-1627-443b-9a81-3c5717dae27b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.460572 Jul 26 04:48:20.625832 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2363/4622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:20 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:20.998379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:21.022731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1d5baff8-4212-498c-811f-1f2c84921d8b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1493 microversion: 2.1 time: 0.485566 Jul 26 04:48:21.023324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2260/4623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:20 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1493 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:21.559938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:21.562621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:21.583746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:21.584368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:21.591492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:21.592169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:21.646901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:21.647584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:21.658368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:21.658838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:21.659641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:21.660089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:21.735778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:21.747238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:21.754271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:21.755828 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1598f906-e6bc-47cb-b73b-6847f1db0fa8 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.200185 Jul 26 04:48:21.758144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2364/4624] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:21 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:22.045384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:22.046355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:22.064895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:22.075621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:22.084015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:22.084837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:22.164675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:22.178831 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b11a17d-302f-4965-ae4a-76cce4da3469 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.531360 Jul 26 04:48:22.186717 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2261/4625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:21 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:22.224324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:22.364553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2f697b33-8c7a-4462-b67f-7a1eadc5d8db req-3ced173a-b711-4e1d-b81f-b0a9c46d30c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ee720-e7d0-433b-85bb-df613b0f2bd7", "name": "network-vif-deleted", "tag": "643514b8-5577-4579-8e09-d82e404b6985"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:22.416970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2f697b33-8c7a-4462-b67f-7a1eadc5d8db req-3ced173a-b711-4e1d-b81f-b0a9c46d30c5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:22.419225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2f697b33-8c7a-4462-b67f-7a1eadc5d8db req-3ced173a-b711-4e1d-b81f-b0a9c46d30c5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:22.442442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:22.455610 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bcc60832-c816-4189-b101-4c39a3c5c0b5 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 200 len: 1451 microversion: 2.1 time: 0.414366 Jul 26 04:48:22.474347 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2f697b33-8c7a-4462-b67f-7a1eadc5d8db req-3ced173a-b711-4e1d-b81f-b0a9c46d30c5 service nova] Creating event network-vif-deleted:643514b8-5577-4579-8e09-d82e404b6985 for instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 on n-h2-848886-16 Jul 26 04:48:22.482705 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2365/4626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:22 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 1451 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:22.484673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2f697b33-8c7a-4462-b67f-7a1eadc5d8db req-3ced173a-b711-4e1d-b81f-b0a9c46d30c5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123935 Jul 26 04:48:22.491768 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2262/4627] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:22.788522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:22.790128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:22.803911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:22.804623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:22.805710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:22.806941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:22.901728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:22.914072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:22.916045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:22.917529 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86a67134-1ac9-4284-8e42-5225502a4f74 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.134999 Jul 26 04:48:22.918722 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2366/4628] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:22 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:23.207734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.208453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.238113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.238624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.239443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.239901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.489732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.490401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.511561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.512361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.513550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.514298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.550935 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 HTTP/1.1 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '935ee720-e7d0-433b-85bb-df613b0f2bd7'} Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.560461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.564694 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.568539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.575348 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b614e000-12d7-4cc3-ad3a-77461e166301 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 404 len: 111 microversion: 2.1 time: 0.086126 Jul 26 04:48:23.576612 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2367/4629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.601389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.602220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.611083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.618549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.620410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.621028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.649875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 HTTP/1.1 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '935ee720-e7d0-433b-85bb-df613b0f2bd7'} Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.657286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.661248 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.663341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.671600 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4825794b-a41c-47b1-9fc4-3e434ff4605a tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 404 len: 111 microversion: 2.1 time: 0.081485 Jul 26 04:48:23.676274 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2368/4630] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:23 2022] DELETE /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.681264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.683532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 935ee720-e7d0-433b-85bb-df613b0f2bd7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.700029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.705632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.706883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.707584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.742201 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 HTTP/1.1 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '935ee720-e7d0-433b-85bb-df613b0f2bd7'} Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.748776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. Jul 26 04:48:23.752681 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.754171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 935ee720-e7d0-433b-85bb-df613b0f2bd7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.755273 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-659c036e-884e-4341-9dad-fc2f68b6b5ac tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7" status: 404 len: 111 microversion: 2.1 time: 0.077844 Jul 26 04:48:23.759442 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2369/4631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/935ee720-e7d0-433b-85bb-df613b0f2bd7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.765974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.766732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.771029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:23.781683 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c81cf26d-69a9-4aa5-9b4b-cac8c21fcb06 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.578499 Jul 26 04:48:23.785020 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2263/4632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:23.796196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.797321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.798397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.799059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.820645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 HTTP/1.1 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1'} Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.823188 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.827771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.829516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e49521f-0e03-480e-8891-fa15d3114b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 404 len: 111 microversion: 2.1 time: 0.068151 Jul 26 04:48:23.830205 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2370/4633] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:23 2022] DELETE /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.839713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.840761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.849881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.850628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.851770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.852526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.875612 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 HTTP/1.1 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1'} Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.877532 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.881423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.881860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ec35fd1-0b2e-4180-9de8-3277d9465fc2 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1" status: 404 len: 111 microversion: 2.1 time: 0.047327 Jul 26 04:48:23.886340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2264/4634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/1d493b57-1ca3-41dc-b8fc-d9b6a83e6ef1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.891649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.892613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.901740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.902745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.903779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.905145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.924347 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f HTTP/1.1 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '97b9dccc-78d0-4d3c-9fb6-690f0f6df77f'} Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:23.926227 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:23.931357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:23.933447 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89e4a0d3-2d47-4966-a7ee-f1ebd40454c7 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 404 len: 111 microversion: 2.1 time: 0.045617 Jul 26 04:48:23.938117 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2371/4635] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:23 2022] DELETE /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:23.944181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.945056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:23.945588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.946192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:23.955231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.955914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.957089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.957771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.964931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.966886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:23.967771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:23.968263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.007647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f HTTP/1.1 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '97b9dccc-78d0-4d3c-9fb6-690f0f6df77f'} Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.019336 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.023472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 97b9dccc-78d0-4d3c-9fb6-690f0f6df77f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.024110 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-940dcccd-639d-4660-8213-42b7f0f50b23 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f" status: 404 len: 111 microversion: 2.1 time: 0.084937 Jul 26 04:48:24.030471 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2265/4636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/97b9dccc-78d0-4d3c-9fb6-690f0f6df77f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.036104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.038082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.061684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.062181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.062988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.063582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.082864 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e HTTP/1.1 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4e33df39-59f2-4fb6-9829-3c625766287e'} Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.086370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.093127 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d14b467-4632-4978-8408-53901f957ab9 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 404 len: 111 microversion: 2.1 time: 0.056242 Jul 26 04:48:24.097106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2266/4637] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:24 2022] DELETE /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.105028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.105730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 4e33df39-59f2-4fb6-9829-3c625766287e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.114631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.115361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.116856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.117797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.142129 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e HTTP/1.1 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4e33df39-59f2-4fb6-9829-3c625766287e'} Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.144362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 4e33df39-59f2-4fb6-9829-3c625766287e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.149806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6513b46b-53bf-455e-9e2e-5147b4c2349f tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e" status: 404 len: 111 microversion: 2.1 time: 0.047614 Jul 26 04:48:24.151026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2267/4638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/4e33df39-59f2-4fb6-9829-3c625766287e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.156353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.156860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.164209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.164916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.166592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.167234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.184816 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a HTTP/1.1 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '072f84ef-4568-498a-9ad8-8f061554487a'} Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.197141 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.201428 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.203962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.206326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d03a08d-b412-4e00-9078-9dccfb592dea tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 404 len: 111 microversion: 2.1 time: 0.053219 Jul 26 04:48:24.209928 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2268/4639] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:24 2022] DELETE /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.215822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.216715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 072f84ef-4568-498a-9ad8-8f061554487a] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.223452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.224195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.225381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.226030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.249326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a HTTP/1.1 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '072f84ef-4568-498a-9ad8-8f061554487a'} Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.252052 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. Jul 26 04:48:24.256031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.259030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 072f84ef-4568-498a-9ad8-8f061554487a could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.260401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68f36976-3ca9-40a1-b08d-bdc6260dbd59 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a" status: 404 len: 111 microversion: 2.1 time: 0.048600 Jul 26 04:48:24.261190 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2269/4640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/072f84ef-4568-498a-9ad8-8f061554487a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.273787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:24.275366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.278507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.284906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:24.299861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:24.301124 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7128b11f-fab1-4c1f-8a46-baca0eed9119 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.361651 Jul 26 04:48:24.301554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.302078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.302914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.303360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.304304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2372/4641] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:23 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:24.337718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 HTTP/1.1 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'dafbe996-3238-48ef-a03a-74931d433a59'} Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.343712 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.347764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-024e7d41-c088-48d1-80fb-259cd756db22 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 404 len: 111 microversion: 2.1 time: 0.079830 Jul 26 04:48:24.354701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2270/4642] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:24 2022] DELETE /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:48:24.355219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.355842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: dafbe996-3238-48ef-a03a-74931d433a59] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.365009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.365257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.366048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.366517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.384391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 HTTP/1.1 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'dafbe996-3238-48ef-a03a-74931d433a59'} Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.393665 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. Jul 26 04:48:24.399218 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.401934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance dafbe996-3238-48ef-a03a-74931d433a59 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.403040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34c29ebb-df5d-4400-ba8b-b726fb51f8b8 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59" status: 404 len: 111 microversion: 2.1 time: 0.053095 Jul 26 04:48:24.403822 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2373/4643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/dafbe996-3238-48ef-a03a-74931d433a59 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.412628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.413317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.422867 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf HTTP/1.1 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'cc66bf19-056f-4bdb-9850-03939740b1bf'} Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.426330 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.430087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.446633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.448027 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3a60586-4126-4909-880d-17ff686b90aa tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf" status: 404 len: 111 microversion: 2.1 time: 0.039473 Jul 26 04:48:24.456871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.457218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2271/4644] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:24 2022] DELETE /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.458223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: cc66bf19-056f-4bdb-9850-03939740b1bf] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.469645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf HTTP/1.1 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cc66bf19-056f-4bdb-9850-03939740b1bf'} Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:24.474360 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance cc66bf19-056f-4bdb-9850-03939740b1bf could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:24.478912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-095d7930-effb-4404-a7c0-a080b89018ce tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf" status: 404 len: 111 microversion: 2.1 time: 0.024613 Jul 26 04:48:24.483645 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2374/4645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/cc66bf19-056f-4bdb-9850-03939740b1bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:24.489025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.490282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.498917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.499877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.501046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.501714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.576323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:48:24.767833 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60a87cad-8a7e-42c9-a556-c53c521736af tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 204 len: 0 microversion: 2.1 time: 0.282254 Jul 26 04:48:24.768912 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2272/4646] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:24 2022] DELETE /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:48:24.780260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.781125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.793418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.795630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.797127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.801697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.810468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:24.811259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:24.827540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.829272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:24.830166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:24.833789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:25.216536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:25.228954 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-775c87c2-0f04-425d-b5ec-d131d44c0a1f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.421849 Jul 26 04:48:25.234385 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2273/4647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:25.265875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:25.279012 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9ae93d43-43c6-4a6f-b325-36d5c24d08f4 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1480 microversion: 2.1 time: 0.501746 Jul 26 04:48:25.280518 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2375/4648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:24 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1480 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:25.331767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:25.332395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:25.344526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:25.344988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:25.345792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:25.346346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:25.492031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:25.509365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:25.512012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:25.514575 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5925cc22-2266-477e-a81e-c08fa18a3ea1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.185955 Jul 26 04:48:25.518368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2274/4649] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:25 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:25.865587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4dbae3f5-3d72-4286-863d-b908227b86c3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: .version_select at 0x7f38b52d5550>, body: {"keypair": {"name": "tempest-keypair-717266050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ+EVHxpxfN1nRyzcuThEuJkWDdYvwZ1qIGOhgcAblM94e02WANBEWjEfWMKQ64dVtpUrC8Yp/ojzIHXdWWsBn7A0O0J1fRinetcPWWWt+LXpFnDXkELIGhOG6Kq1fJAw=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:25.910282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4dbae3f5-3d72-4286-863d-b908227b86c3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:25.923401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4dbae3f5-3d72-4286-863d-b908227b86c3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for user 18807cad26884822b91771a618f32f71 and project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:25.981044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4dbae3f5-3d72-4286-863d-b908227b86c3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.618896 Jul 26 04:48:25.982432 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2376/4650] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:48:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 623 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 26 04:48:26.254889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:26.256657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:26.266894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.267714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:26.269882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.271726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:26.304733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:26.305682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:26.321705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.323462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:26.324888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.327002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:26.719393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:26.722065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:26.724838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:26.741718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-304aa733-6d66-4e31-a7d2-413df8ab9401 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.492817 Jul 26 04:48:26.742459 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ce5c8315-f471-482d-b7ea-a0fa97927317 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1480 microversion: 2.1 time: 0.431641 Jul 26 04:48:26.743152 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2377/4651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:26 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1480 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:26.754929 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2275/4652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:26 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:26.800705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:26.801376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:26.811289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.811946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:26.812752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:26.813195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:27.007152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:27.015120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:27.028888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:27.038906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-012ea3db-3954-4937-ba0d-1f8c8bf1f406 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.255363 Jul 26 04:48:27.039777 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2378/4653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:26 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:27.774727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:27.776029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:27.778880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:27.786892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:27.810904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:27.811608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:27.812401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:27.812849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:27.825466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:27.829155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:27.833872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:27.842595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:28.083411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14659647f8cf4386bf91eecd847e8aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e8c19499ee46cea2e52ec98141c310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:28.092697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4e31485-ea99-4738-91cd-c2f69b95044b tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 200 len: 1438 microversion: 2.1 time: 0.328352 Jul 26 04:48:28.093296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2276/4654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:27 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 1438 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:28.115334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c5671071-bafa-419d-9bc2-18fcf35dc289 req-f66cf295-e113-4e1e-9473-d9509c50965d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1596193d-0329-4198-90bb-9e354125d6bc", "name": "network-vif-deleted", "tag": "15cc71c2-34ea-4ddf-a1b6-f920d81b596f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:28.163743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c5671071-bafa-419d-9bc2-18fcf35dc289 req-f66cf295-e113-4e1e-9473-d9509c50965d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:28.164350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c5671071-bafa-419d-9bc2-18fcf35dc289 req-f66cf295-e113-4e1e-9473-d9509c50965d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:28.189624 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c5671071-bafa-419d-9bc2-18fcf35dc289 req-f66cf295-e113-4e1e-9473-d9509c50965d service nova] Creating event network-vif-deleted:15cc71c2-34ea-4ddf-a1b6-f920d81b596f for instance 1596193d-0329-4198-90bb-9e354125d6bc on n-h1-848886-16 Jul 26 04:48:28.210634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c5671071-bafa-419d-9bc2-18fcf35dc289 req-f66cf295-e113-4e1e-9473-d9509c50965d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116044 Jul 26 04:48:28.215044 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2277/4655] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:28.238250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:28.239176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:28.263255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:28.263985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:28.266019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:28.268104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:28.323060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:28.354118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34f28e15-4252-40b5-9619-73a2c1e76e2a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.588180 Jul 26 04:48:28.361067 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2379/4656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:27 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:28.520662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:28.537642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:28.554992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:28.573116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-792706b1-ab4a-434d-a1bf-b41e4050e179 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.343830 Jul 26 04:48:28.573820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2278/4657] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:28 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:29.117431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:29.118090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] [instance: 1596193d-0329-4198-90bb-9e354125d6bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:29.131503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.131962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.139712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.140535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.179814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] HTTP exception thrown: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Request method failure captured: Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc HTTP/1.1 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EwdydRLFwzw-kug7Xn-Ztp0E2qAYeofhsCLLFmDCn4_zuIpcIWnhwLun2JMquU-PnmygxLW056QNG6Gd4vYygFh6GHz9K-qLSPLeOV3RoFsUzMfLciV5bjWrIR2zRK_cMCZfMu_N42yXu9X96T5raAHaHfTZXi9Mmwhg0SWBNp9Tg Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_12e8c19499ee46cea2e52ec98141c310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersTestJSON-361415708 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 12e8c19499ee46cea2e52ec98141c310 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersTestJSON-361415708 Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersTestJSON-361415708-project Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 14659647f8cf4386bf91eecd847e8aab Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersTestJSON-361415708-project Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1596193d-0329-4198-90bb-9e354125d6bc'} Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:29.181402 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] Returning 404 to user: Instance 1596193d-0329-4198-90bb-9e354125d6bc could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:29.187077 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed425c8c-1e30-46d8-8de9-0d65bd218159 tempest-ServersTestJSON-361415708 tempest-ServersTestJSON-361415708-project] 10.222.0.43 "GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc" status: 404 len: 111 microversion: 2.1 time: 0.069614 Jul 26 04:48:29.195748 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2380/4658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:29 2022] GET /compute/v2.1/servers/1596193d-0329-4198-90bb-9e354125d6bc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:29.385990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:29.386654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:29.405147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.405597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.406420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.406866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.601005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:29.602293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:29.621145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.621861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.622879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:29.627224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:29.788710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:29.851908 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0c179a8-1621-474d-8ee2-3ef4b4df39fe tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.467571 Jul 26 04:48:29.851908 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2279/4659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:29 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:30.160724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:30.164805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597900559", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21aa032b-39a1-4d25-8a4c-7012c80e3abf"}], "security_groups": [{"name": "tempest-securitygroup--1650873418"}], "key_name": "tempest-keypair-717266050", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:30.173079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:30.178708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:30.180069 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cd01ca5-4362-4557-a7e1-14df35e692e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.583109 Jul 26 04:48:30.180675 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2381/4660] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:29 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:30.195160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:30.359006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] validate_networks() for [('21aa032b-39a1-4d25-8a4c-7012c80e3abf', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:48:30.875590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:30.896941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:30.909806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:30.910320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:30.911268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:30.911719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:31.365947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:31.367223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:31.368011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:31.368728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:31.370145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:31.388157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:31.388699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:31.391787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:31.393542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:31.442983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:31.458107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for user 18807cad26884822b91771a618f32f71 and project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:31.499768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:48:31.504510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:48:31.554663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:31.570936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb35cfeb-fa9b-47c7-805d-a409762ba057 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1513 microversion: 2.1 time: 0.701993 Jul 26 04:48:31.576521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2382/4661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:30 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1513 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:31.586722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:31.592089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:31.594304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7dd9ca90-8fc8-4c19-9a14-b29deea47c72 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.434546 Jul 26 04:48:31.601493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2280/4662] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:48:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 04:48:31.602853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:31.603538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:31.604754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:31.605364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:31.619491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:31.621400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:31.813482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:31.828097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:31.844987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:31.850046 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0904620-5ac3-4f74-8d46-467e6318ce9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1281 microversion: 2.20 time: 0.246061 Jul 26 04:48:31.850816 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2281/4663] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:31 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:32.018714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:32.041364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:32.045657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:32.046969 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a68fd0e-9280-439f-94d1-0b9dbbc1f623 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.469201 Jul 26 04:48:32.047549 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2383/4664] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:31 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:32.596806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:32.597575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:32.613875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:32.614580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:32.615441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:32.615912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:32.875157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:32.876171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:32.885387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:32.885852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:32.886680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:32.891190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:32.969189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:32.980744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9e281cc-b9ac-41c6-9f20-9d1217e4c97c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1490 microversion: 2.1 time: 0.385931 Jul 26 04:48:32.982027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2282/4665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:32 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1490 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:33.003665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:33.004713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:33.023117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.027566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.031624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.032265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.078605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.090227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.100207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.108720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85b00075-448a-4d9b-b9db-ee8922d032b5 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1333 microversion: 2.20 time: 0.239519 Jul 26 04:48:33.112901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2384/4666] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:32 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1333 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:33.114507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:48:33.128435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:33.137500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:33.159145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.159935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.163897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.168265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.302785 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ae8b007-b411-43e7-bed3-aa72586ac127 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 204 len: 0 microversion: 2.1 time: 0.304064 Jul 26 04:48:33.304154 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2283/4667] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:48:32 2022] DELETE /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:48:33.320952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:33.321801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:33.335803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.336569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.339412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:33.340124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:33.414143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.431974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.435002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.437604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fca198bb-70c3-46c5-9727-36b3d02229db tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.321662 Jul 26 04:48:33.438851 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2385/4668] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:33 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:33.597899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:33.607280 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9d230c2a-4e62-46d5-bdde-be56e7d4b06f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1496 microversion: 2.1 time: 0.295942 Jul 26 04:48:33.608368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2284/4669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:33 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1496 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:34.141134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:34.141759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:34.152809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.153444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.156045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.156520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.263076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.274139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.277064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.278712 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-309ea78c-94f5-4fc3-858b-727ff7c00c7c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1351 microversion: 2.20 time: 0.141784 Jul 26 04:48:34.279779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2386/4670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:34 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:34.472187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:34.473188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:34.483613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.484077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.484883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.485334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.609734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.628114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.632458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:34.633236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:34.645631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.646076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.648191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.649444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53b4da60-2af1-419c-9dd1-33bb1a654d0f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.184871 Jul 26 04:48:34.650089 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2285/4671] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:34 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:34.662564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:34.663271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:34.967927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:34.979312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca235dca-c3b7-4356-b92b-57dca32f6671 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1496 microversion: 2.1 time: 0.350212 Jul 26 04:48:34.981417 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2387/4672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:34 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:35.307013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:35.308041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:35.326189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:35.326932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:35.328783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:35.330400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:35.679704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:35.680334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:35.698920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:35.699388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:35.700189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:35.701564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:35.765483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.796976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:35.808427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:35.816502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:35.818510 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38705103-1027-4b3e-877c-070c99baa925 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.518028 Jul 26 04:48:35.819628 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2286/4673] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:35 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:35.934970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.972408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:35.988058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:35.989699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:36.006854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:36.007485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:36.011223 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dabfe405-823a-4f7c-b6af-9d4f97fde07e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.338100 Jul 26 04:48:36.011827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2388/4674] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:35 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:36.032207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:36.032872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:36.033846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:36.034657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:36.219413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:36.229070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5cb0126-2e4d-46ba-8923-f219504eb024 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 200 len: 1454 microversion: 2.1 time: 0.226007 Jul 26 04:48:36.233104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2287/4675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:36 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 1454 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:36.262763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2a26ad36-2c9d-4b64-acea-90ad8065736f req-989957e4-fdfd-4e1d-997f-88039c992ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de728e-64fe-4ae8-b3a5-0234ca2e0fbd", "name": "network-vif-deleted", "tag": "47529a09-27f0-4ee4-9663-6fc680fec526"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:36.330004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2a26ad36-2c9d-4b64-acea-90ad8065736f req-989957e4-fdfd-4e1d-997f-88039c992ca6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:36.333765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2a26ad36-2c9d-4b64-acea-90ad8065736f req-989957e4-fdfd-4e1d-997f-88039c992ca6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:36.372662 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2a26ad36-2c9d-4b64-acea-90ad8065736f req-989957e4-fdfd-4e1d-997f-88039c992ca6 service nova] Creating event network-vif-deleted:47529a09-27f0-4ee4-9663-6fc680fec526 for instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd on n-h2-848886-16 Jul 26 04:48:36.392693 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2a26ad36-2c9d-4b64-acea-90ad8065736f req-989957e4-fdfd-4e1d-997f-88039c992ca6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133647 Jul 26 04:48:36.398934 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2389/4676] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:36.848202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:36.848830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:36.868378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:36.871094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:36.877209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:36.883331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.036797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:37.038221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:37.069330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:37.070127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.071323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:37.074757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.242128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.253969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.262119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.264391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.266010 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa1cafb6-2186-49aa-a7df-89203be617d0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.234408 Jul 26 04:48:37.276234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.276234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:37.278942 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2390/4677] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:37 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:37.279571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-52ac070c-0615-4745-90dd-09f862300f3a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.436890 Jul 26 04:48:37.290250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2288/4678] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:36 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:37.302714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:37.303465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:37.309729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:37.310219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.311141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:37.311590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.332900 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd HTTP/1.1 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '25de728e-64fe-4ae8-b3a5-0234ca2e0fbd'} Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:37.335473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-770cb50c-d53d-4ed4-9d6d-b4dd9c906b13 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 404 len: 111 microversion: 2.1 time: 0.043833 Jul 26 04:48:37.343050 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2391/4679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:37 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:48:37.618537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-122231065", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "84c66dba-789a-4cdf-9568-906349dee87f"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:37.726669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] validate_networks() for [('84c66dba-789a-4cdf-9568-906349dee87f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:48:37.772535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-96e153b4-66f3-49e6-a46e-461721ad65fb req-aa116242-fc63-4844-a6b1-21935265b657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:37.800853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96e153b4-66f3-49e6-a46e-461721ad65fb req-aa116242-fc63-4844-a6b1-21935265b657 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:37.801391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96e153b4-66f3-49e6-a46e-461721ad65fb req-aa116242-fc63-4844-a6b1-21935265b657 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:37.836514 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-96e153b4-66f3-49e6-a46e-461721ad65fb req-aa116242-fc63-4844-a6b1-21935265b657 service nova] Creating event network-changed:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:48:37.850645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-96e153b4-66f3-49e6-a46e-461721ad65fb req-aa116242-fc63-4844-a6b1-21935265b657 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085280 Jul 26 04:48:37.852288 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2392/4680] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:48:38.302870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:38.303691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:38.317470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.327803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.329112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.329562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.339102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:38.339595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:38.340883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:38.341343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:38.342010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:38.351408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.352653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.354470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.355166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.378603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:38.385983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Getting quotas for user c6de7305e69d48bfa9b4ced914b1c22b and project 0baf27ca34984f65ab6e8430e34b6458. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:38.404254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:48:38.407160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:48:38.488233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.491897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a245a990-8382-432e-8a9d-32d68282b91c tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877524 Jul 26 04:48:38.495571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2289/4681] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:48:38.500459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.505746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:38.506857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.507480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:38.508083 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-396c1904-f6b7-4303-b01a-9eb14cbd6340 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.209948 Jul 26 04:48:38.528859 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2393/4682] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:38 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:38.532106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48e707f6-cc03-4c58-bf30-1d071f4e3106 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:38.532729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-48e707f6-cc03-4c58-bf30-1d071f4e3106 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:38.535643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.538121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.540143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:38.542860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:38.673626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-48e707f6-cc03-4c58-bf30-1d071f4e3106 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.683568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-48e707f6-cc03-4c58-bf30-1d071f4e3106 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1214 microversion: 2.1 time: 0.153748 Jul 26 04:48:38.686466 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2394/4683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:38 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:38.773166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.789772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.792474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:38.793884 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d379e475-117b-47a0-b3e7-b69f3f8dbefa tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.297248 Jul 26 04:48:38.794648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2290/4684] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:38 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:39.536916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:39.538247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:39.553633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.554682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.558931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.559530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.707550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:39.708975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:39.724281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.725206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.726318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.729435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.785584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:39.799191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:39.800781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:39.808249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f458af45-6a46-45b8-809a-5a3d573af40a tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.275960 Jul 26 04:48:39.809899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2395/4685] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:39 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:39.832792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:39.833788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:39.845211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.848786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.850533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:39.851327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:39.892587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:39.901443 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9261c0fc-3192-4939-af44-6e3156326140 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1218 microversion: 2.1 time: 0.199700 Jul 26 04:48:39.907939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2291/4686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:39 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:40.144521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:40.157723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:40.159949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:40.161670 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-057f279a-3139-48a9-8e02-9638f1087ba3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.332944 Jul 26 04:48:40.163100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2396/4687] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:39 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:40.845366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:40.846000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:40.869444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:40.870014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:40.871217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:40.871860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:40.937508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:40.948296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:40.977357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:40.981218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:40.985022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:40.990556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:41.147127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.169944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.178666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.186448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a01cd80-7213-41c6-aa25-9fcda1d6e15c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.350821 Jul 26 04:48:41.191800 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2292/4688] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:40 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:41.230263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:41.234839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:41.257956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:41.258738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:41.261612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:41.264097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:41.426047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.439449 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cce6426-63f6-4587-8bca-c124a649d497 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1218 microversion: 2.1 time: 0.516287 Jul 26 04:48:41.457336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2397/4689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:40 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1218 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:41.654855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.661358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:41.664600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.666958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:41.678854 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-123ac9b1-62be-4d62-b467-51ae7ac9ad4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.466008 Jul 26 04:48:41.679459 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2293/4690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:41 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:42.230474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:42.232785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:42.247740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.250797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.251971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.254066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.472974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:42.474492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:42.489933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.492457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.494098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.494867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.613735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:42.628617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:42.634109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:42.636024 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8a3b670-bd41-4d24-a2c5-fb152e4a1325 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.416354 Jul 26 04:48:42.636630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2398/4691] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:42 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:42.707687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:42.708530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:42.717756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.722832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.724008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:42.725340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:42.739028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:42.752410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01799311-188f-4d8e-b84b-c01c7de6afb3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1272 microversion: 2.1 time: 0.286964 Jul 26 04:48:42.765341 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2294/4692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:42 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:43.043933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.052991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.059961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.061136 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3ef1a97-f347-4016-b8e9-f9931f0aa28a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.357899 Jul 26 04:48:43.061700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2399/4693] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:42 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:43.668355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:43.668982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:43.683117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:43.683628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:43.686839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:43.687349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:43.785232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:43.785926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:43.797341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:43.797808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:43.798635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:43.799076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:43.922886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.965128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.972318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:43.978458 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fcbb7a1-1b19-447b-ab55-ce2b1f8fabdd tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.313154 Jul 26 04:48:43.980835 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2295/4694] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:43 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:44.088869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:44.090335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:44.108938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:44.110629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:44.112102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:44.115612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:44.296431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:44.314903 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d3591473-3a84-46ff-a199-d10321e53939 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.533540 Jul 26 04:48:44.340232 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2400/4695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:43 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:44.735581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:44.748859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:44.752374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:44.753791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c825d6f-c0c7-4264-b0be-483906be1fd8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.671387 Jul 26 04:48:44.773003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2296/4696] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:44 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:45.006190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:45.007386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:45.018108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:45.022650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.024244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.026938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.027583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.217310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:45.231578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:45.236558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:45.237875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-166e8045-f3fe-4084-a618-a5e6bcd774cc tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.235883 Jul 26 04:48:45.245461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2401/4697] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:45 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:45.339522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:45.340150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:45.355897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.359118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.363188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.363822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.783195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:45.784196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:45.797649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.799377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.802292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:45.807528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:45.815425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:45.834836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ff87f56-095a-4385-b099-769327dd43de tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.498677 Jul 26 04:48:45.838542 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2297/4698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:45 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:46.287135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:46.288408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:46.302196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:46.303741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:46.304725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:46.305330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:46.366545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.379521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.387421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.392342 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccfb9571-b863-4357-a28b-6aa0b2966494 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.614379 Jul 26 04:48:46.393381 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2402/4699] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:45 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:46.589503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.598273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.604376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:46.620370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6006c3fc-3c08-450e-8a15-b601325e80e0 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1366 microversion: 2.47 time: 0.343029 Jul 26 04:48:46.620370 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2298/4700] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:46 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:46.690774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f008b8ab-39b2-49cb-bfa8-555937872708 req-131ef98f-c35c-48b9-a798-ee24e481e76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3216b5e-d9cb-41f2-9772-c0ab715c4f2f", "tag": "cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:46.711386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f008b8ab-39b2-49cb-bfa8-555937872708 req-131ef98f-c35c-48b9-a798-ee24e481e76d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:46.711834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f008b8ab-39b2-49cb-bfa8-555937872708 req-131ef98f-c35c-48b9-a798-ee24e481e76d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:46.753786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f008b8ab-39b2-49cb-bfa8-555937872708 req-131ef98f-c35c-48b9-a798-ee24e481e76d service nova] Creating event network-changed:cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d for instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f on n-h2-848886-16 Jul 26 04:48:46.775778 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f008b8ab-39b2-49cb-bfa8-555937872708 req-131ef98f-c35c-48b9-a798-ee24e481e76d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087833 Jul 26 04:48:46.783419 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2403/4701] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:46.858412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:46.859546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:46.875823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:46.876556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:46.877518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:46.878566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:47.425497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:47.428431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:47.446191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:47.447104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:47.451645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:47.452536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:48.364877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:48.395010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=14 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:48.410624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.422997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.424640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.432087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-858841df-1dc2-4349-ac73-e47d9bec5f15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 1.014760 Jul 26 04:48:48.440539 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2404/4702] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:47 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:48.448278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:48.457857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:48.491055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:48.491533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:48.492351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:48.492800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:48.497680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.517387 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a8c0ee4-f67d-40dd-a72c-43ba5c9b2acd tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 1.664245 Jul 26 04:48:48.517986 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2299/4703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:46 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:48.543485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ab864532-4bef-4567-bdd9-a92c9ca57811 req-c8b992f7-af02-44d1-b183-c711dea607bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "name": "network-vif-plugged", "status": "completed", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:48.573754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab864532-4bef-4567-bdd9-a92c9ca57811 req-c8b992f7-af02-44d1-b183-c711dea607bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:48.574509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ab864532-4bef-4567-bdd9-a92c9ca57811 req-c8b992f7-af02-44d1-b183-c711dea607bb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:48.601532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ab864532-4bef-4567-bdd9-a92c9ca57811 req-c8b992f7-af02-44d1-b183-c711dea607bb service nova] Creating event network-vif-plugged:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:48:48.612479 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ab864532-4bef-4567-bdd9-a92c9ca57811 req-c8b992f7-af02-44d1-b183-c711dea607bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086936 Jul 26 04:48:48.615182 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2300/4704] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:48.681993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:48.804601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.826045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.827958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:48.830022 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b68ad18f-c274-4fbd-a878-47c1077d8d37 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1372 microversion: 2.47 time: 0.387643 Jul 26 04:48:48.831203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2405/4705] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:48 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1372 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:49.459506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:49.460134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:49.489133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:49.492203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:49.503029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:49.503804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:49.543552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:49.544806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:49.552481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:49.558370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:49.559306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:49.560659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:50.034689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.058508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1d8442e-8da7-44ac-a3d2-1c4c4d04bd15 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.519515 Jul 26 04:48:50.065180 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2406/4706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:49 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:50.083160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:50.085809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:50.102186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:50.106296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:50.107357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:50.108182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:50.251919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.268236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.272819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.277642 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9eae9817-0580-4fb7-a9f4-8a0e810ac548 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.821409 Jul 26 04:48:50.279567 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2301/4707] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:49 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:50.376475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.386115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.387799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:50.389614 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d24f4c7e-4072-46ff-97e6-663298117cf5 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1372 microversion: 2.47 time: 0.323166 Jul 26 04:48:50.390573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2407/4708] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:50 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:51.089108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:51.090667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:51.128497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.128991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:51.131526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.132283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:51.304088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:51.304693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:51.319172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.321297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:51.323185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.323727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:51.720111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:51.722532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:51.746369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:51.748359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:51.751465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:51.753583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ec8b56a-f12c-4a60-b71b-1825a2dba6f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 0.451205 Jul 26 04:48:51.754884 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2408/4709] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:51 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:51.762139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:51.764866 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1a7a5c5-8bc2-456b-9df9-de4cf9ae0022 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.681538 Jul 26 04:48:51.766958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:51.771049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2302/4710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:51 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:51.779684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.783372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:51.784417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:51.786454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:52.094430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.099635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2139295270", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:52.119896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.123721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.128906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-97ef9728-f6eb-4ef3-8051-fcd788720783 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1357 microversion: 2.47 time: 0.369922 Jul 26 04:48:52.130302 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2409/4711] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:51 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1357 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:52.154603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:52.159564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.163406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Searching by: {'deleted': False, 'project_id': 'f2c376112ba6492ba93e645726a5e838'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 04:48:52.174660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:52.175394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:52.179534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:52.180545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:52.194586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] validate_networks() for [('a96b578f-f211-4d67-affa-b201a2dd5fac', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:48:52.351836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 04:48:52.444778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.463912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:52.464424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:52.486785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.488487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:52.757880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-426ac404-7711-41c2-a2d9-2ce80ce449a3 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.607957 Jul 26 04:48:52.777258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2410/4712] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Jul 26 04:48:52 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:48:52.795637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:52.797509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:52.826523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:52.828057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:52.829188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:52.831299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:53.243776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:48:53.244928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:48:53.245660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:48:53.246938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:48:53.247705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:48:53.261974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:53.263012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:53.264421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:53.269367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:53.299944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Getting quotas for project 418dea0a66ac4e1dacc0ecbaf980d228. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:48:53.307706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Getting quotas for user 1fe0903ebc284c97985e822236e1aff2 and project 418dea0a66ac4e1dacc0ecbaf980d228. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:48:53.333304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:48:53.336247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:48:53.449185 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17d895e8-fd95-4467-a651-915658bb338a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.674235 Jul 26 04:48:53.450597 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2303/4713] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:48:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:48:53.461253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:53.463882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:53.478965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:53.483798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:53.486415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:53.512583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:53.516111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:53.944978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:53.966646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-120f1f60-5d29-462c-98e6-9568876ed0a8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.510445 Jul 26 04:48:53.973706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2304/4714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:53 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:54.027609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:54.037977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:54.058135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:54.058925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:54.064267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:54.069055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:54.107229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.127722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.132501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.133714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8f3d9f8-496b-46c2-a0ec-1e18ad9de8f4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1407 microversion: 2.20 time: 1.351713 Jul 26 04:48:54.135312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:48:54.148205 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2411/4715] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:52 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1407 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:54.163510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f96a7f9a-112e-400a-a6fb-fc29200b6aca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:54.164136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f96a7f9a-112e-400a-a6fb-fc29200b6aca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:54.369451 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db4d1468-84fc-4d46-8607-9e5077ef4c97 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 204 len: 0 microversion: 2.47 time: 0.364194 Jul 26 04:48:54.370363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2305/4716] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:48:53 2022] DELETE /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:48:54.380484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:54.381370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:54.401654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:54.402484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:54.406868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:54.407452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:54.471073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f96a7f9a-112e-400a-a6fb-fc29200b6aca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.481507 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f96a7f9a-112e-400a-a6fb-fc29200b6aca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1217 microversion: 2.1 time: 0.331995 Jul 26 04:48:54.483006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2412/4717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:54 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:54.568855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.581948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.588429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:54.589722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f283f8c-c415-48a9-b624-de7277bd1da1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1363 microversion: 2.47 time: 0.214726 Jul 26 04:48:54.595172 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2306/4718] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:54 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:55.010458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:55.012489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:55.071983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.072567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.073389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.073853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.171778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:55.172403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:55.183634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.195927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.197598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.198062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.560703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.575142 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-486da3f9-0d59-4fea-85d8-1c639420e7e5 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.582938 Jul 26 04:48:55.576019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2413/4719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:54 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:55.592196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:55.593236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:55.601092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.604005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.604693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.605707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.606415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.614388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.617101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.619743 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3348c59-f2f3-4633-a91e-26484ca2f364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1599 microversion: 2.20 time: 0.451531 Jul 26 04:48:55.621021 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2307/4720] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:55 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1599 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:55.626252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:55.628477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:55.643648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.647008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.650768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.651497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.738318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.750043 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-215c448f-27ea-4a6e-b60c-dbcb0732d6db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1269 microversion: 2.1 time: 0.172073 Jul 26 04:48:55.750669 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2414/4721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:55 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:55.758273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:55.759091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:55.772499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.773278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.775794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:55.777681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:55.779534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.794024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.798964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:55.800221 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1914b9b1-870e-44e7-93ad-f93560006300 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1363 microversion: 2.47 time: 0.178068 Jul 26 04:48:55.814375 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2308/4722] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:55 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:56.093463 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d10f324-6483-44e7-9501-b12e658a7061 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.340679 Jul 26 04:48:56.094683 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2415/4723] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:48:55 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:48:56.599951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:56.600880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:56.614745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:56.615919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:56.616874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:56.617505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:56.772139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:56.773790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:56.800782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:56.817336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:56.822473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:56.826969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:56.976651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:56.979092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:56.988135 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ee56038-e3f6-4c63-b854-b2058da50006 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1275 microversion: 2.1 time: 0.221972 Jul 26 04:48:56.994447 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2416/4724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:56 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:48:56.994901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6736f14a-a50b-4ea6-9c34-5a346bd8bab2 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.398784 Jul 26 04:48:57.009416 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2309/4725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:56 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:57.013192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:57.013816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:57.036149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:57.036642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:57.041927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:57.042412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:57.133835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:57.136596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:57.137073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lazy-loading 'fault' on Instance uuid d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:48:57.285235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:57.325765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:57.343007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:57.348010 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51cc70f2-5e32-478b-9457-fff65d49163f tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 200 len: 1368 microversion: 2.47 time: 0.347281 Jul 26 04:48:57.353220 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2417/4726] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:56 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:57.631037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4bf6f845-de35-4355-a689-f62b26e20225 req-884868c8-672c-45df-a3e4-950bd54a6ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3216b5e-d9cb-41f2-9772-c0ab715c4f2f", "name": "network-vif-plugged", "status": "completed", "tag": "cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:57.663342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4bf6f845-de35-4355-a689-f62b26e20225 req-884868c8-672c-45df-a3e4-950bd54a6ad8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:57.666949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4bf6f845-de35-4355-a689-f62b26e20225 req-884868c8-672c-45df-a3e4-950bd54a6ad8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:57.672002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:57.682595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4bf6f845-de35-4355-a689-f62b26e20225 req-884868c8-672c-45df-a3e4-950bd54a6ad8 service nova] Creating event network-vif-plugged:cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d for instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f on n-h2-848886-16 Jul 26 04:48:57.690295 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4bf6f845-de35-4355-a689-f62b26e20225 req-884868c8-672c-45df-a3e4-950bd54a6ad8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063968 Jul 26 04:48:57.692593 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2310/4727] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:58.027146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:58.029876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:58.030360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:58.031224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:58.055552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.058184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.060936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.061607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.061758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.062458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.063417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.063864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.188750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:58.201190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33516cc6-2dcf-4eb4-9529-1a27bbf2fde3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1275 microversion: 2.1 time: 0.188972 Jul 26 04:48:58.216862 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2418/4728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:58 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:58.376366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:58.378567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: d13754f1-ed25-4f3b-adb9-bbebc5b4bd41] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:58.407586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.409848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.412105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.414001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.467390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] HTTP exception thrown: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Request method failure captured: Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 HTTP/1.1 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33IH24Dh_iLfYAKzI_BOiTo0TBlyyGOcZyQi3eSuaOHa3XQv0luE3qjfmb62ELlso0q5Zo9XGV_GGj0DIDOlM0lQIXELX62F-4cXmjiAU2E8sc_gDi5kspjSvk0ctzGZdGbYjbsNbId_MQlz8pG6Hl3rhS0I2_baWA0LKYtfZWx_1ZM Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f2c376112ba6492ba93e645726a5e838 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerShowV247Test-169095691 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f2c376112ba6492ba93e645726a5e838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerShowV247Test-169095691 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f2c376112ba6492ba93e645726a5e838 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerShowV247Test-169095691 Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerShowV247Test-169095691-project Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 0b2e91ea872f4e08b5c7b3bec65656cc Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerShowV247Test-169095691-project Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd13754f1-ed25-4f3b-adb9-bbebc5b4bd41'} Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:48:58.470650 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. Jul 26 04:48:58.475908 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:48:58.490966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Returning 404 to user: Instance d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:48:58.498348 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdb024a9-034b-4bed-bed3-3d7c21d48ae1 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41" status: 404 len: 111 microversion: 2.47 time: 0.127549 Jul 26 04:48:58.500659 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2419/4729] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:58 2022] GET /compute/v2.1/servers/d13754f1-ed25-4f3b-adb9-bbebc5b4bd41 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:48:58.515732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:58.523039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:58.532303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:58.544208 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3441478-e166-4152-9c95-72aed5bfa83d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.529607 Jul 26 04:48:58.545162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.545664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.546518 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2311/4730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:58 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:48:58.550654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.554595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.650435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9152e371-04b7-45fa-9a52-87006cc4af59 req-73ca8bcd-d100-43bd-a056-0c51207de45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:48:58.669713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9152e371-04b7-45fa-9a52-87006cc4af59 req-73ca8bcd-d100-43bd-a056-0c51207de45e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.670194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9152e371-04b7-45fa-9a52-87006cc4af59 req-73ca8bcd-d100-43bd-a056-0c51207de45e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.692377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:48:58.705823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9152e371-04b7-45fa-9a52-87006cc4af59 req-73ca8bcd-d100-43bd-a056-0c51207de45e service nova] Creating event network-changed:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:48:58.719280 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9152e371-04b7-45fa-9a52-87006cc4af59 req-73ca8bcd-d100-43bd-a056-0c51207de45e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073334 Jul 26 04:48:58.720639 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2312/4731] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:48:58.957088 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-743bc9aa-3be1-4b68-9ae7-5a7c169d088b tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "DELETE /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 204 len: 0 microversion: 2.47 time: 0.451950 Jul 26 04:48:58.958187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2420/4732] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:48:58 2022] DELETE /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 04:48:58.968169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:58.969612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:58.987061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.987864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:58.988908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:58.990758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:59.195062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:59.217299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:59.221176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:59.223953 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-240a0af2-0780-4c3c-b75e-b66daa0c778e tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 200 len: 1362 microversion: 2.47 time: 0.260954 Jul 26 04:48:59.226450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:59.227379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:59.228772 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2313/4733] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:48:58 2022] GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:48:59.254792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:59.256558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:59.258111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:59.258531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:59.566742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:48:59.567370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:48:59.582392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:59.582868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:59.583703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:48:59.589451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:48:59.965273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:48:59.975627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba02f5c0-8b5d-48d8-a26f-6ec94dd4d0a3 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1314 microversion: 2.1 time: 0.414169 Jul 26 04:48:59.976640 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2314/4734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:59 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:00.264455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:00.267534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:00.279228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:00.279702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:00.281572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:00.282078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:00.888413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:00.911306 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37c96424-2663-4c16-a03e-b2d450e8cfc5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 1.689576 Jul 26 04:49:00.912812 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2421/4735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:48:59 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:01.002540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:01.003394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:01.040698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:01.041775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:01.046414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:01.048251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:01.201830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:01.233855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:01.239965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:01.246540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee5cb217-fce6-43cb-a948-b5e7dd54633c tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 200 len: 1362 microversion: 2.47 time: 0.993619 Jul 26 04:49:01.257499 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2315/4736] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:49:00 2022] GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 1362 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:49:01.936569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:01.937843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:01.955560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:01.959405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:01.973702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:01.976639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc49fead-ce63-42af-bf42-6f2186985c63 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1501 microversion: 2.1 time: 0.983553 Jul 26 04:49:01.978127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:01.978812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:01.979687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2422/4737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:00 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1501 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:02.014188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:02.017972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:02.051913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:02.053016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:02.055381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:02.057255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:02.147934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lazy-loading 'flavor' on Instance uuid e3216b5e-d9cb-41f2-9772-c0ab715c4f2f {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:49:02.249119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:02.284246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:02.313762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-241fd0bf-d0bd-4ff8-a089-438bc8715c87 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "POST /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f/action" status: 202 len: 0 microversion: 2.1 time: 0.311429 Jul 26 04:49:02.315007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2423/4738] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:49:01 2022] POST /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:49:02.329896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:02.331655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:02.343845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:02.345294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:02.347094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:02.349461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:02.409126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:02.409990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:02.410790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lazy-loading 'fault' on Instance uuid 97539e5f-8d94-4e31-8798-533a8cdf8df1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:49:02.492915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:02.505676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:02.508374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2e91ea872f4e08b5c7b3bec65656cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c376112ba6492ba93e645726a5e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:02.510421 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf0c9075-3f81-4d32-b33e-8ce16af69c66 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 200 len: 1367 microversion: 2.47 time: 0.192675 Jul 26 04:49:02.511271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2424/4739] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:49:02 2022] GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:49:02.519337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:02.536556 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-334486d4-158d-4b0c-b288-4a28f19dc633 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 0.606931 Jul 26 04:49:02.550835 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2316/4740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:01 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:03.127213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bb7ead8d-059d-431b-a3f6-c5cd9a897272 req-8bc032ce-391d-4a31-b0b0-45dec7bcf509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:03.149951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bb7ead8d-059d-431b-a3f6-c5cd9a897272 req-8bc032ce-391d-4a31-b0b0-45dec7bcf509 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.151030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bb7ead8d-059d-431b-a3f6-c5cd9a897272 req-8bc032ce-391d-4a31-b0b0-45dec7bcf509 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.176416 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bb7ead8d-059d-431b-a3f6-c5cd9a897272 req-8bc032ce-391d-4a31-b0b0-45dec7bcf509 service nova] Creating event network-changed:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h1-848886-16 Jul 26 04:49:03.189567 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bb7ead8d-059d-431b-a3f6-c5cd9a897272 req-8bc032ce-391d-4a31-b0b0-45dec7bcf509 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065371 Jul 26 04:49:03.191048 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2317/4741] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:49:03.210008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:03.213793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:03.223018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.225039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.226067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.226706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.547620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:03.549336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] [instance: 97539e5f-8d94-4e31-8798-533a8cdf8df1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:03.565849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:03.567032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:03.569075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.580702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.582544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.585966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.621694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] HTTP exception thrown: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Request method failure captured: Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 HTTP/1.1 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33IH24Dh_iLfYAKzI_BOiTo0TBlyyGOcZyQi3eSuaOHa3XQv0luE3qjfmb62ELlso0q5Zo9XGV_GGj0DIDOlM0lQIXELX62F-4cXmjiAU2E8sc_gDi5kspjSvk0ctzGZdGbYjbsNbId_MQlz8pG6Hl3rhS0I2_baWA0LKYtfZWx_1ZM Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f2c376112ba6492ba93e645726a5e838 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerShowV247Test-169095691 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2c376112ba6492ba93e645726a5e838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f2c376112ba6492ba93e645726a5e838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerShowV247Test-169095691 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f2c376112ba6492ba93e645726a5e838 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerShowV247Test-169095691 Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerShowV247Test-169095691-project Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 0b2e91ea872f4e08b5c7b3bec65656cc Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerShowV247Test-169095691-project Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '97539e5f-8d94-4e31-8798-533a8cdf8df1'} Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:03.629671 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. Jul 26 04:49:03.634827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:03.635623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] Returning 404 to user: Instance 97539e5f-8d94-4e31-8798-533a8cdf8df1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:03.636719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a990e1b3-989f-439c-83c2-e66431382396 tempest-ServerShowV247Test-169095691 tempest-ServerShowV247Test-169095691-project] 10.222.0.43 "GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1" status: 404 len: 111 microversion: 2.47 time: 0.104482 Jul 26 04:49:03.637434 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2318/4742] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:49:03 2022] GET /compute/v2.1/servers/97539e5f-8d94-4e31-8798-533a8cdf8df1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:03.647538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:03.650073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:03.658574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.659191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.660173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:03.660725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:03.763157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:03.776786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5972086-d37e-48d7-a777-129494a8d2e0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1509 microversion: 2.1 time: 1.264630 Jul 26 04:49:03.780795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2425/4743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:02 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1509 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:04.148347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:04.160302 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59e5b025-035b-41fe-9ef7-8de21c6b6ba8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 0.521675 Jul 26 04:49:04.167107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2319/4744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:03 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:04.803623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:04.804284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:04.809246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:04.825733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:04.825733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:04.825733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:04.825733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.143311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:05.164457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d3b51b94-f6dd-495f-a90d-1f760c7f5417 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1492 microversion: 2.1 time: 0.360037 Jul 26 04:49:05.166730 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2426/4745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:04 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1492 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:05.187231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:05.187865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:05.189279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:05.190035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:05.198334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.199054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.200094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.201007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.208798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.209644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.210716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.211770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.258386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:49:05.428445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f3c5b73-21b8-4212-aae7-7dde303dfca6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 204 len: 0 microversion: 2.1 time: 0.243636 Jul 26 04:49:05.434529 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2427/4746] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:05 2022] DELETE /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:49:05.440811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:05.441841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:05.449985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.451204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.452477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:05.453200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:05.597543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:05.608150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3466ee0a-f8ba-492f-9799-1cd250b759ee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 0.425798 Jul 26 04:49:05.608879 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2320/4747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:05 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:05.894301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:05.905210 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64a28b57-47c2-4a41-af86-297a9a88d4db tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1498 microversion: 2.1 time: 0.469039 Jul 26 04:49:05.909394 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2428/4748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:05 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1498 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:06.630541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:06.631899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:06.640715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:06.641555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:06.642702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:06.643855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:06.933796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:06.939726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:06.941020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:06.945537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b24ddf1-a5c5-44a9-835a-b50b84cf901c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 0.319816 Jul 26 04:49:06.946821 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2321/4749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:06 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:06.949461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:06.949918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:06.950722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:06.951398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:07.220881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:07.244374 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94b3a03a-263f-4b45-ad07-18e4a3a29b34 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1498 microversion: 2.1 time: 0.307881 Jul 26 04:49:07.246527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2429/4750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:06 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1498 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:07.980721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:07.986549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:08.028318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.029436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.032800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.033603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.233415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-708663e9-f196-4d87-a6b0-d033ccf70da3 req-2a03d604-4b9b-4ad2-830b-8b6300c67fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3216b5e-d9cb-41f2-9772-c0ab715c4f2f", "name": "network-vif-deleted", "tag": "cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:08.254323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-708663e9-f196-4d87-a6b0-d033ccf70da3 req-2a03d604-4b9b-4ad2-830b-8b6300c67fae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.255080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-708663e9-f196-4d87-a6b0-d033ccf70da3 req-2a03d604-4b9b-4ad2-830b-8b6300c67fae service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.281349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-708663e9-f196-4d87-a6b0-d033ccf70da3 req-2a03d604-4b9b-4ad2-830b-8b6300c67fae service nova] Creating event network-vif-deleted:cd7278cc-0f4d-4dd4-bdc0-c0d3a080e36d for instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f on n-h2-848886-16 Jul 26 04:49:08.299634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-708663e9-f196-4d87-a6b0-d033ccf70da3 req-2a03d604-4b9b-4ad2-830b-8b6300c67fae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070611 Jul 26 04:49:08.316679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2430/4751] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:49:08.332019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:08.333518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:08.347214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.347915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.349260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.350176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.501537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6de7305e69d48bfa9b4ced914b1c22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0baf27ca34984f65ab6e8430e34b6458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:08.520152 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d83cd70b-4d15-4b12-8562-2a6c8a12697a tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 200 len: 1290 microversion: 2.1 time: 0.198337 Jul 26 04:49:08.522473 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2431/4752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:08 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 1290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:08.600496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:08.612381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-366e1dd6-3405-4ff0-bc44-ff3b03cb1efe tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 0.641455 Jul 26 04:49:08.614593 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2322/4753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:07 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:08.621738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2d11a86b-9acb-4f30-a0b7-1549695a0f5c req-5cdeb681-242b-48f2-ba12-17679ecbed22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "name": "network-vif-plugged", "status": "completed", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:08.651200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2d11a86b-9acb-4f30-a0b7-1549695a0f5c req-5cdeb681-242b-48f2-ba12-17679ecbed22 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:08.651799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2d11a86b-9acb-4f30-a0b7-1549695a0f5c req-5cdeb681-242b-48f2-ba12-17679ecbed22 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:08.675509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2d11a86b-9acb-4f30-a0b7-1549695a0f5c req-5cdeb681-242b-48f2-ba12-17679ecbed22 service nova] Creating event network-vif-plugged:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h1-848886-16 Jul 26 04:49:08.683636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2d11a86b-9acb-4f30-a0b7-1549695a0f5c req-5cdeb681-242b-48f2-ba12-17679ecbed22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066198 Jul 26 04:49:08.684770 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2323/4754] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:09.115475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:09.116806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:09.137801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.138287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.139083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.139694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.181312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a64154b4-881c-479f-b568-fdf01f1a8af4 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/ips" status: 200 len: 144 microversion: 2.1 time: 0.657446 Jul 26 04:49:09.183147 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2432/4755] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:49:08 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/ips => generated 144 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:09.548936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:09.549742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:09.569131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.569864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.572775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.573619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.622356 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f HTTP/1.1 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e3216b5e-d9cb-41f2-9772-c0ab715c4f2f'} Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.628700 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.633468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:09.639584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:09.640355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:09.646773 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f95e483-6488-4283-a642-b93720529248 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 404 len: 111 microversion: 2.1 time: 0.103563 Jul 26 04:49:09.655750 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2324/4756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:09 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:09.665354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.679090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.683211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.684834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:09.688156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.691544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:09.745351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.747030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.748553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.753033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.829066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f HTTP/1.1 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e3216b5e-d9cb-41f2-9772-c0ab715c4f2f'} Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:09.831440 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.835952 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.837716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:09.852814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8219c241-f6d4-4b20-92aa-e85111effbc8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 404 len: 111 microversion: 2.1 time: 0.180972 Jul 26 04:49:09.878304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2325/4757] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:09 2022] DELETE /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:09.890728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:09.891859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: e3216b5e-d9cb-41f2-9772-c0ab715c4f2f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:09.924258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.931351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.932741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:09.933682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:09.982223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f HTTP/1.1 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e3216b5e-d9cb-41f2-9772-c0ab715c4f2f'} Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:09.992040 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. Jul 26 04:49:09.997261 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.000368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance e3216b5e-d9cb-41f2-9772-c0ab715c4f2f could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.002970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e9d16e0-d9e1-4bf8-83fe-72047a548616 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f" status: 404 len: 111 microversion: 2.1 time: 0.119839 Jul 26 04:49:10.006465 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2326/4758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:09 2022] GET /compute/v2.1/servers/e3216b5e-d9cb-41f2-9772-c0ab715c4f2f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.019112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.019822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.036739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.037204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.039504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.040748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.091458 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd HTTP/1.1 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '25de728e-64fe-4ae8-b3a5-0234ca2e0fbd'} Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.093176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.097060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.099466 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1f53df5-97ae-4751-b619-cf6cbca48bf8 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 404 len: 111 microversion: 2.1 time: 0.091757 Jul 26 04:49:10.100265 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2327/4759] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:10 2022] DELETE /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.108364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.110973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.127473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.127473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.129182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.131107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.165975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd HTTP/1.1 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '25de728e-64fe-4ae8-b3a5-0234ca2e0fbd'} Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.168070 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. Jul 26 04:49:10.172540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.175130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 25de728e-64fe-4ae8-b3a5-0234ca2e0fbd could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.176337 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-25e47a6f-ad9b-445e-9f81-73f06be6833b tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd" status: 404 len: 111 microversion: 2.1 time: 0.071969 Jul 26 04:49:10.177510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2328/4760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:10 2022] GET /compute/v2.1/servers/25de728e-64fe-4ae8-b3a5-0234ca2e0fbd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:49:10.186632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.187491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.200470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.201000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.201852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.202474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.219669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 HTTP/1.1 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '52f78cb3-ded8-4fa4-888f-bd0ea2b669d4'} Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.221377 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-715c24a3-9175-497d-b01c-051906662925 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 404 len: 111 microversion: 2.1 time: 0.041653 Jul 26 04:49:10.229556 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2329/4761] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:10 2022] DELETE /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.234329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.235109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.244063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.244673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.245593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.246341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.265688 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 HTTP/1.1 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '52f78cb3-ded8-4fa4-888f-bd0ea2b669d4'} Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.267787 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9ddb59e-5c25-4b8d-95bc-e26b909b5ca1 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4" status: 404 len: 111 microversion: 2.1 time: 0.043096 Jul 26 04:49:10.272823 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2330/4762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:10 2022] GET /compute/v2.1/servers/52f78cb3-ded8-4fa4-888f-bd0ea2b669d4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.282543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.283121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.291554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.292533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.293857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.294529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.319451 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 HTTP/1.1 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2c3f9552-e2be-42d8-bb97-af523fb06472'} Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.325799 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c6dbb57-6a41-4bb4-8827-c4c72c56ac0d tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 404 len: 111 microversion: 2.1 time: 0.049088 Jul 26 04:49:10.329947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2331/4763] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:10 2022] DELETE /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.341387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.342118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 2c3f9552-e2be-42d8-bb97-af523fb06472] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.359078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.359542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.360343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.360790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.401961 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 HTTP/1.1 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '2c3f9552-e2be-42d8-bb97-af523fb06472'} Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.408108 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 2c3f9552-e2be-42d8-bb97-af523fb06472 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9d835ac0-24a8-4840-8e00-169e127d0028 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472" status: 404 len: 111 microversion: 2.1 time: 0.073694 Jul 26 04:49:10.416840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2332/4764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:10 2022] GET /compute/v2.1/servers/2c3f9552-e2be-42d8-bb97-af523fb06472 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:49:10.425431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.426034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.448189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.455935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.456951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.457415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.481965 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b HTTP/1.1 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7becc74d-3ca2-481e-a221-44dc034b793b'} Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.483572 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.488216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.490073 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2dc82a51-73fd-423b-b08b-9a63afc7fa31 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 404 len: 111 microversion: 2.1 time: 0.070046 Jul 26 04:49:10.494855 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2333/4765] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:10 2022] DELETE /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:10.500381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:10.501013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 7becc74d-3ca2-481e-a221-44dc034b793b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:10.533049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.537780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.539163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:10.542090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:10.585768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b HTTP/1.1 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7becc74d-3ca2-481e-a221-44dc034b793b'} Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:10.587610 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 7becc74d-3ca2-481e-a221-44dc034b793b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:10.591550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7148aa28-e215-41e2-a586-5b698b9d896f tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b" status: 404 len: 111 microversion: 2.1 time: 0.092637 Jul 26 04:49:10.592624 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2334/4766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:10 2022] GET /compute/v2.1/servers/7becc74d-3ca2-481e-a221-44dc034b793b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:11.026745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:11.037114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2c597ce-411a-40c0-9d25-8a24d105e4e9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1317 microversion: 2.1 time: 1.402210 Jul 26 04:49:11.053943 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2433/4767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1317 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:11.887196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a169c40-f620-427c-be3d-3916e35ed29b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:11.893081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:11.926446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:11.930824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:11.934501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:11.936220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:12.063982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:12.064897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:12.083542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:12.087286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:12.105331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:12.106315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:12.557448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d3bccf2-35a1-48ee-b5e4-ba438e76121e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677531 Jul 26 04:49:12.574684 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2335/4768] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:49:11 2022] POST /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:13.146589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:13.167624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24e5c1ab-badc-4ffc-9bdd-b77c09c59f94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.110334 Jul 26 04:49:13.168277 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2434/4769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:12 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:13.345480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-965815848", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:13.451447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] validate_networks() for [('a96b578f-f211-4d67-affa-b201a2dd5fac', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:49:14.803954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:49:14.804565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:49:14.804835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:49:14.806103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:49:14.806643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:49:14.833941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:14.834356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:14.837203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:14.837645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:14.882229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:14.912192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Getting quotas for project 418dea0a66ac4e1dacc0ecbaf980d228. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:49:14.935468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Getting quotas for user 1fe0903ebc284c97985e822236e1aff2 and project 418dea0a66ac4e1dacc0ecbaf980d228. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:49:14.986918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:49:14.989328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:49:15.156963 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00c05e55-4a8a-48ae-9250-fb3feecc9e6b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816103 Jul 26 04:49:15.158126 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2336/4770] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:49:15.169028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6f0e45a-6fea-4abe-a216-89612104b119 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:15.170401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6f0e45a-6fea-4abe-a216-89612104b119 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:15.179612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:15.389628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a6f0e45a-6fea-4abe-a216-89612104b119 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:15.410864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6f0e45a-6fea-4abe-a216-89612104b119 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1216 microversion: 2.1 time: 0.246161 Jul 26 04:49:15.417618 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2435/4771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:15 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:16.451224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:16.452478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:16.465780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:16.471346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:16.472658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:16.473325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:16.783265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:16.797580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-446f1e1d-6d50-440f-af48-c4e2e2e25a71 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1212 microversion: 2.1 time: 0.360984 Jul 26 04:49:16.798828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2337/4772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:16 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1212 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:17.820582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:17.821920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:17.845970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:17.846679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:17.848762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:17.850621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.225708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:18.241592 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b495673f-afc8-464b-b205-d198f5afbb44 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1274 microversion: 2.1 time: 0.421706 Jul 26 04:49:18.244858 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2436/4773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:17 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1274 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:18.628694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:18.629229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:18.643431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.643886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.644682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.645122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.703473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef HTTP/1.1 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '28a68b05-b5fb-4da1-b99c-8691f57754ef'} Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:18.705215 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.710002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:18.715476 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb1bd8fd-a90d-4055-a667-8e01cea3dce6 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 404 len: 111 microversion: 2.1 time: 0.090863 Jul 26 04:49:18.716096 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2338/4774] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:18 2022] DELETE /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:18.724832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:18.725757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 28a68b05-b5fb-4da1-b99c-8691f57754ef] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:18.753314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.762747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.768921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.769730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.814347 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef HTTP/1.1 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '28a68b05-b5fb-4da1-b99c-8691f57754ef'} Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.827243 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. Jul 26 04:49:18.831994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.837304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 28a68b05-b5fb-4da1-b99c-8691f57754ef could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:18.838518 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef" status: 404 len: 111 microversion: 2.1 time: 0.118224 Jul 26 04:49:18.845993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2437/4775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:18 2022] GET /compute/v2.1/servers/28a68b05-b5fb-4da1-b99c-8691f57754ef => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:18.855571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:18.856473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:18.857432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:18.858955 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b07221a-bcfa-4d9a-b31e-f3845726dd52 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003572 Jul 26 04:49:18.862061 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2438/4776] 10.222.0.43 () {56 vars in 886 bytes} [Tue Jul 26 04:49:18 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 04:49:18.876102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.876874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.877983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:18.878685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:18.940927 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 HTTP/1.1 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '6568b36c-d024-4bca-b977-933bc21751c0'} Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:18.943562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:18.947411 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:18.962276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:18.967350 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14380fac-406b-4436-98dc-190e069433d0 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 404 len: 111 microversion: 2.1 time: 0.118161 Jul 26 04:49:18.968558 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2339/4777] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:18 2022] DELETE /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:18.977530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:18.978810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] [instance: 6568b36c-d024-4bca-b977-933bc21751c0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:18.996048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:19.000394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:19.005551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:19.006497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:19.060848 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] HTTP exception thrown: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Request method failure captured: Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 HTTP/1.1 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ER7qxLgzcFY8vfhjOdGLRcNZNLymkA9iMWb-vicrRIqCxWaZbOviC9U8FR366DQ1elECW1891Vx72815bGjANG1CbAL_RcoKFXprxZfVRpD069LoybNTM6ApfuR5IrG5EKqcDbmnCUZzNL11xbY2evlN2U8yppHMFh0XqLZ7IbsQA Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0baf27ca34984f65ab6e8430e34b6458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 0baf27ca34984f65ab6e8430e34b6458 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1936585373 Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: c6de7305e69d48bfa9b4ced914b1c22b Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1936585373-project Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6568b36c-d024-4bca-b977-933bc21751c0'} Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:19.068466 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] Returning 404 to user: Instance 6568b36c-d024-4bca-b977-933bc21751c0 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:19.075730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64f8c199-c70b-4b69-923d-67e0bf604513 tempest-DeleteServersTestJSON-1936585373 tempest-DeleteServersTestJSON-1936585373-project] 10.222.0.43 "GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0" status: 404 len: 111 microversion: 2.1 time: 0.097311 Jul 26 04:49:19.080521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2439/4778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:18 2022] GET /compute/v2.1/servers/6568b36c-d024-4bca-b977-933bc21751c0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:19.267629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:19.272703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:19.293309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:19.293911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:19.294806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:19.295249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:19.561156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:19.585045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-078e73ad-5285-4923-924c-cdf30ab6d392 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1274 microversion: 2.1 time: 0.319332 Jul 26 04:49:19.590456 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2340/4779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:19 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:20.611718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:20.612515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:20.624933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:20.636301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:20.637399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:20.638570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:22.185066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:22.198584 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4484ca4e-eacd-41d7-aa8d-23e1edfa9b5c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 1.590616 Jul 26 04:49:22.201047 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2440/4780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:20 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:23.221220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:23.224565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:23.247431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:23.248970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:23.250997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:23.251865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:24.280619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:24.296815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ddc9d632-8b81-42b4-8bc4-c3b0de69d488 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 1.077740 Jul 26 04:49:24.298695 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2341/4781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:23 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:24.918036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7d64b0ad-bf5c-4955-832a-f9889157392c req-480e7a6c-1d20-470d-8928-2f2a0bc01da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af069b5f-2bd5-4bec-963a-1c8bfbd45753", "tag": "e6ef789b-622f-431b-a62a-2117b1314d48"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:24.950749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7d64b0ad-bf5c-4955-832a-f9889157392c req-480e7a6c-1d20-470d-8928-2f2a0bc01da6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:24.951209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7d64b0ad-bf5c-4955-832a-f9889157392c req-480e7a6c-1d20-470d-8928-2f2a0bc01da6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:24.993938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7d64b0ad-bf5c-4955-832a-f9889157392c req-480e7a6c-1d20-470d-8928-2f2a0bc01da6 service nova] Creating event network-changed:e6ef789b-622f-431b-a62a-2117b1314d48 for instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 on n-h1-848886-16 Jul 26 04:49:25.019667 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7d64b0ad-bf5c-4955-832a-f9889157392c req-480e7a6c-1d20-470d-8928-2f2a0bc01da6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104932 Jul 26 04:49:25.023679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2441/4782] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:25.320796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:25.322961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:25.332249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:25.333546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:25.335394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:25.338406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:25.339311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:25.341377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:25.341994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:26.579884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:26.591410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6777f598-a28b-4025-8ad2-1493e0610209 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 1.275949 Jul 26 04:49:26.607547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2342/4783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:25 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:27.618899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:27.620420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:27.625131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:27.660818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:27.661310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:27.662409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:27.665666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:28.240096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:28.247753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:28.252487 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2927c2c1-c914-417d-b53e-1d776865b438 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 0.639522 Jul 26 04:49:28.258321 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2442/4784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:27 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:29.282011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:29.282867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:29.297037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:29.298752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:29.301661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:29.302358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:29.470504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-403964794", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:29.586478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:49:29.761120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:29.787740 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f54f5e4e-17d8-4622-8b4c-dfbc8242097b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 0.511038 Jul 26 04:49:29.803336 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2343/4785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:29 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:30.464277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:49:30.478138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:49:30.479497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:49:30.480301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:49:30.480911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:49:30.505356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:30.506175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:30.507459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:30.508516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:30.530989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Getting quotas for project 825f8be0c3154d5d84084e9f1ff34cba. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:49:30.559916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Getting quotas for user 4aa0c7b694bd428e9cea853e1e8001ac and project 825f8be0c3154d5d84084e9f1ff34cba. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:49:30.584910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:49:30.588949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:49:30.643422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-86046d5b-63be-46c0-8a0b-d0f8467586ab req-cdc8b0ba-295b-4d3b-823e-6f3056d1af8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af069b5f-2bd5-4bec-963a-1c8bfbd45753", "name": "network-vif-plugged", "status": "completed", "tag": "e6ef789b-622f-431b-a62a-2117b1314d48"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:30.668835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-86046d5b-63be-46c0-8a0b-d0f8467586ab req-cdc8b0ba-295b-4d3b-823e-6f3056d1af8e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:30.669620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-86046d5b-63be-46c0-8a0b-d0f8467586ab req-cdc8b0ba-295b-4d3b-823e-6f3056d1af8e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:30.688689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-86046d5b-63be-46c0-8a0b-d0f8467586ab req-cdc8b0ba-295b-4d3b-823e-6f3056d1af8e service nova] Creating event network-vif-plugged:e6ef789b-622f-431b-a62a-2117b1314d48 for instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 on n-h1-848886-16 Jul 26 04:49:30.700005 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-86046d5b-63be-46c0-8a0b-d0f8467586ab req-cdc8b0ba-295b-4d3b-823e-6f3056d1af8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060271 Jul 26 04:49:30.704151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2344/4786] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:49:30.719028 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22168a89-c345-4e5c-be08-e3a43a92143c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.252765 Jul 26 04:49:30.745135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2443/4787] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:49:30.757550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3037752-3350-4cdc-9431-1622ac7ee38a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:30.759131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3037752-3350-4cdc-9431-1622ac7ee38a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:30.810608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:30.811261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:30.842310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:30.842557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:30.843431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:30.844016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:30.968752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3037752-3350-4cdc-9431-1622ac7ee38a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:30.980790 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3037752-3350-4cdc-9431-1622ac7ee38a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1214 microversion: 2.1 time: 0.228421 Jul 26 04:49:30.983690 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2345/4788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:30 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:30.999511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:31.001106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:31.020272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:31.023492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:31.025300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:31.026177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:31.114238 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6996e59b-b985-43c0-b322-a18a86b40b05 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127028 Jul 26 04:49:31.121649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2346/4789] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:49:30 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:31.128494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:31.129174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:31.136861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:31.137574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:31.138931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:31.139525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:31.176912 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1bdef10b-e549-49bf-aa92-fa2aa2d93aa9 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b" status: 200 len: 194 microversion: 2.1 time: 0.053803 Jul 26 04:49:31.185559 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2347/4790] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Jul 26 04:49:31 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:31.743971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:31.759443 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71f02ea9-bd73-46e6-bf4a-bb5162e562a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 0.954358 Jul 26 04:49:31.764271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2444/4791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:30 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:32.008925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:32.013665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:32.025971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:32.033506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:32.034407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:32.034934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:32.159154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:32.175194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0a9d971-7804-47b6-b68e-a84c0ee32f23 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1266 microversion: 2.1 time: 0.169052 Jul 26 04:49:32.177624 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2348/4792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:32 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:32.797894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:32.801995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:32.819025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:32.819972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:32.821513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:32.822509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:33.074088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:33.082854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4ccbd4a-bd6f-4239-a474-4885b52af704 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1316 microversion: 2.1 time: 0.295480 Jul 26 04:49:33.083537 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2445/4793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:32 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:33.202120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:33.202756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:33.209701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:33.210182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:33.214668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:33.215403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:33.352411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:33.366358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-564b0792-c22b-4277-a5bf-46c46394abf9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1272 microversion: 2.1 time: 0.169330 Jul 26 04:49:33.398673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2349/4794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:33 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:33.884055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13c83722-8b0b-4f18-8049-c139cf09a60f"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:33.887508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:33.894728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:33.895373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:33.896315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:33.896916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.105376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:34.106071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:34.123005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.123445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.124417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.124870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.420231 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dac3117a-c478-4bc1-ba03-8f53658b938e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "POST /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540694 Jul 26 04:49:34.420872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2446/4795] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:49:33 2022] POST /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:34.441126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:34.445175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:34.448002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:34.458063 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e8d14e3-a1ca-4644-94bc-195ffdbfc80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1504 microversion: 2.1 time: 0.357909 Jul 26 04:49:34.462115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2350/4796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:34 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:34.485839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.485994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:34.486831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:34.488364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.491528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.493376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.495936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.496540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.497333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.498270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.543965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:49:34.668996 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f92ba06-3817-4886-85da-c9f8ba1aec7a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 204 len: 0 microversion: 2.1 time: 0.189899 Jul 26 04:49:34.671414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2351/4797] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:34 2022] DELETE /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:49:34.681332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:34.682277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:34.689958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.690684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.691694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:34.692497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:34.944952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:34.955041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ac064e1-e66f-46ff-88fd-a2aa386562f7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1510 microversion: 2.1 time: 0.278967 Jul 26 04:49:34.956131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2352/4798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:34 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:35.075856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:35.090826 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6199a423-e7bd-4641-b6ea-a84c13d5b2b0 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 0.666643 Jul 26 04:49:35.093324 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2447/4799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:34 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:35.491725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98dc3b01-c3ef-4777-b836-af8b932a7ac6 tempest-ExtensionsTest-1094809147 tempest-ExtensionsTest-1094809147-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:35.496540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98dc3b01-c3ef-4777-b836-af8b932a7ac6 tempest-ExtensionsTest-1094809147 tempest-ExtensionsTest-1094809147-project] 10.222.0.43 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.528549 Jul 26 04:49:35.497657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2353/4800] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:49:34 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:35.511030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-482a796a-5cbf-4e17-8775-cc6b49b79877 tempest-ExtensionsTest-1094809147 tempest-ExtensionsTest-1094809147-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:35.513171 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-482a796a-5cbf-4e17-8775-cc6b49b79877 tempest-ExtensionsTest-1094809147 tempest-ExtensionsTest-1094809147-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009990 Jul 26 04:49:35.513807 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2448/4801] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Jul 26 04:49:35 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:49:35.933040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3fdc27b2-8c0d-4e8a-bc67-4c21d8b825ec req-fdd4cec9-a6ba-4469-abe9-3fac4fa9c82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430827f3-a5af-4643-a664-daedc66f7f8c", "tag": "5f4baeec-589c-4b8e-97eb-d35b265d6422"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:35.978818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:35.979651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3fdc27b2-8c0d-4e8a-bc67-4c21d8b825ec req-fdd4cec9-a6ba-4469-abe9-3fac4fa9c82d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:35.979784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:35.980116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3fdc27b2-8c0d-4e8a-bc67-4c21d8b825ec req-fdd4cec9-a6ba-4469-abe9-3fac4fa9c82d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:35.991771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:35.996314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:36.000299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:36.000780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:36.013922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3fdc27b2-8c0d-4e8a-bc67-4c21d8b825ec req-fdd4cec9-a6ba-4469-abe9-3fac4fa9c82d service nova] Creating event network-changed:5f4baeec-589c-4b8e-97eb-d35b265d6422 for instance 430827f3-a5af-4643-a664-daedc66f7f8c on n-h2-848886-16 Jul 26 04:49:36.031219 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3fdc27b2-8c0d-4e8a-bc67-4c21d8b825ec req-fdd4cec9-a6ba-4469-abe9-3fac4fa9c82d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098239 Jul 26 04:49:36.033994 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2354/4802] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:36.120644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:36.121784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:36.139420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:36.141006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:36.142929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:36.145427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:36.606128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:36.616254 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bce84c49-02d8-456e-85fd-98c8545b9ff4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1510 microversion: 2.1 time: 0.643179 Jul 26 04:49:36.618465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2449/4803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:35 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1510 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:36.625819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:36.649288 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0575ed10-5ad7-4f89-9be5-6a8a86514482 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 0.528627 Jul 26 04:49:36.649933 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2355/4804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:36 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:37.637988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:37.639506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:37.658878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:37.659739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:37.660788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:37.666948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:37.678927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:37.680541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:37.693314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:37.700218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:37.701404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:37.705115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:37.833844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:37.970802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:37.995303 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7197d8af-6860-4420-b915-eb0920e238de tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 200 len: 1468 microversion: 2.1 time: 0.346221 Jul 26 04:49:37.997353 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2450/4805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:37 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 1468 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:38.111288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-54ef2a13-d714-43e6-b87d-daa7eda6457c req-bbe1bfbe-38d4-42c2-96cf-f9b67d901a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af069b5f-2bd5-4bec-963a-1c8bfbd45753", "name": "network-vif-deleted", "tag": "e6ef789b-622f-431b-a62a-2117b1314d48"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:38.129707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54ef2a13-d714-43e6-b87d-daa7eda6457c req-bbe1bfbe-38d4-42c2-96cf-f9b67d901a46 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:38.134244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54ef2a13-d714-43e6-b87d-daa7eda6457c req-bbe1bfbe-38d4-42c2-96cf-f9b67d901a46 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:38.151311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-54ef2a13-d714-43e6-b87d-daa7eda6457c req-bbe1bfbe-38d4-42c2-96cf-f9b67d901a46 service nova] Creating event network-vif-deleted:e6ef789b-622f-431b-a62a-2117b1314d48 for instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 on n-h1-848886-16 Jul 26 04:49:38.157180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-54ef2a13-d714-43e6-b87d-daa7eda6457c req-bbe1bfbe-38d4-42c2-96cf-f9b67d901a46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050470 Jul 26 04:49:38.158545 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2451/4806] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:49:38.228373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:38.245561 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2c0a589-555f-4ad4-8117-71ad003cff5e tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 0.574414 Jul 26 04:49:38.246198 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2356/4807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:37 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:39.024059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:39.025516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:39.041464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.042691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.045523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.047416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.073365 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 HTTP/1.1 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'af069b5f-2bd5-4bec-963a-1c8bfbd45753'} Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:39.075576 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:49:39.080532 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.082796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:39.083947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5808b841-f6fb-4428-a12c-08437ee47d46 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 404 len: 111 microversion: 2.1 time: 0.066532 Jul 26 04:49:39.084773 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2452/4808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:39 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:39.096632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:39.097381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:39.109676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.110141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.110937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.111440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.271451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:39.273011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:39.283835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.284805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.286259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.286949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.588953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:39.602760 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77d2dc70-001b-4fea-8abc-675318bdb5db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.511376 Jul 26 04:49:39.606936 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2357/4809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:39 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:39.786330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9df716bb-c0b3-4001-bd4b-21a73b65b266 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9df716bb-c0b3-4001-bd4b-21a73b65b266 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 163 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": 12345, "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 12345 Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:49:39.802856 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 04:49:39.810463 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:39.813444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9df716bb-c0b3-4001-bd4b-21a73b65b266 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:39.816950 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9df716bb-c0b3-4001-bd4b-21a73b65b266 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.036303 Jul 26 04:49:39.822274 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2358/4810] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:39 2022] POST /compute/v2.1/servers => generated 127 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:39.837691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:39.839969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:39.881486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.883566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:39.890074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:39.897626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:40.344523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:40.356372 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa059b52-a500-45dc-bf72-833f3e23cc14 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 1.090901 Jul 26 04:49:40.357620 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2453/4811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:39 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:40.523803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:40.535867 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-be946d3d-fa4a-4557-a79b-daa1f34272c1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.708176 Jul 26 04:49:40.556956 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2359/4812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:39 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:40.564250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:40.565390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:40.572362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:40.582436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:40.583306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:40.585005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:40.588523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:40.597594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:41.321853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:41.344484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-faffba01-4878-4e57-8926-0564ccd34551 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.785921 Jul 26 04:49:41.345946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2454/4813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:40 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:41.380187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:41.380836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:41.389097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:41.397781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:41.398469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:41.401926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:41.402528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:42.342210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-908e7078-6dc6-4b87-baef-43b6541c8eeb req-75093625-953c-4ea2-b579-e6d99ed51de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430827f3-a5af-4643-a664-daedc66f7f8c", "name": "network-vif-plugged", "status": "completed", "tag": "5f4baeec-589c-4b8e-97eb-d35b265d6422"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:42.347796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:42.360448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5bf11b8-46c8-44d6-918b-5e6735029fe9 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 0.984832 Jul 26 04:49:42.363395 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2360/4814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:41 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:42.369029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-908e7078-6dc6-4b87-baef-43b6541c8eeb req-75093625-953c-4ea2-b579-e6d99ed51de7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:42.369561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-908e7078-6dc6-4b87-baef-43b6541c8eeb req-75093625-953c-4ea2-b579-e6d99ed51de7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:42.401609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-908e7078-6dc6-4b87-baef-43b6541c8eeb req-75093625-953c-4ea2-b579-e6d99ed51de7 service nova] Creating event network-vif-plugged:5f4baeec-589c-4b8e-97eb-d35b265d6422 for instance 430827f3-a5af-4643-a664-daedc66f7f8c on n-h2-848886-16 Jul 26 04:49:42.418716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-908e7078-6dc6-4b87-baef-43b6541c8eeb req-75093625-953c-4ea2-b579-e6d99ed51de7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080620 Jul 26 04:49:42.420043 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2455/4815] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:43.386276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:43.386895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:43.414908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:43.416971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:43.417834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:43.418335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:43.689604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:43.701788 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3606237d-89f8-4696-b403-da6160e4e8aa tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1314 microversion: 2.1 time: 0.321212 Jul 26 04:49:43.703325 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2361/4816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:43 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:44.673389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0eb5995c-7b8d-44ef-a0b3-819a18e9d78d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1245192350", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "07aae102-957a-4bd3-995a-115b9d0270d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:44.728737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:44.729765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:44.738759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:44.739818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:44.741057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:44.743026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:44.779224 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0eb5995c-7b8d-44ef-a0b3-819a18e9d78d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0eb5995c-7b8d-44ef-a0b3-819a18e9d78d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 358 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1245192350", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "07aae102-957a-4bd3-995a-115b9d0270d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: exception: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1245192350', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '07aae102-957a-4bd3-995a-115b9d0270d5'}], 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:44.801539 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. Jul 26 04:49:44.806826 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:49:44.809145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0eb5995c-7b8d-44ef-a0b3-819a18e9d78d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Block Device 07aae102-957a-4bd3-995a-115b9d0270d5 is not bootable. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:44.810357 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0eb5995c-7b8d-44ef-a0b3-819a18e9d78d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.142201 Jul 26 04:49:44.811120 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2456/4817] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:44 2022] POST /compute/v2.1/servers => generated 110 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:44.822717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:44.823834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:44.840976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:44.842392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:44.844761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:44.845811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.184071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:45.192414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e2b2614-5382-4f8f-9be3-dea4d367546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.376859 Jul 26 04:49:45.196796 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2457/4818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:44 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:45.209071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.216096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.236812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.237706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.239318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.240169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.285710 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fb57120-2804-4bd1-9b82-c505cbd7f8dc tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087367 Jul 26 04:49:45.288184 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2458/4819] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:49:45 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:45.295211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.296163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.304117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:45.306810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.308317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.310870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.311489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.350785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:45.371104 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c7ea9a7-a744-4f43-9c89-893dc8ea3ce1 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1464 microversion: 2.1 time: 0.647750 Jul 26 04:49:45.381215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2362/4820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:44 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1464 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:45.432082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.432885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.441177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.442316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.443697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.444074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.481965 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c6e6ffd-b0ba-4066-8c31-7c5d9df2a917 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b" status: 200 len: 194 microversion: 2.1 time: 0.057341 Jul 26 04:49:45.483264 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2363/4821] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Jul 26 04:49:45 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:49:45.488659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.489499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.500142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.500912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.502185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.502975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.541061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:49:45.705751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ec2441b5-6ddf-4a15-9c57-fe5b11d3d295 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "DELETE /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 204 len: 0 microversion: 2.1 time: 0.220981 Jul 26 04:49:45.710828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2364/4822] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:49:45 2022] DELETE /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:49:45.724899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.727339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.741590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.743098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.744300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.744918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.823088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:45.839202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4acdfe0d-f957-462c-a0d0-34bb3cd4331c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.548797 Jul 26 04:49:45.839788 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2459/4823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:45 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:45.845555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:45.846431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:45.854119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.854871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.855810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:45.856405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:45.937841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lazy-loading 'services' on Instance uuid 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:49:46.141567 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c01047f8-6d0d-426e-85ac-f087a4354612 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b" status: 202 len: 0 microversion: 2.1 time: 0.429164 Jul 26 04:49:46.142215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2365/4824] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:49:45 2022] DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/6a169c40-f620-427c-be3d-3916e35ed29b => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:49:46.317394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:46.341777 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5b69bd0-3656-4242-8eab-be8244d53c34 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1470 microversion: 2.1 time: 0.494659 Jul 26 04:49:46.369951 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2460/4825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:45 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1470 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:47.386615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:47.403532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:47.414712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:47.418133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:47.419883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:47.422078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:47.811224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:47.822980 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1420295-1e4a-48fd-97c1-bbddb2640b5c tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1470 microversion: 2.1 time: 0.446392 Jul 26 04:49:47.828508 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2366/4826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:47 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:48.854464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:48.855084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:48.871649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:48.872104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:48.872884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:48.873322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:48.909668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9529e237-9fc3-4f43-9238-cf53036a18cd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1469573254", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "destination_type": "local"}, {"source_type": "volume", "uuid": "b3db7be0-4ae9-43f2-af74-9c125db5611d", "destination_type": "invalid"}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9529e237-9fc3-4f43-9238-cf53036a18cd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 495 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1469573254", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "destination_type": "local"}, {"source_type": "volume", "uuid": "b3db7be0-4ae9-43f2-af74-9c125db5611d", "destination_type": "invalid"}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1469573254', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b3db7be0-4ae9-43f2-af74-9c125db5611d', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:48.915347 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:48.920770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9529e237-9fc3-4f43-9238-cf53036a18cd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:48.927767 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9529e237-9fc3-4f43-9238-cf53036a18cd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013315 Jul 26 04:49:48.928441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2367/4827] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:48 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:48.949044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:48.954854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:48.991017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:48.995281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:48.996687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:49.001036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:49.303750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:49.318418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89c3a8b2-c5d8-4330-a82a-bd74ea7af680 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.378260 Jul 26 04:49:49.319331 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2368/4828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:48 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:49.350449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:49.352490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:49.371307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:49.372866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:49.374824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:49.376740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:49.431548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:49.442057 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9fc3c6eb-59eb-4a67-874f-91f943aabb77 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1470 microversion: 2.1 time: 0.592544 Jul 26 04:49:49.443249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2461/4829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:48 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:49.972580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b936567f-eed8-4487-8eef-70809ed2e798 req-0d95712e-993d-4166-9aa1-4894483ff7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430827f3-a5af-4643-a664-daedc66f7f8c", "name": "network-vif-deleted", "tag": "5f4baeec-589c-4b8e-97eb-d35b265d6422"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:50.029627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b936567f-eed8-4487-8eef-70809ed2e798 req-0d95712e-993d-4166-9aa1-4894483ff7bc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.030426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b936567f-eed8-4487-8eef-70809ed2e798 req-0d95712e-993d-4166-9aa1-4894483ff7bc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.052391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:50.071914 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-182246cf-6405-4300-938e-dfea77b8d62b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.725209 Jul 26 04:49:50.100065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b936567f-eed8-4487-8eef-70809ed2e798 req-0d95712e-993d-4166-9aa1-4894483ff7bc service nova] Creating event network-vif-deleted:5f4baeec-589c-4b8e-97eb-d35b265d6422 for instance 430827f3-a5af-4643-a664-daedc66f7f8c on n-h2-848886-16 Jul 26 04:49:50.109112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2369/4830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:49 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:50.131614 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b936567f-eed8-4487-8eef-70809ed2e798 req-0d95712e-993d-4166-9aa1-4894483ff7bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169970 Jul 26 04:49:50.135695 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2462/4831] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 04:49:50.386258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4786d027-b2fe-4b5f-a0f0-cce6e7d45fe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089837677", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4786d027-b2fe-4b5f-a0f0-cce6e7d45fe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 492 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089837677", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2089837677', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.398321 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:50.401351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4786d027-b2fe-4b5f-a0f0-cce6e7d45fe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:50.409849 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4786d027-b2fe-4b5f-a0f0-cce6e7d45fe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.037192 Jul 26 04:49:50.410491 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2370/4832] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:50 2022] POST /compute/v2.1/servers => generated 624 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:50.419948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:50.421172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:50.448526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.450340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.451426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.455320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.468474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:50.475548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:50.494882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.511427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.524069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.525338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.552248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:50.637755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:50.638441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:50.639177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lazy-loading 'fault' on Instance uuid 430827f3-a5af-4643-a664-daedc66f7f8c {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:49:50.778313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa0c7b694bd428e9cea853e1e8001ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825f8be0c3154d5d84084e9f1ff34cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:50.791279 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a39d3e93-63f3-450d-8367-68e3a3f00848 tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 200 len: 1304 microversion: 2.1 time: 0.324994 Jul 26 04:49:50.793701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2371/4833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:50 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:50.953246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:50.965332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02ed1d54-9300-46ff-988f-2a5e89680edf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.549575 Jul 26 04:49:50.970474 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2463/4834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:50.995735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:51.003306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:51.045337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:51.045817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:51.046672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:51.052911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:51.546805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-404338446", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "bc4f955e-f48c-480e-95b1-066e8e37315a"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:51.663294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] validate_networks() for [('bc4f955e-f48c-480e-95b1-066e8e37315a', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:49:52.473428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:52.489137 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c9bb8ed-e562-43e8-872f-62dadf9177c8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.498835 Jul 26 04:49:52.490328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2372/4835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:52.498042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:52.501506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] [instance: 430827f3-a5af-4643-a664-daedc66f7f8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:52.517753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:52.518459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:52.519455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:52.519809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:52.554441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] HTTP exception thrown: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Request method failure captured: Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c HTTP/1.1 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33JWXhoGOcmTjOt9EriSW8Z3UV-5B2TdvqkQt2bmAs1o_vYxPk7HiFl5_abp62dhbbK42wIjbOGUChskoPmqdlAkQ7PV_8Mmqiu0KqAgH9PyQO3GZVrv4zJojRdeFutggP95kZiPI11URwAJnNbI3g0ycT_4tnJnstSm-Tkmr4hwKSY Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 825f8be0c3154d5d84084e9f1ff34cba Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesNegativeTest-1147685858 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/825f8be0c3154d5d84084e9f1ff34cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/825f8be0c3154d5d84084e9f1ff34cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/825f8be0c3154d5d84084e9f1ff34cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_825f8be0c3154d5d84084e9f1ff34cba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesNegativeTest-1147685858 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 825f8be0c3154d5d84084e9f1ff34cba Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesNegativeTest-1147685858 Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesNegativeTest-1147685858-project Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4aa0c7b694bd428e9cea853e1e8001ac Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesNegativeTest-1147685858-project Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '430827f3-a5af-4643-a664-daedc66f7f8c'} Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:52.556945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] Returning 404 to user: Instance 430827f3-a5af-4643-a664-daedc66f7f8c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9aa95352-3bcb-47af-8b3f-4f73960def2a tempest-VolumesNegativeTest-1147685858 tempest-VolumesNegativeTest-1147685858-project] 10.222.0.43 "GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c" status: 404 len: 111 microversion: 2.1 time: 0.067974 Jul 26 04:49:52.561920 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2373/4836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:52 2022] GET /compute/v2.1/servers/430827f3-a5af-4643-a664-daedc66f7f8c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:49:52.703362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9335a2d-7765-46ec-8c94-3f12402206dd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9335a2d-7765-46ec-8c94-3f12402206dd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 416 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.708094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:49:52.712257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:52.716680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9335a2d-7765-46ec-8c94-3f12402206dd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:52.716680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9335a2d-7765-46ec-8c94-3f12402206dd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014791 Jul 26 04:49:52.717169 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2374/4837] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:52 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:49:52.731302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:52.732322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:52.742737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:52.743531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:52.744783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:52.745465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:52.750389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:53.821656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:49:53.821656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:49:53.821656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:49:53.821656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:49:53.821656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:49:53.840334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:53.840790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:53.841607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:53.842400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:53.899661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:53.907143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Getting quotas for project bf160464cbea411e98f4fb762daaf72f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:49:53.919910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a66965b2-48d9-44fe-a652-8837af9bd6eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.199194 Jul 26 04:49:53.920993 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2375/4838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:52 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:53.925189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Getting quotas for user 4bf5c0aca3594c4aa69c21b07793ef35 and project bf160464cbea411e98f4fb762daaf72f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:49:53.950928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:53.956123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:53.959401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:49:53.961677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:49:53.973772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:53.974265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:53.975072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:53.975531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:54.078881 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58cac25a-9c55-48bb-82ae-5198e2f39722 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.799881 Jul 26 04:49:54.091797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2464/4839] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:49:54.110358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13f10284-61c8-4bfe-8714-1eae5e683ee3 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:54.110999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13f10284-61c8-4bfe-8714-1eae5e683ee3 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:54.305798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13f10284-61c8-4bfe-8714-1eae5e683ee3 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:54.322908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13f10284-61c8-4bfe-8714-1eae5e683ee3 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1216 microversion: 2.1 time: 0.220857 Jul 26 04:49:54.336005 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2465/4840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:54 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:54.479333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:54.497033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8660d89-74cc-434b-bcb2-4bea830f3a1d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.554024 Jul 26 04:49:54.517651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2376/4841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:53 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:55.027950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46c64b0e-5f5a-4d75-95fc-825c4339361f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1533008533", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": -1, "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:55.077057 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-46c64b0e-5f5a-4d75-95fc-825c4339361f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Flavor -1 could not be found. Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46c64b0e-5f5a-4d75-95fc-825c4339361f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 206 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1533008533", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": -1, "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor -1 could not be found. Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1533008533', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': -1, 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:55.089235 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 26 04:49:55.094071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:55.098059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46c64b0e-5f5a-4d75-95fc-825c4339361f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:55.100877 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46c64b0e-5f5a-4d75-95fc-825c4339361f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.078491 Jul 26 04:49:55.103426 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2377/4842] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 26 04:49:55.118228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:55.120179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:55.146052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.150255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:55.155575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.156465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:55.195359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d03cf426-222e-429b-b0b6-4230479aee02 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: .version_select at 0x7f38b4c36a60>, body: {"keypair": {"name": "tempest-keypair-1802385811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwZvanVPGoOpw9VAAnciLxSzxbUWlA0lB/CdGevXp7+vhbbQmdXGqMzxh494CaPeHgxxOapl+fIGC2fZi+hVd3fdRM02VMkmKO+RXODIszLyTmyW5RRTGc6rGHSmmKE3g=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:55.239274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d03cf426-222e-429b-b0b6-4230479aee02 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:49:55.255575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d03cf426-222e-429b-b0b6-4230479aee02 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:49:55.358994 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d03cf426-222e-429b-b0b6-4230479aee02 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.954128 Jul 26 04:49:55.363397 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2466/4843] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:49:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:55.379943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:55.380787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:55.398107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.399095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:55.401410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.402089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:55.688326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:55.697020 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d636a4f1-7d94-4081-8374-14bf886fdbdb tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1220 microversion: 2.1 time: 0.332473 Jul 26 04:49:55.700175 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2467/4844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:55 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1220 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:55.790929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:55.801215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43ea9c99-dffc-45d8-9f31-a4b0df97add5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.693178 Jul 26 04:49:55.808701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2378/4845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:55 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:55.836245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:55.837260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:55.865193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.867167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:55.869382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:55.870908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:56.374985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:56.383661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b830bb5-59be-49f8-b130-ed849fa1afa7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.552702 Jul 26 04:49:56.391826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2468/4846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:55 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:56.696250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74d0683b-2889-410d-9736-05cb5f7ce100 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-96553411", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74d0683b-2889-410d-9736-05cb5f7ce100 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 171 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-96553411", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-96553411', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi -1 Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:49:56.704775 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 04:49:56.709056 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:56.716256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74d0683b-2889-410d-9736-05cb5f7ce100 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:56.722547 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74d0683b-2889-410d-9736-05cb5f7ce100 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.027710 Jul 26 04:49:56.723772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:56.724972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:56.730620 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2379/4847] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:56.736615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:56.747124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:56.748795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:56.749461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:56.750121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:56.751152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:56.764670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:49:56.784560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:56.785029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:56.785865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:56.792085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:56.922690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:56.933319 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4adedc3d-70df-4a34-acb1-09f731ed9a5a tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1286 microversion: 2.1 time: 0.216556 Jul 26 04:49:56.939101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2469/4848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:56 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:57.171662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:57.185926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4f57608-2819-4af4-9596-a6466c714eba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.452538 Jul 26 04:49:57.188777 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2380/4849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:56 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:57.212543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:57.213083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:57.224207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:57.226216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:57.228799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:57.231142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:57.962485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:57.963436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:57.977967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:57.989895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:57.992313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:57.993493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:58.269433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:58.281297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f58533fb-35cd-4102-8e1c-3f5b891a121b tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1274 microversion: 2.1 time: 0.323239 Jul 26 04:49:58.293227 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2381/4850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:57 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:49:58.416624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:58.426999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d97bd14-2c0c-4bab-860b-9016768e4de9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.219016 Jul 26 04:49:58.427465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2470/4851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:57 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:58.789846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fd44ed9-c913-4e85-bd95-d8fca08a5edc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1767528628", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:49:58.797813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9fd44ed9-c913-4e85-bd95-d8fca08a5edc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fd44ed9-c913-4e85-bd95-d8fca08a5edc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 216 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1767528628", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1767528628', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:49:58.808527 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fd44ed9-c913-4e85-bd95-d8fca08a5edc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fd44ed9-c913-4e85-bd95-d8fca08a5edc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027125 Jul 26 04:49:58.814207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2382/4852] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:49:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:49:58.823012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:58.823639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:58.837126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:58.837582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:58.838877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:58.840406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.343860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:59.345647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:59.362719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.363484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.365923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.367506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.461354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:49:59.472425 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0906ce10-2f7b-4256-b889-9e9e364ea985 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.654934 Jul 26 04:49:59.480496 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2471/4853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:58 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:49:59.504226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:59.506243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:59.516514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.531335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.532390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.534867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.676347 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e984ab7-4786-4bc6-b5ae-4a5bb7087e65 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/13c83722-8b0b-4f18-8049-c139cf09a60f" status: 200 len: 194 microversion: 2.1 time: 0.192335 Jul 26 04:49:59.678506 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2472/4854] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Jul 26 04:49:59 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/13c83722-8b0b-4f18-8049-c139cf09a60f => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:49:59.689155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:49:59.692735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:49:59.712504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.714182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:49:59.718388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:49:59.721875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:00.134064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:00.142500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2eada358-e7fb-4fc0-8b4e-e3bc9cd26166 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.828077 Jul 26 04:50:00.143101 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2383/4855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:59 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:00.166067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:00.166603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:00.193408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:00.193871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:00.199081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:00.199721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:00.423075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lazy-loading 'services' on Instance uuid 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:50:00.425580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:00.445259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b08d56f-d2b3-4abe-8103-89cee9857f66 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.756245 Jul 26 04:50:00.445933 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2473/4856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:49:59 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:00.623452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-122581b3-8b6d-4cd5-a576-0ec59114488f tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/13c83722-8b0b-4f18-8049-c139cf09a60f" status: 202 len: 0 microversion: 2.1 time: 0.470383 Jul 26 04:50:00.626202 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2384/4857] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:50:00 2022] DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments/13c83722-8b0b-4f18-8049-c139cf09a60f => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:00.780870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-40660414", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-key-1770201268", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:00.876255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] validate_networks() for [('a96b578f-f211-4d67-affa-b201a2dd5fac', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:50:01.169039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:01.170071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:01.193281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:01.194047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:01.195949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:01.196668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:01.638034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:01.646206 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0768fb4a-9df0-4211-9dba-1ff2a36db71d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.482369 Jul 26 04:50:01.662319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2385/4858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:01 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:01.841792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Invalid key_name provided. Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 245 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-40660414", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-key-1770201268", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid key_name provided. Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-40660414', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'key_name': 'tempest-key-1770201268', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1770201268 not found for user 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:01.844797 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 26 04:50:01.848732 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:01.855855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid key_name provided. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:01.861671 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8099b7b-878c-4135-abbc-bc95d7cbdbed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.085653 Jul 26 04:50:01.862602 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2474/4859] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:00 2022] POST /compute/v2.1/servers => generated 70 bytes in 1088 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:01.872071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:01.872710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:01.883482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:01.883941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:01.899299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:01.899770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:02.178433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-272333634", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb5d3d-bcd3-424d-b89b-f73e7e58dea5"}], "security_groups": [{"name": "tempest-securitygroup--337403357"}], "key_name": "tempest-keypair-1802385811", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:02.321876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:02.350956 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74567a18-ca2c-49c3-8ee7-16410d131973 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.483110 Jul 26 04:50:02.355713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2386/4860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:01 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:02.411236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:02.413919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:02.443350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:02.445064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:02.446216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:02.449570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:02.993355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] validate_networks() for [('79bb5d3d-bcd3-424d-b89b-f73e7e58dea5', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:50:03.147027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:03.185931 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb2526e2-226f-453a-8381-4f021c695ed6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.807890 Jul 26 04:50:03.196958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2387/4861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:02 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:03.217689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cf6dee0f-536a-4d1c-9f62-4042fdf54cd0 req-d51c788f-410c-4304-88ed-6b29b86b1876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fa315e-bd44-4ada-809f-a2fdfe089c26", "tag": "789bed34-c222-42bf-b55c-c5bb5d9b6cfc"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:03.257300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cf6dee0f-536a-4d1c-9f62-4042fdf54cd0 req-d51c788f-410c-4304-88ed-6b29b86b1876 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:03.265281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cf6dee0f-536a-4d1c-9f62-4042fdf54cd0 req-d51c788f-410c-4304-88ed-6b29b86b1876 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:03.321517 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cf6dee0f-536a-4d1c-9f62-4042fdf54cd0 req-d51c788f-410c-4304-88ed-6b29b86b1876 service nova] Creating event network-changed:789bed34-c222-42bf-b55c-c5bb5d9b6cfc for instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 on n-h2-848886-16 Jul 26 04:50:03.335021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cf6dee0f-536a-4d1c-9f62-4042fdf54cd0 req-d51c788f-410c-4304-88ed-6b29b86b1876 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132553 Jul 26 04:50:03.336546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2388/4862] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:03.343017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:03.345665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:03.353506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:03.354394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:03.355432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:03.356115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:03.889721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:04.125775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:50:04.127937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:50:04.128647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:50:04.130553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:50:04.131573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:50:04.160937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.161689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.162783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.163445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.213986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:50:04.221006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:50:04.252887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:04.262332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:50:04.264646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:50:04.266300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba8ed202-ce09-4f80-9811-9bd4fcecfefa tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.927841 Jul 26 04:50:04.267057 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2389/4863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:03 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:04.280212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:04.280977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:04.297048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.297751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.300704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.301394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.364461 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-117db744-d2f7-4c10-9060-cff0231f4053 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/ips" status: 200 len: 152 microversion: 2.20 time: 0.095006 Jul 26 04:50:04.375319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2390/4864] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Jul 26 04:50:04 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/ips => generated 152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:50:04.385221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063493761", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:04.390061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ec87fe4-a716-4573-8477-7ec55794aeda tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.216175 Jul 26 04:50:04.390741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2475/4865] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:50:04.411648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ecc5000-066b-4ba3-9be5-b97aed0fd261 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:04.418432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ecc5000-066b-4ba3-9be5-b97aed0fd261 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:04.555042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3ecc5000-066b-4ba3-9be5-b97aed0fd261 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:04.564924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.security_group_api [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Neutron security group does_not_exist not found {{(pid=119487) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 26 04:50:04.565149 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.570418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ecc5000-066b-4ba3-9be5-b97aed0fd261 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1241 microversion: 2.1 time: 0.172762 Jul 26 04:50:04.577019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2476/4866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:04 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 258 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063493761", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2063493761', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 26 04:50:04.579945 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 26 04:50:04.584014 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:04.593917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:04.593917 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d134ff42-e441-4e1f-ae86-f338c91854f9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.216082 Jul 26 04:50:04.593917 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2391/4867] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:04 2022] POST /compute/v2.1/servers => generated 106 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:04.603709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:04.604533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:04.612738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.613749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.614754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:04.615317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:04.932600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:04.946629 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eee28f06-bd3e-49a4-bda8-2dd013491e25 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.348660 Jul 26 04:50:04.947877 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2477/4868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:04 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:04.981875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:04.982812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:04.999655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.000809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.003037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.005080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.292495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:05.293215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:05.322634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.323363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.325205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.327858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.594613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:05.609508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6798dd8-56ed-4a1f-babc-9105447b3fcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.639210 Jul 26 04:50:05.613345 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2392/4869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:04 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:05.623884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:05.624681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:05.661670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.666997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.669365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.671505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.763944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:05.789001 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86631c45-fb3f-4475-a735-772696d11a60 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.500683 Jul 26 04:50:05.804990 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2478/4870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:05 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:05.816209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:05.831190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: dd8e3d22-6aef-4904-8455-32a729bc1e34] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:05.843371 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/dd8e3d22-6aef-4904-8455-32a729bc1e34 HTTP/1.1 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'dd8e3d22-6aef-4904-8455-32a729bc1e34'} Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:05.846060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. Jul 26 04:50:05.851353 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:05.858989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:05.863816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance dd8e3d22-6aef-4904-8455-32a729bc1e34 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:05.870638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bdb8b4d3-45f3-458c-8085-b78534a01986 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dd8e3d22-6aef-4904-8455-32a729bc1e34" status: 404 len: 111 microversion: 2.1 time: 0.061926 Jul 26 04:50:05.872219 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e11620d7-5340-44ad-8296-3369caf8174d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1245 microversion: 2.1 time: 0.257429 Jul 26 04:50:05.873838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2479/4871] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:50:05 2022] DELETE /compute/v2.1/servers/dd8e3d22-6aef-4904-8455-32a729bc1e34 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:05.887409 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2393/4872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:05 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1245 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:05.902492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:05.906358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:05.926132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.928324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:05.929854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:05.931659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.283693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:06.301182 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f399a61-8026-4ebb-8c61-903c5cc74585 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.419873 Jul 26 04:50:06.304001 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2480/4873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:05 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:06.329057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:06.329928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:06.362210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.366352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.367461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.370330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.665920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:06.678306 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66ed6aaf-37a1-4f19-9a43-1a0715e59682 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.354328 Jul 26 04:50:06.680716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2394/4874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:06 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:06.701643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:06.702212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:50:06.702742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 9223372036854775808 could not be found. Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '9223372036854775808'} Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:06.704422 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-56c95c58-6fbd-4f53-b95c-0011ae542320 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009714 Jul 26 04:50:06.708962 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2481/4875] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Jul 26 04:50:06 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:50:06.718961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:06.722641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:06.734948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.742458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.743606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.744234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.812486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:06.813382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:06.831949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.839425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:06.845581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:06.846526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.089686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:07.105367 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b60097e2-9ffb-48ed-8bf6-7fda61f3dbe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.390776 Jul 26 04:50:07.106015 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2395/4876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:06 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:07.133292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:07.145105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:07.170119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.176583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.177631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.178270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.192501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:07.390947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:07.409844 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1434b2c-b339-4646-a250-b29de92430e3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1299 microversion: 2.1 time: 0.280375 Jul 26 04:50:07.410773 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2396/4877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:07 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:07.416620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:07.417896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:07.427280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.429894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.430986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.431670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.730137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:07.750029 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-98c0db05-019e-4992-9a36-bcbafb7f2f8b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.337879 Jul 26 04:50:07.752703 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2397/4878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:07 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:07.774165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:07.775571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Failed to fetch instance by id -1 {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 04:50:07.776260 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance -1 could not be found. Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance -1 could not be found. Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '-1'} Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:07.781008 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:07.785948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:07.785948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:07.785948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 26 04:50:07.785948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:07.788409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:07.792740 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad468e8d-81ad-46cb-bafc-eb107e4a85d7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024487 Jul 26 04:50:07.798026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2398/4879] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 04:50:07 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 04:50:07.810373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:07.812253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:07.831412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.831889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:07.832690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:07.833143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.117203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:08.126672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-902e5bd1-e1bc-480e-9494-2ef9bc2f000a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.327254 Jul 26 04:50:08.129579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2399/4880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:07 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:08.150880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:08.152257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:08.163071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.164045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.167490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.168399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.186695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:08.212641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d59414d-ba4a-4412-90e7-e3c14a597b28 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 1.402889 Jul 26 04:50:08.216030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2482/4881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:06 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:08.389380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:08.389835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:08.400682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.410851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.411905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.412505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.452170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:08.459932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lazy-loading 'flavor' on Instance uuid b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:50:08.464054 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b393f58a-dc99-476b-ac7d-b7c03c58cbaa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.318134 Jul 26 04:50:08.468125 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2400/4882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:08 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:08.479439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:08.480574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:08.494865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.497296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.498111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.498584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.654178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:08.666879 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-623f3b50-fdd2-4942-bda8-162f004c7ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1299 microversion: 2.1 time: 0.195899 Jul 26 04:50:08.668490 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2401/4883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:08 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:08.689525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:08.691832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 30132783-75f9-49b4-81ca-8430d874af5b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:08.712116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/30132783-75f9-49b4-81ca-8430d874af5b/action HTTP/1.1 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 19 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: {"forceDelete": {}} Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '30132783-75f9-49b4-81ca-8430d874af5b', 'body': {'forceDelete': {}}} Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:08.722537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 30132783-75f9-49b4-81ca-8430d874af5b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df9c4bbb-7833-4605-b02f-b82788415eab tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/30132783-75f9-49b4-81ca-8430d874af5b/action" status: 404 len: 111 microversion: 2.1 time: 0.040842 Jul 26 04:50:08.727406 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2402/4884] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:08 2022] POST /compute/v2.1/servers/30132783-75f9-49b4-81ca-8430d874af5b/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:08.733513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:08.734140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:08.750234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.750700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.751489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:08.751929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:08.996596 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a404021-0e19-40da-b0f0-a07aa7fa1a60 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/action" status: 202 len: 0 microversion: 2.20 time: 0.610911 Jul 26 04:50:08.998928 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2483/4885] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:50:08 2022] POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:50:09.009216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:09.010703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.018001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.018898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.020636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.021303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.072865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.081426 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-641e7880-a00f-47a0-9dde-be937e962bfb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.352175 Jul 26 04:50:09.083190 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2403/4886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:08 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:09.103848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:09.106042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.122197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.122742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.123609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.124132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.418688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.427089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af982961-4651-474b-9503-f445306c2695 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.328729 Jul 26 04:50:09.427672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2404/4887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:09.433929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:09.435166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.441837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.442535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.443654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.444625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.526324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.539505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.551912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.555297 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba818422-f017-4fbe-a65c-13c36c0de5c8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.551660 Jul 26 04:50:09.557092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2484/4888] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:09.562279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:09.565467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: c868d426-e4a1-44c0-9c7f-1a625ced86a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.574973 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/c868d426-e4a1-44c0-9c7f-1a625ced86a7/action HTTP/1.1 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 39 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: {"os-getConsoleOutput": {"length": 10}} Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'c868d426-e4a1-44c0-9c7f-1a625ced86a7', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:09.578465 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. Jul 26 04:50:09.583651 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:09.587077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance c868d426-e4a1-44c0-9c7f-1a625ced86a7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:09.588226 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f9554124-4e36-4243-884c-577e96f365b3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/c868d426-e4a1-44c0-9c7f-1a625ced86a7/action" status: 404 len: 111 microversion: 2.1 time: 0.029544 Jul 26 04:50:09.590664 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2485/4889] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:09 2022] POST /compute/v2.1/servers/c868d426-e4a1-44c0-9c7f-1a625ced86a7/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:09.597685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:09.598729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.607234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.607772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.608808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.609317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.628814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:09.764656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.777613 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c083911a-ae92-4bdb-a79c-24b088b284d6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.348686 Jul 26 04:50:09.778239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2405/4890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:09.791422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:09.792007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:09.820112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.820941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.822467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.823508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:09.945737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.956953 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca72081b-b063-4790-8af3-eb63a459fcd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.363345 Jul 26 04:50:09.960336 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2486/4891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:09.965530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-81a0bdfd-3366-413c-bf7b-d2eb0b35a844 req-467505f8-f525-4cc9-ba88-956a6b9acde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fa315e-bd44-4ada-809f-a2fdfe089c26", "name": "network-vif-plugged", "status": "completed", "tag": "789bed34-c222-42bf-b55c-c5bb5d9b6cfc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:09.973483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:09.986643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0b4f951-6801-4c7d-97d4-cfdf6ba3a458 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1299 microversion: 2.1 time: 0.197701 Jul 26 04:50:09.987635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2406/4892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:09.993295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:09.998941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-81a0bdfd-3366-413c-bf7b-d2eb0b35a844 req-467505f8-f525-4cc9-ba88-956a6b9acde7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:09.999558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-81a0bdfd-3366-413c-bf7b-d2eb0b35a844 req-467505f8-f525-4cc9-ba88-956a6b9acde7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.005028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.005832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.024517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.026902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.047082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.047806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.063122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-81a0bdfd-3366-413c-bf7b-d2eb0b35a844 req-467505f8-f525-4cc9-ba88-956a6b9acde7 service nova] Creating event network-vif-plugged:789bed34-c222-42bf-b55c-c5bb5d9b6cfc for instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 on n-h2-848886-16 Jul 26 04:50:10.073795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-81a0bdfd-3366-413c-bf7b-d2eb0b35a844 req-467505f8-f525-4cc9-ba88-956a6b9acde7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111939 Jul 26 04:50:10.075763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2487/4893] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:10.170666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.173194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.183579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.184234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.185176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.185777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.235565 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-017507fa-0d14-49e4-8ba8-e1f5f5fac3aa tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069338 Jul 26 04:50:10.236508 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2488/4894] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:50:10 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:50:10.424224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.427749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.436048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.436915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.438787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.439474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.484054 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4780cb4-dc06-4f48-8aee-227d10306d43 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064629 Jul 26 04:50:10.504554 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2489/4895] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:50:10 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:50:10.520788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:10.534969 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a56e154-e82a-4cf3-8c5b-02ad743d47fa tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.544806 Jul 26 04:50:10.536342 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2407/4896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:10.557821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.558553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 7e0751aa-933e-44be-9cd9-edb20d610bf1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.583165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.583974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.591610 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7e0751aa-933e-44be-9cd9-edb20d610bf1 HTTP/1.1 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7e0751aa-933e-44be-9cd9-edb20d610bf1'} Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:10.593552 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:10.597882 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:10.597882 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:10.597882 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:10.597882 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. Jul 26 04:50:10.597882 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:10.601092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 7e0751aa-933e-44be-9cd9-edb20d610bf1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:10.602553 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb38b91c-1996-47ab-96a6-f8fdd669ac2c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/7e0751aa-933e-44be-9cd9-edb20d610bf1" status: 404 len: 111 microversion: 2.1 time: 0.049240 Jul 26 04:50:10.604210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2490/4897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:10 2022] GET /compute/v2.1/servers/7e0751aa-933e-44be-9cd9-edb20d610bf1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:10.606262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.606732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.607604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.608051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.617925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.618589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.629381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.629846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.630970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.632154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.669380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:50:10.821373 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4acd15f1-6e0f-4830-a420-7f23350901b7 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 204 len: 0 microversion: 2.1 time: 0.242645 Jul 26 04:50:10.823371 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2408/4898] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:50:10 2022] DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:50:10.833028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:10.833960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:10.845050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.846178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.846988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:10.847572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:10.987642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:10.999684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.001510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.003077 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5d28139-fae2-4864-8022-aee96db58151 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.397479 Jul 26 04:50:11.003702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2491/4899] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:10 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:11.012965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:11.013809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:11.021187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.021651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.022765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.023210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.202490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.217680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f739219-8fc1-47e5-8a25-83604ab6dc36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.391857 Jul 26 04:50:11.219112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2409/4900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:10 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:11.226371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:11.227322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:11.235383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.236228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.237799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.238725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.406847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.418319 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfb726f8-87cc-4627-96dc-f59dbf97f8c6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 0.413330 Jul 26 04:50:11.418916 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2492/4901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:11 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:11.436108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:11.439793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:11.454743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.455195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.455972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.457284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.629093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.643060 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-caaebdf9-0e21-42f8-b713-5022878ec892 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1673 microversion: 2.1 time: 0.421599 Jul 26 04:50:11.644256 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2410/4902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:11 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1673 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:11.653418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:11.654591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:11.665252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.665975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.667117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.667752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.684644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:11.692831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed96bac2-7085-4441-b8ed-5fd0687007dc tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.272880 Jul 26 04:50:11.697111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2493/4903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:11 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:11.798431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b4c502b7-c88b-4ca7-a47e-7ca1b2db03aa req-5f36857d-f543-4699-95fc-e480d0e59e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea37c0c6-911a-4726-ae3a-2b6b55b4a019", "tag": "f154b19f-132d-4ffe-a1ae-5fe572dd937b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:11.821555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b4c502b7-c88b-4ca7-a47e-7ca1b2db03aa req-5f36857d-f543-4699-95fc-e480d0e59e6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:11.822318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b4c502b7-c88b-4ca7-a47e-7ca1b2db03aa req-5f36857d-f543-4699-95fc-e480d0e59e6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:11.843293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b4c502b7-c88b-4ca7-a47e-7ca1b2db03aa req-5f36857d-f543-4699-95fc-e480d0e59e6b service nova] Creating event network-changed:f154b19f-132d-4ffe-a1ae-5fe572dd937b for instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 on n-h1-848886-16 Jul 26 04:50:11.856482 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b4c502b7-c88b-4ca7-a47e-7ca1b2db03aa req-5f36857d-f543-4699-95fc-e480d0e59e6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061292 Jul 26 04:50:11.857021 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2494/4904] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:50:12.033133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:12.033836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:12.048148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.048530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.049332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.049776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.343633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:12.353671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-104f5e28-03f0-46f0-aeee-68e7ef1aa80d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.707454 Jul 26 04:50:12.354295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2411/4905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:11 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:12.366521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:12.384631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:12.386933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:12.396336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45bbdc36-24bb-4fa3-a6d3-578f0a5fe10d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.367421 Jul 26 04:50:12.398783 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2495/4906] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:12 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:12.439377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:12.439994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:12.449804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.466864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.467741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.468201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.562508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63a92302-9a7d-4af8-9f4f-f13805ff4324 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27851776", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63a92302-9a7d-4af8-9f4f-f13805ff4324 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 236 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27851776", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-27851776', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.582389 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63a92302-9a7d-4af8-9f4f-f13805ff4324 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63a92302-9a7d-4af8-9f4f-f13805ff4324 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025171 Jul 26 04:50:12.589209 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2496/4907] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:12.593468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:12.593871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:12.603194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.603464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.617920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.618670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.928950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:12.937464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-999c05ac-1915-4ea9-be36-c0958d161d70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.347633 Jul 26 04:50:12.938748 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2497/4908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:12 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:12.949313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:12.952419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:12.970485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.973407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:12.976733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:12.977555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:13.279548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:13.290261 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df15b452-6d14-45cb-97df-e913319ecf85 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1673 microversion: 2.1 time: 0.349997 Jul 26 04:50:13.291510 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2498/4909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:12 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1673 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:13.302112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:13.302684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:13.311831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:13.312763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:13.313545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:13.313983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:13.397051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:13.438239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d186db51-373a-4a20-8bc1-9e36fb42975c tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1316 microversion: 2.1 time: 1.002500 Jul 26 04:50:13.441832 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2412/4910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:12 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1316 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:13.456521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:13.462937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:13.473800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:13.474744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:13.493056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:13.494820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:13.554221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:13.958657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:13.988818 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-456d5127-d701-47e0-a4f4-45f33f6e56e7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.545350 Jul 26 04:50:13.994463 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2413/4911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:13 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:14.005118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:14.006108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:14.014620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.015456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.016494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.017460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.189569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.197016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:14.206890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f464a91c-1915-4ee6-bfd5-eaf4054b0652 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.909292 Jul 26 04:50:14.212856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2499/4912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:13 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:14.217741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6619d62-2206-4a4e-8f15-21c77b828cee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-437258476", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6619d62-2206-4a4e-8f15-21c77b828cee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 234 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-437258476", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-437258476', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.251151 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 04:50:14.255529 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:14.264937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6619d62-2206-4a4e-8f15-21c77b828cee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:14.270299 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6619d62-2206-4a4e-8f15-21c77b828cee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.056306 Jul 26 04:50:14.274953 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2500/4913] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:14 2022] POST /compute/v2.1/servers => generated 133 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:14.292116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:14.294021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:14.313483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.316903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.320746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.322181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.560167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=20 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:14.638797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.647712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.660159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.661719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c623148-5c9f-4331-9413-6b1812d32471 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.666041 Jul 26 04:50:14.663544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2414/4914] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:13 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:14.668354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:14.671298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:14.688659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.689328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.690323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.690922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.804923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a7bc18117240aeb6ef844585458f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a2fba339a44f20b2a9997ed4eb71e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.824958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2be53dc-29d7-40f4-87f1-3e2cc81c9a40 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 200 len: 1605 microversion: 2.1 time: 0.160130 Jul 26 04:50:14.825602 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2415/4915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:14 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:14.831137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:14.837070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:14.853524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.854492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.857801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.858630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.866521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:14.879582 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d68f4b43-f61d-4c6a-b18a-780cbb99d2bc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.602883 Jul 26 04:50:14.891267 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2501/4916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:14 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:14.910853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:14.911675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:14.919360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.920056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:14.921032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:14.921671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.248631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:15.257429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:15.258525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9afa4df8-f6f8-4eb2-a25f-9e1fa37816c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.354616 Jul 26 04:50:15.259118 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2502/4917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:14 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:15.267357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:15.273132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.282966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc9ec06b-1621-469a-ad5f-3d4b65db84b6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1506 microversion: 2.1 time: 0.456204 Jul 26 04:50:15.283732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2416/4918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:14 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:15.288915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.296549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.297384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.298243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.314221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:15.323247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 0644e8fd-9ca2-40e1-b9de-402a7a03f012] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.340921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/0644e8fd-9ca2-40e1-b9de-402a7a03f012/action HTTP/1.1 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 13 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: {"pause": {}} Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0644e8fd-9ca2-40e1-b9de-402a7a03f012', 'body': {'pause': {}}} Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:15.349758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:15.355320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:15.355320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:15.355320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. Jul 26 04:50:15.355320 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:15.355320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 0644e8fd-9ca2-40e1-b9de-402a7a03f012 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:15.356345 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6cc6595a-3a38-4073-ae9c-f0e46c061ef8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/0644e8fd-9ca2-40e1-b9de-402a7a03f012/action" status: 404 len: 111 microversion: 2.1 time: 0.058231 Jul 26 04:50:15.357883 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2417/4919] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:15 2022] POST /compute/v2.1/servers/0644e8fd-9ca2-40e1-b9de-402a7a03f012/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:15.370124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:15.372151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.391354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.393418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.396239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.396603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.477660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:15.479998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4fc74ee8-c292-405f-ab24-0c82d9943e31 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/os-instance-actions/req-58cac25a-9c55-48bb-82ae-5198e2f39722" status: 200 len: 313 microversion: 2.1 time: 0.119148 Jul 26 04:50:15.491651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2418/4920] 10.222.0.43 () {58 vars in 1419 bytes} [Tue Jul 26 04:50:15 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/os-instance-actions/req-58cac25a-9c55-48bb-82ae-5198e2f39722 => generated 313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:15.503476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:15.508818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.520890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.521718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.523658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.525674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.652689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:15.665143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e16b4141-0f15-4a42-8485-322e1a0b95f3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.401331 Jul 26 04:50:15.666247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2503/4921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:15 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:15.671374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:15.673916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.681141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.681873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.684683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.685464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.804405 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c184af7e-8d06-49a6-bd89-227e609e6156 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "POST /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/action" status: 202 len: 0 microversion: 2.1 time: 0.136395 Jul 26 04:50:15.805445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2504/4922] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:15 2022] POST /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:15.815262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1fdd6607-2ef1-41e6-950a-82406c1f9ba5 req-c0296b22-c74c-4997-9870-df0577490573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bceb5e2-f458-4ca6-b746-c85ab51ba1ee", "name": "network-vif-deleted", "tag": "504a5ae3-a563-4cf5-85e8-590a1b7723e4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:15.837859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1fdd6607-2ef1-41e6-950a-82406c1f9ba5 req-c0296b22-c74c-4997-9870-df0577490573 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.843432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1fdd6607-2ef1-41e6-950a-82406c1f9ba5 req-c0296b22-c74c-4997-9870-df0577490573 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.906348 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1fdd6607-2ef1-41e6-950a-82406c1f9ba5 req-c0296b22-c74c-4997-9870-df0577490573 service nova] Creating event network-vif-deleted:504a5ae3-a563-4cf5-85e8-590a1b7723e4 for instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee on n-h2-848886-16 Jul 26 04:50:15.911753 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1fdd6607-2ef1-41e6-950a-82406c1f9ba5 req-c0296b22-c74c-4997-9870-df0577490573 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104348 Jul 26 04:50:15.912705 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2505/4923] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:15.922197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:15.927068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.931840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:15.940571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.942886 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0459d604-5256-4112-bb6e-8e612d25156b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.449832 Jul 26 04:50:15.944885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.946067 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2419/4924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:15 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:15.946991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.947466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.965103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:15.965947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:15.981936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.982743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:15.983708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:15.984309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.243231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:16.269443 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa02e979-948b-4548-ae4a-84312ffc3925 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1508 microversion: 2.1 time: 0.322028 Jul 26 04:50:16.271812 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2420/4925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:15 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:16.286231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:16.292208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:16.311202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.315297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.317308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.322747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.373351 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee HTTP/1.1 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7bceb5e2-f458-4ca6-b746-c85ab51ba1ee'} Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:16.380808 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:16.385101 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:16.387030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:16.392111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21f0fbaf-19a5-4b99-aba7-c824db91171e tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 404 len: 111 microversion: 2.1 time: 0.117512 Jul 26 04:50:16.392926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2421/4926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:16 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:16.404496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:16.405111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:16.430914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.431426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.432213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.432667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.805221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:16.814329 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dccff6df-4162-4938-8fe9-acbe85480cbd tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.413592 Jul 26 04:50:16.841971 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2422/4927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:16 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:16.853922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33b00509-b153-4e3b-9d59-d66c5f801b27 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '.version_select at 0x7f38b51ec3a0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:16.901709 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33b00509-b153-4e3b-9d59-d66c5f801b27 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111097576" status: 202 len: 0 microversion: 2.1 time: 0.057488 Jul 26 04:50:16.911126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:16.914843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2423/4928] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111097576 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:16.920873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:16.925003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:16.926195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:16.933339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:16.935393 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ceee9973-ee36-4ab1-ba19-40b18ad60f01 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 1.021275 Jul 26 04:50:16.939554 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2506/4929] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:15 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:16.952550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.956426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:16.957288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:16.957419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.958331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.958972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.976267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.976984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:16.978439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:16.980936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:17.029023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:17.149215 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-feee31ad-ea19-4613-979f-299a90fa1c58 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.207953 Jul 26 04:50:17.157802 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2507/4930] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:16 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:17.168578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:17.169970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:17.191028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:17.192063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:17.193144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:17.194515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:17.754219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:17.774483 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c15c6b8-c0f2-4784-83f2-7749973944d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1510 microversion: 2.1 time: 0.612057 Jul 26 04:50:17.780556 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2508/4931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:17 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1510 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:17.795068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:17.795946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:17.813141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:17.813967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:17.817275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:17.820226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:18.227172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:18.236895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c68e42e3-8210-4bed-b473-22150d6818d0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 1.320882 Jul 26 04:50:18.243365 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2424/4932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:16 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:18.253609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:18.254283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:18.275046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:18.275515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:18.276316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:18.276765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:18.671256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:18.687207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:18.689218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:18.690705 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ca1d0c6-59f9-4598-8066-f3b8dc3d26eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.446223 Jul 26 04:50:18.691828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2425/4933] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:18 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:18.772463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:18.781129 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c48e8599-98f5-4238-935e-2e68c4697754 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1508 microversion: 2.1 time: 0.999171 Jul 26 04:50:18.789965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2509/4934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:17 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1508 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:18.801263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:18.802071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:18.809461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:18.810829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:18.811778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:18.812379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.137104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:19.145132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb666a38-5e78-47e0-895a-17dbc733ed90 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1490 microversion: 2.1 time: 0.347593 Jul 26 04:50:19.166276 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2426/4935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:18 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1490 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:19.168491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:19.169311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:19.187154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.187972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.188956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.189577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.263981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:19.265241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:19.277194 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'pause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state paused Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 13 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: {"pause": {}} Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'pause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state paused Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'pause': {}}} Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state paused. Cannot pause while the instance is in this state. Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state paused Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:19.279155 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state paused Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'pause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state paused {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:19.284060 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84d5a352-653c-464e-b46f-9a34ebe0e523 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 143 microversion: 2.1 time: 0.117263 Jul 26 04:50:19.285653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.286331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.288291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.293162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.294337 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2510/4936] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:19 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 143 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 04:50:19.318889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:19.319443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:19.343486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.345861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.347048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.350570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.663692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d790657-a175-488b-9ccd-0a0460aa09a3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.357891 Jul 26 04:50:19.668134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2511/4937] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:19 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:19.714555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:19.714555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:19.748213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.748213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.748213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:19.748213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:19.959018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:19.982508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-029a1f0a-7e22-48b2-a1f5-f08915f9661c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.719150 Jul 26 04:50:19.986607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2427/4938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:19 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:20.001030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:20.003225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:20.016524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:20.024432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.027166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.029170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.029810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.169770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:20.179845 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4366272a-60cd-4b53-81d0-0d302a966a53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1497 microversion: 2.1 time: 0.505419 Jul 26 04:50:20.189969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2512/4939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:19 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1497 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:20.215835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:20.219254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:20.247162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.251136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.252205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.254701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.657715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:20.683692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59618036-da76-44dc-ae89-0e2d7276e2ba tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1506 microversion: 2.1 time: 0.479650 Jul 26 04:50:20.685407 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2513/4940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:20 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:20.708676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '.version_select at 0x7f38b45c0670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:20.709867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:20.728637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.736503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.737509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.737985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.754675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:20.771130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:20.773781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:20.788217 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e51842e-3f31-4421-aca2-3a326d008530 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.798560 Jul 26 04:50:20.788992 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2428/4941] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:19 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:20.823680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f5889f7-41ab-47b1-88bc-a348e01030b4 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.119039 Jul 26 04:50:20.843508 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2514/4942] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Jul 26 04:50:20 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26/os-instance-actions => generated 611 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:20.859059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:20.860133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:20.870541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.872250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.874881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:20.876956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:20.938975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:50:21.009137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:21.010198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:21.029123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.036420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.038829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.040091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.142023 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-925431b9-f1d2-4e2d-bce1-dbfe12d1718d tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 204 len: 0 microversion: 2.1 time: 0.295813 Jul 26 04:50:21.148968 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2429/4943] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:50:20 2022] DELETE /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:50:21.178951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:21.182117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:21.196305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.198828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.201542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.205131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.525871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:21.535003 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9942f2c6-5cc7-45eb-9d82-fdbecf22c9e5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.530975 Jul 26 04:50:21.542243 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2515/4944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:21 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:21.547380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:21.549173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:21.565970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.567161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.568146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.568793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.597420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:21.605415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:21.613876 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8437f879-97ed-423f-9502-9543ecbde219 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1512 microversion: 2.1 time: 0.463177 Jul 26 04:50:21.631562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2430/4945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:21 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:21.819984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:21.821513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:21.839304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.840393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.842630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.843555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.947329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:21.951834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db94919f-a71f-4886-b3c8-de518bfcdcc8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.408164 Jul 26 04:50:21.965684 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2516/4946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:21 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:21.977870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:21.978422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:21.991321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.993355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:21.996467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:21.996920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:22.467235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:22.483932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:22.485681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:22.495535 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ac8a3b9-de83-4fc3-ba07-14138db509bc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1745 microversion: 2.20 time: 0.684967 Jul 26 04:50:22.498422 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2431/4947] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:21 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1745 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:22.505252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-de19b649-7a73-4192-958f-161c597cab27 req-2936b919-494e-4cfb-98bb-a1ad090e5b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea37c0c6-911a-4726-ae3a-2b6b55b4a019", "name": "network-vif-plugged", "status": "completed", "tag": "f154b19f-132d-4ffe-a1ae-5fe572dd937b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:22.554532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-de19b649-7a73-4192-958f-161c597cab27 req-2936b919-494e-4cfb-98bb-a1ad090e5b09 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:22.554993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-de19b649-7a73-4192-958f-161c597cab27 req-2936b919-494e-4cfb-98bb-a1ad090e5b09 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:22.580886 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-de19b649-7a73-4192-958f-161c597cab27 req-2936b919-494e-4cfb-98bb-a1ad090e5b09 service nova] Creating event network-vif-plugged:f154b19f-132d-4ffe-a1ae-5fe572dd937b for instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 on n-h1-848886-16 Jul 26 04:50:22.598269 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-de19b649-7a73-4192-958f-161c597cab27 req-2936b919-494e-4cfb-98bb-a1ad090e5b09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098299 Jul 26 04:50:22.603176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2432/4948] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:22.621385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:22.627963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:22.652950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:22.654339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:22.655352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:22.663018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:22.919731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:22.936614 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c0cf045-7e3b-43ee-a913-e1c2224e8c5b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.962137 Jul 26 04:50:22.960137 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2517/4949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:21 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:22.973314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:22.973984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:22.992279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:22.992567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:22.993687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:22.996995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.088851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:23.098835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fbc8c571-4a22-4067-85d8-a1f5781bd935 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 0.486758 Jul 26 04:50:23.099439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2433/4950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:22 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:23.124401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:23.143025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:23.157376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.158190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.159208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.159867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.193455 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action HTTP/1.1 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 28 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: {"reboot": {"type": "SOFT"}} Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'af069b5f-2bd5-4bec-963a-1c8bfbd45753', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:23.199660 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:23.205537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-069f048d-313d-4e0a-9067-57b5658bdfed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action" status: 404 len: 111 microversion: 2.1 time: 0.080744 Jul 26 04:50:23.208145 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2434/4951] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:23 2022] POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:23.212763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:23.213372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:23.233188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.233645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.237631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.238126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.504306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:23.519307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c510af1-aa4b-4f5d-8d05-33cea3ccd568 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.307064 Jul 26 04:50:23.520108 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2435/4952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:23 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:23.542836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:23.543480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:23.562968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.569399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.572641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:23.573265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:23.961989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:23.971408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:23.979681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:23.997741 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a507a90-10d5-4913-b741-254f7a08f446 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1745 microversion: 2.20 time: 0.469716 Jul 26 04:50:23.998685 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2436/4953] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:23 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1745 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:24.009480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:24.010528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:24.017873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.018613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.024742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.025451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.119779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:24.128757 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47ffd934-ac49-4abc-8839-acb1185274f5 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1512 microversion: 2.1 time: 1.165964 Jul 26 04:50:24.129350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2518/4954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:22 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1512 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:24.144380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:24.145008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:24.178044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.179343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.187738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.188474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.396109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:24.411829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34145620-def9-486e-bf53-eaa0f40a2e6d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.411142 Jul 26 04:50:24.432950 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2437/4955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:23 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:24.437951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:24.440899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: cd42505f-a75c-4e82-b19c-c82ef6447592] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:24.467648 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/cd42505f-a75c-4e82-b19c-c82ef6447592/action HTTP/1.1 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 28 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: {"reboot": {"type": "SOFT"}} Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'cd42505f-a75c-4e82-b19c-c82ef6447592', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. Jul 26 04:50:24.469292 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:24.474094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance cd42505f-a75c-4e82-b19c-c82ef6447592 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:24.491265 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9dfedbff-7413-48b9-8134-462ca46a6581 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/cd42505f-a75c-4e82-b19c-c82ef6447592/action" status: 404 len: 111 microversion: 2.1 time: 0.052871 Jul 26 04:50:24.494493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2438/4956] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:24 2022] POST /compute/v2.1/servers/cd42505f-a75c-4e82-b19c-c82ef6447592/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:24.510579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:24.518759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:24.535397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.536726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.539941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.540657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.832361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:24.850038 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c55919d8-e518-428a-8cc6-813af41303c2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.350210 Jul 26 04:50:24.850983 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2439/4957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:24 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:24.883702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:24.886088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:24.914967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.915539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:24.916804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:24.917939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:25.256271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:25.266173 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-801d2e10-f7c0-4cb5-9f8c-410b99c199ec tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.390005 Jul 26 04:50:25.273197 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2440/4958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:24 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:25.285266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:25.286201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:25.301380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:25.304288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:25.306123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:25.308424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:25.747101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:25.760296 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb530174-83b2-4abb-877d-4de1c2e9500f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1366 microversion: 2.1 time: 1.628301 Jul 26 04:50:25.765014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2519/4959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:24 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1366 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:25.782574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:25.783278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:25.804077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:25.804615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:25.809068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:25.823306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.105237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf5c0aca3594c4aa69c21b07793ef35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf160464cbea411e98f4fb762daaf72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:26.114600 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-414abe60-b708-43c2-b1b7-90ea29c46f41 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 200 len: 1470 microversion: 2.1 time: 0.348365 Jul 26 04:50:26.118782 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2520/4960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:25 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:26.125558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:26.129354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:26.147918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.148890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.149857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.150492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.169411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action HTTP/1.1 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 65 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'af069b5f-2bd5-4bec-963a-1c8bfbd45753', 'body': {'rebuild': {'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b'}}} Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 04:50:26.171461 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:50:26.177027 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:26.182025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:26.184433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e82334b-1e25-4a5e-923c-bc73db34a1ad tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action" status: 404 len: 111 microversion: 2.1 time: 0.064378 Jul 26 04:50:26.188821 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2521/4961] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:26 2022] POST /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:26.205785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6a4df2d8-e757-43d3-b9c8-7ab933d5c124 req-df41edd5-8670-4850-aa23-e052cb6264f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fa315e-bd44-4ada-809f-a2fdfe089c26", "name": "network-vif-deleted", "tag": "789bed34-c222-42bf-b55c-c5bb5d9b6cfc"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:26.236387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6a4df2d8-e757-43d3-b9c8-7ab933d5c124 req-df41edd5-8670-4850-aa23-e052cb6264f5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.239557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6a4df2d8-e757-43d3-b9c8-7ab933d5c124 req-df41edd5-8670-4850-aa23-e052cb6264f5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.266891 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6a4df2d8-e757-43d3-b9c8-7ab933d5c124 req-df41edd5-8670-4850-aa23-e052cb6264f5 service nova] Creating event network-vif-deleted:789bed34-c222-42bf-b55c-c5bb5d9b6cfc for instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 on n-h2-848886-16 Jul 26 04:50:26.279893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6a4df2d8-e757-43d3-b9c8-7ab933d5c124 req-df41edd5-8670-4850-aa23-e052cb6264f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086919 Jul 26 04:50:26.284114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2522/4962] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:26.299251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:26.300068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:26.313748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.316094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.316962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.319157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.320570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:26.338707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:26.344240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:26.347677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4cdeaa4-9cc7-425d-b722-b17ab224e53e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1745 microversion: 2.20 time: 1.071987 Jul 26 04:50:26.351118 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2441/4963] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:25 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1745 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:26.361574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:26.788279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:26.788788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:26.800072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.800539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.801335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:26.801781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:26.984651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:26.995345 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fec078dd-a9d3-4509-bba9-2148ca9273da tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.709680 Jul 26 04:50:26.997468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2523/4964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:26 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:27.030725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:27.031399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:27.053560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.054142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.055013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.055461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.621031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:27.630368 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2312d77a-9332-4448-8304-a8bbbcf1e75c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1557 microversion: 2.1 time: 0.847619 Jul 26 04:50:27.640188 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2442/4965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:26 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1557 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:27.647881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:27.648735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] [instance: 30fa315e-bd44-4ada-809f-a2fdfe089c26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:27.658109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.658892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.659939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.660544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.681770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] HTTP exception thrown: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Request method failure captured: Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 HTTP/1.1 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33JuN66ExVl5I1jEqsh9y8zY_MvpX0TVYKVFvtEX4K3T5nc8CKHuaQJ4Ch95cHkNnJlcR99O3VDwGqIgA1giJbsd9z7QyPXfMDLGqNDKS5w6CsQiSkx2B0oFAdx29hEpchDPBrtozbjNU7FnXLx-kLfVsFR_HusKAHm3qbdjK2qY9_E Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: bf160464cbea411e98f4fb762daaf72f Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-InstanceActionsTestJSON-362078877 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf160464cbea411e98f4fb762daaf72f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf160464cbea411e98f4fb762daaf72f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf160464cbea411e98f4fb762daaf72f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf160464cbea411e98f4fb762daaf72f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-InstanceActionsTestJSON-362078877 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: bf160464cbea411e98f4fb762daaf72f Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-InstanceActionsTestJSON-362078877 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-InstanceActionsTestJSON-362078877-project Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4bf5c0aca3594c4aa69c21b07793ef35 Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-InstanceActionsTestJSON-362078877-project Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '30fa315e-bd44-4ada-809f-a2fdfe089c26'} Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:27.689454 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] Returning 404 to user: Instance 30fa315e-bd44-4ada-809f-a2fdfe089c26 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff76c254-8e1b-4209-ac90-beaff2e5bca6 tempest-InstanceActionsTestJSON-362078877 tempest-InstanceActionsTestJSON-362078877-project] 10.222.0.43 "GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26" status: 404 len: 111 microversion: 2.1 time: 0.050275 Jul 26 04:50:27.696745 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2443/4966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:27 2022] GET /compute/v2.1/servers/30fa315e-bd44-4ada-809f-a2fdfe089c26 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:27.704308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:27.705817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:27.722873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.723355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.724168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.724622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.810018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:27.820404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cbe107b8-1836-43ff-8612-c22e5bb22891 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.793369 Jul 26 04:50:27.821528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2524/4967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:27 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:27.848211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:27.853194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:27.870239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.870724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:27.871522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:27.872154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:28.451819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cc2b599e-9010-4450-af30-91d8e84481a5 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.614601 Jul 26 04:50:28.453267 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2525/4968] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:50:27 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-interface => generated 285 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:28.467456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:28.490782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 3c432dc2-2b13-4e7e-806a-30c218c34251] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:28.517087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/3c432dc2-2b13-4e7e-806a-30c218c34251/action HTTP/1.1 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 65 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3c432dc2-2b13-4e7e-806a-30c218c34251', 'body': {'rebuild': {'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b'}}} Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 04:50:28.521286 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:28.529280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 3c432dc2-2b13-4e7e-806a-30c218c34251 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:28.532960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d20a1001-0aa1-4602-8e41-d6375cb923fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/3c432dc2-2b13-4e7e-806a-30c218c34251/action" status: 404 len: 111 microversion: 2.1 time: 0.065317 Jul 26 04:50:28.533627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2526/4969] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:28 2022] POST /compute/v2.1/servers/3c432dc2-2b13-4e7e-806a-30c218c34251/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:28.561004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:28.561833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:28.577379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:28.577848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:28.578693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:28.579140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:28.760585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:28.791545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:28.796905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:28.800679 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0301d152-0c1e-4a37-937a-078642572599 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.103922 Jul 26 04:50:28.801296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2444/4970] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:27 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:28.935133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-06824b1e-3ac0-4138-b977-98bedb403de4 req-2e1d3a8d-f5c1-42b4-9889-19b471dd09a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "name": "network-vif-plugged", "status": "completed", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:28.966576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06824b1e-3ac0-4138-b977-98bedb403de4 req-2e1d3a8d-f5c1-42b4-9889-19b471dd09a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:28.967519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06824b1e-3ac0-4138-b977-98bedb403de4 req-2e1d3a8d-f5c1-42b4-9889-19b471dd09a4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:29.000898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-06824b1e-3ac0-4138-b977-98bedb403de4 req-2e1d3a8d-f5c1-42b4-9889-19b471dd09a4 service nova] Creating event network-vif-plugged:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:50:29.015963 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-06824b1e-3ac0-4138-b977-98bedb403de4 req-2e1d3a8d-f5c1-42b4-9889-19b471dd09a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087894 Jul 26 04:50:29.017560 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2445/4971] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:29.827671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:29.828379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:29.845558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:29.847197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:29.848263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:29.851973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:29.860163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:29.879554 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-32b825ef-60ec-4a63-8dfd-ebfc63bb69c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.341164 Jul 26 04:50:29.899188 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2527/4972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:28 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:29.921158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:29.921803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:29.946640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:29.954538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:29.956394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:29.959880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:30.598996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:30.614779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:30.623414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:30.627041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-843c7a18-28a2-4522-9a64-36e5f0d2f523 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.805636 Jul 26 04:50:30.627831 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2446/4973] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:29 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:50:30.807868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:30.820573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ec5ee4f-a327-42bb-986e-60f1bfd9b84f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.914955 Jul 26 04:50:30.822419 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2528/4974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:29 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:30.845904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:30.847153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 4fff4615-f2ef-4c42-8683-2a64e4231160] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:30.858425 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/4fff4615-f2ef-4c42-8683-2a64e4231160/action HTTP/1.1 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 15 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: {"restore": {}} Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4fff4615-f2ef-4c42-8683-2a64e4231160', 'body': {'restore': {}}} Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:30.860383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:30.865370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:30.865370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:30.865370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. Jul 26 04:50:30.865370 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:30.871395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 4fff4615-f2ef-4c42-8683-2a64e4231160 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:30.872468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cd85c3f4-6242-4bd6-a267-9e77b659ff05 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/4fff4615-f2ef-4c42-8683-2a64e4231160/action" status: 404 len: 111 microversion: 2.1 time: 0.031155 Jul 26 04:50:30.883697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:30.884912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:30.888098 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2447/4975] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:30 2022] POST /compute/v2.1/servers/4fff4615-f2ef-4c42-8683-2a64e4231160/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:30.893669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:30.895132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:30.897524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:30.899253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:31.655506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:31.656134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:31.681808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:31.682333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:31.691958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:31.692486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:32.297384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:32.310665 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d956ef5a-b20e-4cd6-9969-ef74222dafd7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.432784 Jul 26 04:50:32.327481 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2529/4976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:30 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:32.333841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:32.336217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:32.351682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:32.352949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:32.354474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:32.355583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:32.953388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:32.977163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:32.982878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:32.984145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-64bad2d4-2feb-4446-8da8-3b94fb2757cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.332754 Jul 26 04:50:32.984728 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2448/4977] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:31 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:50:33.352077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-65b16880-6943-4373-aa6d-bf87e720e905 req-003832f1-88cb-4857-aa5b-40f9bdbba7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea37c0c6-911a-4726-ae3a-2b6b55b4a019", "tag": "f154b19f-132d-4ffe-a1ae-5fe572dd937b"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:33.376885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65b16880-6943-4373-aa6d-bf87e720e905 req-003832f1-88cb-4857-aa5b-40f9bdbba7f8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:33.377631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65b16880-6943-4373-aa6d-bf87e720e905 req-003832f1-88cb-4857-aa5b-40f9bdbba7f8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:33.404837 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-65b16880-6943-4373-aa6d-bf87e720e905 req-003832f1-88cb-4857-aa5b-40f9bdbba7f8 service nova] Creating event network-changed:f154b19f-132d-4ffe-a1ae-5fe572dd937b for instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 on n-h1-848886-16 Jul 26 04:50:33.418545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-65b16880-6943-4373-aa6d-bf87e720e905 req-003832f1-88cb-4857-aa5b-40f9bdbba7f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072065 Jul 26 04:50:33.420008 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2449/4978] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:33.468422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:33.479056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e059d46-489b-46c1-9e02-6e76c48f876d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.149795 Jul 26 04:50:33.479654 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2530/4979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:32 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:33.505507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:33.507534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:33.534792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:33.540961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:33.542781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:33.546068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:33.677367 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'restore' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 15 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: {"restore": {}} Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'restore' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'restore': {}}} Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state active. Cannot restore while the instance is in this state. Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:33.689977 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:33.695257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:33.695257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:33.695257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:33.695257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:33.695257 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:33.698696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'restore' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:33.706891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2826e202-2347-4921-a05a-5068e933fcb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 145 microversion: 2.1 time: 0.201075 Jul 26 04:50:33.710746 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2450/4980] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:33 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 145 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:50:33.719037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:33.719648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:33.736172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:33.736949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:33.737927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:33.746784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:34.016495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:34.017183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:34.046331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:34.046842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:34.058041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:34.058850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:35.023424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:35.054512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:35.063251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:35.069245 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f05c1fe0-53c0-4e91-8fb5-9726f92d86a6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.058782 Jul 26 04:50:35.071104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2451/4981] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:34 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:50:35.551786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:35.561073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bbea6bd6-2ace-44eb-bb1e-0cabbf0fb5c3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.845790 Jul 26 04:50:35.574193 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2531/4982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:33 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:35.600383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:35.600998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:35.620749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:35.621208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:35.622003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:35.622470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:36.098574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:36.099645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:36.111909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:36.122339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:36.123538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:36.126329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:36.715085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:36.737027 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf482e0f-4d04-4044-b193-f327c7f4de30 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.140651 Jul 26 04:50:36.744647 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2452/4983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:35 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:36.786247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:36.787442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 0be583f5-8424-41ff-a4ab-e7b59e4114b0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:36.799416 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/0be583f5-8424-41ff-a4ab-e7b59e4114b0/action HTTP/1.1 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: {"resume": {}} Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0be583f5-8424-41ff-a4ab-e7b59e4114b0', 'body': {'resume': {}}} Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:36.812360 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:36.816682 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:36.816682 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:36.816682 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. Jul 26 04:50:36.816682 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:36.819295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 0be583f5-8424-41ff-a4ab-e7b59e4114b0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:36.823841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db337699-9e6e-4fe6-9b78-e0d212447499 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/0be583f5-8424-41ff-a4ab-e7b59e4114b0/action" status: 404 len: 111 microversion: 2.1 time: 0.054575 Jul 26 04:50:36.832311 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2453/4984] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:36 2022] POST /compute/v2.1/servers/0be583f5-8424-41ff-a4ab-e7b59e4114b0/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:36.851411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:36.859144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:36.881406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:36.882289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:36.883408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:36.884069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:36.889389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:37.488560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:37.510585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:37.527359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:37.528607 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18538de2-aa73-41a2-a284-c773df3d85ac tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.433998 Jul 26 04:50:37.529196 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2532/4985] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:36 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:37.560996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:37.576531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:37.578005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:37.593173 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bbc68bc6-5d82-47ac-b159-09dcd325591d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.752574 Jul 26 04:50:37.594669 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2454/4986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:36 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:37.602008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.602524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.614894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.618852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.622077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:37.622863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:37.640281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.644806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.655210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.655861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.706506 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee HTTP/1.1 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7bceb5e2-f458-4ca6-b746-c85ab51ba1ee'} Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:37.722717 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.728460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:37.729895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6acccf1-3ccf-4b84-b767-128c9221d075 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 404 len: 111 microversion: 2.1 time: 0.190643 Jul 26 04:50:37.743877 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2533/4987] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:50:37 2022] DELETE /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:37.778374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:37.787576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:37.816557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.817088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.828818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:37.829310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:37.916042 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee HTTP/1.1 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7bceb5e2-f458-4ca6-b746-c85ab51ba1ee'} Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:37.930578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. Jul 26 04:50:37.936990 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:50:37.939175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance 7bceb5e2-f458-4ca6-b746-c85ab51ba1ee could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:37.943797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e1a68200-f4dd-441b-82e5-9cbcf359e72c tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee" status: 404 len: 111 microversion: 2.1 time: 0.198204 Jul 26 04:50:37.958340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2534/4988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:37 2022] GET /compute/v2.1/servers/7bceb5e2-f458-4ca6-b746-c85ab51ba1ee => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:38.519617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:38.533378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4cdc848-0072-467e-9494-d6996c6b546c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.917197 Jul 26 04:50:38.534534 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2455/4989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:37 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:38.552782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:38.559719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:38.560724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:38.570340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:38.573733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.585529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:38.594181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.595055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:38.600782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.605906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:38.611348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.618837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:38.735148 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'resume' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: {"resume": {}} Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'resume' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'resume': {}}} Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state active. Cannot resume while the instance is in this state. Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:38.737087 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:38.742114 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:38.742114 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:38.742114 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:38.742114 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:50:38.742114 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:38.745618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'resume' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:38.746779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e7f601a1-53a3-422d-b342-22e856d92b92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 144 microversion: 2.1 time: 0.191244 Jul 26 04:50:38.748612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2456/4990] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:38 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 144 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:50:38.765906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:38.767028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:38.790362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.792961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:38.794064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:38.805033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:39.361243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:39.377872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55af7b47-6198-4d4f-ba5d-31aaf043df7e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.625920 Jul 26 04:50:39.378502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2457/4991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:38 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:39.424102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:39.425130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:39.442548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:39.445608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:39.449310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:39.456827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:40.447421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:40.456546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c541c6d-4e4e-46d5-85a9-bc57b43d57eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.051713 Jul 26 04:50:40.470557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2458/4992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:39 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:40.569648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:40.584856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:40.597329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:40.602874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63924efe-467e-4575-ad84-c9a34c9c79c4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 2.054097 Jul 26 04:50:40.607521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2535/4993] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:38 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:40.862039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c5371c5-4d28-4424-99c2-98e4b4af6adf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c5371c5-4d28-4424-99c2-98e4b4af6adf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 160 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "a96b578f-f211-4d67-affa-b201a2dd5fac"}]}} Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': '', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'networks': [{'uuid': 'a96b578f-f211-4d67-affa-b201a2dd5fac'}]}}} Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:40.878602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c5371c5-4d28-4424-99c2-98e4b4af6adf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:40.883744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c5371c5-4d28-4424-99c2-98e4b4af6adf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024230 Jul 26 04:50:40.889099 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2459/4994] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:40.891138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:40.892969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:40.905072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=94 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:40.909822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:40.910555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:40.911088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:40.911530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:41.638579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:41.640069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:41.661453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:41.666860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:41.668072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:41.668695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:42.217829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:42.229629 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1fc7a50d-842c-4f11-9832-7b038f18f861 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 1.342565 Jul 26 04:50:42.246754 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2536/4995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:40 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:42.257729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:42.258685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:42.265286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:42.266023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:42.267183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:42.267780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:42.591363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:42.604202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:42.619533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:42.620807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8bfce270-e1c4-45c3-b6ad-37832b675aab tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.993549 Jul 26 04:50:42.621381 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2460/4996] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:41 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:42.853228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:42.863841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88f523c8-dfbe-4e6f-b8c5-69acc883e134 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.610826 Jul 26 04:50:42.878756 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2537/4997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:42 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:42.888919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:42.891170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 44b78c33-1115-4fd7-bf72-e8a199e870f8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:42.900420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/44b78c33-1115-4fd7-bf72-e8a199e870f8/action HTTP/1.1 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: {"shelve": {}} Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '44b78c33-1115-4fd7-bf72-e8a199e870f8', 'body': {'shelve': {}}} Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:42.909165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:42.914612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:42.914612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:42.914612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. Jul 26 04:50:42.914612 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:42.915859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 44b78c33-1115-4fd7-bf72-e8a199e870f8 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:42.916970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-08d10945-9838-438d-a6d6-66233a786c99 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/44b78c33-1115-4fd7-bf72-e8a199e870f8/action" status: 404 len: 111 microversion: 2.1 time: 0.032562 Jul 26 04:50:42.918695 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2461/4998] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:42 2022] POST /compute/v2.1/servers/44b78c33-1115-4fd7-bf72-e8a199e870f8/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:42.926040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:42.926683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:42.942473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:42.947225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:42.948305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:42.948916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:43.535134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:43.543534 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78f7d1f9-4d9a-434f-962c-1a015a0697fc tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.621245 Jul 26 04:50:43.544131 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2538/4999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:42 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:43.586110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:43.586913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:43.599004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:43.608493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:43.609351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:43.609793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:43.644753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:43.645353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:43.664762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:43.673569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:43.674694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:43.675153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:44.246244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:44.259979 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36a1a0f8-dfda-4fb7-b26f-99ce46bac70c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.691565 Jul 26 04:50:44.274962 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2462/5000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:43 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:44.313903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:44.328199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:44.336628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:44.346731 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e7a9e62-b252-4127-acaf-990705d2b987 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.705419 Jul 26 04:50:44.363289 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2539/5001] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:43 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:44.371087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:44.374583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:44.401863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:44.405700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:44.408049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:44.411098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:44.461693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lazy-loading 'flavor' on Instance uuid 95225298-e71a-4104-8894-5136c62708ba {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:50:44.642628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:44.672997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1426124b-6885-4216-81eb-7de878bcf916 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1151198706", "availability_zone": "foo_zone"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:44.723159 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:44.723159 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:44.724269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.aggregate [None req-1426124b-6885-4216-81eb-7de878bcf916 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Generated uuid 8cc7f3ce-6010-456f-b859-7c41b39d71d2 for aggregate {{(pid=119487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 04:50:44.819203 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1426124b-6885-4216-81eb-7de878bcf916 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.542649 Jul 26 04:50:44.822637 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2463/5002] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Jul 26 04:50:44 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:44.839668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ebf8042-cc39-4249-8c65-10a0853225f6 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:44.848671 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:44.848671 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:44.922580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ebf8042-cc39-4249-8c65-10a0853225f6 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.086634 Jul 26 04:50:44.925228 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2464/5003] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:50:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:44.943563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:44.956886 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:44.956886 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:44.966456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:44.969552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:44.970694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:44.971351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.047301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94ac9a5f-c0d8-44c6-b117-f93b4042e1be tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.681513 Jul 26 04:50:45.047424 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2540/5004] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:50:44 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:50:45.070740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:45.071451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:45.085282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-454dab8e-2abd-492e-b911-d00cbf349bb4 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.153028 Jul 26 04:50:45.089306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2465/5005] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Jul 26 04:50:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:45.097062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:45.097515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.098332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:45.098774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.104783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ebf3ed3f-7b41-4d49-aacd-3a3aeda001ee tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:45.105904 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:45.105904 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:45.130266 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ebf3ed3f-7b41-4d49-aacd-3a3aeda001ee tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.032933 Jul 26 04:50:45.133712 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2466/5006] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Jul 26 04:50:45 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:50:45.146752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1385a26f-ee7f-4363-9c34-e7b6cbc1416a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:45.155123 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:45.155123 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:45.182109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1385a26f-ee7f-4363-9c34-e7b6cbc1416a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:45.182968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1385a26f-ee7f-4363-9c34-e7b6cbc1416a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.264632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:45.769225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:45.782966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-812e801a-8e86-4954-8f55-bbd1d558a349 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.729549 Jul 26 04:50:45.783647 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2541/5007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:45 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:45.803630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:45.807392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:45.843764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:45.847434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.848284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:45.848738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:45.852214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1385a26f-ee7f-4363-9c34-e7b6cbc1416a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.710969 Jul 26 04:50:45.853097 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2467/5008] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:50:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:50:45.889125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4257a49e-591d-465f-97ef-e0b9c38f0eef tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:45.890396 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:45.890396 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:45.933464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4257a49e-591d-465f-97ef-e0b9c38f0eef tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.063267 Jul 26 04:50:45.937603 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2468/5009] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:50:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:45.962714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9659a3a-315d-442b-94cc-5536f9aa786c tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-683321955", "availability_zone": "foo_zone"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:46.117927 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:46.117927 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:46.220415 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9659a3a-315d-442b-94cc-5536f9aa786c tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.270078 Jul 26 04:50:46.230897 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2469/5010] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 26 04:50:45 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:46.236075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:46.236935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:46.246144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.247036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.248077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.248753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.267960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 HTTP/1.1 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e04ec941-3381-4c35-87f8-c8fab9a27640'} Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:46.270316 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.275016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.280072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:46.281286 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e819c89-b9dd-49da-8e1b-01ab8be44f70 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 404 len: 111 microversion: 2.1 time: 0.049104 Jul 26 04:50:46.282474 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2470/5011] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:50:46 2022] DELETE /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:46.287495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55f111db-e20b-407b-bfe9-61c3209cf713 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:46.291448 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:46.291448 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:46.330838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55f111db-e20b-407b-bfe9-61c3209cf713 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.046485 Jul 26 04:50:46.338619 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2471/5012] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:50:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:46.344227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:46.345001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] [instance: e04ec941-3381-4c35-87f8-c8fab9a27640] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:46.354022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.354643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.355551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.356138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.383779 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] HTTP exception thrown: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Request method failure captured: Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 HTTP/1.1 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33EK-1rrETMzkAl8Rx5g3Yf80lTp-23TkcQ6ZzHAIj30XX09bgHbm7zD4MftwwV8gL2FyM6xp_NpkBsd7rH5pNFEYlAwcYvEq55N9YKELjhBGboPaMzVmbmgQQbv_52Zgx1CVfZtQBNMqf2pPpv5t1NeIw9MnPZETbj_KOZYeE5P9dA Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92a2fba339a44f20b2a9997ed4eb71e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 92a2fba339a44f20b2a9997ed4eb71e4 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1410192735 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: f4a7bc18117240aeb6ef844585458f38 Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeTestJSON-1410192735-project Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e04ec941-3381-4c35-87f8-c8fab9a27640'} Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:46.385939 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. Jul 26 04:50:46.390307 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:46.393994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] Returning 404 to user: Instance e04ec941-3381-4c35-87f8-c8fab9a27640 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:46.395401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-803a1429-c724-4594-a72b-aa943d2abc48 tempest-AttachVolumeTestJSON-1410192735 tempest-AttachVolumeTestJSON-1410192735-project] 10.222.0.43 "GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640" status: 404 len: 111 microversion: 2.1 time: 0.055516 Jul 26 04:50:46.396800 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2472/5013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:46 2022] GET /compute/v2.1/servers/e04ec941-3381-4c35-87f8-c8fab9a27640 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:50:46.403680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af9829b9-9dc1-426f-ae16-b9aa472763a3 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:46.404896 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:46.404896 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:46.424709 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af9829b9-9dc1-426f-ae16-b9aa472763a3 tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.020670 Jul 26 04:50:46.434509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2473/5014] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 26 04:50:46 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:46.442124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e302a4f-b6f7-4fba-9820-5bd387a0f18b tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-848886-16"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:46.447506 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:46.447506 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:46.457800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e302a4f-b6f7-4fba-9820-5bd387a0f18b tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.458783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e302a4f-b6f7-4fba-9820-5bd387a0f18b tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.688471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e302a4f-b6f7-4fba-9820-5bd387a0f18b tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.251673 Jul 26 04:50:46.692845 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2474/5015] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Jul 26 04:50:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:46.707305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b41e4005-b83d-4476-af81-18b77243782a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:46.709011 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:50:46.709011 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 04:50:46.788286 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b41e4005-b83d-4476-af81-18b77243782a tempest-TestAggregatesBasicOps-893628940 tempest-TestAggregatesBasicOps-893628940-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.089394 Jul 26 04:50:46.789241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2475/5016] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:50:46 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 04:50:46.807164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:46.807804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:46.840284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.844591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.846956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:46.859384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:46.968422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:46.977470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:46.984253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:47.014507 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d15eb2f6-489b-4559-8ead-c5a614c95047 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.228607 Jul 26 04:50:47.020195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2542/5017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:45 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:48.056299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:48.057243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:48.071814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:48.088221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:48.090937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:48.092599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:48.142365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:48.159354 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e5a82f0-3d16-4020-9a69-c4dcbf299b53 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 1.358181 Jul 26 04:50:48.177538 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2476/5018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:46 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:50:49.025699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:49.038572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:49.064818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:49.066146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8947efc-5e69-403a-aa1e-b418214bb645 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 1.023868 Jul 26 04:50:49.067213 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2543/5019] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:48 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:49.184808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:49.185940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:49.206543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:49.208094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:49.211179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:49.211859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:50.092310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:50.093021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:50.102684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:50.103290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:50.104174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:50.108904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:50.189570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:50.201284 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-400cfbe1-c45e-4223-925f-2b7e7fa80897 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 1.021236 Jul 26 04:50:50.212917 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2477/5020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:49 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:50.754689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:50.794741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:50.798038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:50.802419 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa084e25-3040-4448-94d9-b85fabbd2534 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.713889 Jul 26 04:50:50.805024 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2544/5021] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:50 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:50:51.225417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:51.226747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:51.238723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:51.243902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:51.247264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:51.247264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:51.325440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf05a43d-3bbc-40c0-8dcc-366191494198 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-32484805", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:51.330944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-bf05a43d-3bbc-40c0-8dcc-366191494198 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] HTTP exception thrown: min_count must be <= max_count Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf05a43d-3bbc-40c0-8dcc-366191494198 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Request method failure captured: Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 182 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Kqv4RIA_ZFoGVi7vepyoA9yqIGx9ZSbnHGNWmkiImVf65URWmTawRd5VtZ1qReFMH2S9u8x4mi6reb_r3QRp2Pis_bzZndHOTOTyJ9K3hBKDQQWJhdRdo52qpEnArFXsOm_jrzqeMYjbxz29Xtbv6WxtJB0qUFyyKk77Xrkq8IDc8 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6f5378380dd245f298dcf706207d100b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6f5378380dd245f298dcf706207d100b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dbf533666bf4f73822b585f1261c5f8 Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-32484805", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: exception: min_count must be <= max_count Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-32484805', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 26 04:50:51.332854 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.340534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf05a43d-3bbc-40c0-8dcc-366191494198 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Returning 400 to user: min_count must be <= max_count {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:51.341886 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf05a43d-3bbc-40c0-8dcc-366191494198 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.480748 Jul 26 04:50:51.342935 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2478/5022] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:50 2022] POST /compute/v2.1/servers => generated 74 bytes in 483 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:51.427100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11c4fdf6-4bf5-49a9-9778-f9398dd149a0 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-667578857", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "max_count": 0}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11c4fdf6-4bf5-49a9-9778-f9398dd149a0 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Request method failure captured: Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 167 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Kqv4RIA_ZFoGVi7vepyoA9yqIGx9ZSbnHGNWmkiImVf65URWmTawRd5VtZ1qReFMH2S9u8x4mi6reb_r3QRp2Pis_bzZndHOTOTyJ9K3hBKDQQWJhdRdo52qpEnArFXsOm_jrzqeMYjbxz29Xtbv6WxtJB0qUFyyKk77Xrkq8IDc8 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6f5378380dd245f298dcf706207d100b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6f5378380dd245f298dcf706207d100b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dbf533666bf4f73822b585f1261c5f8 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-667578857", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "max_count": 0}} Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-667578857', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'max_count': 0}}} Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 0 Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:51.431954 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11c4fdf6-4bf5-49a9-9778-f9398dd149a0 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:51.436410 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11c4fdf6-4bf5-49a9-9778-f9398dd149a0 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010339 Jul 26 04:50:51.452908 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2479/5023] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:51 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:51.592773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95a569c7-2ceb-4c97-b3ad-b0070daccf92 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038410714", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "max_count": 2.5}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95a569c7-2ceb-4c97-b3ad-b0070daccf92 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Request method failure captured: Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 170 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Kqv4RIA_ZFoGVi7vepyoA9yqIGx9ZSbnHGNWmkiImVf65URWmTawRd5VtZ1qReFMH2S9u8x4mi6reb_r3QRp2Pis_bzZndHOTOTyJ9K3hBKDQQWJhdRdo52qpEnArFXsOm_jrzqeMYjbxz29Xtbv6WxtJB0qUFyyKk77Xrkq8IDc8 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6f5378380dd245f298dcf706207d100b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6f5378380dd245f298dcf706207d100b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dbf533666bf4f73822b585f1261c5f8 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038410714", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "max_count": 2.5}} Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1038410714', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'max_count': 2.5}}} Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:51.602395 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.607648 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.610768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95a569c7-2ceb-4c97-b3ad-b0070daccf92 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:51.611879 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95a569c7-2ceb-4c97-b3ad-b0070daccf92 tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026648 Jul 26 04:50:51.620037 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2480/5024] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:51.680692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:51.694824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19f4519f-f0ae-4264-aa15-6a29f1fc00ac tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-588913332", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 0}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19f4519f-f0ae-4264-aa15-6a29f1fc00ac tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Request method failure captured: Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 167 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Kqv4RIA_ZFoGVi7vepyoA9yqIGx9ZSbnHGNWmkiImVf65URWmTawRd5VtZ1qReFMH2S9u8x4mi6reb_r3QRp2Pis_bzZndHOTOTyJ9K3hBKDQQWJhdRdo52qpEnArFXsOm_jrzqeMYjbxz29Xtbv6WxtJB0qUFyyKk77Xrkq8IDc8 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6f5378380dd245f298dcf706207d100b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6f5378380dd245f298dcf706207d100b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dbf533666bf4f73822b585f1261c5f8 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-588913332", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 0}} Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-588913332', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'min_count': 0}}} Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 0 Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:51.705148 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 04:50:51.712260 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.714862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19f4519f-f0ae-4264-aa15-6a29f1fc00ac tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:51.715461 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31ab7c40-ec2a-48de-8d69-43f42cfbb611 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.482509 Jul 26 04:50:51.761559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2545/5025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:51 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:51.764829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19f4519f-f0ae-4264-aa15-6a29f1fc00ac tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.070908 Jul 26 04:50:51.766847 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2481/5026] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:51 2022] POST /compute/v2.1/servers => generated 130 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:51.834881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:51.836176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:51.853002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:51.853503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:51.856444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:51.856906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:51.876035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13451334-8fec-43a1-8898-4fd37c564fad tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-444165616", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 2.5}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13451334-8fec-43a1-8898-4fd37c564fad tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Request method failure captured: Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 169 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Kqv4RIA_ZFoGVi7vepyoA9yqIGx9ZSbnHGNWmkiImVf65URWmTawRd5VtZ1qReFMH2S9u8x4mi6reb_r3QRp2Pis_bzZndHOTOTyJ9K3hBKDQQWJhdRdo52qpEnArFXsOm_jrzqeMYjbxz29Xtbv6WxtJB0qUFyyKk77Xrkq8IDc8 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6f5378380dd245f298dcf706207d100b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6f5378380dd245f298dcf706207d100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6f5378380dd245f298dcf706207d100b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 6f5378380dd245f298dcf706207d100b Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2090840103 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dbf533666bf4f73822b585f1261c5f8 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2090840103-project Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-444165616", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "min_count": 2.5}} Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-444165616', 'imageRef': '33ab09be-5eb6-45a4-ae6c-563cf5c54e5b', 'flavorRef': '452', 'min_count': 2.5}}} Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:50:51.884732 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 04:50:51.890105 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:50:51.894978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13451334-8fec-43a1-8898-4fd37c564fad tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:50:51.896423 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13451334-8fec-43a1-8898-4fd37c564fad tempest-MultipleCreateNegativeTestJSON-2090840103 tempest-MultipleCreateNegativeTestJSON-2090840103-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024833 Jul 26 04:50:51.897761 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2482/5027] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:50:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:50:52.595462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:52.611444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:52.620103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:52.623997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7de99760-fdc9-43d4-b628-731c0b04c98f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.795690 Jul 26 04:50:52.646838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2546/5028] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:51 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:52.745073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:52.745695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:52.776374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:52.777019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:52.782001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:52.784123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:53.285050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:53.303362 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4b032b2-027e-4e6e-ba70-274228fd88f3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.562279 Jul 26 04:50:53.304024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2483/5029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:52 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:53.653183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:53.653960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:53.662477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:53.663359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:53.664579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:53.665257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.083338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:54.103726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:54.117995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:54.119572 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62b8a80f-ac27-4d97-a5a3-01c73ee69daf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.470271 Jul 26 04:50:54.121963 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2547/5030] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:53 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:54.332748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:54.335643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:54.353083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.353876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.356112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.358259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.995204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:55.149813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:55.151267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:55.169574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:55.170044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:55.180997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:55.183272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:55.200166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:55.212712 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-961e7d6d-3902-4b82-b334-8dfe65cfdd36 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.884591 Jul 26 04:50:55.223141 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2484/5031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:54 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:55.982652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:55.992741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:56.004898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:56.012875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71c4a497-5928-4d11-a725-8568da34ca23 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.864516 Jul 26 04:50:56.042973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2548/5032] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:55 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:50:56.242064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:56.250621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:56.262084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:56.263871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:56.265611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:56.266366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:57.041426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:57.042035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:57.049550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:57.063932 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-be6f28e7-8378-4f4f-90c4-d7c36da7a7d8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.828343 Jul 26 04:50:57.078713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:57.079421 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2485/5033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:56 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:57.079530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:57.082703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:57.083288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:57.843581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:57.854425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:57.863061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:57.869525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5ec447e-e357-445b-98da-cb93db507a7a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.831783 Jul 26 04:50:57.875642 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2549/5034] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:57 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:50:58.092173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:58.093813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:58.106074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:58.106666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:58.107538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:58.108100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:58.900777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:58.901400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:58.908566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:58.909315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:58.911925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:58.912658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:58.975693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:58.984366 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca23b08f-1b32-4120-ab97-c8eb840ec929 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.897788 Jul 26 04:50:58.985233 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2486/5035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:50:58 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:50:59.034978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:59.035795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:50:59.071216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:59.071668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:59.072682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:59.073548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:59.121704 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd6dbd80-5a29-4318-bb55-03c0e02452e9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/ips" status: 200 len: 151 microversion: 2.1 time: 0.090786 Jul 26 04:50:59.127306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2487/5036] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:50:59 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/ips => generated 151 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:59.799755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:59.812484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:59.817136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:50:59.819617 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d289ab27-a9c7-4cb4-a8de-20cd817f8d74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1740 microversion: 2.20 time: 0.924122 Jul 26 04:50:59.821002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2550/5037] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:50:58 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1740 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:00.007519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:00.008522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:00.020466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:00.020466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:00.021244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:00.024045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:00.458177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:00.495595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc5e4898-c41c-475d-9846-2c24b7f0d098 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.490473 Jul 26 04:51:00.499614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2488/5038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:00 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:00.845930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:00.846824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:00.862559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:00.863227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:00.878322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:00.880369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:01.523835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:01.525477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:01.548853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:01.549567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:01.550971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:01.551422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:01.570033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:01.741110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:01.754625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:01.768026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:01.769276 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-384c1030-62c7-414c-ade7-7b23102b1592 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1722 microversion: 2.20 time: 0.927458 Jul 26 04:51:01.769892 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2551/5039] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:00 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1722 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:01.981143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:01.997390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1d77995-ea0a-4b95-812f-173476ec1db7"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:01.998007 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ca69459-7ac3-4db4-b54a-60c008b1afe0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1532 microversion: 2.1 time: 0.480503 Jul 26 04:51:01.999903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:02.000693 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2489/5040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:01 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1532 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:02.016060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:02.016602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:02.017508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:02.017972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:02.324205 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c33fdec6-5637-4034-90cb-c0519393f26e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330612 Jul 26 04:51:02.325746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2552/5041] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:51:01 2022] POST /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:51:02.793540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:02.795447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:02.826858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:02.827321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:02.828299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:02.828738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:03.022963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:03.025163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:03.061187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:03.070634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:03.072096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:03.072568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:03.631551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:03.668056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:03.670794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:03.676533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a42b16e0-65e7-4b00-b7ca-8d26ecea0aa0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1722 microversion: 2.20 time: 0.887107 Jul 26 04:51:03.678288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2490/5042] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:02 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1722 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:04.439223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:04.453851 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa6d7263-0567-4312-bf40-e9a0013e51eb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 1.435027 Jul 26 04:51:04.454515 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2553/5043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:03 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:04.713348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:04.715195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:04.747898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:04.749598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:04.756703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:04.757162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:05.447786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1db7f28f-4b31-4dce-823a-19bd66bfc004 req-2b795bbb-30bf-46a2-9b51-bd5008fdea6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "name": "network-vif-unplugged", "status": "completed", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:05.527503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1db7f28f-4b31-4dce-823a-19bd66bfc004 req-2b795bbb-30bf-46a2-9b51-bd5008fdea6e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:05.530292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1db7f28f-4b31-4dce-823a-19bd66bfc004 req-2b795bbb-30bf-46a2-9b51-bd5008fdea6e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:05.582000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_external_events [req-1db7f28f-4b31-4dce-823a-19bd66bfc004 req-2b795bbb-30bf-46a2-9b51-bd5008fdea6e service nova] Unable to find a host for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58. Dropping event network-vif-unplugged {{(pid=119488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 04:51:05.589249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1db7f28f-4b31-4dce-823a-19bd66bfc004 req-2b795bbb-30bf-46a2-9b51-bd5008fdea6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.141075 Jul 26 04:51:05.592331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2554/5044] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 151 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 04:51:05.616831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:05.617545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:05.658531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:05.658987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:05.659773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:05.660212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:05.703721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:05.712861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:05.719222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:05.721136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42aaaa75-885b-465a-82cd-307c54a1b8e0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1665 microversion: 2.20 time: 1.019918 Jul 26 04:51:05.726939 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2491/5045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:04 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1665 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:05.760943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b16eb34-7372-4e28-8ed5-d2cec731d5d4"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:05.770692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:05.784806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:05.789667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:05.790771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:05.792007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:06.459745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:06.474927 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-856cecc1-6ce9-411e-a414-d7569f5978a8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.881235 Jul 26 04:51:06.478113 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2555/5046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:05 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:06.697436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-07c99f91-a050-4a70-b715-b9aeb459fcee tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.943856 Jul 26 04:51:06.719090 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2492/5047] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Jul 26 04:51:05 2022] POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 188 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:51:06.956737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:06.957328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:07.003164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.005318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:07.009789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.011732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:07.193726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:07.324281 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69fe5a1c-7b79-4adf-b6eb-1c0113f67f0b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/action" status: 202 len: 0 microversion: 2.20 time: 0.372453 Jul 26 04:51:07.327397 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2556/5048] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:51:06 2022] POST /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:51:07.336544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:07.337170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:07.361648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.362093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:07.367416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.368558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:07.509347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:07.510642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:07.520868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.522966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:07.524674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:07.529905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:09.079153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:09.104087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5227fd42-daa7-48bb-8ac0-75d3aac72d85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 1.600130 Jul 26 04:51:09.107964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2557/5049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:07 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:09.117249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-107c06ca-2af3-483a-87fb-3803623e18aa req-31ff28dd-82a1-4543-8613-e05766bc6ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "name": "network-vif-plugged", "status": "completed", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:09.148823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-107c06ca-2af3-483a-87fb-3803623e18aa req-31ff28dd-82a1-4543-8613-e05766bc6ff2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:09.150930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-107c06ca-2af3-483a-87fb-3803623e18aa req-31ff28dd-82a1-4543-8613-e05766bc6ff2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:09.190095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-107c06ca-2af3-483a-87fb-3803623e18aa req-31ff28dd-82a1-4543-8613-e05766bc6ff2 service nova] Creating event network-vif-plugged:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h1-848886-16 Jul 26 04:51:09.202609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-107c06ca-2af3-483a-87fb-3803623e18aa req-31ff28dd-82a1-4543-8613-e05766bc6ff2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091244 Jul 26 04:51:09.203594 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2558/5050] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:10.141137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:10.141866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:10.164733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:10.165195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:10.165985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:10.182694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:10.552730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:10.578463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:10.587384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:10.590732 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39a87b42-3c69-4973-a8b0-6c96a71a4b8c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1751 microversion: 2.20 time: 3.259130 Jul 26 04:51:10.600312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2493/5051] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:07 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1751 bytes in 3268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:10.907000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:10.925206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d9234cd-0d97-4c6a-b735-ca36f2c3e865 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.792488 Jul 26 04:51:10.925816 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2559/5052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:10 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:11.628897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:11.630138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:11.663212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:11.664221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:11.665038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:11.665768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:11.950080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:11.950794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:11.959788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=50 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:11.963846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:11.966013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:11.966762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:11.969641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:12.670755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:12.679494 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c26fd1ab-8a12-42be-8c67-61c068c257ed tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.734392 Jul 26 04:51:12.693440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2560/5053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:11 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:12.780388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:12.793427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:12.803564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:12.808533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5cee3fb2-d360-41aa-9041-134af71e3f57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 1.179848 Jul 26 04:51:12.809437 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2494/5054] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:11 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:13.710603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:13.711864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:13.737686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:13.737686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:13.737686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:13.737686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:13.837484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:13.838403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:13.861197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:13.862589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:13.864651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:13.865376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:15.346254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:15.380260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:15.382753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:15.384282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38cfa6b2-a609-453d-885a-9fe6b0ebfd9b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 1.555352 Jul 26 04:51:15.387267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2495/5055] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:13 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:15.589583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:15.602008 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-437e3458-b741-4993-9fde-e07031dbc21f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 1.896930 Jul 26 04:51:15.614261 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2561/5056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:13 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:16.412986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:16.413607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:16.417470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:16.432274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:16.433479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:16.436079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:16.436568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:16.645843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:16.657935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:16.660070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:16.662213 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21d2be54-257d-466a-b856-d89a6c6e8529 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.254988 Jul 26 04:51:16.663791 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2496/5057] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:16 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:16.669275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:16.670197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:16.678618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:16.679368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:16.681333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:16.682074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:17.163969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:17.198742 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1191048-e262-45f7-a52c-a93a6db9efe5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.530406 Jul 26 04:51:17.205700 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2497/5058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:16 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:17.479701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4cc2ceb-99f8-48db-8260-9d216d1f540b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: .version_select at 0x7f38b452cd30>, body: {"keypair": {"name": "tempest-keypair-1725916150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx7sJkpqffbyaToNTd2A4MHgEEEgg3vyHvfXEnE4IT0rS5XoxCea3OZbx1kNe60DsbJ/siONLMnMYhVINfwg+6mkQ1hq+sbUqCY0cfCEpHeB3j58OVl9r+rsqP30bDdNg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:17.568514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b4cc2ceb-99f8-48db-8260-9d216d1f540b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:51:17.592518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b4cc2ceb-99f8-48db-8260-9d216d1f540b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:51:17.680637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4cc2ceb-99f8-48db-8260-9d216d1f540b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.097856 Jul 26 04:51:17.683598 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2562/5059] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:51:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:17.686066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:17.687755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:17.703722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:17.711052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:17.713059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:17.713709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:18.221054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:18.222033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:18.239794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:18.241861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:18.244755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:18.247134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:18.611280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:18.622027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:18.658857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:18.662647 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d88cc6b-874a-4721-b14b-89a3c67067ea tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.981430 Jul 26 04:51:18.687382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2498/5060] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:17 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:18.895075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:18.913157 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f663adb-236a-4209-a9d3-67512f8f38c9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.697301 Jul 26 04:51:18.914096 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2563/5061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:18 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:19.692337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:19.693011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:19.706754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:19.709200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:19.710029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:19.710542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:19.939019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:19.940395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:19.969125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:19.969125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:19.969125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:19.969125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:20.381134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:20.397837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:20.403751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:20.409918 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90d68d4d-dda5-491a-90b7-ca2b5d69cbfb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.720370 Jul 26 04:51:20.414482 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2499/5062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:19 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:20.656391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:20.671143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95818516-0cc6-4092-ad97-0ce889f38145 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.735862 Jul 26 04:51:20.679952 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2564/5063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:19 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:21.439525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:21.440134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:21.476107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:21.477082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:21.479313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:21.482142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:21.700624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:21.701414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:21.724927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:21.725477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:21.727219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:21.727891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:22.111698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:22.123016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:22.138720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:22.141485 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef358a71-d817-4d9b-bfc7-d21ad13e652c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.708283 Jul 26 04:51:22.162838 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2500/5064] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:21 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:23.096899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:23.112602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ddc113e5-8056-4302-8b04-c771ef6ed33e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 1.416982 Jul 26 04:51:23.113725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2565/5065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:21 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:23.177915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:23.179761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:23.198485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:23.200348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:23.203542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:23.204214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:23.611009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-124299226", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "167545a1-7614-488e-b0ff-7dc229109bb2"}], "security_groups": [{"name": "tempest-securitygroup--366661145"}], "key_name": "tempest-keypair-1725916150", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:24.349162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:24.374336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:24.382857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:24.387028 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-089c45d0-a2cf-408c-855d-18939b3b0b4b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 1.215378 Jul 26 04:51:24.391916 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2501/5066] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:23 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:24.407814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f75cf920-d9e2-41a9-b706-d5a368261435 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: .version_select at 0x7f38b49d5430>, body: {"keypair": {"name": "tempest-keypair-2082829446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Ud0yAmeY8ycuKDJdmCWL2rRdPY87bUV9eZIscSLrx5hp5ln69rytFPMsV/OVUOYPNneXiAk/M688Yh3BSIIUHJXrGihwJzOJW6I9uGG5ehXTvjZRQfr5LLi8TSe1ctg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:24.418772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] validate_networks() for [('167545a1-7614-488e-b0ff-7dc229109bb2', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:51:24.469995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f75cf920-d9e2-41a9-b706-d5a368261435 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:51:24.480044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f75cf920-d9e2-41a9-b706-d5a368261435 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:51:24.543833 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f75cf920-d9e2-41a9-b706-d5a368261435 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149872 Jul 26 04:51:24.544659 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2502/5067] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:51:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:24.559599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:24.569331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:24.582881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:24.587475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:24.588897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:24.589838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:24.861503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:24.876681 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-920b4821-63ec-42d5-ac89-0e90032f5af3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.323350 Jul 26 04:51:24.880817 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2503/5068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:24 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:25.419964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:25.421848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:25.452113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.455767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.457883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.461213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.467832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:25.756151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:51:25.756646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:51:25.756973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:51:25.757389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:51:25.757799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:51:25.778667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.779120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.779923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.780369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.821381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:51:25.835960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:51:25.848794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:25.864316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:51:25.866647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:51:25.866859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:25.868748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:25.878723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13e3a3cd-199e-4ae1-9731-bf76973fec3f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.463034 Jul 26 04:51:25.879756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2504/5069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:25 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:25.905357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:25.906349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:25.923972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.929290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.931128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:25.933188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:25.974620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eda4d3e7-04fc-49f5-8056-0e418ce6aa9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.368634 Jul 26 04:51:25.975565 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2566/5070] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:51:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:51:25.986555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0808bd5a-29da-426d-8003-20345199d5e0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:25.987788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0808bd5a-29da-426d-8003-20345199d5e0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:26.142037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0808bd5a-29da-426d-8003-20345199d5e0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:26.155376 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0808bd5a-29da-426d-8003-20345199d5e0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1238 microversion: 2.1 time: 0.172795 Jul 26 04:51:26.156616 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2567/5071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:25 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1238 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:26.768497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:26.782829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b412830-7f11-4d16-94cd-59aca93d7247 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.878241 Jul 26 04:51:26.786609 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2505/5072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:25 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:26.912433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:26.917492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:26.939905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:26.944430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:26.948653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:26.951107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:27.178387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:27.179418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:27.196024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:27.213019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:27.221236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:27.239138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:27.529590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:27.546172 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a9b1f9e-1623-4823-a3f3-4fbb5c6632ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1234 microversion: 2.1 time: 0.372683 Jul 26 04:51:27.557121 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2506/5073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:27 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1234 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:27.647754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:27.667827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:27.672369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:27.674797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8a1ce38-811a-40ed-85dc-7ed8705f4c26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 0.771578 Jul 26 04:51:27.694649 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2568/5074] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:26 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:27.805570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:27.807337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:27.830731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:27.831254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:27.831986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:27.833695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:28.579134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:28.581080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:28.597887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:28.602802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:28.603902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:28.604556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:28.648132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:28.670440 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0e18528-3fc1-419e-b36c-7f638f8411ba tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.856202 Jul 26 04:51:28.683323 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2507/5075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:27 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:28.702114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:28.703210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:28.717548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:28.720432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:28.723962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:28.724829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:28.865549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:28.881202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a501178-a02a-4ffd-a258-feabc0291ed9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1296 microversion: 2.1 time: 0.306736 Jul 26 04:51:28.886748 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2569/5076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:28 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:29.695777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:29.698103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:29.724609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:29.725309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:29.726439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:29.727049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:30.266748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:30.276548 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dd4f7398-ca01-4aeb-be7c-5cc4eb5220d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.585292 Jul 26 04:51:30.282305 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2570/5077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:29 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:30.288925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:30.289846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:30.298337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:30.299152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:30.300255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:30.301624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:30.309879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:30.368039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:30.379926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:30.389432 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1becd701-aa23-4396-80a6-88c98a6d5897 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 1.688074 Jul 26 04:51:30.396313 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2508/5078] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:28 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:30.497211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:30.505466 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d9733798-971c-4b19-9cf9-a0f0c0dcfd31 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1296 microversion: 2.1 time: 0.221131 Jul 26 04:51:30.509970 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2571/5079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:30 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1296 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:31.311488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:31.314912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:31.337672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.338737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:31.344857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.345716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:31.420507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:31.420968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:31.431821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.432364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:31.445427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.445910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:31.887428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:31.896232 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8f778b4-919e-40a3-8410-5dbb385147ca tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.591349 Jul 26 04:51:31.896824 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2509/5080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:31 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:31.905799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:31.908001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:31.935036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.947974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:31.949202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:31.949882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:32.479085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:32.492418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e385dcef-6522-49a6-b590-def41bfd35db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.589388 Jul 26 04:51:32.493688 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2510/5081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:31 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:32.501311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-736553788", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb5d3d-bcd3-424d-b89b-f73e7e58dea5"}], "security_groups": [{"name": "tempest-securitygroup--538512941"}], "key_name": "tempest-keypair-2082829446", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:32.864976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] validate_networks() for [('79bb5d3d-bcd3-424d-b89b-f73e7e58dea5', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:51:33.236237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:33.255319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:33.257070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:33.276025 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44d06633-45ec-48bb-b924-d90bf83fcd4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1753 microversion: 2.20 time: 1.859595 Jul 26 04:51:33.280551 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2572/5082] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:31 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1753 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:33.318656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:33.319568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:33.327416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:33.328073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:33.329027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:33.329639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:34.200485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:34.223690 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4967043c-2353-4eae-9641-dd5ecf0e4e73 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 0.908565 Jul 26 04:51:34.238572 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2573/5083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:33 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:34.247855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:34.255066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:34.281811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:34.284524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:34.289396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:34.292302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:34.506893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:35.396156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:35.404672 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a0ba8b8-eba9-4317-8bb1-38a7cf49443d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 1.176944 Jul 26 04:51:35.405261 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2574/5084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:34 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:35.429843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:35.436696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:35.476994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.477462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:35.478284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.482096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:35.494933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:51:35.495385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:51:35.495865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:51:35.496742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:51:35.497422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:51:35.536444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.537572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:35.540377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.542772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:35.607599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:51:35.615342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:51:35.633034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:51:35.635864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:51:35.768258 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13475111-a3f2-4cf9-956a-5c5783ee5fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.272187 Jul 26 04:51:35.768951 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2511/5085] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:51:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:51:35.793284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:35.794081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:35.798274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:35.838506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.841159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:35.842036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:35.844876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:36.153864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:36.448302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:36.450749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:36.480142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:36.497821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:36.501515 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fed35716-fbb2-425d-8d9f-fb2c12b20b48 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.095204 Jul 26 04:51:36.523482 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2575/5086] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:35 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:36.530071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ebf1b51-3226-4ab9-af61-9a2885382fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:36.531139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ebf1b51-3226-4ab9-af61-9a2885382fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:36.749338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ebf1b51-3226-4ab9-af61-9a2885382fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:36.761892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ebf1b51-3226-4ab9-af61-9a2885382fe9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1241 microversion: 2.1 time: 0.237073 Jul 26 04:51:36.765130 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2576/5087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:36 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:36.782738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0ddffd4e-ed7c-4529-a733-928fae95da0f req-a058fe05-2b38-48ac-9543-d33dd966c0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:36.804228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ddffd4e-ed7c-4529-a733-928fae95da0f req-a058fe05-2b38-48ac-9543-d33dd966c0ee service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:36.817553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0ddffd4e-ed7c-4529-a733-928fae95da0f req-a058fe05-2b38-48ac-9543-d33dd966c0ee service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:36.845645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0ddffd4e-ed7c-4529-a733-928fae95da0f req-a058fe05-2b38-48ac-9543-d33dd966c0ee service nova] Creating event network-changed:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:51:36.853908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0ddffd4e-ed7c-4529-a733-928fae95da0f req-a058fe05-2b38-48ac-9543-d33dd966c0ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084860 Jul 26 04:51:36.855257 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2577/5088] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:36.863487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:36.864836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:36.873018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:36.873837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:36.875125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:36.877267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:37.362636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.374182 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c0ca32df-80b5-48ca-a8dc-5dd51faee3ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.515969 Jul 26 04:51:37.375600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2578/5089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:36 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:37.428108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.456226 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f38149b4-e7c1-4fd1-a3be-211575939b8f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1527 microversion: 2.1 time: 1.679224 Jul 26 04:51:37.468613 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2512/5090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:35 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1527 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:37.533279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:37.533991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:37.543709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:37.544726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:37.545744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:37.546545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:37.786486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:37.788010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:37.804158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:37.805336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:37.807725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:37.809789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:37.927971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.941008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.942447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a3df90c-a746-40dd-9a75-d02faf528ba0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1293 microversion: 2.1 time: 0.159433 Jul 26 04:51:37.943913 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2513/5091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:37 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:37.953972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.960921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:37.967774 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d7fe26f-f9eb-4893-9544-6f7d931c689b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.438677 Jul 26 04:51:37.968779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2579/5092] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:37 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:38.405157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:38.405776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:38.414981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.416012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:38.416810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.417376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:38.483229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:38.483896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:38.492774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.493224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:38.498515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.498986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:38.647029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:38.656167 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ab9f021-4617-4cf7-9ce4-8a1e75fccda7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.256444 Jul 26 04:51:38.669860 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2514/5093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:38.966416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:38.966799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:38.974917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.978462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:38.983256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:38.984118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:39.035752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:39.045882 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7bfc3976-8abc-424f-a168-54473d1630f8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1509 microversion: 2.1 time: 0.567956 Jul 26 04:51:39.058142 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2580/5094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:38 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:39.063364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:39.064208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:39.073723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:39.074548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:39.078574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:39.079431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:39.149788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:39.165698 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d444e06-b36f-4b42-89a0-70b05763eaec tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1299 microversion: 2.1 time: 0.204242 Jul 26 04:51:39.167078 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2515/5095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:38 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:39.519735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:39.533057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:39.543781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:39.545332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0abf7365-1afc-40cd-8580-4176b38849b7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.485957 Jul 26 04:51:39.546086 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2581/5096] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:39 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:39.678633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:39.679489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:39.696091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:39.696636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:39.697684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:39.698308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.073315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:40.074210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:40.086591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:40.107051 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e14d34b-0e1e-41a4-9c01-927e1d5ccd34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.433557 Jul 26 04:51:40.118843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.119933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.121619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.122350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.126454 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2516/5097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:40.188963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:40.189638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:40.201777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.202950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.205729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.208789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.372808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:40.385008 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4695d47d-b047-4075-b2bc-3afea39a439a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1299 microversion: 2.1 time: 0.200927 Jul 26 04:51:40.388327 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2517/5098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:40 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:40.571189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:40.572157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:40.584155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.587215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:40.590766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:40.591760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:41.044785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:41.064637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:41.073662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:41.074850 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-354bd287-4ae4-4732-b7da-486abc5f1f51 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.509913 Jul 26 04:51:41.086187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2518/5099] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:40 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:41.133669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:41.134476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:41.147111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:41.149176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:41.155436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:41.157986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:41.428086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:41.461049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7a2c79c7-eff7-4240-9821-1e931ee85202 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1509 microversion: 2.1 time: 1.395017 Jul 26 04:51:41.462347 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2582/5100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:40 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1509 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:41.476260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6fd476d5-92bd-4a47-b31c-055a548876b9 req-aef7804b-e6ac-4da4-9a88-502fbbba5400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "name": "network-vif-unplugged", "status": "completed", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:41.507660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6fd476d5-92bd-4a47-b31c-055a548876b9 req-aef7804b-e6ac-4da4-9a88-502fbbba5400 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:41.508108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6fd476d5-92bd-4a47-b31c-055a548876b9 req-aef7804b-e6ac-4da4-9a88-502fbbba5400 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:41.549741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:41.551219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_external_events [req-6fd476d5-92bd-4a47-b31c-055a548876b9 req-aef7804b-e6ac-4da4-9a88-502fbbba5400 service nova] Unable to find a host for instance 95225298-e71a-4104-8894-5136c62708ba. Dropping event network-vif-unplugged {{(pid=119488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 04:51:41.552380 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6fd476d5-92bd-4a47-b31c-055a548876b9 req-aef7804b-e6ac-4da4-9a88-502fbbba5400 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088573 Jul 26 04:51:41.552988 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2583/5101] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 04:51:41.560975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34fd28ed-cae8-4bdf-b209-a6e66cc71584 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.432294 Jul 26 04:51:41.562274 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2519/5102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:41.573020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:41.573558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:41.593792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:41.594270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:41.595058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:41.595506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:42.103278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:42.105183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:42.121565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:42.124782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:42.125850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:42.128390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:42.637182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:42.653976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71377780-b1f3-4c34-b69a-19b05d2cfaba tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 1.099830 Jul 26 04:51:42.662259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2584/5103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:41 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:42.668019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:42.671646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:42.685805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:42.688137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:42.689003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:42.691404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:42.692157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:42.905901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:42.922579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:42.924222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:42.962949 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb334ec1-2e4d-4cf8-9b48-e93c9350f1b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.862499 Jul 26 04:51:42.972423 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2520/5104] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:42 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:42.999300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:42.999998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:43.049623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.050759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:43.064465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.064967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:43.136432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:43.253205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:43.264048 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d96dce29-3c2d-44b0-9bba-ac3eafba4472 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1452 microversion: 2.1 time: 0.600291 Jul 26 04:51:43.265778 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2585/5105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:42 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1452 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:43.292594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:43.293672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:43.304369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.305861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:43.309878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.312892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:43.771428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:43.780963 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-381a77df-d6ad-477d-a513-58061a0abd47 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1452 microversion: 2.1 time: 0.493720 Jul 26 04:51:43.788911 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2586/5106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:43 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1452 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:43.809439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:43.816223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:43.838143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.840506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:43.841604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:43.847084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:44.241224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:44.249872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c2a8709-7eda-439e-9bcb-61fcad939a9c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 1.276224 Jul 26 04:51:44.282568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2521/5107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:42 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:44.304280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:44.304661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:44.356798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:44.357285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:44.361829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:44.366776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:44.469143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lazy-loading 'flavor' on Instance uuid 95225298-e71a-4104-8894-5136c62708ba {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:51:44.505066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'shelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state shelved_offloaded Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 14 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: {"shelve": {}} Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'shelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state shelved_offloaded Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'shelve': {}}} Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 26 04:51:44.510722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state shelved_offloaded Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state shelved_offloaded Jul 26 04:51:44.516342 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:51:44.523216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'shelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state shelved_offloaded {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:51:44.527691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d7703f8-4f39-4b31-8f59-4a33dac36e59 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 155 microversion: 2.1 time: 0.243806 Jul 26 04:51:44.528488 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2522/5108] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:51:44 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 155 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:51:44.553464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:44.554928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:44.568171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:44.572271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:44.573354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:44.576945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.059954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:45.072544 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-48a23125-b6f8-4410-86f4-bb4ddac39fe4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 1.281599 Jul 26 04:51:45.082328 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2587/5109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:43 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:45.099532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:45.104582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:45.126719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.127173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.132769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.133470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.174313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:45.197151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:45.202063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:45.205734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c32ba8c-dc43-45d9-93fa-9f4130239ab9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.676149 Jul 26 04:51:45.207599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2523/5110] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:44 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:45.283030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:45.295451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:45.307759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.313422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.317111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.317740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.453147 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fef396f5-93d9-40c7-aaa2-cb88388cb814 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.349996 Jul 26 04:51:45.458187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2588/5111] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:51:45 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:51:45.492758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:45.498417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:45.526849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.527304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.528091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:45.528534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:45.584870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:45.626478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:45.969803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:45.985352 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51e4fe23-b0af-4c13-a218-7444ef084f3f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1460 microversion: 2.1 time: 0.525914 Jul 26 04:51:45.989522 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2589/5112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:45 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1460 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:45.999995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2652abe5-b4f4-4a69-8509-1d2279b4a88c req-506e75e6-fa20-4728-ac88-b5071ab6f3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0744f394-0d00-4534-a634-12ca3afaaa48", "tag": "7cb35a11-8b3b-433e-8c43-f8b849a6a6ed"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:46.032007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2652abe5-b4f4-4a69-8509-1d2279b4a88c req-506e75e6-fa20-4728-ac88-b5071ab6f3e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:46.033561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2652abe5-b4f4-4a69-8509-1d2279b4a88c req-506e75e6-fa20-4728-ac88-b5071ab6f3e0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:46.060803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2652abe5-b4f4-4a69-8509-1d2279b4a88c req-506e75e6-fa20-4728-ac88-b5071ab6f3e0 service nova] Creating event network-changed:7cb35a11-8b3b-433e-8c43-f8b849a6a6ed for instance 0744f394-0d00-4534-a634-12ca3afaaa48 on n-h1-848886-16 Jul 26 04:51:46.078207 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2652abe5-b4f4-4a69-8509-1d2279b4a88c req-506e75e6-fa20-4728-ac88-b5071ab6f3e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086512 Jul 26 04:51:46.080246 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2590/5113] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:46.091381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:46.116150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-909cddbf-0d46-43ec-8e32-ff596cd34fa1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.837190 Jul 26 04:51:46.117241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:46.119542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:46.122551 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2524/5114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:45 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:46.151480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:46.157091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:46.162884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:46.164504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:46.234266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:46.235076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:46.255614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:46.259340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:46.266936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:46.267411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:46.762593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:46.883042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:46.895567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:46.902140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:46.906859 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b602b19-be8f-4668-b504-f244bfe26f2c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.676468 Jul 26 04:51:46.908291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2525/5115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:46 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:47.007866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:47.008589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:47.021393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:47.029062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.029536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:47.032944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.037303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:47.172857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:47.183771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c35b670b-3c6e-4662-9865-15377ca8d1b2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 1.080990 Jul 26 04:51:47.187899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2591/5116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:46 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:47.216347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:47.218396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:47.256217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.258250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:47.279799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.281241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:47.500387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:47.512324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93082afd-7401-4843-935c-bc48327dd5d0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1460 microversion: 2.1 time: 0.508295 Jul 26 04:51:47.529740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2526/5117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:47 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1460 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:47.948596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:47.950865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:47.957541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:47.970769 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ecde98d-dd9f-44bb-88c2-44739f6986ea tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.775362 Jul 26 04:51:47.977915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.978759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2592/5118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:47 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:47.985642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:47.987746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:47.989779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:48.078798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a3deaae8-c02d-46c3-97de-baa7e693d6f4 req-adee3b00-fef2-4655-9d12-d803a5288190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-plugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:48.125688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a3deaae8-c02d-46c3-97de-baa7e693d6f4 req-adee3b00-fef2-4655-9d12-d803a5288190 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:48.134804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a3deaae8-c02d-46c3-97de-baa7e693d6f4 req-adee3b00-fef2-4655-9d12-d803a5288190 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:48.180648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a3deaae8-c02d-46c3-97de-baa7e693d6f4 req-adee3b00-fef2-4655-9d12-d803a5288190 service nova] Creating event network-vif-plugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:51:48.212549 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a3deaae8-c02d-46c3-97de-baa7e693d6f4 req-adee3b00-fef2-4655-9d12-d803a5288190 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134865 Jul 26 04:51:48.214540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2593/5119] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:51:48.233186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:48.234033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:48.261330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:48.267432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:48.268420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:48.274059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:48.843918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:48.857596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:48.860593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:48.871334 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48036e9d-e224-42a8-8b71-780ffc6f4998 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.932566 Jul 26 04:51:48.872345 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2527/5120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:47 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:51:48.886792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:48.887435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:48.921408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:48.927634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:48.930291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:48.931127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:49.583510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:49.599977 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-12cd1127-f5c9-4515-9bbd-b5167c3f60d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1460 microversion: 2.1 time: 0.726290 Jul 26 04:51:49.607675 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2528/5121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:48 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1460 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:49.624984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:49.628537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:49.658547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:49.663266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:49.664206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:49.664888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:49.752314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:49.780475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d007b814-a2e9-4af9-8cd0-d12b826da810 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 1.564579 Jul 26 04:51:49.781700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2594/5122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:48 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:49.905992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:49.907728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:49.926393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:49.927174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:49.928665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:49.929284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:49.939811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:50.366279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:50.459515 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8e8b2bf-663a-42ed-a92a-ecf922fcf5ff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1363 microversion: 2.1 time: 0.847231 Jul 26 04:51:50.477738 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2529/5123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:49 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1363 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:50.615131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:50.631795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:50.633505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:50.633811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:50.640607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:50.644220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:50.644859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:50.645953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:50.646592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:50.672687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e1ba29ec-2a6e-4c5c-8fbf-9bfb00a628ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.771675 Jul 26 04:51:50.676035 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2595/5124] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:49 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:50.803042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:50.805237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:50.828906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:50.833348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:50.837044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:50.839736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:51.681575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:51.705292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68b425f3-d3d8-43c4-bc11-b1850a34bc07 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 0.906753 Jul 26 04:51:51.710927 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2596/5125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:50 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:51.714783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:51.735065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:51.735600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:51.764697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11463618-3913-4653-9ceb-48224b138a4b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1460 microversion: 2.1 time: 1.138299 Jul 26 04:51:51.802507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:51.802507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:51.802507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:51.802507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:51.813865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2530/5126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1460 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:51.857136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:51.867476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:51.903052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:51.903503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:51.913338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:51.915595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:53.333060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:53.357600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:53.371330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:53.378901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e8e454b-544b-4d43-b809-c24c72c8ec26 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.561408 Jul 26 04:51:53.396797 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2531/5127] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:51 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:53.422818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:53.424504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:53.455192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:53.455192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:53.455192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:53.455192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.077428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:54.093726 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24360038-8b78-428f-b31e-bd19dda7aa19 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 0.685842 Jul 26 04:51:54.097435 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2532/5128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:53 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:54.104961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:54.105575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:54.134449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.135532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.136351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.142177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.173931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:54.185694 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3f5fbf3-49f8-45a0-8db1-662e3bec6d92 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1550 microversion: 2.1 time: 2.473658 Jul 26 04:51:54.188565 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2597/5129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:51 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1550 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:54.216466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:54.217806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:54.236389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.240076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.242056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.243881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.547433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:54.582731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c99d397-5d6f-43b2-84e4-bfce9606bdb7 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.483914 Jul 26 04:51:54.586487 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2533/5130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:54 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:54.598960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:54.603420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:54.630090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.631102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.637898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:54.640003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:54.855046 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-273b31a3-9471-440c-bf03-a10d45df6eb2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.645213 Jul 26 04:51:54.856701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2598/5131] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:51:54 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/os-interface => generated 284 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:51:55.122327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:55.122953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:55.190409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:55.191301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:55.191821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:55.192261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:55.494832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:55.537951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:55.545328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:55.562944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24b761fd-05ce-4868-8476-87d1389c5ecc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.974242 Jul 26 04:51:55.569844 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2534/5132] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:54 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:55.617901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:55.619990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:55.644906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:55.647614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:55.649983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:55.652929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:55.945266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:55.963379 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e128f1a-e6ab-4c2e-a7eb-7290acb81f2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 0.849015 Jul 26 04:51:55.966492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2599/5133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:55 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:56.037155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-807edc5a-8ba6-4aeb-b7db-1fadf674176c req-31ba907a-d666-4125-bc74-7d30f455518c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0744f394-0d00-4534-a634-12ca3afaaa48", "name": "network-vif-plugged", "status": "completed", "tag": "7cb35a11-8b3b-433e-8c43-f8b849a6a6ed"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:56.076818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-807edc5a-8ba6-4aeb-b7db-1fadf674176c req-31ba907a-d666-4125-bc74-7d30f455518c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:56.078451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-807edc5a-8ba6-4aeb-b7db-1fadf674176c req-31ba907a-d666-4125-bc74-7d30f455518c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:56.130492 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-807edc5a-8ba6-4aeb-b7db-1fadf674176c req-31ba907a-d666-4125-bc74-7d30f455518c service nova] Creating event network-vif-plugged:7cb35a11-8b3b-433e-8c43-f8b849a6a6ed for instance 0744f394-0d00-4534-a634-12ca3afaaa48 on n-h1-848886-16 Jul 26 04:51:56.146593 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-807edc5a-8ba6-4aeb-b7db-1fadf674176c req-31ba907a-d666-4125-bc74-7d30f455518c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114671 Jul 26 04:51:56.151458 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2600/5134] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:56.283106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:56.304033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0b930909-6bd5-47ea-b74d-5c8a90e4b26f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.686723 Jul 26 04:51:56.319358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2535/5135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:55 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:56.594793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:56.596143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:56.616737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:56.617472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:56.619024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:56.621851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:56.995455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:56.996776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:57.019896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:57.021407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:57.023915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:57.027012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:57.859920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:57.911682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:57.922901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:57.932378 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88b5c769-7bf3-4e25-967e-978a4bbb08f8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.341861 Jul 26 04:51:57.936934 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2601/5136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:56 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:57.947799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:57.951331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:57.979979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:57.985928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:57.987605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:57.990121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:58.011299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:58.024679 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ba4e82c-ee04-49c8-8ee9-e8bac0602cc9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1366 microversion: 2.1 time: 1.035200 Jul 26 04:51:58.030942 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2536/5137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:56 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1366 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:51:58.045002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8e3cc2c1-4db8-407a-884d-8d323acfe85a req-4ce5562a-eb49-4333-89ea-188663999458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:58.086614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8e3cc2c1-4db8-407a-884d-8d323acfe85a req-4ce5562a-eb49-4333-89ea-188663999458 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:58.087492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8e3cc2c1-4db8-407a-884d-8d323acfe85a req-4ce5562a-eb49-4333-89ea-188663999458 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:58.135669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8e3cc2c1-4db8-407a-884d-8d323acfe85a req-4ce5562a-eb49-4333-89ea-188663999458 service nova] Creating event network-changed:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h2-848886-16 Jul 26 04:51:58.148777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8e3cc2c1-4db8-407a-884d-8d323acfe85a req-4ce5562a-eb49-4333-89ea-188663999458 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116039 Jul 26 04:51:58.150242 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2537/5138] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:51:58.515136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-045690ae-6946-4ef4-828e-44e7f399b172 req-710e857e-ad39-4035-9a70-01b1d9f132e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:51:58.533029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-045690ae-6946-4ef4-828e-44e7f399b172 req-710e857e-ad39-4035-9a70-01b1d9f132e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:58.537609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-045690ae-6946-4ef4-828e-44e7f399b172 req-710e857e-ad39-4035-9a70-01b1d9f132e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:58.579336 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-045690ae-6946-4ef4-828e-44e7f399b172 req-710e857e-ad39-4035-9a70-01b1d9f132e7 service nova] Creating event network-changed:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:51:58.598865 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-045690ae-6946-4ef4-828e-44e7f399b172 req-710e857e-ad39-4035-9a70-01b1d9f132e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089576 Jul 26 04:51:58.603458 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2538/5139] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:51:58.794505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:58.812167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-06d9df0e-e842-499f-a29b-4c9a2365e32e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.873858 Jul 26 04:51:58.816819 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2602/5140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:57 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:51:58.972879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:58.973746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:58.986280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:58.987506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:58.988650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:58.989593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:59.010755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:59.054058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:59.056266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:59.072575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:59.075426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:59.084593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:59.085697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:59.400570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:59.413208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:59.418078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:51:59.425415 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6bc70c92-d551-41e9-be06-faa54d94344c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.460401 Jul 26 04:51:59.426834 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2539/5141] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:51:58 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:51:59.839733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:51:59.840568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:51:59.864296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:59.870822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:51:59.875408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:51:59.878743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:00.376272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:00.396537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-feb2a884-8e9f-4fa2-9326-0df32f631e0e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.562094 Jul 26 04:52:00.397991 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2540/5142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:59 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:00.424836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:00.443206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75cd21e4-486c-4a7e-847d-d3cd7a343ecf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1556 microversion: 2.1 time: 1.394161 Jul 26 04:52:00.452717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:00.453308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:00.459271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2603/5143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:51:59 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1556 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:00.467583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:00.468049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:00.468843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:00.469308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:00.474465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:00.474989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:00.488584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:00.489048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:00.493454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:00.493907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:00.682920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8aef83ab-8e0e-4dde-8695-affe00afb1c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215479 Jul 26 04:52:00.691136 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2604/5144] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:52:00 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:01.017672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:01.031952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:01.041810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:01.044044 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3ef2339a-b6b3-4593-95a4-85190d5157ad tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.595212 Jul 26 04:52:01.058809 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2541/5145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:00 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:52:01.424035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:01.425008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:01.436687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:01.437149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:01.441895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:01.448229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:02.072464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:02.073263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:02.085803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:02.094133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:02.095146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:02.096026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:02.294743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:02.304086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e8fa6c1-d720-42a6-8330-018210bd663d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.888628 Jul 26 04:52:02.324315 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2605/5146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:01 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:03.143336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:03.162079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:03.165571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:03.167159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80948104-9e99-4f98-849e-a40284805ce7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.099544 Jul 26 04:52:03.168302 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2542/5147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:02 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:52:03.340807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:03.341434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:03.351110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:03.351564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:03.352340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:03.352779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:03.493498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cd21ae9e-1f87-497f-baa3-e72bd31ed2ea req-fc9c4b8f-6045-4baa-81eb-b997c0c0f268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0744f394-0d00-4534-a634-12ca3afaaa48", "tag": "7cb35a11-8b3b-433e-8c43-f8b849a6a6ed"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:03.527057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cd21ae9e-1f87-497f-baa3-e72bd31ed2ea req-fc9c4b8f-6045-4baa-81eb-b997c0c0f268 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:03.528031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cd21ae9e-1f87-497f-baa3-e72bd31ed2ea req-fc9c4b8f-6045-4baa-81eb-b997c0c0f268 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:03.577012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cd21ae9e-1f87-497f-baa3-e72bd31ed2ea req-fc9c4b8f-6045-4baa-81eb-b997c0c0f268 service nova] Creating event network-changed:7cb35a11-8b3b-433e-8c43-f8b849a6a6ed for instance 0744f394-0d00-4534-a634-12ca3afaaa48 on n-h1-848886-16 Jul 26 04:52:03.591070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cd21ae9e-1f87-497f-baa3-e72bd31ed2ea req-fc9c4b8f-6045-4baa-81eb-b997c0c0f268 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103112 Jul 26 04:52:03.599207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2543/5148] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:04.198099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:04.200117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:04.227277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:04.227854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:04.228858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:04.230644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:04.725275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:04.736830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:04.741701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:04.756603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d81e1dd8-8dd1-4002-a821-ebd2713b3a96 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.551480 Jul 26 04:52:04.757995 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2544/5149] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:04 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:52:05.232264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:05.245180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ef58723-3f1c-4c66-8b12-c2d93a4b5abf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 1.903759 Jul 26 04:52:05.266278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2606/5150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:03 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:05.788996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:05.789837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:05.820528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:05.821287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:05.822131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:05.829791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:06.268661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:06.269378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:06.298965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:06.300801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:06.312292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:06.325309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:06.775630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:06.789452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:06.800838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:06.807006 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-afdcd625-2842-4e38-9630-09645c800812 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.021472 Jul 26 04:52:06.808676 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2545/5151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:05 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:07.241720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:07.255437 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c283929-c2c1-4963-9a45-6c0b678c94d1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.987759 Jul 26 04:52:07.258443 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2607/5152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:06 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:07.836480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:07.838071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:07.855283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:07.859009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:07.864303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:07.865044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:08.311492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:08.318487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:08.373547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:08.383018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:08.390257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:08.390864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:08.645934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:08.659899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:08.661564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:08.684765 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd3d7565-1375-4ee9-b881-9c4512ca28d3 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.855482 Jul 26 04:52:08.698949 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2546/5153] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:07 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:08.785673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:08.797462 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1e633a0-c964-4c21-b491-2129f8a62ade tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.517527 Jul 26 04:52:08.797462 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2608/5154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:08 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:09.729686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:09.730847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:09.740214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:09.748962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:09.750305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:09.750929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:09.821095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:09.825785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:09.841349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:09.842960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:09.844013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:09.844844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:10.081810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:10.099827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:10.108672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:10.110864 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a1fdb531-7eee-49e0-8ce0-eb3121f8ac6d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.386743 Jul 26 04:52:10.111498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2547/5155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:09 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:10.116125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624314397", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "018b940f-5305-45a0-b622-1b30498da507", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:10.233412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:10.243925 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63d4845b-5224-4ea1-901c-d1e44ceeffe3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.430236 Jul 26 04:52:10.246340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2609/5156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:10.286314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:52:11.136885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:11.137682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:11.179336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:11.179798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:11.183199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:11.183653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:11.679563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:11.688838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:11.706292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:11.715680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb4d435d-2a5e-4ea6-ae1c-ebb9e523cc56 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.584652 Jul 26 04:52:11.722597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2610/5157] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:11 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:52:11.727998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:11.750593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:11.773741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:11.777147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:11.778207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:11.784088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:12.147098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:12.156564 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bccecce4-fdea-4c53-9684-af35d64008f5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.432506 Jul 26 04:52:12.157141 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2611/5158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:11 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:12.372998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:52:12.373539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:52:12.373852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:52:12.374308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:52:12.375369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:52:12.417950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:12.418613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:12.419777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:12.433057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:12.494890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:52:12.509955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:52:12.693063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:52:12.706219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='018b940f-5305-45a0-b622-1b30498da507',volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:52:12.749362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:12.754881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:12.769745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=57 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:12.786017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:12.786550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:12.787383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:12.791157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:13.075017 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e82629af-d97e-45f8-bbbe-08d0c8d7d66b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.962398 Jul 26 04:52:13.075675 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2548/5159] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:52:13.094474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c17cb5f3-400d-4ba1-962c-f404449e80df tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:13.100125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c17cb5f3-400d-4ba1-962c-f404449e80df tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:13.279025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c17cb5f3-400d-4ba1-962c-f404449e80df tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:13.290019 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c17cb5f3-400d-4ba1-962c-f404449e80df tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1056 microversion: 2.1 time: 0.199480 Jul 26 04:52:13.294548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2549/5160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:13 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1056 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:13.305111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:13.309222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:13.325102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:13.326095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:13.327490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:13.328240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:13.593178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:13.611688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:13.618075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:13.620396 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-db2114a2-c9fd-4323-8653-c80a0f8042cc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.875405 Jul 26 04:52:13.621528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2612/5161] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:12 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:13.700325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:13.725223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1fcbbc51-2f4c-4462-b702-9599876077db tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.429251 Jul 26 04:52:13.729388 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2550/5162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:13 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:14.317778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:14.319565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:14.333599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.335823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:14.339525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.340509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:14.378829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:14.554962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:14.569016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-422ba225-203e-4812-b22b-fbb140a9bbfe tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1106 microversion: 2.1 time: 0.256009 Jul 26 04:52:14.573632 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2613/5163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:14 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1106 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:14.649713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:14.650776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:14.675937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.676718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:14.677704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.682822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:14.758215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:14.759554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:14.786595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.788521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:14.792192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:14.794918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:15.288994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:15.310676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e8af6ed7-718b-4add-86b1-52fc4c7a57b8 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.556690 Jul 26 04:52:15.319342 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2614/5164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:14 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:15.789863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-71974c84-c1a5-4ff2-a4b6-4e8869558e18 req-238fd564-e297-4946-b984-aef292faaba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "name": "network-vif-plugged", "status": "completed", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:15.852413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-71974c84-c1a5-4ff2-a4b6-4e8869558e18 req-238fd564-e297-4946-b984-aef292faaba6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:15.852945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-71974c84-c1a5-4ff2-a4b6-4e8869558e18 req-238fd564-e297-4946-b984-aef292faaba6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:15.901218 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-71974c84-c1a5-4ff2-a4b6-4e8869558e18 req-238fd564-e297-4946-b984-aef292faaba6 service nova] Creating event network-vif-plugged:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:52:15.941362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-71974c84-c1a5-4ff2-a4b6-4e8869558e18 req-238fd564-e297-4946-b984-aef292faaba6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.614127 Jul 26 04:52:15.956088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2615/5165] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:16.004267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:16.014294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:16.031995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:16.056298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:16.056782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:16.066845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:16.070115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:16.094750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:16.114589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:16.118980 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77f2bca6-96a7-4229-b117-c055ebf61a76 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 1.471488 Jul 26 04:52:16.124036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2551/5166] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:14 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:16.345226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:16.347147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:16.366642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:16.370258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:16.372307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:16.375708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:16.431034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:16.448510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a16c618f-f1f1-4993-bdb9-c65bac6022e9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1172 microversion: 2.1 time: 0.484591 Jul 26 04:52:16.474692 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2616/5167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:15 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1172 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:17.029628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:17.043145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20e81291-d0c2-4b2a-ac10-75c1704bda85 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.705621 Jul 26 04:52:17.047725 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2552/5168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:16 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:17.153402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:17.154022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:17.161828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:17.176738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:17.182284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:17.184947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:17.489011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:17.492179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:17.518342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:17.541345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:17.548121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:17.552884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:17.554565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:17.828946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:17.852079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:17.853612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:17.854898 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a054d3f-312b-4c1a-b593-9f62c1f52898 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.705431 Jul 26 04:52:17.872894 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2617/5169] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:17 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:18.077106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:18.077740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:18.089270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:18.089740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:18.090560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:18.091017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:18.201393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:18.212381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-553ad592-60ed-4c5f-a774-d1843917fa7a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 0.729354 Jul 26 04:52:18.228848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2553/5170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:17 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:18.572227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:18.587432 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4ffb9938-31aa-4456-be3a-ddc29269667c tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.512878 Jul 26 04:52:18.593055 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2618/5171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:18 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:18.884906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:18.885535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:18.910561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:18.911094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:18.911933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:18.912387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:19.235288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:19.236612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:19.262665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:19.266937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:19.271402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:19.273572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:19.553487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:19.601257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:19.617653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:19.628448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3752de0c-9ef0-40dc-9adf-1c26362fcccb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.748212 Jul 26 04:52:19.634073 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2554/5172] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:18 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:19.645271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:19.660525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:19.686083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:19.690955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:19.692526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:19.695260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:20.186181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:20.193712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:20.196713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15a1bf35-4f75-410a-9a83-cca0ccd0ebb0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 0.966191 Jul 26 04:52:20.203433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2619/5173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:19 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:20.210287 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e77b273-ffe4-4bdb-b293-2ad57ec37225 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.572347 Jul 26 04:52:20.211870 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2555/5174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:19 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:20.621324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1054b06b-136e-402e-b427-b50029b0b494 req-1c5de7a7-0f1f-42b0-99a5-b5b822729934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2", "tag": "6f1d9609-eac8-4786-88db-73095eada2d6"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:20.648382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1054b06b-136e-402e-b427-b50029b0b494 req-1c5de7a7-0f1f-42b0-99a5-b5b822729934 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:20.651029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1054b06b-136e-402e-b427-b50029b0b494 req-1c5de7a7-0f1f-42b0-99a5-b5b822729934 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:20.657328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:20.658949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:20.677158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:20.678002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:20.679203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:20.680330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:20.720044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1054b06b-136e-402e-b427-b50029b0b494 req-1c5de7a7-0f1f-42b0-99a5-b5b822729934 service nova] Creating event network-changed:6f1d9609-eac8-4786-88db-73095eada2d6 for instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 on n-h1-848886-16 Jul 26 04:52:20.737807 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1054b06b-136e-402e-b427-b50029b0b494 req-1c5de7a7-0f1f-42b0-99a5-b5b822729934 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122261 Jul 26 04:52:20.738875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2620/5175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:21.030103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:21.061566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:21.079455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:21.081293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8938bc40-7239-4d2d-b99e-9c541c12b27e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.428210 Jul 26 04:52:21.084125 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2556/5176] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:20 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:21.219992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:21.223466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:21.237276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:21.238018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:21.256483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:21.256978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:21.258331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:21.258784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:21.259593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:21.267861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:21.268504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:21.274559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:21.706950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:21.717601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1d09b455-422d-4c7a-9aba-587a698d13c0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.485010 Jul 26 04:52:21.733538 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2557/5177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:21 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:22.113872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:22.114537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:22.125197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:22.125760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:22.130194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:22.133270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:22.168839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:22.391852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:22.420157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:22.423199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:22.425199 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8ef6a45-c4d9-429c-853c-fdb4f545d364 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.316853 Jul 26 04:52:22.426479 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2558/5178] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:22 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:22.690956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:22.699637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b09de96-3f87-4ea6-ab94-ae77d016cde7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 1.486182 Jul 26 04:52:22.726540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2621/5179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:21 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:22.741050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:22.741782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:22.750392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:22.754101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:22.757138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:22.759474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:22.760113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:23.212004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:23.222431 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a0b8bd7-3471-470f-94ba-a00873d0abf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.485069 Jul 26 04:52:23.238538 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2559/5180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:22 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:23.449480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:23.449712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:23.475090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:23.475455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:23.476830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:23.487043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:23.724536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:23.725404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:23.735003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:23.740686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:23.741370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:23.743599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:23.746129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:24.021894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:24.043075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:24.051116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:24.055641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ec4e3ad-6816-406e-898b-45f3dde1ba7b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1809 microversion: 2.20 time: 0.610426 Jul 26 04:52:24.071247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2622/5181] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:23 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1809 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:24.143932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:24.154139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a3ee5df-ef3b-4e3b-9e27-9a42f8676259 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 0.436205 Jul 26 04:52:24.155122 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2560/5182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:23 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:24.251304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:24.251982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:24.261981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:24.263817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:24.264842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:24.266772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:24.503982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:24.512453 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-74b72a14-e695-44a6-b584-273c19767662 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.265143 Jul 26 04:52:24.513271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2623/5183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:24 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:25.089263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:25.090009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:25.105754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.106519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.107461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.107988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.184098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:25.185340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:25.196313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.201277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.202421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.203328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.421784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:25.432579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:25.434516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:25.435946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d9a2891-901b-47da-b89a-2a189956c77d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1796 microversion: 2.20 time: 0.350945 Jul 26 04:52:25.437293 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2561/5184] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:52:25 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1796 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:52:25.477883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:25.486044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d03721b-d044-48e8-974c-dccd5e6868d2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 0.306014 Jul 26 04:52:25.489747 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2624/5185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:25 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:25.538688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:25.539867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:25.551538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.552246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.553337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:25.554739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:25.875428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:25.889518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3dd74367-2954-4c8f-b7a4-43b918927abb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.354747 Jul 26 04:52:25.890591 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2562/5186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:25 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:26.514626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:26.515386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:26.534878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:26.535720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:26.536764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:26.537432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:26.737353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:26.745639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-23145763-0b59-41b4-8117-a20d0eb9bf63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1214 microversion: 2.1 time: 0.235014 Jul 26 04:52:26.746826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2625/5187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:26 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:26.932369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:26.932993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:26.940652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:26.941100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:26.946672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:26.947293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:27.699340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:27.708476 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b1818c7-2f16-4be8-abe6-798859e4382b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.790448 Jul 26 04:52:27.710881 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2563/5188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:26 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:27.769276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:27.770221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:27.780367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:27.781029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:27.782116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:27.783016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:28.145293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:28.160336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e7fa71c-98b5-4c37-b37a-0ac440052cc9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.396033 Jul 26 04:52:28.171031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2626/5189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:27 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:28.731518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:28.732765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:28.748083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:28.748542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:28.749333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:28.751761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:28.992633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:29.006128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7fa4b174-ea38-4872-ae58-93fac2331825 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.277927 Jul 26 04:52:29.006861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2564/5190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:28 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:29.182397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:29.184240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:29.204088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:29.205151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:29.205956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:29.206421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:29.568147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:29.596437 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69fcf5bc-14eb-4104-948a-873dacb7e90c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.416955 Jul 26 04:52:29.597660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2627/5191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:29 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:30.027896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:30.028510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:30.036294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:30.036748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:30.037531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:30.037969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:30.313454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:30.321526 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9c15a66-dd81-495f-bbb7-722713bdd425 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.297513 Jul 26 04:52:30.322104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2565/5192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:30 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:30.633123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:30.634956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:30.657218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:30.657736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:30.658639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:30.659268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:30.929637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:30.937546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25db20c6-ce92-4fda-b832-2ef005a340d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.316105 Jul 26 04:52:30.938145 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2628/5193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:30 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:31.343551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:31.344170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:31.357204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:31.361196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:31.362020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:31.363586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:31.669444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:31.680829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9f2eab4-9aac-4bdc-bb1e-8224c6e952e1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.341316 Jul 26 04:52:31.682254 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2566/5194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:31 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:31.970773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:31.972354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:31.980897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:31.981677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:31.982729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:31.983346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:32.168778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:32.180278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9809c7fd-3b68-4702-9ab2-0c0b98743b33 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.216374 Jul 26 04:52:32.181440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2629/5195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:31 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:32.705493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:32.706107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:32.718099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:32.718834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:32.719792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:32.720457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:32.986770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:33.004729 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2df4475c-5782-45ad-a437-f7692b61c2b2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.303671 Jul 26 04:52:33.005260 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2567/5196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:32 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:33.108982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fa308b51-5c4b-4613-818b-f3001c2c84b1 req-7e56a7cc-5028-4532-b35c-fecd74ea85bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "name": "network-vif-plugged", "status": "completed", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:33.130059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fa308b51-5c4b-4613-818b-f3001c2c84b1 req-7e56a7cc-5028-4532-b35c-fecd74ea85bf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:33.145533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fa308b51-5c4b-4613-818b-f3001c2c84b1 req-7e56a7cc-5028-4532-b35c-fecd74ea85bf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:33.162416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fa308b51-5c4b-4613-818b-f3001c2c84b1 req-7e56a7cc-5028-4532-b35c-fecd74ea85bf service nova] Creating event network-vif-plugged:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h2-848886-16 Jul 26 04:52:33.171933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fa308b51-5c4b-4613-818b-f3001c2c84b1 req-7e56a7cc-5028-4532-b35c-fecd74ea85bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067075 Jul 26 04:52:33.175488 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2630/5197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:33.202649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:33.203265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:33.215020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:33.216719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:33.221738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:33.222455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:33.692146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:33.707511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60cf70f4-264d-4ac4-ba4e-c43de22bc716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.508606 Jul 26 04:52:33.709448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2568/5198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:33 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:34.034548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:34.035259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:34.064808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:34.066798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:34.069631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:34.070795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:34.359738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:34.367684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:34.375041 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61f3e8e9-f4a5-4261-bd08-4a26087dffcf tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.341200 Jul 26 04:52:34.376290 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2631/5199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:34 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:34.733897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:34.736104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:34.750294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:34.754324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:34.756580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:34.757250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:34.955791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:34.965838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c23beb66-5c32-4cdc-9d76-658fe8f7c523 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.238017 Jul 26 04:52:34.966498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2569/5200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:34 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:35.398307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:35.400886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:35.419714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.424962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.425922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.426829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.706570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:35.707069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:35.721767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.725672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.726727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.727345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.787686 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73b65a36-f128-4f27-b004-7bba6798125b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/ips" status: 200 len: 149 microversion: 2.1 time: 0.086277 Jul 26 04:52:35.788663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:35.799058 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2570/5201] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:52:35 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:35.800006 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50a6937f-e726-468e-b784-40ca25e4917d tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1518 microversion: 2.1 time: 0.406014 Jul 26 04:52:35.800590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2632/5202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:35 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:35.804607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1d77995-ea0a-4b95-812f-173476ec1db7"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:35.813326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:35.831528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.832005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.832851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.833296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.989575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:35.990238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:35.997950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:35.998429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:35.999207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.013696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.045603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/os-volume_attachments HTTP/1.1 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 74 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: {"volumeAttachment": {"volumeId": "f1d77995-ea0a-4b95-812f-173476ec1db7"}} Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '0744f394-0d00-4534-a634-12ca3afaaa48', 'body': {'volumeAttachment': {'volumeId': 'f1d77995-ea0a-4b95-812f-173476ec1db7'}}} Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:36.048157 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 Jul 26 04:52:36.054688 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:36.068711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 400 to user: Invalid volume: volume f1d77995-ea0a-4b95-812f-173476ec1db7 is already attached to instances: ea37c0c6-911a-4726-ae3a-2b6b55b4a019 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:36.070559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb3a8265-78da-4925-a1db-440ceef51b1c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270340 Jul 26 04:52:36.072330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2571/5203] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:52:35 2022] POST /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:52:36.086024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:36.087873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:36.113743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.119694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.121048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.122772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.207019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:52:36.399687 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6a3886f-1726-40a6-aece-d036f36ecc86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 204 len: 0 microversion: 2.1 time: 0.321310 Jul 26 04:52:36.403522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2572/5204] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:52:36 2022] DELETE /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:52:36.422206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:36.424235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:36.460421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.462389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.463250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.467230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.632340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:36.643418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc148111-65c7-4698-a3b8-303363c96c80 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.659228 Jul 26 04:52:36.644990 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2633/5205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:35 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:36.732690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:36.735937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:36.749767 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d012ab2c-fee9-4789-a6dc-a197c5a79b15 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1680 microversion: 2.1 time: 0.343805 Jul 26 04:52:36.751277 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2573/5206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:36 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1680 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:36.833394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:36.834322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:36.843895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.850313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:36.851420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:36.851865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.124286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:37.138009 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-166902ef-8a0e-4581-962f-ac2bfaaec694 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.311824 Jul 26 04:52:37.140461 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2634/5207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:36 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:37.166953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:37.167628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:37.180325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.181955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.183469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.184148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.467416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:37.482644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e05c28f4-28a6-4878-b08e-3aab364913a1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.324638 Jul 26 04:52:37.486759 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2574/5208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:37 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:37.528332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:37.537831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:37.550203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.551276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.552796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.553417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.670633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:37.671626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:37.685276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.690062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:37.691184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:37.691566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.120797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:38.133468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2618c40d-6922-40ee-9b2b-f3dfd443ac63 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.465895 Jul 26 04:52:38.146930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2575/5209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:37 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:38.163320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:38.163957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:38.180462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.182988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.187803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.187803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.210120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:38.219499 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e83048d-959d-4306-85de-28878f96b6f6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.697153 Jul 26 04:52:38.224915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2635/5210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:37 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:38.232105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-20582c7d-3302-431d-92f1-632ac252fe1d req-e5598906-228f-435d-90da-064bc8c9ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2", "name": "network-vif-plugged", "status": "completed", "tag": "6f1d9609-eac8-4786-88db-73095eada2d6"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:38.259169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20582c7d-3302-431d-92f1-632ac252fe1d req-e5598906-228f-435d-90da-064bc8c9ba18 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.260412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20582c7d-3302-431d-92f1-632ac252fe1d req-e5598906-228f-435d-90da-064bc8c9ba18 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.276352 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-20582c7d-3302-431d-92f1-632ac252fe1d req-e5598906-228f-435d-90da-064bc8c9ba18 service nova] Creating event network-vif-plugged:6f1d9609-eac8-4786-88db-73095eada2d6 for instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 on n-h1-848886-16 Jul 26 04:52:38.292578 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-20582c7d-3302-431d-92f1-632ac252fe1d req-e5598906-228f-435d-90da-064bc8c9ba18 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063643 Jul 26 04:52:38.293582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2636/5211] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:38.304942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0ed79a1-9b6e-4aff-bdac-3321c5a21378 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:38.319434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f0ed79a1-9b6e-4aff-bdac-3321c5a21378 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0ed79a1-9b6e-4aff-bdac-3321c5a21378 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837/action HTTP/1.1 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 15 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: {"os-stop": {}} Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837', 'body': {'os-stop': {}}} Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:38.335467 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. Jul 26 04:52:38.340127 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:38.346429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0ed79a1-9b6e-4aff-bdac-3321c5a21378 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837 has no mapping to a cell. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:38.347308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0ed79a1-9b6e-4aff-bdac-3321c5a21378 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837/action" status: 404 len: 117 microversion: 2.1 time: 0.050679 Jul 26 04:52:38.348114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2637/5212] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:38 2022] POST /compute/v2.1/servers/87e4b8e3-7c0e-406e-aeb0-a9f87a6a3837/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:52:38.357185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:38.357995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:38.365233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.365777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.366647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.367149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.709888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:38.717990 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40a9b226-7270-43fe-9cc5-34f1c820fa99 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1680 microversion: 2.1 time: 0.569654 Jul 26 04:52:38.722472 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2576/5213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:38 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1680 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:38.758315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:38.766471 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b8a7313-5616-40c9-aef4-61bd6eafb9b6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.412889 Jul 26 04:52:38.771903 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2638/5214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:38 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:38.795258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:38.797633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:38.806667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.809077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:38.809907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:38.810367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.041688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:39.051062 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2aa4c6e4-b4bf-4b6d-ba16-841bf5105aa5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.259761 Jul 26 04:52:39.054435 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2577/5215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:38 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:39.074665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:39.075231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 724af7bd-93c8-49e2-bc36-6dccea960c61] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:39.083526 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/724af7bd-93c8-49e2-bc36-6dccea960c61/action HTTP/1.1 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 15 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: {"suspend": {}} Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '724af7bd-93c8-49e2-bc36-6dccea960c61', 'body': {'suspend': {}}} Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:39.087743 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:39.092936 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:39.092936 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:39.092936 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. Jul 26 04:52:39.092936 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:39.099765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 724af7bd-93c8-49e2-bc36-6dccea960c61 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:39.104405 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8832222-952c-499d-b569-ae46476794c4 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/724af7bd-93c8-49e2-bc36-6dccea960c61/action" status: 404 len: 111 microversion: 2.1 time: 0.033931 Jul 26 04:52:39.105695 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2639/5216] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:39 2022] POST /compute/v2.1/servers/724af7bd-93c8-49e2-bc36-6dccea960c61/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:52:39.132609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:39.136668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:39.159637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:39.160391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:39.170185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.172604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.174441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.177134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.179346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.187182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.190866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.195343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.659168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:39.669230 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef439ac1-6b05-4eee-a556-1d526d936b94 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.558636 Jul 26 04:52:39.670299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2578/5217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:39 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:39.700310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:39.701193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:39.713598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.713969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.714784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.715218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.873347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:39.889430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80e52bfb-03cf-40e5-9a7b-199142080fac tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1202 microversion: 2.1 time: 0.731410 Jul 26 04:52:39.892156 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2640/5218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:39 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1202 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:39.903216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:39.904083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:39.920243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.920908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:39.921877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:39.925229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.090904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:40.091866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:40.101603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-351ae4a1-8704-42ab-9564-2e07d412455f tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.405157 Jul 26 04:52:40.103032 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2579/5219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:39 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:40.113225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-283dd9b5-f7ef-4a29-bbca-c9f269d2055c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 200 len: 1326 microversion: 2.1 time: 0.219094 Jul 26 04:52:40.114318 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2641/5220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:39 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:40.150464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:40.151481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:40.160621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.165039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.166770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.170839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.249348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lazy-loading 'flavor' on Instance uuid 95225298-e71a-4104-8894-5136c62708ba {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:52:40.364914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-78d4221b-693e-40f5-a45b-6108dbf49387 req-abac7307-55a1-4b3f-bcbf-df7fe2fd042d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0744f394-0d00-4534-a634-12ca3afaaa48", "name": "network-vif-deleted", "tag": "7cb35a11-8b3b-433e-8c43-f8b849a6a6ed"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:40.401133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-78d4221b-693e-40f5-a45b-6108dbf49387 req-abac7307-55a1-4b3f-bcbf-df7fe2fd042d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.402458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-78d4221b-693e-40f5-a45b-6108dbf49387 req-abac7307-55a1-4b3f-bcbf-df7fe2fd042d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.436125 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-78d4221b-693e-40f5-a45b-6108dbf49387 req-abac7307-55a1-4b3f-bcbf-df7fe2fd042d service nova] Creating event network-vif-deleted:7cb35a11-8b3b-433e-8c43-f8b849a6a6ed for instance 0744f394-0d00-4534-a634-12ca3afaaa48 on n-h1-848886-16 Jul 26 04:52:40.445240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55a90de1-3c7d-4fbd-9602-435040e7c3d5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.307158 Jul 26 04:52:40.446672 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2642/5221] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:40 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:52:40.451921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-78d4221b-693e-40f5-a45b-6108dbf49387 req-abac7307-55a1-4b3f-bcbf-df7fe2fd042d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346219 Jul 26 04:52:40.455551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:40.456486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2580/5222] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:40.459576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:40.475881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.476694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.478939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.479800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.787402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:40.803997 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59b214ec-116e-4809-8f88-7bd32bdea496 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1513 microversion: 2.1 time: 0.351810 Jul 26 04:52:40.805405 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2643/5223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:40 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:40.915199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:40.916463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:40.934581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.935656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:40.937803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:40.938867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.136974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:41.139148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:41.154603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.160706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:41.171402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.174618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.175625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.176561 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7842ed49-0cbe-4cad-9fc8-fcfdb5cd6eee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1389 microversion: 2.1 time: 0.267348 Jul 26 04:52:41.179576 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2581/5224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:40 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1389 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:41.196994 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 HTTP/1.1 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '0744f394-0d00-4534-a634-12ca3afaaa48'} Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:41.210671 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:52:41.215419 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:41.215928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:41.216030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:41.216133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:41.216222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88ec16fd-6895-4fe5-8b7b-cd98e2048dc6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 404 len: 111 microversion: 2.1 time: 0.080503 Jul 26 04:52:41.216222 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2644/5225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:41 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:52:41.220846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.221307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.222097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.222570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.223296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b875f0d7-3aa4-4c45-8c23-0ae7433aae65 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '.version_select at 0x7f38b45d3af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:41.246591 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b875f0d7-3aa4-4c45-8c23-0ae7433aae65 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082829446" status: 202 len: 0 microversion: 2.1 time: 0.028025 Jul 26 04:52:41.251561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2645/5226] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:52:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082829446 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:52:41.630004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:41.661543 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-865092e2-0907-4633-b215-69d6a72426c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1389 microversion: 2.1 time: 0.444403 Jul 26 04:52:41.692779 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2582/5227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:41 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1389 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:41.704466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:41.705288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:41.725380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.731297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.732377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.732843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.825903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:41.826794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:41.850515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.850992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:41.852058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:41.852943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.032679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:42.043533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f62b793f-83e1-4e87-991d-8f0799b68e31 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1389 microversion: 2.1 time: 0.356037 Jul 26 04:52:42.066606 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2646/5228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:41 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1389 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:42.074012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:42.074799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:42.082846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.083342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.084329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.084793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.113890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:52:42.233658 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdf6e2fa-182a-4632-8afb-5df8ae2829bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 204 len: 0 microversion: 2.1 time: 0.163492 Jul 26 04:52:42.235805 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2647/5229] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:52:42 2022] DELETE /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:52:42.245911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:42.246927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:42.255920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.256657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.257629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.258315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.401857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:42.414859 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-021bd587-5aa2-403a-b54b-038ecc5bd1a6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1496 microversion: 2.1 time: 0.593703 Jul 26 04:52:42.417338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2583/5230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:41 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1496 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:42.439036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:42.440204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:42.452490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:42.452840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.453652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.455673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.456299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.462469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-338f54dc-355d-4291-83fc-de0c1b3b55d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1395 microversion: 2.1 time: 0.221019 Jul 26 04:52:42.463254 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2648/5231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:42 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:42.512099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lazy-loading 'flavor' on Instance uuid 95225298-e71a-4104-8894-5136c62708ba {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:52:42.533419 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'suspend' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state suspended Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 15 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: {"suspend": {}} Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'suspend' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state suspended Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'suspend': {}}} Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state suspended. Cannot suspend while the instance is in this state. Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 26 04:52:42.536031 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state suspended Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state suspended Jul 26 04:52:42.543069 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:42.545733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'suspend' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state suspended {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:42.549012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c0036be4-a992-4d22-873f-0aee35d9b636 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 148 microversion: 2.1 time: 0.114632 Jul 26 04:52:42.551544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2584/5232] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:42 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 148 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:52:42.571453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:42.572206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:42.581695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.582463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.583791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.584548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.605531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:42.780377 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe7abe1c-e1fc-4f2e-aa99-9715818a8700 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 202 len: 0 microversion: 2.1 time: 0.224948 Jul 26 04:52:42.782435 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2649/5233] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:42 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:52:42.792950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:42.793665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:42.806069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.807567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:42.810433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:42.812206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:43.485701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:43.495728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:43.498753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:43.530414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:43.531666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:43.533342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:43.534944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:43.761096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:43.771850 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2080701e-2cc8-40c7-8c0a-286f7db23c1a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1395 microversion: 2.1 time: 0.291103 Jul 26 04:52:43.775438 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2650/5234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:43 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1395 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:43.898402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:43.936945 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b099dcc4-15c8-497a-aa9f-55cce37575e5 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1502 microversion: 2.1 time: 1.149007 Jul 26 04:52:43.940425 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2585/5235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:42 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1502 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:44.045940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:44.046834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:44.056212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.056886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.057898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.058639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.214099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lazy-loading 'services' on Instance uuid ea37c0c6-911a-4726-ae3a-2b6b55b4a019 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:52:44.372105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d60a3bf-dcbe-40f5-bc3b-3010d6e6d4c6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments/f1d77995-ea0a-4b95-812f-173476ec1db7" status: 202 len: 0 microversion: 2.1 time: 0.330331 Jul 26 04:52:44.381696 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2651/5236] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:52:44 2022] DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments/f1d77995-ea0a-4b95-812f-173476ec1db7 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:52:44.387957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:44.391079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:44.415365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.420110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.421332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.429275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.509106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b681951d-027d-461d-9da6-cff8737954bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130205 Jul 26 04:52:44.513057 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2586/5237] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:44 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:44.803056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:44.805464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:44.818179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.819026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.820463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.823012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.869422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a34c45d7-0b01-4e78-a777-741262c903d8 req-ddd52f3d-2c02-4983-9e4b-0c54134ae323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2", "name": "network-vif-deleted", "tag": "6f1d9609-eac8-4786-88db-73095eada2d6"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:44.896757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a34c45d7-0b01-4e78-a777-741262c903d8 req-ddd52f3d-2c02-4983-9e4b-0c54134ae323 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:44.897478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a34c45d7-0b01-4e78-a777-741262c903d8 req-ddd52f3d-2c02-4983-9e4b-0c54134ae323 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:44.920199 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a34c45d7-0b01-4e78-a777-741262c903d8 req-ddd52f3d-2c02-4983-9e4b-0c54134ae323 service nova] Creating event network-vif-deleted:6f1d9609-eac8-4786-88db-73095eada2d6 for instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 on n-h1-848886-16 Jul 26 04:52:44.945870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a34c45d7-0b01-4e78-a777-741262c903d8 req-ddd52f3d-2c02-4983-9e4b-0c54134ae323 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086454 Jul 26 04:52:44.947958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2587/5238] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 04:52:44.962533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:44.963886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:44.980203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:45.007490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a8e7609-dae2-45a3-9b5f-f1a595560380 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1353 microversion: 2.1 time: 0.208812 Jul 26 04:52:45.018189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:45.018414 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2652/5239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:44 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:45.018553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:45.018553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:45.018553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:45.274771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:45.292503 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a45b20a9-55b9-4445-89f0-d402ecdc296a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1502 microversion: 2.1 time: 0.331501 Jul 26 04:52:45.294368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2588/5240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:44 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:45.523534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:45.527053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:45.558012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:45.558511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:45.566505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:45.567030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:45.623110 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b617cea-71ac-4999-9d18-9700352aea12 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103792 Jul 26 04:52:45.624534 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2653/5241] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:45 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:46.033686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:46.035183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.042803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.043577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.044723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.045458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.124955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:46.138735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0de55ef-9172-41b8-bdd0-e111263f2ffc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.110111 Jul 26 04:52:46.140163 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2589/5242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:46 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:46.317180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:46.318677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.331245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.332006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.333001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.333441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.494447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:46.505642 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-763641ea-ab83-4f18-9ffa-8a656965a1e3 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.193340 Jul 26 04:52:46.506483 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2654/5243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:46 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:46.538008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:46.538742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.546435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.546894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.549074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.550207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.638005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:46.640362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.665135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.665604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.666510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.666958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.735318 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-98367d0d-3cf7-4008-96dd-02d4aa836ca6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102950 Jul 26 04:52:46.751125 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2655/5244] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:46 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:46.862489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:46.875128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2dfcd38-e96b-41d8-8319-3dbf1b0d9ab1 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.344901 Jul 26 04:52:46.876226 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2590/5245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:46 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:46.896709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:46.897528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.906472 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/1de5ad9c-92e4-429a-be3f-59fcd95b0d1a/action HTTP/1.1 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 15 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: {"unpause": {}} Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1de5ad9c-92e4-429a-be3f-59fcd95b0d1a', 'body': {'unpause': {}}} Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:46.911870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 1de5ad9c-92e4-429a-be3f-59fcd95b0d1a could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a5eca22-31d2-44da-a5b6-f12cf5ee47c6 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/1de5ad9c-92e4-429a-be3f-59fcd95b0d1a/action" status: 404 len: 111 microversion: 2.1 time: 0.021810 Jul 26 04:52:46.917776 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2656/5246] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:46 2022] POST /compute/v2.1/servers/1de5ad9c-92e4-429a-be3f-59fcd95b0d1a/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:52:46.927055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:46.928112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:46.936508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.939423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:46.940457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:46.941778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.161954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:47.162711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:47.174207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.179614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.180931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.181585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.220060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:47.228215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:47.235845 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af9e2711-4fbc-4cd7-961e-3023f7b3a7e0 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.311482 Jul 26 04:52:47.238428 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2591/5247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:46 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:47.268201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:47.269998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:47.292475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.293614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.294716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.296413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.343208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:47.356602 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-250e7c28-f07b-4ec0-82b4-a18e4f7e75f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.198582 Jul 26 04:52:47.371078 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2657/5248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:47 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:47.581879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:47.590984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4365e5ef-195a-4f93-89f6-2acce4a6bc17 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.331644 Jul 26 04:52:47.592203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2592/5249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:47 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:47.622611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:47.623181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:47.650563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.651040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.652844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.652844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.737038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'unpause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 15 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: {"unpause": {}} Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: exception: Cannot 'unpause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'unpause': {}}} Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state active. Cannot unpause while the instance is in this state. Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:47.740594 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:47.746960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:47.746960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:47.746960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:47.746960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:47.746960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:47.748998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'unpause' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:47.750140 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7422064d-bcc2-443d-8976-41478af90294 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 145 microversion: 2.1 time: 0.135650 Jul 26 04:52:47.754515 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2658/5250] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:47 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 145 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:52:47.760466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:47.761343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:47.769264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:47.771565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:47.781536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:47.784076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.784788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.785876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.789788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.790096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.790766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.790955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:47.791484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:47.858262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9d677214-bc0b-40a3-916f-bb82fa15e910 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107381 Jul 26 04:52:47.865055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2593/5251] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:47 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:48.046909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:48.057845 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e4c69c7-1673-468a-a717-93cfb4264e9b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.301686 Jul 26 04:52:48.058458 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2659/5252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:47 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:48.081640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:48.082647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.090051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.090989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.091867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.092462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.365419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:48.375262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30a648d5-4957-4724-846f-e5d08a06ae70 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.298557 Jul 26 04:52:48.376220 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2594/5253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:48 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:48.391906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:48.392803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.403355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:48.403620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.403882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.404567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af743df1-cfae-4b84-919d-7e0fb8991d11] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.404821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.405217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.417576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/af743df1-cfae-4b84-919d-7e0fb8991d11/action HTTP/1.1 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 18 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: {"unshelve": null} Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'af743df1-cfae-4b84-919d-7e0fb8991d11', 'body': {'unshelve': None}} Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:48.420805 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af743df1-cfae-4b84-919d-7e0fb8991d11 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:48.428702 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c7be4d2-ed56-4ec5-be42-619f2e0eeb31 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/af743df1-cfae-4b84-919d-7e0fb8991d11/action" status: 404 len: 111 microversion: 2.1 time: 0.035626 Jul 26 04:52:48.442571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2595/5254] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:48 2022] POST /compute/v2.1/servers/af743df1-cfae-4b84-919d-7e0fb8991d11/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:52:48.449800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:48.450449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.472241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.472624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.473422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.473866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.532151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:48.546522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5dbdb2fb-12b0-425c-bd41-9af290414416 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.168755 Jul 26 04:52:48.548659 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2660/5255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:48 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:48.707767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:48.716442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9f4c19f2-e945-4e15-957f-2ea4915f9172 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.272103 Jul 26 04:52:48.720509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2596/5256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:48 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:48.742030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:48.742953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.751062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.752001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.753031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.753752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.880979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:48.888588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:48.896965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.897780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.898699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:48.899022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:48.942691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6c48734-cc5c-4dd8-b341-2c5bb49c3206 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074375 Jul 26 04:52:48.945743 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2597/5257] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:48 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:49.064191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:49.077000 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8929cfd5-562e-4c6e-94d0-3d06fecbc105 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.338741 Jul 26 04:52:49.080209 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2661/5258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:48 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:49.100619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:49.101205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.117234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.118996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.120363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.121032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.296836 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Cannot 'unshelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action HTTP/1.1 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 18 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: {"unshelve": null} Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: exception: Cannot 'unshelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'unshelve': None}} Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95225298-e71a-4104-8894-5136c62708ba in vm_state active. Cannot unshelve while the instance is in this state. Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 04:52:49.299835 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active Jul 26 04:52:49.305058 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.308360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 409 to user: Cannot 'unshelve' instance 95225298-e71a-4104-8894-5136c62708ba while it is in vm_state active {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:49.309499 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4460dce1-36ed-4d34-a964-33aaf4a55e64 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action" status: 409 len: 146 microversion: 2.1 time: 0.213094 Jul 26 04:52:49.315211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2598/5259] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:52:49 2022] POST /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba/action => generated 146 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:52:49.321509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.322129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.331531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.331988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.332802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.333303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.534683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:49.548696 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-539a764c-82c6-4e8c-a1d5-f01a12abae1e tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.232969 Jul 26 04:52:49.549762 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2662/5260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:49.572264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.580563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.581800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.584985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.592903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.598013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.598245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.600393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.601075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.602052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.603238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.609619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.789595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:49.804031 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6dc694d7-195b-4134-acb4-fbd1e088f089 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.232683 Jul 26 04:52:49.808541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:49.809786 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2599/5261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:49.836269 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5ee9677-f7ee-424b-abfd-a72513c55f6a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.260957 Jul 26 04:52:49.838734 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2663/5262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:49.859410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-50702492_updated"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:49.862751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 197ab1c8-a235-432d-bb27-6493b45ff8ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.868722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/servers/197ab1c8-a235-432d-bb27-6493b45ff8ec HTTP/1.1 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 79 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-50702492_updated"}} Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '197ab1c8-a235-432d-bb27-6493b45ff8ec', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-50702492_updated'}}} Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 04:52:49.870356 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 197ab1c8-a235-432d-bb27-6493b45ff8ec could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:49.876566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b99581b8-d4c8-4ffd-bc45-4236df61a673 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "PUT /compute/v2.1/servers/197ab1c8-a235-432d-bb27-6493b45ff8ec" status: 404 len: 111 microversion: 2.1 time: 0.016978 Jul 26 04:52:49.881204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.881940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.886614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2600/5263] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:52:49 2022] PUT /compute/v2.1/servers/197ab1c8-a235-432d-bb27-6493b45ff8ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:52:49.889636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.890557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.892319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.892936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.963499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.965713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:49.973000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.973663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:49.974684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:49.975295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.010602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40a01859-e36d-4155-8dbc-6b11de1bed48 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055708 Jul 26 04:52:50.011897 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2601/5264] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:50.204267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:50.217519 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-133e9067-e18b-4231-9767-53ebb6842dee tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.340517 Jul 26 04:52:50.219062 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2664/5265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:50.244094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:50.245258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:50.263763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.264212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.265223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.265854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.466745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:50.477684 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97bdb697-485b-4869-8f4a-0e89150a3839 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.238660 Jul 26 04:52:50.478851 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2602/5266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:50.498680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ac02860-d6e6-479e-aeea-0f13e80f2c3a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ac02860-d6e6-479e-aeea-0f13e80f2c3a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: request: PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba HTTP/1.1 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 280 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.503512 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 04:52:50.507642 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:52:50.511431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ac02860-d6e6-479e-aeea-0f13e80f2c3a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:50.512574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ac02860-d6e6-479e-aeea-0f13e80f2c3a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 400 len: 619 microversion: 2.1 time: 0.017920 Jul 26 04:52:50.520993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2665/5267] 10.222.0.43 () {60 vars in 1257 bytes} [Tue Jul 26 04:52:50 2022] PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:52:50.523209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:50.524219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:50.530880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.532315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.533460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.534106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.818621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:50.830972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:50.831702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:50.852796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.857878 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16eb60c2-765b-4dd2-93b8-d22e7d6ad5fb tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.330898 Jul 26 04:52:50.868323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.870606 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2603/5268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:50.873849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.873849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.891906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:50.892909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:50.907907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.913833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:50.915240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:50.915759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:51.140332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:51.150030 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d10418a6-a7ab-4379-bbc2-7b1bda310257 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.270866 Jul 26 04:52:51.163720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2604/5269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:50 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:51.181320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:51.184444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:51.197121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:51.197724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:51.198899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:51.199584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:51.245822 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26ad34c2-e3e0-4f9e-bd0e-c1fa83281fae tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080299 Jul 26 04:52:51.251506 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2605/5270] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:51 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:51.256701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e2aa5ab-1b53-443d-9fd8-3677a2374cf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e2aa5ab-1b53-443d-9fd8-3677a2374cf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: request: PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba HTTP/1.1 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 24 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: {"server": {"name": ""}} Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba', 'body': {'server': {'name': ''}}} Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:52:51.260888 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 04:52:51.266863 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:52:51.271138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e2aa5ab-1b53-443d-9fd8-3677a2374cf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:52:51.272860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e2aa5ab-1b53-443d-9fd8-3677a2374cf2 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 400 len: 108 microversion: 2.1 time: 0.019668 Jul 26 04:52:51.273695 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2606/5271] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 04:52:51 2022] PUT /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:52:51.285266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:51.286206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:51.296118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:51.297065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:51.298449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:51.299131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:51.466306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:51.470459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:51.479612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8429e4b-dc87-4b34-9d88-aa2ed7de9104 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.653353 Jul 26 04:52:51.480510 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2666/5272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:50 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:51.509924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:51.522574 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-303bfb69-37c9-4d66-9700-487a37e3dde9 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1505 microversion: 2.1 time: 0.243906 Jul 26 04:52:51.523350 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2607/5273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:51 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:52.262007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:52.266088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:52.289295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:52.292439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:52.293384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:52.296224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:52.366538 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9a3f035-c117-4086-915f-74561f96e6aa tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111527 Jul 26 04:52:52.373920 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2667/5274] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:52 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:52.503197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:52.504080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:52.525500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:52.526288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:52.527260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:52.527902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:52.660513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:52.670958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd87d822-93fe-4884-af45-c35308ff3574 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.172756 Jul 26 04:52:52.672467 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2608/5275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:52 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:53.382071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:53.385254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:53.393998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:53.394830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:53.396188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:53.397737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:53.435362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0731053-7353-4b1e-8f53-ef67c35406d9 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057204 Jul 26 04:52:53.436531 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2668/5276] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:53 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:53.693783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:53.694414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:53.717381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:53.718128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:53.721373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:53.725103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:53.975019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:53.984653 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f198659-7b20-41b7-98d2-e1c2541ebd76 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.294855 Jul 26 04:52:53.986063 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2609/5277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:53 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:54.450051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:54.453176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:54.468691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.471413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:54.473185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.475000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:54.593087 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9ea892f-fc26-449a-ba18-79d23476dcf4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148048 Jul 26 04:52:54.594268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2669/5278] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:52:54 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:52:54.685408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:54.686382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:54.694956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.696221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:54.697469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.698198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:54.733203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:52:54.794205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:54.866637 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50e9e68f-76b7-46b0-b5b2-dfbd69529448 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 204 len: 0 microversion: 2.1 time: 0.183953 Jul 26 04:52:54.867751 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2610/5279] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:52:54 2022] DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:52:54.876298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:54.877193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:54.884381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.885065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:54.886203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:54.886930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:55.011876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:55.014101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:55.024793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:55.025647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:55.026858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:55.027472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:55.135670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:55.147509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22431eac-364a-43e7-8c95-7cd5ee774090 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.140790 Jul 26 04:52:55.148640 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2611/5280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:55 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:55.217546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:55.227636 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-abf99a23-7439-44bd-a4b1-989e8d1c874b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1682 microversion: 2.1 time: 0.355822 Jul 26 04:52:55.232973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2670/5281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:54 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:56.170184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:56.170975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:56.184955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:56.187547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:56.190282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:56.190744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:56.255437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:56.256660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:56.280109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:56.280573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:56.282196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:56.282614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:56.493506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:56.507076 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a414b0d1-c459-4f56-b329-e9bab91bbe01 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.338466 Jul 26 04:52:56.510058 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2612/5282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:56 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:57.026073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:57.042187 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c6522ec-e61b-45bd-85bd-de16fe31cb84 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1682 microversion: 2.1 time: 0.790813 Jul 26 04:52:57.060258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2671/5283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:56 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1682 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:57.553669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:57.555358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:57.581229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:57.585557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:57.592026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:57.596757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:57.917100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:57.931050 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d87211a5-3941-4e00-aa27-b5c8d96e1bf7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.388702 Jul 26 04:52:57.933155 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2613/5284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:57 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:58.066507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:58.067121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:58.083026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:58.083752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:58.085405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:58.088723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:58.430530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:58.449204 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e091035f-b6fe-428b-9acc-d294c065d031 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1615 microversion: 2.1 time: 0.383872 Jul 26 04:52:58.450677 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2672/5285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:58 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1615 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:58.958547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:58.960114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:58.983398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:58.992716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:58.996473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:58.998904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:59.070684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e8f716d7-3e7f-4c1a-a9dc-67be6f7bbfb2 req-1772905f-4085-4e3d-a1b4-5206e45d9638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea37c0c6-911a-4726-ae3a-2b6b55b4a019", "name": "network-vif-deleted", "tag": "f154b19f-132d-4ffe-a1ae-5fe572dd937b"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:59.095388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e8f716d7-3e7f-4c1a-a9dc-67be6f7bbfb2 req-1772905f-4085-4e3d-a1b4-5206e45d9638 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:59.096468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e8f716d7-3e7f-4c1a-a9dc-67be6f7bbfb2 req-1772905f-4085-4e3d-a1b4-5206e45d9638 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:59.127768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e8f716d7-3e7f-4c1a-a9dc-67be6f7bbfb2 req-1772905f-4085-4e3d-a1b4-5206e45d9638 service nova] Creating event network-vif-deleted:f154b19f-132d-4ffe-a1ae-5fe572dd937b for instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 on n-h1-848886-16 Jul 26 04:52:59.141186 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e8f716d7-3e7f-4c1a-a9dc-67be6f7bbfb2 req-1772905f-4085-4e3d-a1b4-5206e45d9638 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082994 Jul 26 04:52:59.146488 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2673/5286] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:59.419459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:59.437185 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6740431-60cd-4956-8402-bc831f75c70a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.486897 Jul 26 04:52:59.443968 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2614/5287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:58 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:59.492894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:59.493603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:52:59.541098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:59.544837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:59.545689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:59.553495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:59.661590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:52:59.662344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:52:59.663011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lazy-loading 'fault' on Instance uuid ea37c0c6-911a-4726-ae3a-2b6b55b4a019 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:52:59.717580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:52:59.736921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b30d518-ed62-49d6-b2f7-6bef3b01c93e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 200 len: 1331 microversion: 2.1 time: 0.252055 Jul 26 04:52:59.739838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2674/5288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:52:59 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 1331 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:00.466250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:00.467477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:00.490887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:00.494826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:00.496533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:00.497292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:00.648576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:00.658477 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aaea20fd-f675-4935-a279-c385b5236343 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.196937 Jul 26 04:53:00.659084 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2615/5289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:00 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:00.766186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:00.767678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:00.791300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:00.793906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:00.795132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:00.797271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:00.863114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 HTTP/1.1 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ea37c0c6-911a-4726-ae3a-2b6b55b4a019'} Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:00.872491 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:00.878969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:00.894260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88697d9d-6c10-4acf-9046-c7f7388d6b1d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 404 len: 111 microversion: 2.1 time: 0.117866 Jul 26 04:53:00.895017 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2675/5290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:00 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:00.903384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e236830-8f4a-4645-b666-dd56360e30e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '.version_select at 0x7f38b4990d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:00.949780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e236830-8f4a-4645-b666-dd56360e30e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802385811" status: 202 len: 0 microversion: 2.1 time: 0.048773 Jul 26 04:53:00.963795 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2616/5291] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 04:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802385811 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:53:01.679842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:01.680745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:01.695312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:01.696041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:01.697042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:01.697662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:01.891125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:01.918845 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b57cb943-9989-4590-8bf0-56f48cf63c20 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 200 len: 1187 microversion: 2.1 time: 0.229978 Jul 26 04:53:01.919875 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2676/5292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:01 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 1187 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:02.254018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ca1d6f8-d082-422d-bc8e-1ee14a188a29 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: .version_select at 0x7f38b4828c10>, body: {"keypair": {"name": "tempest-keypair-220355030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNgClUxevhvZVS0t9Rz27dbZeHupSYLqrOHODZaxgzrdlpvIZiJfEF2VqgAEBOtgDmhOnYD3SOzplRcB3JcQrAgznpBOs77itdSqgR5hvAK6MqZO7aKMkc3Fgip9frNAw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:02.297735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7ca1d6f8-d082-422d-bc8e-1ee14a188a29 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:53:02.303572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7ca1d6f8-d082-422d-bc8e-1ee14a188a29 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:53:02.353577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ca1d6f8-d082-422d-bc8e-1ee14a188a29 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105510 Jul 26 04:53:02.363224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2617/5293] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:53:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:02.945143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:02.945921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:02.967049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:02.969132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:02.970186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:02.971976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:03.008865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 HTTP/1.1 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2'} Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:03.010838 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:03.017495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e8e74010-f07b-43d9-bf3c-cdc9f4912b12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2" status: 404 len: 111 microversion: 2.1 time: 0.076302 Jul 26 04:53:03.019144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2677/5294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:02 2022] GET /compute/v2.1/servers/9b5b0f40-f7c1-417d-8fdb-0e22f13c9cb2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:04.307268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:04.308634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:04.317470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.323792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.324695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.329275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 HTTP/1.1 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'af069b5f-2bd5-4bec-963a-1c8bfbd45753'} Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:04.362444 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:04.368200 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-06bdc8a2-dcc1-4a4b-a548-c559e0e6dc8a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 404 len: 111 microversion: 2.1 time: 0.058503 Jul 26 04:53:04.370344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:04.371040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: af069b5f-2bd5-4bec-963a-1c8bfbd45753] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:04.378110 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2618/5295] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:53:04 2022] DELETE /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:04.391500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.393173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.396741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.397475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.418759 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 HTTP/1.1 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'af069b5f-2bd5-4bec-963a-1c8bfbd45753'} Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:04.420995 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance af069b5f-2bd5-4bec-963a-1c8bfbd45753 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:04.426657 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ac288405-418c-463f-a3ff-4d122d045a76 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753" status: 404 len: 111 microversion: 2.1 time: 0.057156 Jul 26 04:53:04.435655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:04.436371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:04.442898 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2678/5296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:04 2022] GET /compute/v2.1/servers/af069b5f-2bd5-4bec-963a-1c8bfbd45753 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:04.446623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.447443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.448828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.449455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.497337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:53:04.638777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-957fb2e7-7bfd-458a-a6da-6082c6a99743 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 204 len: 0 microversion: 2.1 time: 0.208598 Jul 26 04:53:04.640681 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2619/5297] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:53:04 2022] DELETE /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:53:04.651273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:04.651896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:04.667681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.669744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:04.673375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:04.674955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:05.291574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:05.299854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95782067-4be4-41cf-a535-cf5a89b29e1b tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.654771 Jul 26 04:53:05.313455 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2679/5298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:04 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:06.327018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:06.330949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:06.344704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:06.345548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:06.347695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:06.348316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:06.425125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2038180750", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb5d3d-bcd3-424d-b89b-f73e7e58dea5"}], "security_groups": [{"name": "tempest-securitygroup--1061822701"}], "key_name": "tempest-keypair-220355030", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:06.561629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:06.569905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2128d528-44c0-46cd-b9c3-b0bb83432f92 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1511 microversion: 2.1 time: 0.247687 Jul 26 04:53:06.574977 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2620/5299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:06 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:06.633384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] validate_networks() for [('79bb5d3d-bcd3-424d-b89b-f73e7e58dea5', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:53:07.370970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:53:07.371504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:53:07.372062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:53:07.372555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:53:07.373051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:53:07.394862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:07.395421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:07.401505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:07.401990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:07.456224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:53:07.475094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:53:07.508247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:53:07.510634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:53:07.594291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:07.596219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:07.608988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:07.610659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:07.622188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:07.622672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:07.676095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd5e522d-8a52-463d-8a47-45e81dcf9988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.256998 Jul 26 04:53:07.677089 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2680/5300] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:53:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:53:07.688257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1c8aa2e-e824-4d7f-a3aa-ec1365d24a11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:07.698645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1c8aa2e-e824-4d7f-a3aa-ec1365d24a11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:07.887776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f1c8aa2e-e824-4d7f-a3aa-ec1365d24a11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:07.896557 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1c8aa2e-e824-4d7f-a3aa-ec1365d24a11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1241 microversion: 2.1 time: 0.212676 Jul 26 04:53:07.915646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2681/5301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:07 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:07.949725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe0903ebc284c97985e822236e1aff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418dea0a66ac4e1dacc0ecbaf980d228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:08.015031 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ddec622-0160-426b-af20-e92afd2cb89a tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 200 len: 1469 microversion: 2.1 time: 0.425601 Jul 26 04:53:08.021715 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2621/5302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:07 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:08.311951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4feb6683-c9d1-4622-a6c5-488f1d0bfd86 req-abff4333-e1da-4740-bc75-a0c2af9dee5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95225298-e71a-4104-8894-5136c62708ba", "name": "network-vif-deleted", "tag": "d5cd5219-bdc6-4604-8f82-8e32206cde7c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:08.325030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4feb6683-c9d1-4622-a6c5-488f1d0bfd86 req-abff4333-e1da-4740-bc75-a0c2af9dee5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:08.325737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4feb6683-c9d1-4622-a6c5-488f1d0bfd86 req-abff4333-e1da-4740-bc75-a0c2af9dee5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:08.344046 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4feb6683-c9d1-4622-a6c5-488f1d0bfd86 req-abff4333-e1da-4740-bc75-a0c2af9dee5e service nova] Creating event network-vif-deleted:d5cd5219-bdc6-4604-8f82-8e32206cde7c for instance 95225298-e71a-4104-8894-5136c62708ba on n-h2-848886-16 Jul 26 04:53:08.352798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4feb6683-c9d1-4622-a6c5-488f1d0bfd86 req-abff4333-e1da-4740-bc75-a0c2af9dee5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.435098 Jul 26 04:53:08.354477 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2682/5303] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:08.941861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:08.942544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:08.975081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:08.975796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:08.980541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:08.981188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:09.054683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:09.055423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] [instance: 95225298-e71a-4104-8894-5136c62708ba] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:09.078715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:09.079654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:09.080901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:09.084521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:09.106880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] HTTP exception thrown: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Request method failure captured: Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba HTTP/1.1 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Iz6lkK7MYODKsUAbzA-vPEab6vc9pBXiEbNJyFZ3ivl_ISbacPYwbCyxjwz45PTPJyJ0cEYwgLTz0eW8ILWtrrWqICb932tR693HutAyrFY48mwQRw4n9lUmPjxGVHau_e5bbabJ4YpQa7aEg0U_4dgn-wHzXG-x7YDmkNR8wSbIg Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_418dea0a66ac4e1dacc0ecbaf980d228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 418dea0a66ac4e1dacc0ecbaf980d228 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1863409595 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1fe0903ebc284c97985e822236e1aff2 Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1863409595-project Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '95225298-e71a-4104-8894-5136c62708ba'} Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:09.109191 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. Jul 26 04:53:09.116857 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:09.125771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] Returning 404 to user: Instance 95225298-e71a-4104-8894-5136c62708ba could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:09.128374 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c8c7c0b-704e-4120-a226-283cf56d5956 tempest-ServersNegativeTestJSON-1863409595 tempest-ServersNegativeTestJSON-1863409595-project] 10.222.0.43 "GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba" status: 404 len: 111 microversion: 2.1 time: 0.087074 Jul 26 04:53:09.129430 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2683/5304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:09 2022] GET /compute/v2.1/servers/95225298-e71a-4104-8894-5136c62708ba => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:09.298937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:09.308584 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4ef9f37-0549-4d34-bc29-e8e591af38d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1245 microversion: 2.1 time: 0.388353 Jul 26 04:53:09.314110 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2622/5305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:08 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1245 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:10.338917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:10.340153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:10.353344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:10.354071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:10.355985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:10.357928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:10.680700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:10.696064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37921359-66f3-4d01-9ecf-335a9c2cbf59 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1299 microversion: 2.1 time: 0.360927 Jul 26 04:53:10.725883 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2684/5306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:10 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1299 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:11.720103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:11.720733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:11.736866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:11.757702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:11.759101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:11.760394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:11.955924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:11.973673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d6dae10-ecc1-4924-a2db-865d4612bbfe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1299 microversion: 2.1 time: 0.257804 Jul 26 04:53:11.974567 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2623/5307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:11 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:12.995720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:12.996555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:13.004486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.005431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.005748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.006191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.081371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:13.081997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:13.090465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:13.102708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.105430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.106450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.107415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.640241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:13.652467 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ea08659-1523-469b-b64a-1258cffad94a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.575716 Jul 26 04:53:13.653541 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2624/5308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:13 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:13.674974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:13.675600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:13.692349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.692813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.693635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:13.694093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:13.976156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:14.004878 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90f7affd-7c93-4724-bb66-6a6810df0066 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 1.010108 Jul 26 04:53:14.006509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2685/5309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:12 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:14.012342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:14.026032 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15830a38-100e-4833-abdd-e3b0e1ee4a73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.355299 Jul 26 04:53:14.027560 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2625/5310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:13 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:14.052496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:14.053272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:14.059649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:14.074272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:14.074745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:14.075578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:14.080294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:14.403671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-581358398", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7060cafc-7875-44e2-bd26-cbd8cf0eee6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:14.486840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:53:14.709477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:14.728954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b71c489-d37c-4ff2-9c8c-994c5149a152 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.683022 Jul 26 04:53:14.729845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2686/5311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:14 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:14.752522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-463935927"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:14.755415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:14.774173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:14.775067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:14.776114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:14.776788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:15.035328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:15.076162 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8696319e-eb85-431d-9664-64ab14f0f99c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.327581 Jul 26 04:53:15.079915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2687/5312] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:53:14 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 04:53:15.089487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:15.096242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:15.135709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:15.136179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:15.145924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:15.149233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:15.529294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:53:15.534015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:53:15.536861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:53:15.537486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:53:15.538088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:53:15.568994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:15.569677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:15.570730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:15.571348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:15.592304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:53:15.601858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:53:15.751715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:53:15.753704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7060cafc-7875-44e2-bd26-cbd8cf0eee6b',volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:53:15.987931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:16.043552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16421808-2710-44d0-96cb-bef82ec3da9e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644691 Jul 26 04:53:16.045051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2626/5313] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:53:16.053096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:16.056968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f2a213d-4cd2-497d-913d-3c7eca3e1b64 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:16.057805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f2a213d-4cd2-497d-913d-3c7eca3e1b64 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:16.084805 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de53527d-7279-4216-ab96-4f890e511e5b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 1.003352 Jul 26 04:53:16.085401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2688/5314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:15 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:16.175731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f2a213d-4cd2-497d-913d-3c7eca3e1b64 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:16.182815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f2a213d-4cd2-497d-913d-3c7eca3e1b64 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1056 microversion: 2.1 time: 0.130398 Jul 26 04:53:16.186529 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2627/5315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:16 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1056 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:16.585054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9f8d744e-c8ff-4298-aec1-ec8974ffb706 req-b47b5b7d-4bb5-48c4-bfd9-3af1fffff002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b02c4a8-d8cb-47b8-a296-4489c3aba916", "tag": "496fd154-78b6-433e-b972-7279dd0b0ec4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:16.633786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9f8d744e-c8ff-4298-aec1-ec8974ffb706 req-b47b5b7d-4bb5-48c4-bfd9-3af1fffff002 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:16.635447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9f8d744e-c8ff-4298-aec1-ec8974ffb706 req-b47b5b7d-4bb5-48c4-bfd9-3af1fffff002 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:16.683259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9f8d744e-c8ff-4298-aec1-ec8974ffb706 req-b47b5b7d-4bb5-48c4-bfd9-3af1fffff002 service nova] Creating event network-changed:496fd154-78b6-433e-b972-7279dd0b0ec4 for instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 on n-h1-848886-16 Jul 26 04:53:16.706616 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9f8d744e-c8ff-4298-aec1-ec8974ffb706 req-b47b5b7d-4bb5-48c4-bfd9-3af1fffff002 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130185 Jul 26 04:53:16.709192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2689/5316] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:53:17.114587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:17.118068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:17.130989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:17.131424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:17.132853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:17.133721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:17.211598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:17.212225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:17.248429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:17.251032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:17.252385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:17.254278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:17.414051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:17.509325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:17.520950 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0cbb4146-653b-4a54-a3f8-bd1209e0053c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1106 microversion: 2.1 time: 0.315242 Jul 26 04:53:17.524663 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2690/5317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:17 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1106 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:17.605702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:17.629460 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb0087f8-f470-4595-89dd-b8b5fe5ac350 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.521623 Jul 26 04:53:17.644405 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2628/5318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:17 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:18.545666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:18.547551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:18.556098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:18.569275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:18.569753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:18.570615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:18.577053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:18.652311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:18.652934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:18.664455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:18.671856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:18.673033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:18.673720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:18.697362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:18.883295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:18.903339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c61a24e-f606-4929-81bc-da4016ce1e86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1162 microversion: 2.1 time: 0.361830 Jul 26 04:53:18.904021 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2691/5319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:18 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1162 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:19.169028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:19.202064 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-70f55c5f-841c-4e1f-acd5-6f919aa0b409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.553662 Jul 26 04:53:19.210202 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2629/5320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:18 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:19.932738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:19.934758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:19.952001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:19.953959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:19.957672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:19.958991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:20.235376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:20.235873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:20.252591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:20.253430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:20.259513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:20.260196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:20.477454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:20.488407 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29c2b5a1-e591-4815-8796-bdc61a96202e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1172 microversion: 2.1 time: 0.561178 Jul 26 04:53:20.489001 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2692/5321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:19 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1172 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:21.035082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:21.056278 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-044a7146-72fe-40a5-af1d-9b07a4781fcf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.825029 Jul 26 04:53:21.070288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2630/5322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:20 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:21.518642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:21.519280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:21.535224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:21.538720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:21.539551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:21.540002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:22.096353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:22.097445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:22.131849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:22.132550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:22.133135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:22.138523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:22.143467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a997d044-2af9-4484-b7b5-d3a29659acd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.630446 Jul 26 04:53:22.145571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:22.166579 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2693/5323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:21 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:22.722801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:22.742100 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba22300d-7cd7-49af-ad38-731c81b1b4bf tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.649987 Jul 26 04:53:22.744554 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2631/5324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:22 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:23.140450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-47b0df51-c972-4516-b10a-7990cd5c5f68 req-e73ea68d-be64-475c-8598-862bb55d9a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-plugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:23.162209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-47b0df51-c972-4516-b10a-7990cd5c5f68 req-e73ea68d-be64-475c-8598-862bb55d9a6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:23.163200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-47b0df51-c972-4516-b10a-7990cd5c5f68 req-e73ea68d-be64-475c-8598-862bb55d9a6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:23.184926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:23.186303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:23.204911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:23.223459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:23.226342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:23.229507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:23.260117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-47b0df51-c972-4516-b10a-7990cd5c5f68 req-e73ea68d-be64-475c-8598-862bb55d9a6d service nova] Creating event network-vif-plugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:53:23.285549 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-47b0df51-c972-4516-b10a-7990cd5c5f68 req-e73ea68d-be64-475c-8598-862bb55d9a6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147832 Jul 26 04:53:23.286785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2694/5325] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:23.769691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:23.770451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:23.790330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:23.790847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:23.791688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:23.792143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:23.844899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:23.857975 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2dd8e4ac-9d24-4c06-9e01-9b77e9b919ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.687256 Jul 26 04:53:23.884459 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2632/5326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:23 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:24.042951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aa6e1e61-c2c6-47a8-bca4-1f691a98fa32 req-9090f06a-d217-4d97-a465-4ea82aef6f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529d232f-04ed-4582-a39b-65679a66144c", "tag": "3dae0126-378e-4c9d-ab05-b33d17c92857"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:24.078747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aa6e1e61-c2c6-47a8-bca4-1f691a98fa32 req-9090f06a-d217-4d97-a465-4ea82aef6f0a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:24.079362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aa6e1e61-c2c6-47a8-bca4-1f691a98fa32 req-9090f06a-d217-4d97-a465-4ea82aef6f0a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:24.107421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aa6e1e61-c2c6-47a8-bca4-1f691a98fa32 req-9090f06a-d217-4d97-a465-4ea82aef6f0a service nova] Creating event network-changed:3dae0126-378e-4c9d-ab05-b33d17c92857 for instance 529d232f-04ed-4582-a39b-65679a66144c on n-h2-848886-16 Jul 26 04:53:24.127972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aa6e1e61-c2c6-47a8-bca4-1f691a98fa32 req-9090f06a-d217-4d97-a465-4ea82aef6f0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089988 Jul 26 04:53:24.135312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2633/5327] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:53:24.207248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:24.220650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-639f30f9-200f-4c6a-93a3-a61ad4b38b86 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.458755 Jul 26 04:53:24.221242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2695/5328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:23 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:24.901400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:24.902126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:24.926031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:24.926509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:24.934306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:24.935032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:25.241245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:25.242456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:25.252871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:25.253564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:25.254565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:25.255168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:25.585840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:25.660752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:25.691871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:25.697735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b931e848-fb49-43ac-8e34-42fd1f8e396c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 0.443115 Jul 26 04:53:25.715392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2696/5329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:25 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:25.715498 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-027ffe2b-0d08-4a06-91e5-324b824570bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.817078 Jul 26 04:53:25.715498 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2634/5330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:24 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:25.716208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8ebf25c7-97ce-40aa-bf64-2bbe7949133c req-cd3247e1-d252-4e53-8782-0d844b7e236b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b02c4a8-d8cb-47b8-a296-4489c3aba916", "name": "network-vif-plugged", "status": "completed", "tag": "496fd154-78b6-433e-b972-7279dd0b0ec4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:25.765230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8ebf25c7-97ce-40aa-bf64-2bbe7949133c req-cd3247e1-d252-4e53-8782-0d844b7e236b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:25.766496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8ebf25c7-97ce-40aa-bf64-2bbe7949133c req-cd3247e1-d252-4e53-8782-0d844b7e236b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:25.795930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8ebf25c7-97ce-40aa-bf64-2bbe7949133c req-cd3247e1-d252-4e53-8782-0d844b7e236b service nova] Creating event network-vif-plugged:496fd154-78b6-433e-b972-7279dd0b0ec4 for instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 on n-h1-848886-16 Jul 26 04:53:25.810642 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8ebf25c7-97ce-40aa-bf64-2bbe7949133c req-cd3247e1-d252-4e53-8782-0d844b7e236b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100370 Jul 26 04:53:25.811268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2697/5331] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:26.724407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:26.726336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:26.735438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:26.736126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:26.737006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:26.739670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:26.740429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:26.741674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:26.742560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:26.759005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:26.776293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:26.777349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:26.777685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:27.170436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:27.181980 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4efb5879-b4e8-4071-9c65-d438055e0b4c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.449697 Jul 26 04:53:27.187487 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2698/5332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:26 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:27.789876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:27.802914 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e36c5090-d82f-4183-8dc6-e55bd6a21b2b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1367 microversion: 2.1 time: 1.083436 Jul 26 04:53:27.803878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2635/5333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:26 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1367 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:28.211468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:28.212591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:28.224736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:28.225188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:28.226042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:28.230539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:28.767951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:28.788624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1759954f-a97c-42b0-84eb-bde9a900a563 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.581989 Jul 26 04:53:28.809806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2699/5334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:28 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:28.823465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:28.824849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:28.865886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:28.866357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:28.867134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:28.867571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:29.226438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:29.234313 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e178df3-3e7f-40fd-a1ba-870f381ec82a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1557 microversion: 2.1 time: 0.414656 Jul 26 04:53:29.241176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2636/5335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:28 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:29.263863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:29.265012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:29.283773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:29.284360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:29.285170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:29.285647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:29.612348 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-37c4ea9c-2cdc-4d33-823a-09af0faae237 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.354398 Jul 26 04:53:29.613490 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2700/5336] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:53:29 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:29.817709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:29.818655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:29.834901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:29.838145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:29.842239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:29.844726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.114647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:30.115763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:30.134242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.134719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.136817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.142412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.282338 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e7ac5dea-8522-4059-a34c-40693f493510 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments/8b16eb34-7372-4e28-8ed5-d2cec731d5d4" status: 200 len: 194 microversion: 2.20 time: 0.924545 Jul 26 04:53:30.293114 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2637/5337] 10.222.0.43 () {60 vars in 1454 bytes} [Tue Jul 26 04:53:29 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments/8b16eb34-7372-4e28-8ed5-d2cec731d5d4 => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:30.331867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:30.356910 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-19012f93-91aa-40b9-9934-c9a88f68d4e2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.543672 Jul 26 04:53:30.360533 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2701/5338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:29 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:30.463273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:30.463770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:30.473183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.480572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.488052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.488732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.699079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lazy-loading 'services' on Instance uuid b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:53:30.911369 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef949a99-0719-4883-85d4-39e6f4e85406 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments/8b16eb34-7372-4e28-8ed5-d2cec731d5d4" status: 202 len: 0 microversion: 2.20 time: 0.452450 Jul 26 04:53:30.912422 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2638/5339] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Jul 26 04:53:30 2022] DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments/8b16eb34-7372-4e28-8ed5-d2cec731d5d4 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 04:53:30.925463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:30.927970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:30.940034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.957024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:30.958837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:30.961647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:31.090331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09078137-e373-47d6-a78a-0d44cb49fda8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171209 Jul 26 04:53:31.096774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2702/5340] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:30 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:53:31.390707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:31.392151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:31.400932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:31.402534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:31.404676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:31.405486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:31.880930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:31.893364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39a14495-cc5d-41f1-9910-b93a7a1a6055 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1214 microversion: 2.1 time: 0.512292 Jul 26 04:53:31.896026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2639/5341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:31 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1214 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:32.110944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:32.113257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:32.131528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:32.141445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:32.143296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:32.145457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:32.305472 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3426f1cb-0b70-4ed4-bd1e-a0fc602e328c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196759 Jul 26 04:53:32.307470 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2703/5342] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:32 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:32.577856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-75545aa3-8979-491f-ac0e-e1bdc4693893 req-3f5c70f0-3c20-4fda-ab1a-2d2c03600948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b02c4a8-d8cb-47b8-a296-4489c3aba916", "tag": "496fd154-78b6-433e-b972-7279dd0b0ec4"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:32.593441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-75545aa3-8979-491f-ac0e-e1bdc4693893 req-3f5c70f0-3c20-4fda-ab1a-2d2c03600948 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:32.594296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-75545aa3-8979-491f-ac0e-e1bdc4693893 req-3f5c70f0-3c20-4fda-ab1a-2d2c03600948 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:32.625655 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-75545aa3-8979-491f-ac0e-e1bdc4693893 req-3f5c70f0-3c20-4fda-ab1a-2d2c03600948 service nova] Creating event network-changed:496fd154-78b6-433e-b972-7279dd0b0ec4 for instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 on n-h1-848886-16 Jul 26 04:53:32.626484 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-75545aa3-8979-491f-ac0e-e1bdc4693893 req-3f5c70f0-3c20-4fda-ab1a-2d2c03600948 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054853 Jul 26 04:53:32.627112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2640/5343] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:32.937449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:32.938841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:32.947205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:32.948004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:32.949011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:32.949668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:33.320578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:33.324789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:33.344748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:33.345289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:33.346124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:33.346601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:33.473571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9a93818-f3de-4b9d-b077-cb6fef873528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157323 Jul 26 04:53:33.485722 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2641/5344] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:33 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:53:34.033843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:34.048650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9186df7a-f8e0-451b-9269-774fad1d8b93 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 1.135232 Jul 26 04:53:34.063280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2704/5345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:32 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:34.485882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:34.488635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:34.501897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:34.502425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:34.517510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:34.518127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:34.670588 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-af03727f-aee0-4a3f-8452-6e8bb2c62d4d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189398 Jul 26 04:53:34.687032 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2642/5346] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:34 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:35.083311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:35.083951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:35.110320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:35.113559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:35.117346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:35.119838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:35.693096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:35.695585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:35.714223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:35.723802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:35.724657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:35.725120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:35.885008 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7628cc32-e486-4816-a2ec-4d4436cc34ba tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.195820 Jul 26 04:53:35.892383 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2643/5347] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:35 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:36.425970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:36.435268 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44c49b14-2067-4b1e-bb54-5eb95edec52e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 1.364500 Jul 26 04:53:36.435914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2705/5348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:35 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:36.898909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:36.901388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:36.918485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:36.918952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:36.919749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:36.920220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:37.044130 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a0639f11-7f27-4d24-a3a1-97ec13c31d1d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149941 Jul 26 04:53:37.049144 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2644/5349] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:36 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:37.461975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:37.463314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:37.477670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:37.478167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:37.479609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:37.480200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:37.541586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:37.935578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:37.970304 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f80e129a-2cc5-4d5e-9f30-fcf99922de94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.514300 Jul 26 04:53:37.979063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2706/5350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:37 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:38.061691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:38.063915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:38.073563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:38.074021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:38.075114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:38.075710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:38.112983 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e37f18fd-e224-42c8-813e-7413d017c8a7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056964 Jul 26 04:53:38.114230 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2645/5351] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:38 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:39.003936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:39.005296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:39.022540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:39.024519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:39.028942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:39.031006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:39.125369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:39.128569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:39.149543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:39.168591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:39.169623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:39.171304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:39.305729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:39.323094 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a754296d-3a31-4aa4-8185-97f901e1c13a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201896 Jul 26 04:53:39.344690 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2646/5352] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:39 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:39.368510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:39.385525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-176cafe8-3e0d-4ff5-afde-2e48a1a220f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.387248 Jul 26 04:53:39.386187 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2707/5353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:38 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:40.347297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:40.349596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:40.382961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:40.383425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:40.386514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:40.387012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:40.410142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:40.410781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:40.447435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:40.448072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:40.454372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:40.454846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:40.498093 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2067fce4-1e43-49e9-9b24-6d856ad10b15 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.154848 Jul 26 04:53:40.503510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2647/5354] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:40 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:40.767489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:40.787704 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2970a90-c796-4e23-bdb0-fb7b02cac6b4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.380869 Jul 26 04:53:40.806115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2708/5355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:40 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:41.510971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:41.513468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:41.534554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:41.544194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:41.545915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:41.554210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:41.638424 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c00ad903-f61c-49d2-864a-03150ecf4f50 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129703 Jul 26 04:53:41.643325 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2648/5356] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:41 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:41.820771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:41.821496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:41.843363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:41.843820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:41.847028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:41.849146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:42.369211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:42.383038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2980ff1c-5057-44fb-820a-d073b4d7cb7c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.571828 Jul 26 04:53:42.384669 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2709/5357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:41 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:42.656231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:42.659359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:42.683931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:42.689246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:42.695341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:42.696645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:42.776589 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4fc22d92-0341-45ef-8e0e-1c4bdc4b58d9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.123810 Jul 26 04:53:42.778572 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2649/5358] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:53:42 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:42.912468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:42.912981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:42.929304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:42.929768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:42.932301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:42.937419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.008820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:53:43.346714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c70f6bf-05ef-44a3-adaf-205ec1182b85 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 204 len: 0 microversion: 2.20 time: 0.438831 Jul 26 04:53:43.348562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2710/5359] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:53:42 2022] DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:53:43.356514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:43.357171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:43.371236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:43.374450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.379667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:43.382038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.411210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:43.412192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:43.444750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:43.449023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.455373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:43.459162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.832518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:43.845598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0b07e1a3-7f45-4210-a7cd-0066d1abd5f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.444172 Jul 26 04:53:43.851686 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2711/5360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:43 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:43.885376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b7769323-8739-4edd-8d59-10cbe18784db req-b7bda5c5-947b-41b6-8f78-ba60676fe55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529d232f-04ed-4582-a39b-65679a66144c", "name": "network-vif-plugged", "status": "completed", "tag": "3dae0126-378e-4c9d-ab05-b33d17c92857"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:43.903024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b7769323-8739-4edd-8d59-10cbe18784db req-b7bda5c5-947b-41b6-8f78-ba60676fe55b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:43.907891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b7769323-8739-4edd-8d59-10cbe18784db req-b7bda5c5-947b-41b6-8f78-ba60676fe55b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:43.943384 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b7769323-8739-4edd-8d59-10cbe18784db req-b7bda5c5-947b-41b6-8f78-ba60676fe55b service nova] Creating event network-vif-plugged:3dae0126-378e-4c9d-ab05-b33d17c92857 for instance 529d232f-04ed-4582-a39b-65679a66144c on n-h2-848886-16 Jul 26 04:53:43.958795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b7769323-8739-4edd-8d59-10cbe18784db req-b7bda5c5-947b-41b6-8f78-ba60676fe55b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092104 Jul 26 04:53:43.960462 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2712/5361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:44.273289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:44.283787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:44.285371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:44.286987 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-063cfccf-55c9-48a2-9e73-a535256eab93 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 0.934381 Jul 26 04:53:44.288433 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2650/5362] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:43 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:44.878026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:44.879548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:44.882267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:44.903158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:44.906893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:44.908083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:44.908750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:45.320270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:45.320897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:45.342419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:45.348284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:45.353052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:45.353535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:45.464438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:45.476824 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-109c4cc8-9c12-4c39-9743-bccc5ad2784b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1202 microversion: 2.1 time: 0.603444 Jul 26 04:53:45.494826 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2713/5363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:44 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1202 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:46.338317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:46.352237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:46.354368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:46.359606 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0578176f-2ed8-43e0-91ca-1c262eab125f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1724 microversion: 2.20 time: 1.045448 Jul 26 04:53:46.375918 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2651/5364] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:45 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1724 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:46.501503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:46.502829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:46.516806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:46.517268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:46.518063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:46.518537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.073210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:47.085334 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-021a5fe5-6cf7-4f79-a677-2edc1dcf2057 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1390 microversion: 2.1 time: 0.587958 Jul 26 04:53:47.085940 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2714/5365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:46 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1390 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:47.114274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:47.115832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:47.126669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=53 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:47.136210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.137205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.140634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.141643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.384260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:47.384968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:47.406032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.406568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.407450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.407905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.643464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:47.664988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:47.666673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:47.674950 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf601fd4-49ca-4fa2-9cc2-0384eabcd747 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 200 len: 1656 microversion: 2.20 time: 0.288588 Jul 26 04:53:47.697676 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2715/5366] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:47 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 1656 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:47.790709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-950cda8c-461f-406a-9fb6-7c58d228629b req-0b7431d3-d13d-4641-aa00-5695d8bc2ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b4dc7-d31c-4f5b-ac74-19367dfe1b58", "name": "network-vif-deleted", "tag": "344efdaf-c136-448e-b3cd-94c8733dc7b7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:47.810503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:47.828669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-950cda8c-461f-406a-9fb6-7c58d228629b req-0b7431d3-d13d-4641-aa00-5695d8bc2ff6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.829201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-950cda8c-461f-406a-9fb6-7c58d228629b req-0b7431d3-d13d-4641-aa00-5695d8bc2ff6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.834935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b117b107-ee7b-4c84-b57b-c9d717442a73 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1390 microversion: 2.1 time: 0.715557 Jul 26 04:53:47.836313 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2652/5367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:47 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1390 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:47.859126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:47.860234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:47.872086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-950cda8c-461f-406a-9fb6-7c58d228629b req-0b7431d3-d13d-4641-aa00-5695d8bc2ff6 service nova] Creating event network-vif-deleted:344efdaf-c136-448e-b3cd-94c8733dc7b7 for instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 on n-h2-848886-16 Jul 26 04:53:47.878447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.879080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.879882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:47.882584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:47.899465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-950cda8c-461f-406a-9fb6-7c58d228629b req-0b7431d3-d13d-4641-aa00-5695d8bc2ff6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107836 Jul 26 04:53:47.900904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2716/5368] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:53:48.106873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:48.118459 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6cc7a5ec-d1e2-4b79-b06f-dfaa664ac763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1390 microversion: 2.1 time: 0.263936 Jul 26 04:53:48.119872 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2653/5369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:47 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:48.145153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:48.145758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:48.168650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.169132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.169989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.170464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.258587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:53:48.533767 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f921d5f-569a-4ff5-9ea9-e9d945dd12bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 204 len: 0 microversion: 2.1 time: 0.393066 Jul 26 04:53:48.535479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2717/5370] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:53:48 2022] DELETE /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:53:48.543582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:48.544209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:48.563433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.563897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.564702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.565152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.707738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:48.708487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:48.744949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.745420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.746289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:48.746720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:48.810218 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 HTTP/1.1 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b50b4dc7-d31c-4f5b-ac74-19367dfe1b58'} Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:48.814883 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:53:48.818704 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:53:48.822968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:48.828929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-069ab906-f265-435f-9b1b-4a68a478068d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 404 len: 111 microversion: 2.20 time: 0.130636 Jul 26 04:53:48.830894 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2718/5371] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:48 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 04:53:48.847961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39a95b5d-2d31-4528-83f1-43b7e609c8ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '.version_select at 0x7f38b604be50>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:48.928065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39a95b5d-2d31-4528-83f1-43b7e609c8ce tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717266050" status: 204 len: 0 microversion: 2.20 time: 0.093130 Jul 26 04:53:48.929329 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2719/5372] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Jul 26 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717266050 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:53:49.090515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:49.103319 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cadc50f-5c7c-44a1-949a-7b63c42ade77 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1396 microversion: 2.1 time: 0.563598 Jul 26 04:53:49.103932 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2654/5373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:48 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1396 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:50.129525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:50.130774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:50.164854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:50.165645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:50.169091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:50.172374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:50.564271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:50.573932 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52583c8d-dfdc-4320-9504-71953e2c45f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1396 microversion: 2.1 time: 0.449383 Jul 26 04:53:50.589830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2720/5374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:50 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1396 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:51.598279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:51.602821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:51.618857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:51.619619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:51.620551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:51.628467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:52.417102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-09f6ef64-dafa-4ff6-939f-a64c193ad9ee req-619dbef7-c3cf-43e9-b307-aa0c21cacf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529d232f-04ed-4582-a39b-65679a66144c", "name": "network-vif-deleted", "tag": "3dae0126-378e-4c9d-ab05-b33d17c92857"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:52.445419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-09f6ef64-dafa-4ff6-939f-a64c193ad9ee req-619dbef7-c3cf-43e9-b307-aa0c21cacf94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:52.454856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-09f6ef64-dafa-4ff6-939f-a64c193ad9ee req-619dbef7-c3cf-43e9-b307-aa0c21cacf94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:52.488159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:52.499591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18ad1f77-8193-4048-ae5c-a1525daa5fe4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1396 microversion: 2.1 time: 0.904010 Jul 26 04:53:52.500518 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-09f6ef64-dafa-4ff6-939f-a64c193ad9ee req-619dbef7-c3cf-43e9-b307-aa0c21cacf94 service nova] Creating event network-vif-deleted:3dae0126-378e-4c9d-ab05-b33d17c92857 for instance 529d232f-04ed-4582-a39b-65679a66144c on n-h2-848886-16 Jul 26 04:53:52.503057 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2655/5375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:51 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1396 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:52.537706 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-09f6ef64-dafa-4ff6-939f-a64c193ad9ee req-619dbef7-c3cf-43e9-b307-aa0c21cacf94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124230 Jul 26 04:53:52.538415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2721/5376] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:53.147513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1331f252-3c18-447f-b4f2-f179dc3a4425 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: .version_select at 0x7f38b489eb80>, body: {"keypair": {"name": "tempest-keypair-659574143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8UKl1Qk+ksTaO5pWzEGmG1qr+jo+tSjv75seusP1eHwdqz/tK7kSf1EmyszkMMJaQ/sTL6/zT0iaeWwPZGdfHb24A2DeMhONAxSBXMGJvW1YCftUksp+wJDqBAj40Gsg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:53.216119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-1331f252-3c18-447f-b4f2-f179dc3a4425 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:53:53.237780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-1331f252-3c18-447f-b4f2-f179dc3a4425 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for user 18807cad26884822b91771a618f32f71 and project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:53:53.317150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1331f252-3c18-447f-b4f2-f179dc3a4425 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.172245 Jul 26 04:53:53.322041 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2656/5377] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Jul 26 04:53:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 04:53:53.525397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:53.526240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:53.553369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:53.554231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:53.555897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:53.561020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:53.776929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:53.791715 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea8c63ab-d123-428e-ab7c-c453fe121354 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.272188 Jul 26 04:53:53.801103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2722/5378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:53 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:54.587626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:54.588931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:54.607775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:54.608555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:54.611168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:54.618266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:54.813846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:54.815103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:54.835706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:54.836305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:54.837146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:54.837598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:54.893343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:55.078628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:55.097058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfb30765-d477-4726-b8bc-362cd4ca5201 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.285723 Jul 26 04:53:55.098006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2723/5379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:54 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:55.473299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:55.503361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-949a31a6-3afd-43ef-b85d-bbe45ece8946 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.917172 Jul 26 04:53:55.511564 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2657/5380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:54 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:56.118776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:56.119399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:56.136475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:56.139636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:56.144438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:56.148168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:56.396234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:56.421025 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7be175f-5c36-4bdb-9b6b-7fef67e33cec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.305952 Jul 26 04:53:56.425083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2724/5381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:56 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:56.527447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:56.528229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:56.543271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:56.544896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:56.547921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:56.548379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:56.734002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1246361532", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21aa032b-39a1-4d25-8a4c-7012c80e3abf"}], "security_groups": [{"name": "tempest-securitygroup--721251495"}], "key_name": "tempest-keypair-659574143", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:56.923471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] validate_networks() for [('21aa032b-39a1-4d25-8a4c-7012c80e3abf', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:53:56.993123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:57.004541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8ed6fd5f-8c90-4389-91ee-c719f43aec8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.481397 Jul 26 04:53:57.008981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2658/5382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:56 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:57.031829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1060335905"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:57.035352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:57.046076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:57.049941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:57.050968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:57.051424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:57.498390 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54edbdb0-0a23-4061-b86d-5b6e1d9850e6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.472426 Jul 26 04:53:57.502975 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2659/5383] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:53:57 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 04:53:57.508288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:57.509004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:57.538497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:57.539306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:57.581296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:57.585367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:57.811492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:57.845878 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a823dc8-7353-483b-81fd-ccc240f28de5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.342880 Jul 26 04:53:57.848839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2660/5384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:57 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:57.977698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:53:57.978791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:53:57.979617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:53:57.980603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:53:57.981320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:53:57.997501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:57.998487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:57.999655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:58.000401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:58.024152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:53:58.032374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Getting quotas for user 18807cad26884822b91771a618f32f71 and project c02c559fd94d4c0ca41c0ae7ee163690. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:53:58.052908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:53:58.056080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:53:58.132452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9822dca7-bebe-42ff-86ef-d43e0f4fe7da tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.400781 Jul 26 04:53:58.134201 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2725/5385] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Jul 26 04:53:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 04:53:58.149069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:58.150794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:58.245978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:58.255604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:58.257333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:58.258691 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce497188-a7bf-453c-b6d0-a500689b0f1e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1281 microversion: 2.20 time: 0.117388 Jul 26 04:53:58.262203 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2661/5386] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:58 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:58.878637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:58.879587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:58.904904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:58.905368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:58.906197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:58.909956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:59.057288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:59.071533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-02640dbc-2f0e-4273-bae1-e9c5d4a6a918 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.199753 Jul 26 04:53:59.077126 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2726/5387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:53:58 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:53:59.277190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3df68a95-19ad-4bdf-895c-d43d61fd220d req-859835c1-0803-4793-a689-e3d8c5ab06e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-unplugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:59.292685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:59.295247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:53:59.321220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:59.322522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:59.323579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:59.324256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:59.334947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3df68a95-19ad-4bdf-895c-d43d61fd220d req-859835c1-0803-4793-a689-e3d8c5ab06e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:53:59.335414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3df68a95-19ad-4bdf-895c-d43d61fd220d req-859835c1-0803-4793-a689-e3d8c5ab06e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:53:59.394882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3df68a95-19ad-4bdf-895c-d43d61fd220d req-859835c1-0803-4793-a689-e3d8c5ab06e2 service nova] Creating event network-vif-unplugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:53:59.403024 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3df68a95-19ad-4bdf-895c-d43d61fd220d req-859835c1-0803-4793-a689-e3d8c5ab06e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130911 Jul 26 04:53:59.407250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2662/5388] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:59.501538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:59.514854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:59.516850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:53:59.518293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e1f3a8d-c9eb-4e14-971f-872664207d68 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1277 microversion: 2.20 time: 0.236087 Jul 26 04:53:59.534245 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2727/5389] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:53:59 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:54:00.103752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:00.104464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:00.112519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:00.113211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:00.114175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:00.114796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:00.198016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:00.213247 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53a89dc5-ed24-4afc-b6ef-c542c6cda40a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 200 len: 1187 microversion: 2.1 time: 0.115550 Jul 26 04:54:00.214320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2663/5390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:00 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:00.548584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:00.551109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:00.561177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:00.561758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:00.562886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:00.563431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:00.772634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:00.797389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:00.800170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:00.801338 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-60b8f7a5-164b-48c0-946e-4f3f5855de92 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1339 microversion: 2.20 time: 0.259230 Jul 26 04:54:00.810829 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2728/5391] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:00 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:01.238785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:01.239815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 529d232f-04ed-4582-a39b-65679a66144c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:01.254355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:01.255112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:01.256600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:01.257274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:01.276526 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c HTTP/1.1 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '529d232f-04ed-4582-a39b-65679a66144c'} Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:01.280293 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. Jul 26 04:54:01.283847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:54:01.285927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 529d232f-04ed-4582-a39b-65679a66144c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:54:01.287282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa9f0d3a-1ad9-4d8a-aff7-00a5ee3a07c4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c" status: 404 len: 111 microversion: 2.1 time: 0.053930 Jul 26 04:54:01.288152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2664/5392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:01 2022] GET /compute/v2.1/servers/529d232f-04ed-4582-a39b-65679a66144c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:54:01.843429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:01.844592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:01.871178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:01.872306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:01.875088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:01.875771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:02.503331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:02.525596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:02.534130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:02.537582 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bcac7480-8d40-4fcd-9a0c-1e9de650c178 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.701547 Jul 26 04:54:02.542183 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2729/5393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:01 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:03.571627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:03.572238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:03.595537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:03.596548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:03.599657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:03.603421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:03.691528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:04.138501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:04.181532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:04.190195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:04.192439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eaf5c2d9-234c-4309-95f7-a473d8a0d5eb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.624832 Jul 26 04:54:04.195884 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2665/5394] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:03 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:04.566008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5a1a32e7-8284-4850-aa56-8c587b2e09a7 req-f95f6849-906c-4e4b-a6ad-ad922b05b456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:04.600275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5a1a32e7-8284-4850-aa56-8c587b2e09a7 req-f95f6849-906c-4e4b-a6ad-ad922b05b456 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:04.601497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5a1a32e7-8284-4850-aa56-8c587b2e09a7 req-f95f6849-906c-4e4b-a6ad-ad922b05b456 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:04.635648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5a1a32e7-8284-4850-aa56-8c587b2e09a7 req-f95f6849-906c-4e4b-a6ad-ad922b05b456 service nova] Creating event network-changed:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h1-848886-16 Jul 26 04:54:04.647323 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5a1a32e7-8284-4850-aa56-8c587b2e09a7 req-f95f6849-906c-4e4b-a6ad-ad922b05b456 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084621 Jul 26 04:54:04.648252 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2730/5395] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:05.005352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:05.005850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:05.022418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:05.022876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:05.023740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:05.024187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:05.099171 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9adefd4-4f80-4ee4-8c47-d5cb8952fb23 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/ips" status: 200 len: 150 microversion: 2.1 time: 0.097634 Jul 26 04:54:05.102998 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2666/5396] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:54:05 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/ips => generated 150 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:05.220553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:05.221264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:05.240432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:05.240893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:05.241753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:05.242122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:05.494695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7598770f-026a-4305-85a5-9ad9d37059fc req-ccb555f9-658f-43d8-8d96-560efb4df9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-plugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:05.526739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7598770f-026a-4305-85a5-9ad9d37059fc req-ccb555f9-658f-43d8-8d96-560efb4df9a7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:05.529627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7598770f-026a-4305-85a5-9ad9d37059fc req-ccb555f9-658f-43d8-8d96-560efb4df9a7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:05.588557 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7598770f-026a-4305-85a5-9ad9d37059fc req-ccb555f9-658f-43d8-8d96-560efb4df9a7 service nova] Creating event network-vif-plugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:54:05.594470 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7598770f-026a-4305-85a5-9ad9d37059fc req-ccb555f9-658f-43d8-8d96-560efb4df9a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104614 Jul 26 04:54:05.603005 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2667/5397] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:05.916915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:05.932118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:05.943795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:05.943795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0dd4b0aa-f089-4871-bbcd-0a45e1b7f834 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.725921 Jul 26 04:54:05.943795 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2731/5398] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:05 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:06.971938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:06.972571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:06.992075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:07.009622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:07.025068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:07.025660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:07.655561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:07.674738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:07.678760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:07.682193 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7c8bf69-b849-4737-a63f-f0281668b92a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.717817 Jul 26 04:54:07.694184 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2668/5399] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:06 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:08.448492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b6dec78-4959-44d8-b2fa-d159d00cb37e"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:08.452933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:08.463657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:08.466249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:08.469526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:08.472717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:08.474097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:08.478776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:08.709011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:08.709684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:08.715118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:08.738978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:08.739453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:08.740274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:08.750245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:09.312151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:09.324782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:09.332701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:09.334276 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d68787d5-a30e-426f-a23a-3bf3f47982b1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.629407 Jul 26 04:54:09.351990 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2669/5400] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:08 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:54:09.565987 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec7d211c-cb3c-4ffe-a541-0f7c02bd1b13 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.121873 Jul 26 04:54:09.588387 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2732/5401] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:54:08 2022] POST /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:10.367608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:10.368958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:10.382729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:10.384602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:10.387186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:10.389842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:10.920591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:10.937042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:10.939784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:10.944485 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da8982bc-fc9b-4702-8472-349c1969411f tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.582579 Jul 26 04:54:10.963422 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2670/5402] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:10 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:11.973138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:11.974863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:11.991914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:11.994859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:11.995953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:11.998421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:12.534310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9b8c819a-dcd7-416b-aa4a-b17b5e4ad452 req-455cdefb-8b4e-4096-853f-ef4220ee3a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "name": "network-vif-plugged", "status": "completed", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:12.571378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9b8c819a-dcd7-416b-aa4a-b17b5e4ad452 req-455cdefb-8b4e-4096-853f-ef4220ee3a1d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:12.573786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9b8c819a-dcd7-416b-aa4a-b17b5e4ad452 req-455cdefb-8b4e-4096-853f-ef4220ee3a1d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:12.623154 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9b8c819a-dcd7-416b-aa4a-b17b5e4ad452 req-455cdefb-8b4e-4096-853f-ef4220ee3a1d service nova] Creating event network-vif-plugged:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h1-848886-16 Jul 26 04:54:12.624571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:12.633297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:12.638682 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9b8c819a-dcd7-416b-aa4a-b17b5e4ad452 req-455cdefb-8b4e-4096-853f-ef4220ee3a1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116202 Jul 26 04:54:12.640234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2671/5403] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:54:12.645179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:12.646682 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bde8163-a3c2-4632-8ebc-b0dfa6b63652 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.678766 Jul 26 04:54:12.682755 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2733/5404] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:11 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:54:13.672541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:13.673346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:13.710830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:13.713419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:13.715334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:13.721954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:14.187328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:14.200330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:14.203076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:14.205471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7dddb7d6-ec75-4c60-b3ac-9e2033b650b4 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1406 microversion: 2.20 time: 0.538452 Jul 26 04:54:14.206552 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2672/5405] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:13 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:15.234917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:15.236313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:15.256511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:15.265498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:15.271061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:15.272857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:15.276903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:15.907146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:15.928304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:15.932542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:15.936418 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d96293fb-4535-4517-b69e-63d371c9f721 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1597 microversion: 2.20 time: 0.705634 Jul 26 04:54:15.956302 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2734/5406] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:15 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1597 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:15.968162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:15.968871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:15.984773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:15.987986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:15.989666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:15.991489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:16.304623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a7b55c1-18ce-469c-a58c-d19f77f9cabb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.341234 Jul 26 04:54:16.306532 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2673/5407] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Jul 26 04:54:15 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-interface => generated 284 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:54:17.217572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Calling method '.version_select at 0x7f38b51b4820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:17.218722 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:54:17.218722 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 04:54:17.220553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:17.221122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:17.256828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:17.258773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:17.281467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:17.282603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:17.292895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdcf32f4-5c7a-42df-a0d1-afcf95c43bed tempest-PortsAdminExtendedAttrsTestJSON-235343849 tempest-PortsAdminExtendedAttrsTestJSON-235343849-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.902540 Jul 26 04:54:17.302345 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2735/5408] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 04:54:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:20.065086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3e9c0fed-ca55-4fd0-ab15-7abdb7ff079e req-17eb31a7-7e56-45ea-b68d-c3d6b142250b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:20.083641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:20.107302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3e9c0fed-ca55-4fd0-ab15-7abdb7ff079e req-17eb31a7-7e56-45ea-b68d-c3d6b142250b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:20.109176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3e9c0fed-ca55-4fd0-ab15-7abdb7ff079e req-17eb31a7-7e56-45ea-b68d-c3d6b142250b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:20.144797 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3e9c0fed-ca55-4fd0-ab15-7abdb7ff079e req-17eb31a7-7e56-45ea-b68d-c3d6b142250b service nova] Creating event network-changed:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h1-848886-16 Jul 26 04:54:20.159239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3e9c0fed-ca55-4fd0-ab15-7abdb7ff079e req-17eb31a7-7e56-45ea-b68d-c3d6b142250b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103176 Jul 26 04:54:20.167492 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2674/5409] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:36.691384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b6dec78-4959-44d8-b2fa-d159d00cb37e"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:36.694617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:36.710185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:36.710892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:36.713991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:36.715952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:36.720855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:36.723221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:36.967624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments HTTP/1.1 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 74 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: {"volumeAttachment": {"volumeId": "1b6dec78-4959-44d8-b2fa-d159d00cb37e"}} Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '3b02c4a8-d8cb-47b8-a296-4489c3aba916', 'body': {'volumeAttachment': {'volumeId': '1b6dec78-4959-44d8-b2fa-d159d00cb37e'}}} Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:54:36.971729 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 400 to user: Invalid volume: volume 1b6dec78-4959-44d8-b2fa-d159d00cb37e is already attached to instances: 3b02c4a8-d8cb-47b8-a296-4489c3aba916 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:54:36.975396 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0051809d-81ad-4459-9290-eb1c33449f25 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.286947 Jul 26 04:54:36.980497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2736/5410] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:54:36 2022] POST /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 174 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:54:37.089633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:37.091919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:37.121749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=41 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:37.128567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:37.132112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:37.134295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:37.140914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:37.358326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lazy-loading 'services' on Instance uuid 3b02c4a8-d8cb-47b8-a296-4489c3aba916 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:54:37.685502 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bef88302-8dd3-4d2c-81e2-60f8202345a2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments/1b6dec78-4959-44d8-b2fa-d159d00cb37e" status: 202 len: 0 microversion: 2.1 time: 0.599874 Jul 26 04:54:37.687906 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2675/5411] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:54:37 2022] DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments/1b6dec78-4959-44d8-b2fa-d159d00cb37e => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:54:37.712207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:37.715220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:37.780922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:37.784160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:37.788836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:37.813578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:37.982742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d3d8c97-1e07-4d0a-b571-5f7232fb7542 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.290236 Jul 26 04:54:37.987291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2737/5412] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:37 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:38.091642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:38.092360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:38.104039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:38.107057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:38.111906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:38.112443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:38.452425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:38.464142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3aac6ffc-839c-4612-8cfc-98797ee27b9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.377048 Jul 26 04:54:38.473229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2676/5413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:39.002968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:39.005181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:39.031332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.031797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:39.032593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.033041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:39.138735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-608c298f-69d5-4dfb-9da7-d29bbf1f7409 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143137 Jul 26 04:54:39.144041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2738/5414] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:38 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:39.493705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:39.495205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:39.509801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.512821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:39.513801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.518712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:39.872960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:39.882817 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f34886a7-70e1-49cc-adc7-3701730aa632 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.397367 Jul 26 04:54:39.892193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2677/5415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:39.936359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-355706775"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:39.940236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:39.955670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.957484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:39.959627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:39.960719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:40.152088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:40.156711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:40.179145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:40.179697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:40.180579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:40.187916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:40.297037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-339cb3c5-0489-4a22-8899-c8841474e3af tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149210 Jul 26 04:54:40.300546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2678/5416] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:40 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:40.366061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c98dfaee-6d5b-4ffa-8e92-59ad0edab15b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.436264 Jul 26 04:54:40.381758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:40.383475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:40.389137 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2739/5417] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:54:39 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 04:54:40.404842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:40.407261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:40.408249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:40.408726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:40.685847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:40.696590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0de149b3-1d75-472e-a7bc-95aa7a4ea8df tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.325418 Jul 26 04:54:40.706275 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2679/5418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:54:41.312174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:41.323012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:41.362192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:41.390449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:41.392570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:41.393140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:41.571570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0fd800b0-82a5-48b7-a157-f0bba0cdba94 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.264672 Jul 26 04:54:41.572815 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2740/5419] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:41 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:41.724256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:41.725611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:41.766563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:41.769454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:41.770600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:41.772939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:42.195969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:42.212838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1f420752-4259-4350-a095-294e4589ecab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.492472 Jul 26 04:54:42.214811 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2680/5420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:42.585345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:42.587929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:42.616452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:42.627496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:42.630293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:42.632241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:42.764025 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4f161448-91e1-4dae-aecb-736d334106e0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172853 Jul 26 04:54:42.770430 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2741/5421] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:42 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:43.241522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:43.242482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:43.262067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:43.271601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:43.272513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:43.277818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:43.644402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:43.660297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3acd5e7e-0671-4b2b-b284-9151393c5aab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.422548 Jul 26 04:54:43.676735 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2681/5422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:43 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:43.780082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:43.782349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:43.811787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:43.817783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:43.818263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:43.818724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:43.943674 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10bd3835-4b78-4d60-bd53-9b693999ea61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169199 Jul 26 04:54:43.949318 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2742/5423] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:43 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:44.139518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3f39ed27-ca6c-4e68-8fd2-ba0c9e54c786 req-034b2705-a37e-4442-9e0b-31ccf5c89773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-unplugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:44.171485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3f39ed27-ca6c-4e68-8fd2-ba0c9e54c786 req-034b2705-a37e-4442-9e0b-31ccf5c89773 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:44.184974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3f39ed27-ca6c-4e68-8fd2-ba0c9e54c786 req-034b2705-a37e-4442-9e0b-31ccf5c89773 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:44.252962 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3f39ed27-ca6c-4e68-8fd2-ba0c9e54c786 req-034b2705-a37e-4442-9e0b-31ccf5c89773 service nova] Creating event network-vif-unplugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:54:44.279552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3f39ed27-ca6c-4e68-8fd2-ba0c9e54c786 req-034b2705-a37e-4442-9e0b-31ccf5c89773 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147855 Jul 26 04:54:44.280843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2682/5424] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:44.688225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:44.688981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:44.697721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:44.707335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:44.711263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:44.711828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:44.957961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:44.960242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:44.974328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:44.974724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:44.975506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:44.976027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:45.087014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:45.108058 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd26f845-cef6-49f7-860e-5aa22459c7b7 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155366 Jul 26 04:54:45.110123 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50447fc6-c92b-4768-b567-479b02e20723 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1686 microversion: 2.1 time: 0.425801 Jul 26 04:54:45.125153 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2743/5425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:44 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1686 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:54:45.125478 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2683/5426] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:44 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:46.122553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:46.124900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:46.152519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:46.154178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:46.154843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:46.161221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:46.162090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:46.162538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:46.162662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:46.162992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:46.163762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:46.164201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:46.272036 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-faf22341-0513-446f-b547-6bffa8575452 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151268 Jul 26 04:54:46.277388 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2744/5427] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:46 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:46.524823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:46.542491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b6eaeed-d3d6-4cc6-9ceb-ef08d3b0834f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1686 microversion: 2.1 time: 0.406128 Jul 26 04:54:46.548299 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2684/5428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:46 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1686 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:47.290725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:47.293717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:47.322677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:47.323111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:47.324606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:47.325050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:47.421763 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4c86182-4bb3-4115-91b9-e7b3c3f9c46c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136599 Jul 26 04:54:47.430941 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2745/5429] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:47 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:47.565756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:47.566393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:47.578697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:47.586716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:47.587808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:47.590760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:47.926859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:47.943621 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-741ba771-3b29-403e-bf99-4556941d85a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1686 microversion: 2.1 time: 0.381764 Jul 26 04:54:47.957179 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2685/5430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:47 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1686 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:48.446816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:48.450294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:48.469446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:48.470105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:48.471086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:48.471678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:48.525600 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1672ea62-4be1-4abb-b00d-754c421ba0d6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086184 Jul 26 04:54:48.527696 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2746/5431] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:54:48 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:54:48.664760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:48.665784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:48.674278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:48.674946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:48.675987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:48.679698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:48.969777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:48.970556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:49.007113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:49.012350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:49.014490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:49.022245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:49.562059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:54:49.848899 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6eec9f1-f35b-494c-b138-8e0ad7ef5988 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 204 len: 0 microversion: 2.1 time: 1.187831 Jul 26 04:54:49.860570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2686/5432] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:54:48 2022] DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:54:49.890309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-774f06f2-487b-4179-9167-3d397e1c7921 req-b97523bd-9964-42f3-a904-9e043b0f00ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-plugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:49.939774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-774f06f2-487b-4179-9167-3d397e1c7921 req-b97523bd-9964-42f3-a904-9e043b0f00ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:49.950623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-774f06f2-487b-4179-9167-3d397e1c7921 req-b97523bd-9964-42f3-a904-9e043b0f00ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:49.990297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-774f06f2-487b-4179-9167-3d397e1c7921 req-b97523bd-9964-42f3-a904-9e043b0f00ab service nova] Creating event network-vif-plugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:54:50.006089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-774f06f2-487b-4179-9167-3d397e1c7921 req-b97523bd-9964-42f3-a904-9e043b0f00ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143855 Jul 26 04:54:50.007278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2687/5433] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:50.028534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:50.030754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:50.050856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:50.052550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:50.054776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:50.056730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:50.183073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:50.193061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-30591ad5-dd5e-41a0-bf08-d62996f329e3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1686 microversion: 2.1 time: 1.227970 Jul 26 04:54:50.216137 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2747/5434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:48 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1686 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:54:51.224049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:51.225357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:51.246753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:51.250984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:51.252652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:51.263250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:51.810486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:51.820582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2afcb9ac-b65c-4697-8a19-ef289bfc303d tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1682 microversion: 2.1 time: 1.811718 Jul 26 04:54:51.824355 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2688/5435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:50 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1682 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:52.013500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:52.029814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99e26492-5d6c-4176-8a66-0cd1dbc95360 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.809679 Jul 26 04:54:52.041062 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2748/5436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:51 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:54:52.624630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:52.626983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:52.649757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:52.656185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:52.657850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:52.658540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:52.784742 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53efd525-5d22-4bfe-b4f2-a1a0e7f4b46e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/ips" status: 200 len: 151 microversion: 2.20 time: 0.163880 Jul 26 04:54:52.785357 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2689/5437] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Jul 26 04:54:52 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/ips => generated 151 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:54:52.850248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:52.851016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:52.865447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:52.867714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:52.870902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:52.875520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:53.056269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:53.059784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:53.078534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:53.079859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:53.086478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:53.089452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:53.424689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:53.433426 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5b7d71bf-6e0e-47ee-9a6a-df745d5e6d92 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1682 microversion: 2.1 time: 0.588346 Jul 26 04:54:53.440621 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2749/5438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:52 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1682 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:53.779211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:53.782887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:53.792933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b2ea7d8-8c59-477a-9e03-b5ba39a4d0fa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.743701 Jul 26 04:54:53.810869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2690/5439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:53 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:54:54.460925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:54.461770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:54.496904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:54.508793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:54.542778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:54.548324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:54.833647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:54.834794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:54.896687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:54.906845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:54.908201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:54.910476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:55.861647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:55.876468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79dbab2e-dddd-47b8-a060-42544eba9459 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 200 len: 1614 microversion: 2.1 time: 1.419774 Jul 26 04:54:55.891200 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2750/5440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:54 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 1614 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:55.901126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8572c0b4-dd59-47ac-a45c-871d7fc903a9 req-c4e7e6b9-8659-40f9-ba82-6e1f1db680ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b02c4a8-d8cb-47b8-a296-4489c3aba916", "name": "network-vif-deleted", "tag": "496fd154-78b6-433e-b972-7279dd0b0ec4"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:55.977687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8572c0b4-dd59-47ac-a45c-871d7fc903a9 req-c4e7e6b9-8659-40f9-ba82-6e1f1db680ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:55.978466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8572c0b4-dd59-47ac-a45c-871d7fc903a9 req-c4e7e6b9-8659-40f9-ba82-6e1f1db680ec service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:55.994377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:56.020650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8572c0b4-dd59-47ac-a45c-871d7fc903a9 req-c4e7e6b9-8659-40f9-ba82-6e1f1db680ec service nova] Creating event network-vif-deleted:496fd154-78b6-433e-b972-7279dd0b0ec4 for instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 on n-h1-848886-16 Jul 26 04:54:56.031352 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8572c0b4-dd59-47ac-a45c-871d7fc903a9 req-c4e7e6b9-8659-40f9-ba82-6e1f1db680ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138510 Jul 26 04:54:56.032559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2751/5441] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:56.904047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:56.908353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:56.913373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:56.927542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ce5f62f-8e8e-45f7-9370-b51a19fa641b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 2.097360 Jul 26 04:54:56.931830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:56.940109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:56.942643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:56.945444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:56.950773 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2691/5442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:54 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:56.976878 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 HTTP/1.1 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3b02c4a8-d8cb-47b8-a296-4489c3aba916'} Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:54:56.978698 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:54:56.983055 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:54:56.985427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:54:56.986609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a51b2d12-4af2-4c09-aa8d-62f5bd84794b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 404 len: 111 microversion: 2.1 time: 0.083069 Jul 26 04:54:56.991960 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2752/5443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:56 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:54:56.998447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59652684-9089-4af9-8f6c-e75bbe1b1105 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '.version_select at 0x7f38b48611f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:57.093780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59652684-9089-4af9-8f6c-e75bbe1b1105 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220355030" status: 202 len: 0 microversion: 2.1 time: 0.100881 Jul 26 04:54:57.099321 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2692/5444] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220355030 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:54:57.619377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:54:57.620651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:57.637797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:57.638287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:57.639082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:57.639533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:57.713268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lazy-loading 'flavor' on Instance uuid 16310c20-bccb-40ea-96e8-8f0eabf5ef23 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:54:57.955315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:57.956318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:57.975037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:57.975609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:57.982601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:57.983099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:58.445585 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f111195b-79ee-4975-8b95-f366cf356028 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/action" status: 202 len: 0 microversion: 2.20 time: 0.829729 Jul 26 04:54:58.449630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2753/5445] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:54:57 2022] POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:54:58.492493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:58.498720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:54:58.564864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:58.565330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:58.566671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:54:58.568580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:54:58.934234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:58.965177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:58.965809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:58.976231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:54:58.981590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-773ef3dd-e3a5-4c15-aeef-a1579015ca8d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.527215 Jul 26 04:54:58.983508 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2754/5446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:54:58 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:58.992950 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4aa91ec6-f3e8-4842-87f9-105ee8cfdae0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 1.040464 Jul 26 04:54:58.993523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2693/5447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:54:57 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:00.013970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:00.016393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:00.018210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:00.018614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:00.034431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:00.034969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:00.035766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:00.036427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:00.042700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:00.043281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:00.043946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:00.044398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:00.428247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:00.453415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:00.454969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:00.456254 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b271be37-7a5e-48e5-a3ec-05b6114ed51a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.451868 Jul 26 04:55:00.456853 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2694/5448] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:00 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:00.471826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c744ee58-fea5-4bc6-8adb-fdaaf843e5d1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: .version_select at 0x7f38b48ba9d0>, body: {"keypair": {"name": "tempest-keypair-809073187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNju5cWLGtmD1syTN80PwLe8hz/HeCc2LxfEvIoWXdocXTbLKMJGet29q0K6KHu4GzeeIQ5tGkHQJ1crzoRW4UDjYFwQyvyVdEbdeY8RXh+l8s+Kkim7UC2IF6o1Q91y5A=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:00.565527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c744ee58-fea5-4bc6-8adb-fdaaf843e5d1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:55:00.596178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c744ee58-fea5-4bc6-8adb-fdaaf843e5d1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:55:00.661323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:00.670397 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6176d167-8113-4182-8e92-1469b1562a45 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.661340 Jul 26 04:55:00.694839 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2755/5449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:00 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:00.707342 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c744ee58-fea5-4bc6-8adb-fdaaf843e5d1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249237 Jul 26 04:55:00.709183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2695/5450] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:55:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:01.490236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:01.490844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:01.516743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:01.517205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:01.536723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:01.537130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:01.707153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:01.707779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:01.755707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:01.756500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:01.769688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:01.770235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:02.433402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:02.445467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:02.450076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:02.464273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3908441e-997b-44b2-a8d3-446480086e19 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.763120 Jul 26 04:55:02.467261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2696/5451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:01 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:02.485218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:02.497603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f26eae5-8c82-4a83-9c62-0313f2e6bce6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 1.001755 Jul 26 04:55:02.497603 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2756/5452] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:01 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:03.506345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:03.518578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:03.535646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:03.536307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:03.565003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:03.565470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:03.569421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:03.572562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:03.575433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:03.577761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:03.579156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:03.582752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:04.095067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:04.106942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b42e63a-4014-41e9-b48c-680704af5556 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.618959 Jul 26 04:55:04.107523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2697/5453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:03 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:04.470733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:04.495549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:04.499669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:04.502529 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-159437df-bc2e-4373-b50a-a6e9f10a9a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.974466 Jul 26 04:55:04.506357 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2757/5454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:03 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:04.876624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1515449601", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ef569d9e-2a6f-48c3-8d0b-7833bbf24b1a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:05.137563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:05.139687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:05.162325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:55:05.169050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:05.177786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:05.179272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:05.179848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:05.630420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:05.650936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af55e0b2-464d-4142-b033-4d0bc4aba670 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.525696 Jul 26 04:55:05.652427 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2758/5455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:05 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:05.662435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:05.663316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:05.676326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:05.680769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:05.683313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:05.683962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:06.303880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:06.323079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:06.325297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:06.327700 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35c0b165-ad2b-46e1-bdad-2d0f29add237 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.673717 Jul 26 04:55:06.328431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2759/5456] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:05 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:06.382767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:55:06.383269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:55:06.383651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:55:06.384149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:55:06.384471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:55:06.415374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:06.416889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:06.420411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:06.423085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:06.495207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:55:06.517375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:55:06.560038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:55:06.569631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ef569d9e-2a6f-48c3-8d0b-7833bbf24b1a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:55:06.675650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:06.676423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:06.697573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:06.706619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:06.707787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:06.708909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:06.795630 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2c96516-e5f3-46a7-a91f-70afff4154fb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925109 Jul 26 04:55:06.799837 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2698/5457] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:55:06.829639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ce4457f-84a4-46fa-94bb-ae1e1996b7ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:06.830317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ce4457f-84a4-46fa-94bb-ae1e1996b7ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:07.117635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ce4457f-84a4-46fa-94bb-ae1e1996b7ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:07.130630 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ce4457f-84a4-46fa-94bb-ae1e1996b7ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1057 microversion: 2.1 time: 0.320434 Jul 26 04:55:07.133420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2699/5458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:06 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1057 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:07.176619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1272566445", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb5d3d-bcd3-424d-b89b-f73e7e58dea5"}], "security_groups": [{"name": "tempest-securitygroup--479257173"}], "key_name": "tempest-keypair-809073187", "user_data": "}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:07.375802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:07.385573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ab06450-b335-49fe-a63f-413c5ff77f9a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.716855 Jul 26 04:55:07.405149 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2760/5459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:06 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:07.418408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:07.430852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:07.453634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=51 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:07.455213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:07.455664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:07.468129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:07.468796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:07.888140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:07.899556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:07.901669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:07.903412 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7124c69a-9526-4671-a8ca-a36232feaac7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.497023 Jul 26 04:55:07.904151 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2761/5460] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:07 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:08.152473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:08.153845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:08.172833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:08.173327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:08.180267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:08.183587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:08.756422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:08.768493 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f9bd54c-f815-4cb1-bd6c-6818d615e9b3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1109 microversion: 2.1 time: 0.620250 Jul 26 04:55:08.774033 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2762/5461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:08 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1109 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:08.785298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:08.786751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:08.810715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:08.811977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:08.813289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:08.815073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:09.247690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:09.263817 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90c406b0-cc2f-40e6-8b63-e0729ecdcd73 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.488323 Jul 26 04:55:09.264408 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2763/5462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:08 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:09.313554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:09.314539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:09.329667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:09.334906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:09.335778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:09.336230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:10.092785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:10.113025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:10.120598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:10.127608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d34cd471-0c24-4fc6-9c24-6806159505f9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1743 microversion: 2.20 time: 0.835752 Jul 26 04:55:10.131173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2764/5463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:09 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1743 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:10.150555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:10.151375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:10.181934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:10.212839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:10.212839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:10.221473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:10.615773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:10.637534 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0836332-14a5-4feb-89ff-812533e9db26 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1127 microversion: 2.1 time: 0.499400 Jul 26 04:55:10.653394 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2765/5464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:10 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1127 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:10.676718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:10.682602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:10.712487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:10.714250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:10.714684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:10.719986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:11.191392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:11.201144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-afc1e33e-be01-48d9-95c2-a0712b4b997f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.538637 Jul 26 04:55:11.201746 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2766/5465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:10 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:11.237427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:11.240603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:11.278742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:11.279447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:11.280957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:11.282314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:11.288906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:11.691793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:11.703818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:11.709110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:11.716831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7641562b-1360-4ee5-a058-08bcfcdc262b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.505429 Jul 26 04:55:11.717420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2767/5466] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:11 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:11.774383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:11.775007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:11.809753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:11.810243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:11.811043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:11.811483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:12.700176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:12.711673 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e6060324-ddc2-43ab-8385-fda0e180153e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.993181 Jul 26 04:55:12.716603 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2768/5467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:11 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:12.735650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:12.741980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:12.763593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:12.777961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:12.777961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:12.781520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:13.769662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:13.781904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1573ed4-6f4a-4ae0-b2ec-eeb9417d5c34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 1.054439 Jul 26 04:55:13.786898 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2769/5468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:12 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:13.807304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:13.809450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:13.829667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:13.830134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:13.832904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:13.833382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:15.383858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:15.394055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:15.395612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:15.397082 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-35512f8f-2a48-4c00-98ac-0c0de531724c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.609068 Jul 26 04:55:15.411240 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2770/5469] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:13 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:15.416294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-14574aba-0d03-4f90-a0d0-a624f574bfcf req-ac3ba8f6-f06f-409d-af93-50b953df5e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "name": "network-vif-plugged", "status": "completed", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:15.445384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-14574aba-0d03-4f90-a0d0-a624f574bfcf req-ac3ba8f6-f06f-409d-af93-50b953df5e60 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:15.455492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-14574aba-0d03-4f90-a0d0-a624f574bfcf req-ac3ba8f6-f06f-409d-af93-50b953df5e60 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:15.508589 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-14574aba-0d03-4f90-a0d0-a624f574bfcf req-ac3ba8f6-f06f-409d-af93-50b953df5e60 service nova] Creating event network-vif-plugged:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h1-848886-16 Jul 26 04:55:15.534883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-14574aba-0d03-4f90-a0d0-a624f574bfcf req-ac3ba8f6-f06f-409d-af93-50b953df5e60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121018 Jul 26 04:55:15.543924 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2771/5470] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:15.559161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:15.578498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:15.586057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:15.586544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:15.587331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:15.588418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.085966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:16.095022 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-da203d19-3d96-4abb-bfcb-a2a9570d3f75 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.547958 Jul 26 04:55:16.102134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2772/5471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:15 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:16.122470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0b51581b-bcd9-4abc-806d-116298166e55 req-e5223148-4218-4441-80c8-6501f168b3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46f925-8029-4774-bf04-a9a0fbc818e7", "tag": "450f4fa0-d4fa-499e-9054-08bccc60719d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:16.160106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0b51581b-bcd9-4abc-806d-116298166e55 req-e5223148-4218-4441-80c8-6501f168b3bc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:16.161616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0b51581b-bcd9-4abc-806d-116298166e55 req-e5223148-4218-4441-80c8-6501f168b3bc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.185836 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0b51581b-bcd9-4abc-806d-116298166e55 req-e5223148-4218-4441-80c8-6501f168b3bc service nova] Creating event network-changed:450f4fa0-d4fa-499e-9054-08bccc60719d for instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 on n-h2-848886-16 Jul 26 04:55:16.193084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0b51581b-bcd9-4abc-806d-116298166e55 req-e5223148-4218-4441-80c8-6501f168b3bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088424 Jul 26 04:55:16.194047 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2773/5472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:16.203093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:16.205306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:16.214314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:16.215384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.216831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:16.217512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.456046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:16.457434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=32 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:16.514098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:16.522888 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4e2aeb3-0105-454d-9f24-599345638acb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.327204 Jul 26 04:55:16.537032 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2774/5473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:16 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:16.537032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:16.537724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:16.553454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:16.553920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.554747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:16.555205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:16.923762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:16.934060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:16.952745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:16.954026 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f9106e1-96ea-40f8-8a75-23684dc0c2f0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.429603 Jul 26 04:55:16.966760 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2775/5474] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:16 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:17.121086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:17.122979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:17.123536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:17.143968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:17.144434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:17.145251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:17.145702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:17.210478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:17.488688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:17.500138 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c27615b-530a-479d-8343-f04b3a78ced8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.383798 Jul 26 04:55:17.501406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2776/5475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:17 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:17.547239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:17.548938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:17.560395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:17.563973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:17.565020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:17.565630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:18.106490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:18.118450 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45aee241-ce52-4428-a240-4234821b6635 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.576500 Jul 26 04:55:18.125114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2777/5476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:17 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:18.144358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:18.147413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:18.165554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:18.166924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:18.173205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:18.174364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:18.829322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:18.842551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:18.850767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:18.855230 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61b186a0-092a-4b39-9a1c-77352f2c49a2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.727890 Jul 26 04:55:18.860382 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2778/5477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:18 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:18.874001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:18.880597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:18.902454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:18.903674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:18.906749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:18.909904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:19.389732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:19.403557 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88a56e84-8db9-4e32-b22c-ddacebe1636f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.541314 Jul 26 04:55:19.404160 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2779/5478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:18 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:19.428760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:19.429405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:19.462174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:19.462814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:19.463615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:19.464057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:19.989062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:20.017468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d0df5ff-7eb3-4e0c-b162-dd9cdca695ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.593602 Jul 26 04:55:20.048707 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2780/5479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:19 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:20.090985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:20.090985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:20.126144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:20.133607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:20.135872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:20.137787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:21.157139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:21.167800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:21.169461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:21.173909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b9010ee-fc30-4005-876e-829f799f9309 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.123091 Jul 26 04:55:21.174629 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2781/5480] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:20 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:21.183075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:21.183950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:21.195080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:21.202703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:21.206702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:21.209390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:21.851429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:21.866981 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c9d7c12-b1e9-4228-8742-8ac9205672bb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.688607 Jul 26 04:55:21.870375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2782/5481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:21 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:21.897022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:21.897655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:21.930413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:21.931866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:21.938363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:21.938831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:22.604347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:22.639421 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c555713a-4862-448e-b442-6fb1b1fa4527 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1681 microversion: 2.1 time: 0.765489 Jul 26 04:55:22.644919 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2783/5482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:21 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1681 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:22.650773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:22.651566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:22.659728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:22.660534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:22.663689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:22.664338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:23.715683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:23.755172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:23.756898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:23.763637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] validate_networks() for [('79bb5d3d-bcd3-424d-b89b-f73e7e58dea5', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:55:23.768159 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f92370f7-2d6f-4f71-a85f-3d18d41315f2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.121953 Jul 26 04:55:23.778585 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2784/5483] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:22 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:23.819215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:23.820318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:23.856238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:23.857655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:23.860914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:23.867234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:23.873986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:24.827462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:24.852543 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dbd57483-0b1e-43fb-a567-10504493be9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 1.054109 Jul 26 04:55:24.859057 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2785/5484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:23 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:24.907774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:24.913495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:24.940441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:24.945821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:24.952388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:24.953143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:25.379054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:55:25.380552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:55:25.381217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:55:25.383192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:55:25.385922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:55:25.427800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:25.429767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:25.433478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:25.434145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:25.459221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:55:25.466071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Getting quotas for user 6a85740a13db4102a29eca16c84a6b1e and project 69de1118038a4055a134e0a2f2514233. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:55:25.519189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:55:25.535052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:55:25.753895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-043e56f7-dbb6-4d0d-a08c-26f890ad7357 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 18.583140 Jul 26 04:55:25.760212 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2700/5485] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:55:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 18590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:55:25.782487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:25.789926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:25.824291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:25.824666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:25.833015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:25.835277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:26.152593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.170066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1bd0f02-3bee-4c73-957a-fe2252769f30 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.304308 Jul 26 04:55:26.171534 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2786/5486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:24 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:26.191316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a7f36e15-8ef1-4bfc-9c94-006ac936967a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:26.192323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a7f36e15-8ef1-4bfc-9c94-006ac936967a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:26.436141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a7f36e15-8ef1-4bfc-9c94-006ac936967a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.448327 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a7f36e15-8ef1-4bfc-9c94-006ac936967a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1241 microversion: 2.1 time: 0.270890 Jul 26 04:55:26.460254 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2787/5487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:26 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1241 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:26.486600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:26.488891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:26.528444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:26.531837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:26.532861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:26.538293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:26.544059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.562281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.576090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.577945 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1d0168c-14be-4b1d-b9f9-affda966471b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.815958 Jul 26 04:55:26.579291 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2701/5488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:25 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:26.897362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:26.907094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93c8e20a-e710-4dbb-974a-6592dac18123 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.444892 Jul 26 04:55:26.938973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2788/5489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:26 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:27.484196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:27.487291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:27.496986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:27.497714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:27.500259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:27.500957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:27.610778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:27.611391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:27.642245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:27.645572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:27.656982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:27.661135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:27.769341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:27.803079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2350653b-5f86-4a06-bfdb-23d54cfc6fc3 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1245 microversion: 2.1 time: 0.323835 Jul 26 04:55:27.807879 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2702/5490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:27 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1245 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:27.949948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:27.953640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:27.982858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:27.992395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:28.007050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:28.010637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:28.428323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:28.444924 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8fc8ec1e-4c18-4567-b21a-5f289aa64bce tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.506835 Jul 26 04:55:28.451471 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2703/5491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:27 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:28.467319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a0b2708b-5c39-44cc-8a7a-ab95ce0eb8a0 req-9dda28ac-e73d-431d-a04e-7963b3d52bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-unplugged", "status": "completed", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:28.506341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a0b2708b-5c39-44cc-8a7a-ab95ce0eb8a0 req-9dda28ac-e73d-431d-a04e-7963b3d52bc5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:28.507109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a0b2708b-5c39-44cc-8a7a-ab95ce0eb8a0 req-9dda28ac-e73d-431d-a04e-7963b3d52bc5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:28.538437 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a0b2708b-5c39-44cc-8a7a-ab95ce0eb8a0 req-9dda28ac-e73d-431d-a04e-7963b3d52bc5 service nova] Creating event network-vif-unplugged:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 04:55:28.577663 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a0b2708b-5c39-44cc-8a7a-ab95ce0eb8a0 req-9dda28ac-e73d-431d-a04e-7963b3d52bc5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121354 Jul 26 04:55:28.578232 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2704/5492] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:28.665061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:28.678096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:28.680474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:28.682964 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85db5483-e705-4eae-b027-c716412afff9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.077008 Jul 26 04:55:28.700773 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2789/5493] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:27 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:28.829285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:28.830740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:28.847044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:28.847511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:28.848318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:28.848783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:29.284348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:29.293621 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6705829d-410e-4df2-a62c-d7d59cd806d4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1301 microversion: 2.1 time: 0.468506 Jul 26 04:55:29.300151 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2705/5494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:28 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1301 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:29.466877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:29.467748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:29.479502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:29.480253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:29.481237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:29.482671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:29.712590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:29.714645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:29.723236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:29.724314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:29.725317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:29.726014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:29.972808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:29.986780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d48eaa82-639c-4758-96cd-99e7206834d4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.523653 Jul 26 04:55:30.000195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2790/5495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:29 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:30.351383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:30.353710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:30.361082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:30.362043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:30.363057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:30.363692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:30.492902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:30.501808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:30.515041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:30.522706 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d20e7ec6-fa6b-41a4-9874-000f075243d0 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.815648 Jul 26 04:55:30.530310 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2706/5496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:29 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:55:31.011812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:31.014036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:31.037414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:31.042897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:31.044094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:31.047462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:31.160629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:31.177791 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22b7a788-5482-46a8-af06-e146f02049f4 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.832160 Jul 26 04:55:31.178365 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2791/5497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:30 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:31.554041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:31.556511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:31.578345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:31.578812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:31.579609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:31.583477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:31.750097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:31.765600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-968ce623-365d-4086-a969-76d69ddd360e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.755225 Jul 26 04:55:31.767102 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2707/5498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:31 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:32.202481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:32.203329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:32.214499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:32.215620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:32.219545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:32.220270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:32.405625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:32.427526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:32.441573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:32.448066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ca7e1a0-7e5a-4667-a248-f307060c0528 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.898358 Jul 26 04:55:32.449015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2792/5499] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:31 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:32.788069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:32.788916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:32.812967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:32.821240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:32.822235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:32.822696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:33.484008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:33.507924 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9899579a-b975-4671-8417-389631df50be tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 1.306773 Jul 26 04:55:33.518197 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2708/5500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:32 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:33.533019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:33.533550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:33.570667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:33.571181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:33.572168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:33.587303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:33.728303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:33.756084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3efbb058-1821-460b-9083-64447b6343da tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.968474 Jul 26 04:55:33.757213 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2793/5501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:32 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:33.790767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:33.792671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:33.817596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:33.833480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:33.838483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:33.839201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:34.223639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:34.237994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:34.250776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:34.259280 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc5692e6-62d0-4d19-9adb-7b23eba8c4c1 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.736702 Jul 26 04:55:34.262930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2709/5502] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:33 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:34.378302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e1a3e45a-c48e-4b1b-a776-b56a13ef15aa req-8d5b4e4a-58e6-42d5-966f-7c89299fd2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32869b7e-cd3d-49f3-9cce-f6e920797730", "tag": "e623321d-e127-48c6-8f1b-6b5bbd0976fd"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:34.435585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e1a3e45a-c48e-4b1b-a776-b56a13ef15aa req-8d5b4e4a-58e6-42d5-966f-7c89299fd2e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:34.445568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e1a3e45a-c48e-4b1b-a776-b56a13ef15aa req-8d5b4e4a-58e6-42d5-966f-7c89299fd2e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:34.494993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:34.511662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e1a3e45a-c48e-4b1b-a776-b56a13ef15aa req-8d5b4e4a-58e6-42d5-966f-7c89299fd2e2 service nova] Creating event network-changed:e623321d-e127-48c6-8f1b-6b5bbd0976fd for instance 32869b7e-cd3d-49f3-9cce-f6e920797730 on n-h1-848886-16 Jul 26 04:55:34.512505 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62edb6e6-83ec-4cc6-82f4-bf00e54ba424 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.752690 Jul 26 04:55:34.513120 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2794/5503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:33 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:34.534704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:34.537684 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e1a3e45a-c48e-4b1b-a776-b56a13ef15aa req-8d5b4e4a-58e6-42d5-966f-7c89299fd2e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165059 Jul 26 04:55:34.541842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2710/5504] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:34.542955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:34.565110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:34.565577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:34.575735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:34.582351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:34.779216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:34.785293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:34.820491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:34.827544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:34.828398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:34.828853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:35.422830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:35.432911 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-64230253-ef38-45e9-82f0-a82b5bda3960 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.659339 Jul 26 04:55:35.441776 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2711/5505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:34 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:35.463464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:35.466039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:35.501518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:35.502800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:35.516544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:35.518879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:35.526596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:35.527282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:36.090835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:36.115630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:36.123855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:36.134088 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7b4edb2-ccec-4b84-9638-20abd9ce735a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.691880 Jul 26 04:55:36.138390 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2712/5506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:35 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:36.331364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:36.352745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-badae97a-926d-4c0a-b16a-256bb4705a8a tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 1.818202 Jul 26 04:55:36.354434 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2795/5507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:34 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:36.459288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:36.460113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:36.469862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:36.472026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:36.472981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:36.478915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:37.004339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:37.021314 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17053cdc-c550-4314-a52a-9979426d545e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.568683 Jul 26 04:55:37.036509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2713/5508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:36 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:37.165168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:37.165688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:37.168342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:37.202590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:37.203050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:37.203845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:37.204354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:37.380232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:37.381095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:37.406302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:37.407024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:37.408165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:37.411479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:37.563214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:37.575315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:37.590295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:37.591930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5713cf6-87e0-41c0-a796-6372ee4747bd tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.431400 Jul 26 04:55:37.613001 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2796/5509] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:37 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:37.720169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:37.754838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a20f93b-9a3c-44a4-8e06-8b5c37aa8fee tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.377858 Jul 26 04:55:37.761185 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2714/5510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:37 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:38.049649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:38.054521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:38.062591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=74 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:38.066235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.072840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:38.074023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.074737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:38.302204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:38.302741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:38.325992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.326722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:38.327854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.328726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:38.709262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:38.721725 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44b0bdbc-c244-40b5-8f0f-3f605a5d93d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.423649 Jul 26 04:55:38.730545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2715/5511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:38.739266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:38.739912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:38.757674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.758139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:38.759037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:38.759477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.184388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:39.197190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:39.212445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:39.218313 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-49c63a51-f2c7-4513-a497-fc89438d749d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.486679 Jul 26 04:55:39.237730 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2716/5512] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:38 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:39.240032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:39.245871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:39.257428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-69c3dcc0-2a10-4252-8ccf-e1dbbbad8d2b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 1.212290 Jul 26 04:55:39.268303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:39.278671 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2797/5513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:38 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:39.290795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.291857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.292971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.298988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:39.299673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:39.301086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.321443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.329266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.332056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.332561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.590891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:39.599269 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da3b4beb-13e6-451d-a018-3eafb11ed7a8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.357870 Jul 26 04:55:39.599850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2717/5514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:39.629546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:39.630898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:39.655696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.656439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.658450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:39.662045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:39.717076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:39.996279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:40.012936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90052a07-b6a5-45c2-9753-0f4cebd520aa tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.392951 Jul 26 04:55:40.013548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2718/5515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:40.039936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:40.048607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:40.081319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.081784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.082626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.083084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.211433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:40.222075 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a564754-ef24-4c3a-847d-3b789b4ff87f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.942193 Jul 26 04:55:40.223464 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2798/5516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:39 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:40.248518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:40.249934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:40.286357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.286894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.287583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.288025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.496009 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96ed2a84-5e2e-4914-90b7-f6b6e7f7e77f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.460302 Jul 26 04:55:40.504600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2719/5517] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:55:40 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:55:40.543241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:40.550864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:40.573358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.578714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.584202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.587083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.831741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:40.856404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:40.858139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:40.859406 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73afae22-768d-449c-ad1e-f6c52eae359c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.614925 Jul 26 04:55:40.860015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2799/5518] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:40 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:40.891524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:40.892056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:40.936950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.937844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:40.938903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:40.939578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:41.405304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:41.415931 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-daea03f8-02da-4f72-a034-22ea9b668bee tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1670 microversion: 2.1 time: 0.534170 Jul 26 04:55:41.419678 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2800/5519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1670 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:41.448649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:41.450236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:41.467280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:41.469194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:41.471217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:41.472995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:41.650801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:41.661288 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67a102b6-6cec-4cfd-8072-31c81986eccb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 1.150823 Jul 26 04:55:41.666199 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2720/5520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:40 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:41.888479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:41.889522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:41.911930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:41.916455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:41.917622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:41.919832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:41.924182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:41.947108 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4538e48d-ca83-45d0-abbb-eb6ab1d4e5f6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.503532 Jul 26 04:55:41.954075 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2801/5521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:41 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:42.443153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:42.444036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:42.470226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:42.471207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:42.472229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:42.472675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:42.530980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:42.542921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:42.547936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:42.551302 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-49a0f96d-8d00-4e58-995b-b9e945c59287 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.665281 Jul 26 04:55:42.553709 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2721/5522] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:41 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:42.690893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:42.692450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:42.703752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:42.704436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:42.705411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:42.706548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:42.944910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:42.949495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:42.969105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ec9efc7-7393-4118-bb05-2eb4bd0be5b9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1670 microversion: 2.1 time: 0.531982 Jul 26 04:55:42.969712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2802/5523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:42 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:42.987249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:42.990771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:43.008696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:43.014876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:43.017672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:43.018323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:43.103525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:43.141200 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-55231421-e7e4-45eb-bcda-458b4fd2de3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.447434 Jul 26 04:55:43.151149 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2722/5524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:42 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:43.347868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:43.359546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-98d97585-c717-4f8e-abd8-abbf05f5dd10 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.376549 Jul 26 04:55:43.360134 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2803/5525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:42 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:43.580772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:43.581389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:43.594864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:43.601302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:43.602384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:43.603193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.016626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:44.017523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:44.030827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.032558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.035124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.035708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.087453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:44.110213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:44.113709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:44.119473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa879d1f-d1a9-4c1e-b393-5bd8471db757 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.542903 Jul 26 04:55:44.122491 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2723/5526] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:43 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:44.172185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:44.173040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:44.187549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.188024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.190113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.192232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.602906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:44.614673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e2c2826-68d5-4514-9a0b-acb52a6ea626 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.446249 Jul 26 04:55:44.623814 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2724/5527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:44 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:44.631371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:44.638104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:44.663468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.672932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.676069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.680556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.761992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:44.784491 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-107b1aa1-1e8b-4b49-ac07-fadc7e35f213 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.785246 Jul 26 04:55:44.792574 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2804/5528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:43 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:44.815629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:44.822713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:44.872641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.878502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.879589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:44.880226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:44.996709 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a05afa9-b38c-49cb-ab3e-250b7ee2463f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 200 len: 324 microversion: 2.1 time: 0.185670 Jul 26 04:55:44.997825 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2805/5529] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:55:44 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:55:45.008027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:45.011800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:45.038097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.042263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.044549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.051914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.182593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:45.204635 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0912be91-fe23-484a-bc57-95bf3bcd6eb1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.573609 Jul 26 04:55:45.208040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2725/5530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:44 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:45.229803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:45.232872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:45.260137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.262099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.263461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.266712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.613309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:45.638402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:45.640057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:45.643937 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b20d096-3790-42af-b968-8d77472e60c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.432070 Jul 26 04:55:45.645120 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2726/5531] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:45 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:45.650877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:45.652003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:45.667609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.668074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.668868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.670353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.729128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:45.743486 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7aaa6a67-0133-40f1-bb80-760fcb61a177 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.739803 Jul 26 04:55:45.749017 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2806/5532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:45 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:45.777534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:45.778521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:45.800815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.806279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:45.810395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:45.812183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.206481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:46.219387 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e99c0811-0370-42fc-b283-04319573ad5a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.572810 Jul 26 04:55:46.220187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2727/5533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:45 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:46.240423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-deb0fefd-3bad-433b-a24a-b871e02b8a01 req-29a0df06-c8aa-4dc0-bad1-60890ef23c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32869b7e-cd3d-49f3-9cce-f6e920797730", "name": "network-vif-plugged", "status": "completed", "tag": "e623321d-e127-48c6-8f1b-6b5bbd0976fd"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:46.281196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-deb0fefd-3bad-433b-a24a-b871e02b8a01 req-29a0df06-c8aa-4dc0-bad1-60890ef23c29 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.286484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-deb0fefd-3bad-433b-a24a-b871e02b8a01 req-29a0df06-c8aa-4dc0-bad1-60890ef23c29 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.313687 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-deb0fefd-3bad-433b-a24a-b871e02b8a01 req-29a0df06-c8aa-4dc0-bad1-60890ef23c29 service nova] Creating event network-vif-plugged:e623321d-e127-48c6-8f1b-6b5bbd0976fd for instance 32869b7e-cd3d-49f3-9cce-f6e920797730 on n-h1-848886-16 Jul 26 04:55:46.334608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-deb0fefd-3bad-433b-a24a-b871e02b8a01 req-29a0df06-c8aa-4dc0-bad1-60890ef23c29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112834 Jul 26 04:55:46.336171 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2728/5534] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:46.341936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:46.347142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:46.363642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.364459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.365464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.366126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.669389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:46.678891 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b76ef33-bbd8-4a45-8855-e6ebaa985816 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.341093 Jul 26 04:55:46.681049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2729/5535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:46 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:46.684815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:46.699283 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a6a2528-1ec2-4eaf-b1c3-a3cee823b95c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.926042 Jul 26 04:55:46.707295 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2807/5536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:45 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:46.708244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:46.708960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:46.723908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.724419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.744212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:46.745253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:46.751573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.754363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.766170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.766778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:46.767722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:46.768278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.241907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:47.261936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:47.275896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:47.277101 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00ae8afa-7e18-4c84-9a19-35df4730947c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.579587 Jul 26 04:55:47.290192 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2730/5537] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:46 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:47.290192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:47.290192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:47.301838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:47.303717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.304187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.306134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.306621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.722039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:47.743862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e84b47cd-1608-4164-a3f6-6a0f9ed9fa49 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.464588 Jul 26 04:55:47.745001 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2731/5538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:47 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:47.756924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:47.760330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:47.768253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.769813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.771144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.772522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.799916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:47.811645 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bf9feb15-0390-4c52-ba1c-070ea384ff2c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.085228 Jul 26 04:55:47.831219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2808/5539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:46 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:47.840804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:47.841666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:47.869873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.870823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:47.872363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:47.875550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:48.251394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:48.260840 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0541586b-b47d-4612-985e-1ea28f985f7c tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1366 microversion: 2.1 time: 0.514570 Jul 26 04:55:48.261447 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2732/5540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:47 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:48.309644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:48.310282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:48.328229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:48.328687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:48.329484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:48.329923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:48.781625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:48.796752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:48.798424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:48.800307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c43f27b-9af0-4900-ab4b-569d259f8dcc tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.494663 Jul 26 04:55:48.800919 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2733/5541] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:48 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:55:48.822808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:48.823660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:48.830223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:48.834842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:48.836490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:48.837172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:49.160738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:49.179634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:49.183983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:49.189174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccd72c2a-9c23-40aa-a82d-583c1fc34e48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.336874 Jul 26 04:55:49.202406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5caf328e-2f3a-478a-a130-ef4708b25dff tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 0.396298 Jul 26 04:55:49.220726 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2809/5542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:47 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:49.221510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2734/5543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:48 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:49.287391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:49.288339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:49.305461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:49.309250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:49.313015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:49.314458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:49.698757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-492330854", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "167545a1-7614-488e-b0ff-7dc229109bb2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:49.910596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:49.917777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] validate_networks() for [('167545a1-7614-488e-b0ff-7dc229109bb2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:55:49.926478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bfad2a3d-4124-4940-a109-781bc61da9d8 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1557 microversion: 2.1 time: 0.642856 Jul 26 04:55:49.929901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2810/5544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:49 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1557 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:49.941205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:49.947511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:49.973994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:49.973994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:49.973994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:49.973994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:50.972378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:50.998685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:51.007664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:51.010232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-beabd897-84ef-4d7b-8573-1e4b84d19393 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.076163 Jul 26 04:55:51.021380 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2811/5545] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:49 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:51.031597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:55:51.032573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:55:51.037341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:55:51.038325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:55:51.039031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:55:51.044810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:51.045309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:51.077631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.078391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.079422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.080066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.086325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.096945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.103520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.105987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.174443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:55:51.198217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:55:51.264993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:55:51.267598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:55:51.385921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f83523ca-14a2-4cd0-9fbe-a6c88fc20ba3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692423 Jul 26 04:55:51.390985 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2735/5546] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:55:51.412203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:51.415778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:51.441057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.441776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.445359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:51.447421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:51.640321 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85d82248-07bc-45ca-91fc-fbda99e34f11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.614088 Jul 26 04:55:51.641229 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2812/5547] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 04:55:51 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-interface => generated 285 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:51.646868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af5d9980-0101-40c5-a191-73a98fbc9614 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:51.648141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af5d9980-0101-40c5-a191-73a98fbc9614 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:51.866789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af5d9980-0101-40c5-a191-73a98fbc9614 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:51.874403 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af5d9980-0101-40c5-a191-73a98fbc9614 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1214 microversion: 2.1 time: 0.231725 Jul 26 04:55:51.875002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2813/5548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:51 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:52.047453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:52.048105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:52.063794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:52.064258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:52.075397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:52.079808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:52.425927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:52.434737 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-573e38fe-1649-4040-b5d0-381322175b46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 1.037128 Jul 26 04:55:52.442582 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2736/5549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:51 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:52.899345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:52.899503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:52.921064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:52.921866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:52.931417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:52.931785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:53.452475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:53.465363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e832baa-f0a6-4fce-a3f6-d42de4382cd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1210 microversion: 2.1 time: 0.573967 Jul 26 04:55:53.474059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2737/5550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:52 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1210 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:55:53.507265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:53.511125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:53.548783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:53.554182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:53.563621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:53.569134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:53.653900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:53.668678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:53.674871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:53.680637 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fbdc2741-f6c6-44ac-869f-ce7c4ba35f07 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.635371 Jul 26 04:55:53.699763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2814/5551] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:52 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:55:54.524670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:54.527034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:54.549359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:54.551450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:54.554301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:54.557382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:54.559165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:54.563860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f893a736-4c10-4e88-9f28-786c07c5c176 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1169 microversion: 2.1 time: 1.088276 Jul 26 04:55:54.570755 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2738/5552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:53 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1169 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:54.711226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:54.711848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:54.720352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:54.720803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:54.730511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:54.735783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:54.816950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:54.857450 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cae168a7-aadd-4cb1-ab8f-041100e72488 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1272 microversion: 2.1 time: 0.353893 Jul 26 04:55:54.859885 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2815/5553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:54 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:55.597826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:55.599012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:55.611306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:55.613704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:55.614701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:55.615920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:55.989156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:56.003848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:56.005784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:56.007305 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58cbb580-76c2-4978-8251-f40ca8172593 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 1.300668 Jul 26 04:55:56.008966 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2739/5554] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:54 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:55:56.015184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:56.016128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:56.029899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:56.045602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:56.048071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:56.052150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:56.551104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:56.559733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2fb48949-e457-4285-968f-db22dab3d0ab tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.549446 Jul 26 04:55:56.575540 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2740/5555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:56 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:56.642237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:56.650759 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28b81b58-bec9-46fb-9e42-9975a361c5c5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 1.056879 Jul 26 04:55:56.651263 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2816/5556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:55 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:56.902601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dfa5fd43-23c3-44c4-9e38-d9a0b2f97fbc req-be9c0b9b-cf17-4690-9392-442af5d29738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32869b7e-cd3d-49f3-9cce-f6e920797730", "tag": "e623321d-e127-48c6-8f1b-6b5bbd0976fd"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:55:56.924374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfa5fd43-23c3-44c4-9e38-d9a0b2f97fbc req-be9c0b9b-cf17-4690-9392-442af5d29738 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:56.929716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dfa5fd43-23c3-44c4-9e38-d9a0b2f97fbc req-be9c0b9b-cf17-4690-9392-442af5d29738 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:56.970267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dfa5fd43-23c3-44c4-9e38-d9a0b2f97fbc req-be9c0b9b-cf17-4690-9392-442af5d29738 service nova] Creating event network-changed:e623321d-e127-48c6-8f1b-6b5bbd0976fd for instance 32869b7e-cd3d-49f3-9cce-f6e920797730 on n-h1-848886-16 Jul 26 04:55:56.979116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dfa5fd43-23c3-44c4-9e38-d9a0b2f97fbc req-be9c0b9b-cf17-4690-9392-442af5d29738 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081865 Jul 26 04:55:56.979754 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2741/5557] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:55:57.038169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:57.040076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:57.054757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.056154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.057915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.060820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.582939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:57.584374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:57.596885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:57.603962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.609567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.611280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.611607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:57.614651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.617683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:57.619260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfd3d8c5-24fd-480f-a38f-4087980b080d tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1738 microversion: 2.20 time: 0.586960 Jul 26 04:55:57.624344 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2817/5558] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:57 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:57.684407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:57.686900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:57.704650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.707304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.711286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:57.712281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:57.899347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:57.921281 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0e457d5b-c1f4-43ba-a51c-8c2e19bc03b5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.343539 Jul 26 04:55:57.921885 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2742/5559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:57 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:58.439549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:58.453113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fc46eafa-fbe7-42d7-a33f-94a1cd6ee43e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.777909 Jul 26 04:55:58.453751 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2818/5560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:57 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:55:58.652883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:58.654283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:58.690321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:58.691174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:58.703032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:58.703775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:58.949756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:58.951068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:58.969152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:58.971415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:58.972454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:58.974601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:59.236117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:59.275484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:59.282982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:55:59.284282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5fd90c6f-b5e5-4bef-ac58-3e1207c0bbda tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1720 microversion: 2.20 time: 0.636201 Jul 26 04:55:59.299730 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2743/5561] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:55:58 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1720 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:55:59.475552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:55:59.477374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:55:59.489830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:59.493251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:55:59.495895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:55:59.497806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:00.096361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:00.105959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:00.116167 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1f89817-5787-415e-8a7d-75ae86574c71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.645214 Jul 26 04:56:00.131176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2744/5562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:59 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:00.138638 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2dc71167-6993-4772-be9e-291325a5e055 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 1.182700 Jul 26 04:56:00.141249 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2819/5563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:55:58 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:00.332268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:00.333151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:00.351983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:00.351983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:00.351983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:00.351983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:00.551915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8d419475-95a3-4ead-8b34-7ebb1a5352cd req-96a31b93-2c67-427b-a983-60f0e081ed38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49de5b37-7837-4acd-9051-776e76d91e2c", "tag": "c63b9656-1c39-457d-906e-e13a2e384220"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:00.574935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d419475-95a3-4ead-8b34-7ebb1a5352cd req-96a31b93-2c67-427b-a983-60f0e081ed38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:00.576718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8d419475-95a3-4ead-8b34-7ebb1a5352cd req-96a31b93-2c67-427b-a983-60f0e081ed38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:00.610841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8d419475-95a3-4ead-8b34-7ebb1a5352cd req-96a31b93-2c67-427b-a983-60f0e081ed38 service nova] Creating event network-changed:c63b9656-1c39-457d-906e-e13a2e384220 for instance 49de5b37-7837-4acd-9051-776e76d91e2c on n-h1-848886-16 Jul 26 04:56:00.625711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8d419475-95a3-4ead-8b34-7ebb1a5352cd req-96a31b93-2c67-427b-a983-60f0e081ed38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075467 Jul 26 04:56:00.627678 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2820/5564] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:00.853051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:00.863272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:00.871538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:00.876917 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1d7f70d1-09a5-4f42-a4f1-9cccc4ef328e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1720 microversion: 2.20 time: 0.550298 Jul 26 04:56:00.877537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2745/5565] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:00 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1720 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:01.139405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:01.146785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:01.164200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:01.165076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:01.167220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:01.185503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.186217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:01.188335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.188927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:01.191934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.192618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:01.196237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.197688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:01.248275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:01.455169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:01.461433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:01.471408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8a7469f-b15f-4dab-bddf-31149c39701d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.336891 Jul 26 04:56:01.484347 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2821/5566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:01 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:01.665562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:01.684966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d789f35-876f-47ef-a399-57052e64dba9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.526085 Jul 26 04:56:01.685810 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2746/5567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:01 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:01.905042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:01.905042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:01.912927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:01.917801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.918983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:01.920203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:01.920835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.238236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:02.247937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:02.250242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:02.259408 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-83c07304-f174-4d84-b2bb-921ca147764c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1723 microversion: 2.20 time: 0.355023 Jul 26 04:56:02.260627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2822/5568] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:01 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:02.285325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6dc036d-d6cc-41b4-93e7-828341fc260c"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:02.288929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:02.307895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.308369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.309198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.315408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.500029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:02.501506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:02.517227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.521021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.522494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.525699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.951055 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6692de5b-0e25-4217-a2e6-32fa5ad97182 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.669550 Jul 26 04:56:02.951703 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2747/5569] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Jul 26 04:56:02 2022] POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments => generated 188 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:56:02.970861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:02.972629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:02.994690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.995159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:02.995970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:02.996754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:03.281020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:03.308730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec879bc2-3521-4d44-9c17-59631bcb5fc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.811759 Jul 26 04:56:03.342917 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2823/5570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:02 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:03.348748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3aa4cb62-596b-463a-acd0-695454533182 req-897b4b99-eee5-4c3b-ae0d-06e105b5df7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "name": "network-vif-unplugged", "status": "completed", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:03.368640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3aa4cb62-596b-463a-acd0-695454533182 req-897b4b99-eee5-4c3b-ae0d-06e105b5df7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:03.369200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3aa4cb62-596b-463a-acd0-695454533182 req-897b4b99-eee5-4c3b-ae0d-06e105b5df7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:03.384905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_external_events [req-3aa4cb62-596b-463a-acd0-695454533182 req-897b4b99-eee5-4c3b-ae0d-06e105b5df7f service nova] Unable to find a host for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23. Dropping event network-vif-unplugged {{(pid=119488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 04:56:03.386319 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3aa4cb62-596b-463a-acd0-695454533182 req-897b4b99-eee5-4c3b-ae0d-06e105b5df7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042042 Jul 26 04:56:03.387355 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2824/5571] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 04:56:03.394959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:03.395992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:03.404545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:03.405218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:03.406271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:03.406906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:03.565453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:03.576689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ee6ed62-66a0-491f-9603-f813b6c9c7c6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.621252 Jul 26 04:56:03.577285 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2748/5572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:02 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:03.821720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1de3839a-2b8e-453d-8ce3-c50638338515 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments/b6dc036d-d6cc-41b4-93e7-828341fc260c" status: 202 len: 0 microversion: 2.20 time: 0.428573 Jul 26 04:56:03.824524 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2825/5573] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Jul 26 04:56:03 2022] DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments/b6dc036d-d6cc-41b4-93e7-828341fc260c => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:56:03.903562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:03.904145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:03.917261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:03.917729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:03.918557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:03.919263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.002075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:04.081303 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7147189-c6c5-40d6-a9cb-679f250c37af tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/action" status: 202 len: 0 microversion: 2.20 time: 0.178588 Jul 26 04:56:04.082863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2749/5574] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Jul 26 04:56:03 2022] POST /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:56:04.104043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:04.106107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:04.121518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.122701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.123818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.124694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.353039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:04.353808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:04.380614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.381093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.382538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.386871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.434263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:04.448857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:04.454092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:04.456954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b326d56-545a-4d7e-a7f5-2655dc159c65 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1671 microversion: 2.20 time: 0.368503 Jul 26 04:56:04.459650 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2826/5575] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:04 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1671 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:04.601740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:04.602677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:04.615202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.616033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.620412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:04.621365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:04.937384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:04.950337 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-28e7be0a-c6b6-407b-8268-05ce7fe799d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.355370 Jul 26 04:56:04.950921 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2827/5576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:04 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:05.203259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:05.214942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd2d1ff3-5033-4379-bc6e-57f479d65ff3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.867212 Jul 26 04:56:05.238471 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2750/5577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:04 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:05.479827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:05.481274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:05.495386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:05.496252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:05.497756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:05.500808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:05.843099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:05.861355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:05.867410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:05.868697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa1c2db7-8915-4c81-b576-2c4c8090eaf7 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1673 microversion: 2.20 time: 0.393032 Jul 26 04:56:05.884921 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2828/5578] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:05 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1673 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:05.971708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:05.972496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:05.986699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:05.987409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:05.988362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:05.992714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:06.238335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:06.238958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:06.253085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:06.253598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:06.267074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:06.267520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:06.395928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:06.405728 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2daf8298-f682-43f8-9256-9af6c2fe0dd7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.437795 Jul 26 04:56:06.407716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2751/5579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:05 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:06.813804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:06.827480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-42710dc0-ccc5-4195-89db-188c4201a5c8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 0.591447 Jul 26 04:56:06.830921 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2829/5580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:06 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:06.911771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:06.912475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:06.925645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:06.926649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:06.927693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:06.928323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:07.428326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:07.430411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:07.443199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:07.444923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:07.448206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:07.448858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:07.786252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:07.796086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:07.803604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:07.805333 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9713ea60-8a56-426f-8692-d45727993a35 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.897908 Jul 26 04:56:07.806813 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2752/5581] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:06 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:07.851868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:07.853505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:07.867904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:07.869606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:07.872228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:07.873084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:07.906881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:07.915174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6d0d138-28bd-4889-929c-ab98de3fcfce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.490800 Jul 26 04:56:07.917369 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2830/5582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:07 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:08.068165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c2fa45ee-a0cf-43c3-ac84-513585b97d59 req-4d4038a6-ef28-430c-9d77-ddedb81b6f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46f925-8029-4774-bf04-a9a0fbc818e7", "name": "network-vif-plugged", "status": "completed", "tag": "450f4fa0-d4fa-499e-9054-08bccc60719d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:08.083713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2fa45ee-a0cf-43c3-ac84-513585b97d59 req-4d4038a6-ef28-430c-9d77-ddedb81b6f70 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:08.084355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2fa45ee-a0cf-43c3-ac84-513585b97d59 req-4d4038a6-ef28-430c-9d77-ddedb81b6f70 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:08.122542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c2fa45ee-a0cf-43c3-ac84-513585b97d59 req-4d4038a6-ef28-430c-9d77-ddedb81b6f70 service nova] Creating event network-vif-plugged:450f4fa0-d4fa-499e-9054-08bccc60719d for instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 on n-h2-848886-16 Jul 26 04:56:08.130690 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c2fa45ee-a0cf-43c3-ac84-513585b97d59 req-4d4038a6-ef28-430c-9d77-ddedb81b6f70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066390 Jul 26 04:56:08.131648 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2831/5583] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:08.834388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:08.836127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:08.838184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=72 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:08.851076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:08.852168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:08.852988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:08.853441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:09.155036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:09.172383 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e09a1692-ac44-47d3-b35a-d5dd4e5a6612 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1203 microversion: 2.1 time: 1.324729 Jul 26 04:56:09.173000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2753/5584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:07 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1203 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:09.185740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:09.198423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:09.218044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:09.218531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:09.219891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:09.220493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:09.251305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:09.268693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:09.274529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:09.276643 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd7b4dea-0601-4f16-8b27-fce02e7eded8 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.447315 Jul 26 04:56:09.277233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2832/5585] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:08 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:09.649219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:09.657475 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c94390e-8c4b-406a-9376-fcbbe3789b2a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.480099 Jul 26 04:56:09.671225 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2754/5586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:09 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:09.752815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f83f7d87-3e84-47bf-ac1d-491e1ee22247 req-8da49d62-e154-42a0-b3c6-85cc3afd69fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:09.782932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f83f7d87-3e84-47bf-ac1d-491e1ee22247 req-8da49d62-e154-42a0-b3c6-85cc3afd69fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:09.782932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f83f7d87-3e84-47bf-ac1d-491e1ee22247 req-8da49d62-e154-42a0-b3c6-85cc3afd69fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:09.802991 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f83f7d87-3e84-47bf-ac1d-491e1ee22247 req-8da49d62-e154-42a0-b3c6-85cc3afd69fb service nova] Creating event network-changed:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h2-848886-16 Jul 26 04:56:09.824594 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f83f7d87-3e84-47bf-ac1d-491e1ee22247 req-8da49d62-e154-42a0-b3c6-85cc3afd69fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075399 Jul 26 04:56:09.826135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2833/5587] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:10.209901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:10.212485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:10.222825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:10.223701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:10.224839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:10.226837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:10.370384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1701918512", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "fda03d0b-1477-4cf3-8c66-970004214749"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:10.459413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] validate_networks() for [('fda03d0b-1477-4cf3-8c66-970004214749', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:56:10.534810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:10.550883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34886862-8823-4f33-add0-c47a538f63e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1390 microversion: 2.1 time: 0.356600 Jul 26 04:56:10.552260 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2834/5588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:10 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:10.558573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c2b5b765-c0f0-4629-9bf5-8af69e1aaf1c req-bc3abf2d-3aef-4ea4-a81c-0feae4fca9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49de5b37-7837-4acd-9051-776e76d91e2c", "name": "network-vif-plugged", "status": "completed", "tag": "c63b9656-1c39-457d-906e-e13a2e384220"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:10.570876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2b5b765-c0f0-4629-9bf5-8af69e1aaf1c req-bc3abf2d-3aef-4ea4-a81c-0feae4fca9c4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:10.573028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c2b5b765-c0f0-4629-9bf5-8af69e1aaf1c req-bc3abf2d-3aef-4ea4-a81c-0feae4fca9c4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:10.590628 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c2b5b765-c0f0-4629-9bf5-8af69e1aaf1c req-bc3abf2d-3aef-4ea4-a81c-0feae4fca9c4 service nova] Creating event network-vif-plugged:c63b9656-1c39-457d-906e-e13a2e384220 for instance 49de5b37-7837-4acd-9051-776e76d91e2c on n-h1-848886-16 Jul 26 04:56:10.597691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c2b5b765-c0f0-4629-9bf5-8af69e1aaf1c req-bc3abf2d-3aef-4ea4-a81c-0feae4fca9c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043777 Jul 26 04:56:10.598940 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2835/5589] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:10.608562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:10.609809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:10.617839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:10.618687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:10.620168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:10.620835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.172171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:11.191142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:11.192987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:11.195791 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3c4dc51-9d7d-4eed-a8fb-d2e5964c6659 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.595302 Jul 26 04:56:11.196969 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2836/5590] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:10 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:11.219747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:11.221184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:11.236315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.236984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.238118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.238736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.528917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:11.541502 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b6f2b1a-8e75-49ab-8f22-a95978a50716 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1390 microversion: 2.1 time: 0.327559 Jul 26 04:56:11.543836 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2837/5591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:11 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:11.549089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:11.549941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:11.559825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.561510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.562909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.564165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.723611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:56:11.724114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:56:11.724697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:56:11.726232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:56:11.726892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:56:11.778137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.780275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.781657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.782331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.829302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Getting quotas for project e238e302b0424d94a5ea151cea1026aa. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:56:11.842054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:11.843628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Getting quotas for user 177771ed1c064bcf848f4eff2b414582 and project e238e302b0424d94a5ea151cea1026aa. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:56:11.844809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:11.852666 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58f458d0-62d5-4023-bfb9-0d6e7999cd62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1314 microversion: 2.1 time: 0.307324 Jul 26 04:56:11.857379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2838/5592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:11 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:11.862439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:11.873736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:56:11.875039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:11.883637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.884059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.885231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:11.887261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:11.891513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:56:11.981315 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88d411c8-e161-4037-8199-8d3c2476e7ae tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.113799 Jul 26 04:56:11.989420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2755/5593] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:56:12.003447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5847063b-abaa-4293-bd30-c08677982786 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:12.004644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5847063b-abaa-4293-bd30-c08677982786 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:12.357123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:12.371380 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c79be774-4763-4eb9-82d1-2dd5190da96a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1390 microversion: 2.1 time: 0.512285 Jul 26 04:56:12.374296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2839/5594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:11 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:12.412372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:12.415143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:12.433796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:12.434935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:12.440397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:12.441222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:12.881279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:12.894588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:12.896497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:12.906659 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8012a99-df48-4a57-aad3-3c7f39974a2a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.508665 Jul 26 04:56:12.907373 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2840/5595] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:12 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:12.914628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:12.915120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:12.946435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:12.946824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:12.947637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:12.948068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.024477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:56:13.060952 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:56:13.061227 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 04:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 (ip 10.222.0.43) !!! Jul 26 04:56:13.215925 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc493737-6261-4f77-ac80-3be14538419d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 204 len: 0 microversion: 2.1 time: 0.305053 Jul 26 04:56:13.216878 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2841/5596] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:56:12 2022] DELETE /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:56:13.222232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:13.222953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:13.243622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.247898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.248793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.250744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.335355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5847063b-abaa-4293-bd30-c08677982786 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:13.347324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5847063b-abaa-4293-bd30-c08677982786 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1215 microversion: 2.1 time: 1.354542 Jul 26 04:56:13.349881 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2756/5597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:11 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1215 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:13.370653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:13.371507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:13.396968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.398929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.399968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.403110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.573323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:13.583404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-513129d7-240a-4487-ba93-08f8137e74cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1502 microversion: 2.1 time: 0.365205 Jul 26 04:56:13.607890 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2842/5598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:13 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:13.613724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4bc8e6a-091c-4d9e-b7de-fc20364a92c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:13.624111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4bc8e6a-091c-4d9e-b7de-fc20364a92c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.624849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4bc8e6a-091c-4d9e-b7de-fc20364a92c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.650879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4bc8e6a-091c-4d9e-b7de-fc20364a92c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Going to try to stop instance {{(pid=119488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:56:13.711500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:13.723933 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-70c9f7cf-d62d-4238-a23f-f30a37c8c9af tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1396 microversion: 2.1 time: 0.372373 Jul 26 04:56:13.724781 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2757/5599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:13 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1396 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:13.743108 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4bc8e6a-091c-4d9e-b7de-fc20364a92c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.133279 Jul 26 04:56:13.743719 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2843/5600] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:13 2022] POST /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:56:13.752907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:13.754417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:13.766591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.768633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.773815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.776387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.932275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:13.932979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:13.949996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.950655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:13.952673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:13.953277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:14.025039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:14.034205 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f0002c3-acf4-486a-ae3c-9f2e63743070 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.286189 Jul 26 04:56:14.035050 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2758/5601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:13 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:14.206422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:14.217956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:14.221688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:14.223332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-715b69ec-b659-478e-9b0d-a3ba4b5a7a8b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.296251 Jul 26 04:56:14.224494 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2844/5602] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:13 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:56:14.372162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:14.372789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:14.386079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:14.386582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:14.389889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:14.390384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:14.652335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:14.693007 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b604d308-1636-4d19-b75d-2efe9ec899a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1219 microversion: 2.1 time: 0.325371 Jul 26 04:56:14.729685 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2759/5603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:14 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1219 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:14.769861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:14.773201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:14.787021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:14.788335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:14.794147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:14.796661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.063935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:15.064618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:15.081228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.084124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.089648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.091683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.129210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:15.138417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3421a5ac-f43f-4901-a06e-47da8b329fa7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1396 microversion: 2.1 time: 0.395796 Jul 26 04:56:15.141955 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2845/5604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:14 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1396 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:15.249236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:15.249817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:15.260453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.260918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.261727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.262192 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.717285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:15.728405 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bac66055-d52e-4235-b3c4-a844f9fd8690 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.671735 Jul 26 04:56:15.741773 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2760/5605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:15 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:15.775146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:15.775664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:15.792165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.799556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:15.802492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:15.802995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:16.159505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:16.193550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-731f9352-bae7-4457-902b-435a92dfe5bc tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1219 microversion: 2.1 time: 0.450294 Jul 26 04:56:16.199351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2761/5606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:15 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1219 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:16.215934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:16.220698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:16.245576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:16.246042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:16.246885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:16.247349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:16.625196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:16.640107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-50f5eab7-ad6e-4d71-bd10-118d58bfbbe1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1396 microversion: 2.1 time: 0.439217 Jul 26 04:56:16.641629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2762/5607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:16 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1396 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:16.663223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:16.680410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:16.682478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:16.683890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4eb218b-5bf9-4bf4-aaad-115857002825 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 1.438982 Jul 26 04:56:16.684965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2846/5608] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:15 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:56:16.765614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:16.766732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:16.774498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:16.775267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:16.776689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:16.777579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:17.223622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:17.224765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:17.268037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:17.279886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:17.283340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:17.287696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:18.454803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:18.480582 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed00f9f4-46c3-457a-b339-951565c62f2c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1275 microversion: 2.1 time: 1.263308 Jul 26 04:56:18.482604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2847/5609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:17 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1275 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:18.500064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:18.501424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:18.532395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:18.534961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:18.535961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:18.539001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:18.574031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:18.645299 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ce155fc-fcb9-4bc0-af5b-81362acf8c08 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 1.887537 Jul 26 04:56:18.651311 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2763/5610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:16 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:18.668043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:18.674693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:18.695872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:18.703000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:18.712530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:18.713638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:18.717085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:18.940573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:18.954782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8bfd412-df3c-4d16-9e39-14142414a0c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1354 microversion: 2.1 time: 0.467995 Jul 26 04:56:18.956727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2848/5611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:18 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1354 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:19.015842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2bb2d83f-630b-4994-82ea-b2bf990d5335 req-32537b7e-e4df-4f9e-a83e-555cfcc5dd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46f925-8029-4774-bf04-a9a0fbc818e7", "name": "network-vif-deleted", "tag": "450f4fa0-d4fa-499e-9054-08bccc60719d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:19.054487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2bb2d83f-630b-4994-82ea-b2bf990d5335 req-32537b7e-e4df-4f9e-a83e-555cfcc5dd75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:19.056673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2bb2d83f-630b-4994-82ea-b2bf990d5335 req-32537b7e-e4df-4f9e-a83e-555cfcc5dd75 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:19.114091 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2bb2d83f-630b-4994-82ea-b2bf990d5335 req-32537b7e-e4df-4f9e-a83e-555cfcc5dd75 service nova] Creating event network-vif-deleted:450f4fa0-d4fa-499e-9054-08bccc60719d for instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 on n-h2-848886-16 Jul 26 04:56:19.136223 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2bb2d83f-630b-4994-82ea-b2bf990d5335 req-32537b7e-e4df-4f9e-a83e-555cfcc5dd75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124812 Jul 26 04:56:19.139254 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2849/5612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:19.517184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:19.517993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:19.545685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:19.547500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:19.550890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:19.553005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:19.931099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:19.965096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:19.967109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:19.981775 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-928e50ad-b011-4919-919a-76745e47a116 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 1.327100 Jul 26 04:56:19.984607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2764/5613] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:18 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:20.012889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:20.013783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:20.045605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:20.046713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:20.047812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:20.051033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:20.226047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:20.234390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dbb491b9-afb1-4bb7-ba41-a4667a5fa32a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1273 microversion: 2.1 time: 0.729945 Jul 26 04:56:20.241563 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2850/5614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:19 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1273 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:20.272980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:20.286329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:20.307835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:20.313782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:20.316701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:20.319885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:20.457000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:20.470439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ceb32c0-cad0-4337-a15f-96317c15d476 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.484376 Jul 26 04:56:20.478183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2765/5615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:19 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:20.806477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:20.821285 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a762ede-4fd0-4590-8374-f8c058ec44eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.574579 Jul 26 04:56:20.847573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2851/5616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:20 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:21.012297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:21.012941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:21.028951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.029464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.046332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.047016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.265752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:21.266632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:21.284332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.284808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.291151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.295983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.772370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:21.786523 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21b2e21a-5514-4e6d-a042-6c34d005f0d8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1273 microversion: 2.1 time: 0.525350 Jul 26 04:56:21.800353 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2852/5617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:21 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1273 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:21.800750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:21.817979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:21.818694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:21.850834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.855058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.858659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.859131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.875901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:21.889177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:21.894437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:21.896193 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc78fb0e-fa9d-4bcc-8fb8-66bd047aa030 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.888730 Jul 26 04:56:21.904146 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2766/5618] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:21 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:21.924620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:21.925365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:21.942984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.943447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:21.945152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:21.947408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:21.948058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:22.010068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:22.163536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:22.177070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2641179-4181-4df3-8745-d166ca3c1cc3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.271471 Jul 26 04:56:22.186721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2767/5619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:21 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:22.810718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:22.811555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:22.833627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:22.834104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:22.835304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:22.835784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:23.052451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.120424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.125378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11ff8eda-1862-44c0-943a-a3071f9dda9a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1273 microversion: 2.1 time: 0.319537 Jul 26 04:56:23.130092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e639e27-1300-4ec4-a270-0f674b21be79 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 1.331763 Jul 26 04:56:23.131763 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2768/5620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:22 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:23.135159 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2853/5621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:21 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:23.147719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:23.153712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:23.208091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:23.208775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:23.211242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:23.214763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:23.215455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:23.215787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:23.236261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:23.236980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:23.241921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:23.244470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:23.341454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:23.487845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.498376 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d482519-1070-4fb9-b3d7-763b075fa5f3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.292625 Jul 26 04:56:23.498979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2854/5622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:23 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:23.508472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.537056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.539754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:23.540657 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58bdd6ef-8372-4b75-b2cf-30dff8df8baf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.407547 Jul 26 04:56:23.561888 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2769/5623] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:23 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:24.168573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:24.170680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:24.173072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:24.173964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:24.194603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.197656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.200732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.202957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.217624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.218140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.218944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.219403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.739347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:24.752654 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b0d7485-2fd4-4925-8fb2-ea3c8293ee6a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.584629 Jul 26 04:56:24.758493 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2770/5624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:24 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:24.768058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:24.774919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:24.806501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.808964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.810538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.816601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.911333 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d439de6e-26b8-4dea-9199-3b769168c3d2 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/ips" status: 200 len: 149 microversion: 2.1 time: 0.151431 Jul 26 04:56:24.920679 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2771/5625] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 04:56:24 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/ips => generated 149 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:24.933243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:24.933924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:24.953147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.956660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.957696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:24.958382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:24.971081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:24.984933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e9a284a-9a2b-4699-8bf3-c574396dc372 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.829100 Jul 26 04:56:24.998991 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2855/5626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:24 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:25.016432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:25.017695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:25.044870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:25.049334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:25.055286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:25.063260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:25.288697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:25.308910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a0214f84-8b5f-4888-a336-131a00a05a27 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.382995 Jul 26 04:56:25.310020 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2772/5627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:24 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:25.785187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:25.788742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:25.806744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:25.817202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:25.817962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:25.819200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:26.383930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:26.393358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b4b8cc6-7194-4c81-a1a3-585f11a80c0b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.613371 Jul 26 04:56:26.393950 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2773/5628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:25 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:26.424892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:26.427308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:26.445876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:26.446720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:26.447869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:26.448978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:27.095759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.113799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cc4c3e33-57a6-4e37-abe7-a06dfe83157e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.703759 Jul 26 04:56:27.115743 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2774/5629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:26 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:27.135406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:27.142528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:27.159462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:27.160039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:27.160846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:27.161298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:27.305344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.315032 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0b47aee7-1c78-48d5-b91a-1f0e4bac3ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.197915 Jul 26 04:56:27.320330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2775/5630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:27 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:27.416384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:27.418002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:27.434046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:27.434801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:27.437789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:27.438560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:27.850525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.860910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-382c7f1c-f51c-4c3b-8ab7-0d14db977127 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.448238 Jul 26 04:56:27.870649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2776/5631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:27 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:27.932094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.942250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.948629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:27.956540 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e7e52795-a985-43c5-9bd7-038916e2dd12 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 2.955784 Jul 26 04:56:27.963607 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2856/5632] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:24 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:28.139387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:28.140016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:28.150250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.150708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.151719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.167670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.348975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:28.349786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:28.365069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.365711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.376324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.377277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.637177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:28.654042 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65a62117-be66-4d82-aea2-d1be3b4e2071 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.519599 Jul 26 04:56:28.655221 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2777/5633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:28 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:28.660983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67916358-9022-4082-800f-1be70ca46246"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:28.664493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:28.672981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.673694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.674861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.675757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.834067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:28.842886 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-16403d58-6f26-43c6-b992-05cf296bef09 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.507689 Jul 26 04:56:28.843483 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2857/5634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:28 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:28.863667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-104d9a63-9a44-41eb-ab83-042d17923d81 req-98ed44e6-e188-41bf-bbf0-8caa7e16730c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d16a0b7e-aaee-4dce-a39c-f612b6d6be92", "tag": "b4cc65fc-83fa-4e69-ab73-18c34fed56cd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:28.874792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-104d9a63-9a44-41eb-ab83-042d17923d81 req-98ed44e6-e188-41bf-bbf0-8caa7e16730c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.875589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-104d9a63-9a44-41eb-ab83-042d17923d81 req-98ed44e6-e188-41bf-bbf0-8caa7e16730c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.931117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-104d9a63-9a44-41eb-ab83-042d17923d81 req-98ed44e6-e188-41bf-bbf0-8caa7e16730c service nova] Creating event network-changed:b4cc65fc-83fa-4e69-ab73-18c34fed56cd for instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 on n-h2-848886-16 Jul 26 04:56:28.937859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-104d9a63-9a44-41eb-ab83-042d17923d81 req-98ed44e6-e188-41bf-bbf0-8caa7e16730c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093177 Jul 26 04:56:28.939053 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2858/5635] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:28.956902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:28.958281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:28.966599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.967109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:28.968532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:28.968994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.116646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91e4f190-0e09-4948-a0df-10e9e16b2928 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "POST /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459598 Jul 26 04:56:29.117676 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2778/5636] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 04:56:28 2022] POST /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:29.133963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:29.135378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:29.144611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.145827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.147319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.148099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.212512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:29.225033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f49d8083-7a32-40e4-ae94-e3cb36e4f04f tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.284442 Jul 26 04:56:29.228638 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2859/5637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:28 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:29.516693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:29.527466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:29.529065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:29.530475 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f051a07b-7ec1-4f45-8fe9-1d46f120df64 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.410984 Jul 26 04:56:29.547178 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2779/5638] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:29 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:29.675946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:29.676658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:29.698307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.698762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.699761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.700375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.866688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:29.867982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:29.874690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.875497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.876500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:29.877149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:29.961986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:29.971637 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f84c6c0f-a0d7-40f6-a65e-c559180ccef1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1188 microversion: 2.1 time: 0.109627 Jul 26 04:56:29.972693 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2780/5639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:29 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1188 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:30.011171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:30.023718 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87513e27-eb4e-4610-bb90-5b4c7914e869 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.351630 Jul 26 04:56:30.034553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2860/5640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:29 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:30.250020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:30.250713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:30.257865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:30.258754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:30.259992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:30.260334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:30.434332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:30.445674 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40d2461c-0ec1-4e3a-ae71-2e49e0f5346a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.199116 Jul 26 04:56:30.459483 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2781/5641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:30 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:30.559092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:30.560425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:30.575916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:30.576556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:30.583243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:30.583958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:30.932049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:30.949453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:30.953401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:30.955366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1fb8cc74-019d-43f4-8a8b-8132f953954c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.402582 Jul 26 04:56:30.967832 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2861/5642] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:30 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:30.995214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:30.995839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:31.008928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.009403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.010192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.013842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.047023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:31.047672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:31.055075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.055532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.056313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.056754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.121303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.121754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.123769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 1e46f925-8029-4774-bf04-a9a0fbc818e7 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:31.198366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:31.216192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:31.221867 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e344800-780c-453f-aa25-e2b95349d7e6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1193 microversion: 2.1 time: 0.231825 Jul 26 04:56:31.225862 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2782/5643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:30 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1193 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:31.469278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:31.470121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:31.482662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.483050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.483854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:31.484301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:31.716044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:31.725619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dbcfb5ce-8546-4a36-86d4-4d2c26c89cb4 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.262074 Jul 26 04:56:31.726727 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2783/5644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:31 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:31.982932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:31.983795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:32.002837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.004166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.005534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.006326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.088031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:32.096213 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2247d184-829e-4049-a72a-776c882f0dae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 1.053392 Jul 26 04:56:32.102401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2862/5645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:31 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:32.210741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:32.225650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:32.227386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:32.229077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37cab1fb-ed91-44c2-9853-b7f45cb01f66 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.250043 Jul 26 04:56:32.230184 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2784/5646] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:31 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:56:32.247864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:32.248718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:32.257182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.257803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.258778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.259363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.326790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.329146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.329780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 1e46f925-8029-4774-bf04-a9a0fbc818e7 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:32.409722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:32.427011 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24899c0e-3bc0-49a7-90f4-784bd80a33f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1193 microversion: 2.1 time: 0.183318 Jul 26 04:56:32.428617 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2863/5647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:32 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1193 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:32.750984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:32.751969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:32.768703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.769381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:32.770620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:32.771640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.065990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.075104 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3de82932-8fa3-4f82-94fd-62c549f16fad tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.328062 Jul 26 04:56:33.092869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2785/5648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:32 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:33.119229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:33.120453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:33.127730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.128387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.129329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.129937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.282258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:33.282258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:33.287535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.288340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.289283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.289911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.508387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.526092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.533745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.535466 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5daee02c-ab1c-4625-91d2-286e2f60e5e2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.281670 Jul 26 04:56:33.550922 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2786/5649] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:33 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:33.559650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:33.567657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:33.583029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.584362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.585484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.586093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.670339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:33.671284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:33.672443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 1e46f925-8029-4774-bf04-a9a0fbc818e7 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:33.749989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.768991 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0e176b90-905d-4be7-84af-746ba48c6c37 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.654547 Jul 26 04:56:33.785283 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2864/5650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:33 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:33.786058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:33.795294 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74462ae5-77cd-4eda-982e-34174f3053d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 200 len: 1147 microversion: 2.1 time: 0.242927 Jul 26 04:56:33.795882 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2787/5651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:33 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 1147 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:34.100642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:34.101581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:34.113187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.116822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:34.117821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.118562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:34.563480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:34.564907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:34.575082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.575550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:34.580166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.580726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:34.690316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:34.707524 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df67d51e-f32f-410f-aa69-be0dbf5d5364 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.605519 Jul 26 04:56:34.710759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2865/5652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:34 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:34.793689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:34.795023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:34.803416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.811054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:34.812060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:34.812616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:35.044866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:35.060547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:35.062143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:35.067692 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a72e968-ae15-4ec2-9ede-2b74fd08f9c2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.509001 Jul 26 04:56:35.070880 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2788/5653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:34 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:56:35.095261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:35.097340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:35.130259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:35.135487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:35.138839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:35.140517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:35.194185 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 HTTP/1.1 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1e46f925-8029-4774-bf04-a9a0fbc818e7'} Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:35.195986 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3247eef-59ce-43a8-a5c1-8657ad022789 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 404 len: 111 microversion: 2.1 time: 0.125357 Jul 26 04:56:35.204536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2789/5654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:35 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:56:35.544394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:35.554786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47cd3479-2aa7-4ede-a49c-7b9724da995a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.765046 Jul 26 04:56:35.565322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2866/5655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:34 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:35.736718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:35.738010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:35.751036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:35.752590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:35.753570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:35.756903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:36.095123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:36.096475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:36.106189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:36.112338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:36.117672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:36.123319 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18b31f6d-7231-4218-adec-5d4527f2420e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.391592 Jul 26 04:56:36.124469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:36.125092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:36.127589 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2790/5656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:35 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:36.359204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5ea53354-5df2-4d2c-9e51-887f5e027468 req-d31dbdd2-4f30-41ad-82c8-c80d68117ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "name": "network-vif-plugged", "status": "completed", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:36.408152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5ea53354-5df2-4d2c-9e51-887f5e027468 req-d31dbdd2-4f30-41ad-82c8-c80d68117ee6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:36.409518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5ea53354-5df2-4d2c-9e51-887f5e027468 req-d31dbdd2-4f30-41ad-82c8-c80d68117ee6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:36.428094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:36.447007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:36.456878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:36.463133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12c2e217-379d-4074-bc0d-30d16595593e tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.372565 Jul 26 04:56:36.475903 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2867/5657] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:36 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:36.492910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5ea53354-5df2-4d2c-9e51-887f5e027468 req-d31dbdd2-4f30-41ad-82c8-c80d68117ee6 service nova] Creating event network-vif-plugged:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h2-848886-16 Jul 26 04:56:36.500015 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5ea53354-5df2-4d2c-9e51-887f5e027468 req-d31dbdd2-4f30-41ad-82c8-c80d68117ee6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154413 Jul 26 04:56:36.501781 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2791/5658] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:36.592890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:36.595860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:36.620343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:36.620835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:36.628483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:36.629637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:37.039475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:37.055226 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5b1ba66-3523-414a-9fc6-87106b05bf6f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.479298 Jul 26 04:56:37.060019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2868/5659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:36 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:37.151833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:37.153812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:37.180340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:37.180832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:37.188028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:37.191782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:37.500229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:37.503190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:37.508032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:37.526873 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2abfb731-93ba-4ad7-9fb3-966a1f0f1b8a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.379941 Jul 26 04:56:37.530958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2792/5660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:37 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:37.533823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:37.564200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:37.565360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:37.566326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:37.936494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:37.988357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:37.992167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:37.994443 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9729bfa7-e337-4564-a796-87456256d2cb tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.498166 Jul 26 04:56:37.996491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2869/5661] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:37 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:56:38.082168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:38.083081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:38.091592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:38.097496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:38.098837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:38.100250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:38.499687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:38.511677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e48ce92d-dde5-43d5-84f5-c7aabfee0d4c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1512 microversion: 2.1 time: 0.434245 Jul 26 04:56:38.512207 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2793/5662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:38 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:38.551212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:38.552956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:38.568393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:38.571419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:38.577638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:38.578416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:38.655010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:39.024417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:39.026556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:39.047216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:39.048888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:39.051025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:39.053939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:39.526238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:39.540252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:39.554789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:39.556321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:39.563349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e92fb7dd-bb5c-43cc-a7c9-734a7a9a7af7 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 1.012082 Jul 26 04:56:39.565525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-09d76bb7-087f-47b0-9704-1a1cf4d87f33 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 0.547910 Jul 26 04:56:39.569500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2794/5663] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:39 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:39.586401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2870/5664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:38 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:39.587001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:39.587692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:39.609321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:39.619434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:39.620521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:39.620991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:39.932149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:39.942143 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dca2e1d5-137e-4fdb-954b-c84089be8cdc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1489 microversion: 2.1 time: 0.371339 Jul 26 04:56:39.942826 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2795/5665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:39 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1489 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:39.968674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:39.979698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.020310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:40.026830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.033140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.035158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.038381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.149769 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ccde7a2-bf5f-4738-a961-1aaecac7b974 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 200 len: 143 microversion: 2.1 time: 0.183769 Jul 26 04:56:40.152296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2871/5666] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:39 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 143 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:40.166817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:40.179537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.187814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.189013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.189971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.190616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.414100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:40.414908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.436372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.436840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.447117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.448028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:40.452606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.459988 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7747cf15-3647-45e8-a403-36411188907d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.301506 Jul 26 04:56:40.460598 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2796/5667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:40.492095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:40.493082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.493200 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 HTTP/1.1 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1e46f925-8029-4774-bf04-a9a0fbc818e7'} Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:56:40.499747 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.504716 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.510014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.513215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.514319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.514896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:56:40.515235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.518779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4bcf4fa6-c536-47a4-9519-63eefdc00276 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 404 len: 111 microversion: 2.1 time: 0.109089 Jul 26 04:56:40.521568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2872/5668] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:56:40 2022] DELETE /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:56:40.530823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:40.534364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46f925-8029-4774-bf04-a9a0fbc818e7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.558263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.560917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.561846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.562354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.610000 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 HTTP/1.1 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '1e46f925-8029-4774-bf04-a9a0fbc818e7'} Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:56:40.611627 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:56:40.616641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 1e46f925-8029-4774-bf04-a9a0fbc818e7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:56:40.619893 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-104f4497-196e-4da9-adad-e6e0bcba3f95 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7" status: 404 len: 111 microversion: 2.1 time: 0.089995 Jul 26 04:56:40.621056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2873/5669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:40 2022] GET /compute/v2.1/servers/1e46f925-8029-4774-bf04-a9a0fbc818e7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:56:40.632786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:40.633668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:40.647489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.649203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.651383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:40.652102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:40.959190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:40.968002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-811af196-beea-4f44-b9b6-b36ae61e9202 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.485198 Jul 26 04:56:40.974607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2797/5670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:41.000157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:41.007126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:41.045996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.046555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:41.052062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.054409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:41.409699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:41.423354 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74ee6958-ace1-45a1-8807-38d350da098b tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.436665 Jul 26 04:56:41.425331 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2798/5671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:40 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:41.441422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:41.444116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:41.455925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.456757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:41.457779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.459023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:41.776183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:41.790831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:41.795996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:41.799092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fbef96db-4f99-4523-a313-a831a4f01c70 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1729 microversion: 2.20 time: 1.175338 Jul 26 04:56:41.800739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:41.801583 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2874/5672] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:40 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1729 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:41.812409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92323f02-8467-4942-8c73-2385b57dde10 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.385787 Jul 26 04:56:41.817160 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2799/5673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:41.839702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:41.840135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:41.871971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.872512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:41.873340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:41.873787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:42.152855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:42.184730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-796abe7a-5652-4ba4-80f2-d2f15bc856ad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.341473 Jul 26 04:56:42.185804 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2875/5674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:42.376019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1257340719", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "167545a1-7614-488e-b0ff-7dc229109bb2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:42.446599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:42.447700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:42.466710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:42.467338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:42.468308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:42.499622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] validate_networks() for [('167545a1-7614-488e-b0ff-7dc229109bb2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:56:42.500171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.170814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:43.185464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51fee8c5-96d2-4956-9b29-2c648b700034 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.742676 Jul 26 04:56:43.186547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2876/5675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:42 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:43.195977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-93966a7e-6d83-41dd-9452-307648c9396c req-4b32adba-df30-47a4-94e4-07b0110cba94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d16a0b7e-aaee-4dce-a39c-f612b6d6be92", "name": "network-vif-plugged", "status": "completed", "tag": "b4cc65fc-83fa-4e69-ab73-18c34fed56cd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:43.238336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-93966a7e-6d83-41dd-9452-307648c9396c req-4b32adba-df30-47a4-94e4-07b0110cba94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:43.241113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-93966a7e-6d83-41dd-9452-307648c9396c req-4b32adba-df30-47a4-94e4-07b0110cba94 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.292311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-93966a7e-6d83-41dd-9452-307648c9396c req-4b32adba-df30-47a4-94e4-07b0110cba94 service nova] Creating event network-vif-plugged:b4cc65fc-83fa-4e69-ab73-18c34fed56cd for instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 on n-h2-848886-16 Jul 26 04:56:43.313062 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-93966a7e-6d83-41dd-9452-307648c9396c req-4b32adba-df30-47a4-94e4-07b0110cba94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124403 Jul 26 04:56:43.316314 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2877/5676] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:43.331488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:43.338291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:43.375951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:43.376452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.377303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:43.377748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.640708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:56:43.641168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:56:43.641595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:56:43.642003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:56:43.642437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:56:43.656552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:43.660911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.664978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:43.665768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:43.722808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:56:43.734183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:56:43.780063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:56:43.782802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:56:43.885838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc8cabe8-6d5f-48e5-904d-336ae5d520eb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516379 Jul 26 04:56:43.888909 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2800/5677] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:56:43.907644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1aacadc5-e2e2-457e-8280-61b84eef8ec6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:43.908685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1aacadc5-e2e2-457e-8280-61b84eef8ec6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:43.940952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:43.951868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:43.956269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:43.957521 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-92caa039-f04c-4856-81a5-7646a0b8a468 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1716 microversion: 2.20 time: 0.640040 Jul 26 04:56:43.958296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2878/5678] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:56:43 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1716 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:56:44.033581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1aacadc5-e2e2-457e-8280-61b84eef8ec6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:44.043863 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1aacadc5-e2e2-457e-8280-61b84eef8ec6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1215 microversion: 2.1 time: 0.146998 Jul 26 04:56:44.046359 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2801/5679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:43 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:44.210899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:44.211598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:44.221858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:44.224951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:44.228921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:44.230684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:44.533388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:44.547558 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4fb8c09-d814-4f33-9e20-2b1db84c3cb5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.342291 Jul 26 04:56:44.563560 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2879/5680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:44 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:45.066938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:45.069011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:45.075415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:45.076070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:45.076852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:45.077306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:45.081718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:45.181754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:45.196526 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6929c39-1d6c-4bbb-8100-15f7163688fc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1267 microversion: 2.1 time: 0.134690 Jul 26 04:56:45.198486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2802/5681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:45 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:45.577869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:45.580005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:45.596060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:45.601125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:45.604123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:45.607671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:46.220551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:46.221849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:46.237567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:46.238029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:46.238848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:46.239374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:46.437780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:46.444698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:46.452776 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed141549-a0e7-49dd-854a-a5004d715af0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1273 microversion: 2.1 time: 0.235921 Jul 26 04:56:46.455954 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2803/5682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:46 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:46.461882 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-735d8226-aaf9-4bfa-95a9-e7866f30b754 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1315 microversion: 2.1 time: 0.889072 Jul 26 04:56:46.463985 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2880/5683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:45 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1315 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:46.836475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:46.836988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:46.839069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:46.847046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:46.847560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:46.863300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:46.864029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.025889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lazy-loading 'services' on Instance uuid 32869b7e-cd3d-49f3-9cce-f6e920797730 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:47.175639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5bbb1a08-4d44-4604-867d-f348458df170 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments/67916358-9022-4082-800f-1be70ca46246" status: 202 len: 0 microversion: 2.1 time: 0.343267 Jul 26 04:56:47.189041 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2804/5684] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 04:56:46 2022] DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments/67916358-9022-4082-800f-1be70ca46246 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:56:47.198461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:47.201913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:47.221314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.230618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.233044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.240546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.301416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62e4abd7-d74c-42a2-971e-cbb205cf7328 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107418 Jul 26 04:56:47.311052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2881/5685] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:47 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:47.478004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:47.479442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:47.494275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:47.495201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:47.507331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.507796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.508608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.508856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.509057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.509659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.510666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:47.511283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:47.883137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:47.892351 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71ea1038-b8eb-4c0c-b651-1140eb058b26 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.418918 Jul 26 04:56:47.892947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2805/5686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:47 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:48.271352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:48.280654 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b49414b-3f4a-4c5b-91f3-9b8b563ab73a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1503 microversion: 2.1 time: 0.791176 Jul 26 04:56:48.284194 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2882/5687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:47 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1503 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:48.315152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:48.316347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:48.321637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:48.331746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:48.341527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.344101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.349939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.352169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.352543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.357624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.359033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.362723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.439814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a445f7bc-e867-43c0-befb-9b9989ae7663 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129573 Jul 26 04:56:48.444528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2883/5688] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:48 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:48.823810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:48.831842 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a2fc26a-ba00-458e-ae64-1e797c4a215e tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1503 microversion: 2.1 time: 0.529390 Jul 26 04:56:48.837486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2806/5689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:48 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1503 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:48.863514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:48.864651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:48.876264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.876724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.877519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.878118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.917308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:48.918182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:48.927746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.929129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.930087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:48.931056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:48.941669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lazy-loading 'flavor' on Instance uuid d16a0b7e-aaee-4dce-a39c-f612b6d6be92 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:49.056761 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0be8fd92-ce43-4452-907f-485e716a823a tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action" status: 202 len: 0 microversion: 2.1 time: 0.198572 Jul 26 04:56:49.058366 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2884/5690] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:48 2022] POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:56:49.068484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:49.069633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:49.083721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:49.084404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:49.085638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:49.086344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:49.270965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:49.283452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99ee3064-9d3a-4d59-b386-2f9a8c7abc2d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.373802 Jul 26 04:56:49.285302 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2807/5691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:48 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:49.388051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:49.396727 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-675f73b2-c62c-44d5-b2c7-e482c65004a3 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1511 microversion: 2.1 time: 0.333968 Jul 26 04:56:49.401895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2885/5692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:49 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:49.453541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:49.456677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:49.487456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:49.487920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:49.488795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:49.489932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:49.550905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14403f19-bce9-465b-9a5e-c5f2120dbcf6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102302 Jul 26 04:56:49.552520 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2808/5693] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:49 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:56:49.594317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-eaa89b18-a3f9-4b5e-9eff-64686cd56a19 req-1a69f3c2-9765-4880-9358-5af481d85836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d76b4b-460e-4c54-ae75-2c53a69c4e62", "tag": "86c90808-445b-4994-94b1-30a74bc426a7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:49.613162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eaa89b18-a3f9-4b5e-9eff-64686cd56a19 req-1a69f3c2-9765-4880-9358-5af481d85836 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:49.615478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-eaa89b18-a3f9-4b5e-9eff-64686cd56a19 req-1a69f3c2-9765-4880-9358-5af481d85836 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:49.666286 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-eaa89b18-a3f9-4b5e-9eff-64686cd56a19 req-1a69f3c2-9765-4880-9358-5af481d85836 service nova] Creating event network-changed:86c90808-445b-4994-94b1-30a74bc426a7 for instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 on n-h1-848886-16 Jul 26 04:56:49.680611 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-eaa89b18-a3f9-4b5e-9eff-64686cd56a19 req-1a69f3c2-9765-4880-9358-5af481d85836 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089825 Jul 26 04:56:49.685075 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2886/5694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:50.305274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:50.305891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:50.312598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.314889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.316806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.319345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.424160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:50.425545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:50.446651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.452441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.453621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.458108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.811225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:50.821986 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9275eeb6-a7b9-415f-9dc2-8a866b960ade tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1494 microversion: 2.1 time: 0.404213 Jul 26 04:56:50.830871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2887/5695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:50 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1494 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:50.836894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:50.840419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:50.857020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.859544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.860454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.862637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.912049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:50.945751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:50.957537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e19f62b-a0fe-4758-b509-e1665d0375ad tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125428 Jul 26 04:56:50.961820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01b28beb-88c5-44d8-8214-ae98196dc074 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.660943 Jul 26 04:56:50.962322 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2888/5696] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:50 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:50.969829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2809/5697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:50 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:50.976131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:50.976658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:50.986390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.987931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:50.988814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:50.989355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:51.094588 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a4afc601-ef56-435e-ba6a-a063bd13c8c5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action" status: 202 len: 0 microversion: 2.1 time: 0.127702 Jul 26 04:56:51.095573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2889/5698] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:50 2022] POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:56:51.105243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:51.107017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:51.122720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:51.123484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:51.124668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:51.125384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:51.354238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:51.364814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe817430-51a7-4e96-aa83-63182521fe0c tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1500 microversion: 2.1 time: 0.263315 Jul 26 04:56:51.365810 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2810/5699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:51 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:51.978856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:51.985417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:51.990052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:51.990717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:51.993905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:51.995051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:51.996598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:51.997489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:52.001573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:52.002881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:52.005113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:52.005774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:52.052291 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa0f9772-ba01-4773-b17a-c9e330e68901 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083633 Jul 26 04:56:52.053453 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2890/5700] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:51 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:52.230205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:52.239600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f5ea608b-27f0-415c-89c8-29e14856dd1e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.252759 Jul 26 04:56:52.251653 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2811/5701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:51 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:52.387375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:52.388155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:52.395014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:52.396253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:52.397241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:52.397870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:52.725836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:52.741721 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0acf2b93-256b-4ea6-92c3-2c5416dcaab9 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1500 microversion: 2.1 time: 0.358594 Jul 26 04:56:52.745851 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2891/5702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:52 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1500 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:53.064954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:53.068410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:53.101752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.106516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.107597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.108214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.162333 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b1b07f2f-73e6-49ec-8523-c396f5b0737f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101383 Jul 26 04:56:53.163446 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2812/5703] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:53 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:53.261702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:53.262390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:53.273719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.274461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.275473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.276103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.769092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:53.770265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:53.772592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:53.779559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.780393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.781566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:53.782237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:53.968279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:53.979700 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-536e5c25-2327-42e9-a450-4d3f30a7c8a2 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1503 microversion: 2.1 time: 0.215979 Jul 26 04:56:53.980875 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2813/5704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:53 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:54.000993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:54.001788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:54.008404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.008742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:54.009092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.009880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.010359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.022928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4938107d-64da-4438-ab78-b154b28b7f2f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.765207 Jul 26 04:56:54.029144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2892/5705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:53 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:54.037188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lazy-loading 'flavor' on Instance uuid d16a0b7e-aaee-4dce-a39c-f612b6d6be92 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:56:54.042658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:54.120179 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e7cdffc8-8f95-4171-8b45-c725e5fdcbd8 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action" status: 202 len: 0 microversion: 2.1 time: 0.122848 Jul 26 04:56:54.122060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2814/5706] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:53 2022] POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:56:54.130563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:54.131671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:54.139844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.143327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.144933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.145940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.177132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:54.180378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:54.190605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.191280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.192868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:54.193682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:54.230909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73e441bd-5c99-4e41-8aa3-a00f51fc35fe tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059871 Jul 26 04:56:54.232086 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2815/5707] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:54 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:54.378875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:54.390601 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-710dd1bd-d894-4aa1-b8e1-3d7a53dde028 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1511 microversion: 2.1 time: 0.264397 Jul 26 04:56:54.396296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2893/5708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:54 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:55.050536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.051392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.064716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.067656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.068567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.069025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.121713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:55.243850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.246572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.259182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.261294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.262501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.263102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.297060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:55.307460 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b67430a-f2a2-49e7-8335-141493261d11 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068093 Jul 26 04:56:55.307915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6bdc7acc-0275-447c-bbcc-6e86abc54820 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.262756 Jul 26 04:56:55.310519 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2894/5709] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 04:56:55 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:56:55.311399 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2816/5710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:55 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:55.317688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7857a539-122a-404c-b636-34bdaea1404f req-b3eb69ba-3591-4e04-97ff-cf1d6d67993c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d76b4b-460e-4c54-ae75-2c53a69c4e62", "name": "network-vif-plugged", "status": "completed", "tag": "86c90808-445b-4994-94b1-30a74bc426a7"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:55.330504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7857a539-122a-404c-b636-34bdaea1404f req-b3eb69ba-3591-4e04-97ff-cf1d6d67993c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.330947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7857a539-122a-404c-b636-34bdaea1404f req-b3eb69ba-3591-4e04-97ff-cf1d6d67993c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.343293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7857a539-122a-404c-b636-34bdaea1404f req-b3eb69ba-3591-4e04-97ff-cf1d6d67993c service nova] Creating event network-vif-plugged:86c90808-445b-4994-94b1-30a74bc426a7 for instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 on n-h1-848886-16 Jul 26 04:56:55.351646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7857a539-122a-404c-b636-34bdaea1404f req-b3eb69ba-3591-4e04-97ff-cf1d6d67993c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040901 Jul 26 04:56:55.352655 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2895/5711] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:56:55.428162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.430325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.431366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.433421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.441454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.442135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.443141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.443701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.454374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.454837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.455640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.456088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.515525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:56:55.648125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa5ec955-985b-409d-9139-231de50be76b tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 204 len: 0 microversion: 2.1 time: 0.226494 Jul 26 04:56:55.648770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2896/5712] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:56:55 2022] DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:56:55.667871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.668423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.684630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.685233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.687234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:55.687526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.688152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.697552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b836f719-266e-460e-89b6-56a452370e20 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1494 microversion: 2.1 time: 0.283848 Jul 26 04:56:55.699054 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2817/5713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:55 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1494 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:55.724984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:55.725877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.736824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.737450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.742609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.743408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.849479 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93f9d1d6-ce6f-4d43-8738-a3734e5401d5 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action" status: 202 len: 0 microversion: 2.1 time: 0.128988 Jul 26 04:56:55.851091 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2818/5714] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:55 2022] POST /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:56:55.871651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:55.875404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:55.885442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.885919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.887246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:55.887769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:55.957232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:55.967678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5c02dbb4-0309-46a1-81c3-664c41c5ae61 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1680 microversion: 2.1 time: 0.314415 Jul 26 04:56:55.974640 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2897/5715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:55 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:56.185194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:56.196429 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-014660f6-dc29-4492-b1bb-41f1c3bb9dfb tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1500 microversion: 2.1 time: 0.330284 Jul 26 04:56:56.197772 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2819/5716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:55 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1500 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:56.337576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:56.338494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:56.346610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:56.347273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:56.348282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:56.348893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:56.767014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:56.776907 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c7f5338-6003-4625-b281-b7798eeb0cdd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1315 microversion: 2.1 time: 0.441868 Jul 26 04:56:56.776907 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2898/5717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:56 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:56.996137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:56.997077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:57.003738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.004202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:57.005715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.006182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:57.162505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:57.170671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-364629a9-b5c8-4ebd-af2a-b74ef67c1200 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1680 microversion: 2.1 time: 0.178416 Jul 26 04:56:57.171253 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2820/5718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:56 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:57.218508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:57.221493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:57.227885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.228718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:57.229871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.230455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:57.461274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:57.469414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2c105f8-aeda-449d-a293-62b94f1ba4bd tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1500 microversion: 2.1 time: 0.254816 Jul 26 04:56:57.470099 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2899/5719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:57 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:57.805178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:57.816027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:57.840866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.843158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:57.855948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:57.857327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.081107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:58.092858 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9d28f0d5-dd0c-4b38-8285-dedfc977c30c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1502 microversion: 2.1 time: 0.299638 Jul 26 04:56:58.096502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2821/5720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:57 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:58.116658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:58.119774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:58.126878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.127676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.128709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.129403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.204608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:58.204608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:58.206001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.207205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.208333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.208789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.219187 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5cf5c8aa-369f-4c02-8334-6406a7a93bec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.106711 Jul 26 04:56:58.220543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2900/5721] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:58 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:56:58.427832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:58.441552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2caedac-8308-4282-b347-7084d554b0b1 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1680 microversion: 2.1 time: 0.251294 Jul 26 04:56:58.447415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2822/5722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:58 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:58.496691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:58.498764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:58.514353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.515298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:58.516671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:58.517748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.032980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:59.043339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5311044-239a-44e8-a57b-77a2d2f0f396 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1503 microversion: 2.1 time: 0.555930 Jul 26 04:56:59.045487 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2901/5723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:58 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:59.065916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:59.067776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:59.077386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.078598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.083245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.083931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.136028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:56:59.233814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:59.238300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:59.249925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.250744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.259288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.265966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.338353 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0911a78e-9cbc-4970-86e3-16e64c8deb91 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 204 len: 0 microversion: 2.1 time: 0.275104 Jul 26 04:56:59.339897 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2823/5724] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:56:59 2022] DELETE /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:56:59.350337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:59.351613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:59.359625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.360165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.361167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.361827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.379007 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31fd025a-1c59-40fd-9b02-cd8f88fc49b8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.149852 Jul 26 04:56:59.396623 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2902/5725] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:56:59 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:56:59.466063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:56:59.466814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:56:59.484235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.485823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.492567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.493588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.590705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a85740a13db4102a29eca16c84a6b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69de1118038a4055a134e0a2f2514233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:59.593648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:59.607332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-291d7466-5eac-4dc6-b262-aa2c2d545544 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 200 len: 1613 microversion: 2.1 time: 0.146233 Jul 26 04:56:59.621399 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2903/5726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:59 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 1613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:56:59.694102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:56:59.705666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2d14cc14-9086-4061-a6f6-a04e7df300db tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1509 microversion: 2.1 time: 0.358907 Jul 26 04:56:59.705666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2824/5727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:56:59 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:56:59.937650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b271054b-61d2-483d-8cf9-1f43b1cf50c3 req-b8733b65-2b9c-4f81-baab-5ed7b099a468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32869b7e-cd3d-49f3-9cce-f6e920797730", "name": "network-vif-deleted", "tag": "e623321d-e127-48c6-8f1b-6b5bbd0976fd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:56:59.967325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b271054b-61d2-483d-8cf9-1f43b1cf50c3 req-b8733b65-2b9c-4f81-baab-5ed7b099a468 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:56:59.968117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b271054b-61d2-483d-8cf9-1f43b1cf50c3 req-b8733b65-2b9c-4f81-baab-5ed7b099a468 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:56:59.996073 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b271054b-61d2-483d-8cf9-1f43b1cf50c3 req-b8733b65-2b9c-4f81-baab-5ed7b099a468 service nova] Creating event network-vif-deleted:e623321d-e127-48c6-8f1b-6b5bbd0976fd for instance 32869b7e-cd3d-49f3-9cce-f6e920797730 on n-h1-848886-16 Jul 26 04:57:00.002051 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b271054b-61d2-483d-8cf9-1f43b1cf50c3 req-b8733b65-2b9c-4f81-baab-5ed7b099a468 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070282 Jul 26 04:57:00.003372 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2904/5728] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:00.420557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:00.423799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:00.450027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.450712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.451687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.452574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.513634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2c423bd-2e10-48c0-ad24-51c9861bbfb8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.100199 Jul 26 04:57:00.515557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2825/5729] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:00 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:00.633168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:00.640654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:00.672960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.674383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.678104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.678639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.729392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:00.730101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:00.748397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.750287 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:00.750984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.752384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 HTTP/1.1 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '32869b7e-cd3d-49f3-9cce-f6e920797730'} Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:00.753768 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:00.758490 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:00.760153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:00.766866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:00.770874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-744103f2-f4c1-4d78-af52-9305f34244e6 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 404 len: 111 microversion: 2.1 time: 0.142522 Jul 26 04:57:00.772828 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2905/5730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:00 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:00.789366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3364e072-36c5-4f89-be55-689257e80a31 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '.version_select at 0x7f38b48c2f70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:00.833151 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3364e072-36c5-4f89-be55-689257e80a31 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809073187" status: 202 len: 0 microversion: 2.1 time: 0.054542 Jul 26 04:57:00.834103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2906/5731] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 04:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809073187 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:01.230130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:01.245050 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce3342d7-7a11-4585-a7b4-ff3ac956edee tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1509 microversion: 2.1 time: 0.521707 Jul 26 04:57:01.246286 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2826/5732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:00 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:01.528296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:01.530507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:01.556094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:01.556563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:01.557368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:01.557815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:01.625144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-855e1c38-39fa-4895-ac34-5fad280d3a3a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.101307 Jul 26 04:57:01.628686 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2907/5733] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:01 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:02.272083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:02.273507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:02.290200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:02.291014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:02.292278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:02.295518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:02.649761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:02.659748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:02.678879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:02.679366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:02.681098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:02.681546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:02.772690 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00e3d27e-f082-4103-aa50-62deac406f46 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.130466 Jul 26 04:57:02.775198 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2908/5734] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:02 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 04:57:02.850079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177771ed1c064bcf848f4eff2b414582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238e302b0424d94a5ea151cea1026aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:02.868730 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e95ed47d-ad92-46f7-86e4-e547e4faa235 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 200 len: 1509 microversion: 2.1 time: 0.601465 Jul 26 04:57:02.872546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2827/5735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:02 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 1509 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:03.031653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e4f0b569-2ec1-4813-98cf-7780b8ea9ba0 req-c2ec6518-ea98-4b5d-bc85-c826f52ced26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d16a0b7e-aaee-4dce-a39c-f612b6d6be92", "name": "network-vif-deleted", "tag": "b4cc65fc-83fa-4e69-ab73-18c34fed56cd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:03.047193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e4f0b569-2ec1-4813-98cf-7780b8ea9ba0 req-c2ec6518-ea98-4b5d-bc85-c826f52ced26 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:03.047762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e4f0b569-2ec1-4813-98cf-7780b8ea9ba0 req-c2ec6518-ea98-4b5d-bc85-c826f52ced26 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:03.068224 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e4f0b569-2ec1-4813-98cf-7780b8ea9ba0 req-c2ec6518-ea98-4b5d-bc85-c826f52ced26 service nova] Creating event network-vif-deleted:b4cc65fc-83fa-4e69-ab73-18c34fed56cd for instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 on n-h2-848886-16 Jul 26 04:57:03.075320 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e4f0b569-2ec1-4813-98cf-7780b8ea9ba0 req-c2ec6518-ea98-4b5d-bc85-c826f52ced26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049891 Jul 26 04:57:03.076601 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2909/5736] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:03.792081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:03.800415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:03.833420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:03.833904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:03.837938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:03.840738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:03.894966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:03.896238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] [instance: d16a0b7e-aaee-4dce-a39c-f612b6d6be92] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:03.936352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:03.936743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:03.942551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:03.943086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:03.983447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d3c16c6-3f26-4de6-afaa-51b814253a22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.201131 Jul 26 04:57:03.984085 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2828/5737] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:03 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:04.021771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] HTTP exception thrown: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Request method failure captured: Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 HTTP/1.1 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33PlV441uFQODb3LMLwobGWH5TOlRjJ4GeWi87k2hhmZBUktP_ec_dInwxUQoTcvaVqtFY9rH4Y4aFbVjEEOnhaC7cNVKWDRlBXAbCNV4eq8E--WBFSd9CVfw5ztGrM3q9WEq7d4r5EkEEst9BqsUFZFa9o36VPkvWr1y-NqrYtnmxo Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e238e302b0424d94a5ea151cea1026aa Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestServerAdvancedOps-684058879 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e238e302b0424d94a5ea151cea1026aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e238e302b0424d94a5ea151cea1026aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e238e302b0424d94a5ea151cea1026aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e238e302b0424d94a5ea151cea1026aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestServerAdvancedOps-684058879 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e238e302b0424d94a5ea151cea1026aa Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestServerAdvancedOps-684058879 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestServerAdvancedOps-684058879-project Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 177771ed1c064bcf848f4eff2b414582 Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestServerAdvancedOps-684058879-project Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd16a0b7e-aaee-4dce-a39c-f612b6d6be92'} Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:04.030847 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. Jul 26 04:57:04.038661 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:04.046259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] Returning 404 to user: Instance d16a0b7e-aaee-4dce-a39c-f612b6d6be92 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:04.046259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e055a9bd-7189-4c94-9723-b2ea9d7f9827 tempest-TestServerAdvancedOps-684058879 tempest-TestServerAdvancedOps-684058879-project] 10.222.0.43 "GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92" status: 404 len: 111 microversion: 2.1 time: 0.151554 Jul 26 04:57:04.046259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2910/5738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:03 2022] GET /compute/v2.1/servers/d16a0b7e-aaee-4dce-a39c-f612b6d6be92 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:05.000840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:05.004766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:05.025081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:05.025536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:05.028461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:05.028957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:05.151746 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-197da2cc-a73c-41d5-a81f-d57c75a23f52 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.153848 Jul 26 04:57:05.153486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2829/5739] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:04 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:06.181597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:06.183846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:06.192242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:06.192890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:06.193681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:06.194313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:06.253489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6bef38c-6d1e-40bd-9145-094be8102503 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.087821 Jul 26 04:57:06.257061 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2911/5740] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:06 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:07.266271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:07.270105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:07.301817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:07.322954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:07.323813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:07.324444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:07.408480 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2542863d-aa4a-4777-bbba-4faf48ad3736 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.146391 Jul 26 04:57:07.413130 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2830/5741] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:07 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:08.426202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:08.427015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:08.449147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.449885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.450854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.451560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.537293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-583a22a1-2288-4835-a497-7f3b14b812db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.117248 Jul 26 04:57:08.538374 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2912/5742] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:08 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:08.549557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:08.550138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:08.565505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.567425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.569671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.571651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.631804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 HTTP/1.1 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '32869b7e-cd3d-49f3-9cce-f6e920797730'} Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:08.636089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.641450 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.643873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:08.647576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9febfe92-a3d0-4f08-9d17-750264e91777 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 404 len: 111 microversion: 2.1 time: 0.101380 Jul 26 04:57:08.655441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2831/5743] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:57:08 2022] DELETE /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:08.661267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:08.661980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 32869b7e-cd3d-49f3-9cce-f6e920797730] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:08.679137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.679599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.683323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:08.684678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:08.729758 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 HTTP/1.1 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '32869b7e-cd3d-49f3-9cce-f6e920797730'} Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:08.732909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. Jul 26 04:57:08.736632 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:08.740153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 32869b7e-cd3d-49f3-9cce-f6e920797730 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:08.742274 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7087b9d3-2845-4b65-aac0-a3cbafd2ea96 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730" status: 404 len: 111 microversion: 2.1 time: 0.086668 Jul 26 04:57:08.744439 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2913/5744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:08 2022] GET /compute/v2.1/servers/32869b7e-cd3d-49f3-9cce-f6e920797730 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:09.548342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:09.551658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:09.573307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:09.573683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:09.574507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:09.574959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:09.637658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:09.704863 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6f68dcbe-38fc-4548-8264-31fa6b1a420b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 14 microversion: 2.1 time: 0.154928 Jul 26 04:57:09.705575 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2832/5745] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:09 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 04:57:10.717328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:10.719595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:10.754177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:10.755778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:10.762517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:10.765380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:10.769743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:10.874522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71b8eb03-8bf8-4b14-b146-370e7439668d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action" status: 200 len: 8207 microversion: 2.1 time: 0.161336 Jul 26 04:57:10.877091 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2914/5746] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:10 2022] POST /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62/action => generated 8207 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:10.897377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:10.902320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:10.929872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:10.930398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:10.931312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:10.934191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:11.231508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:11.240968 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b3892372-0def-4c33-9203-c44c8dbca7a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.358171 Jul 26 04:57:11.244992 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2833/5747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:10 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:11.273050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:11.274764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:11.288324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:11.289060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:11.290026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:11.294519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:11.638689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:11.659917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad613cf1-9b3c-47a9-b946-31192de88f07 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.391048 Jul 26 04:57:11.662910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2915/5748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:11 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:11.684919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:11.686700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:11.704403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:11.704873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:11.705700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:11.706202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.015210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:12.031136 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eece2747-a7c7-4f42-816b-03cada393519 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.350883 Jul 26 04:57:12.033139 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2834/5749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:11 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:12.059027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:12.060531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:12.087543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.098790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.099999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.101171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.482085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:12.511947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c39dee0-981b-4126-9cca-e3e3a5c029d5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.462932 Jul 26 04:57:12.515293 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2916/5750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:12 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:12.540261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:12.541034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:12.588646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.590743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.591599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.592050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.715708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Locking {{(pid=119487) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 26 04:57:12.826815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1f65e40f-7d35-4c87-b7ac-339e2b2b5e9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.296732 Jul 26 04:57:12.827964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2835/5751] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:12 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:12.837206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:12.838020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:12.856840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.857467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:12.858412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:12.858964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:13.896895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:13.925351 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5498113a-ca4f-4134-9a35-e7508a6f1e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.089506 Jul 26 04:57:13.931965 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2917/5752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:12 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:13.953081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:13.973108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:13.974017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.041920 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action HTTP/1.1 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 15 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: {"os-stop": {}} Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86', 'body': {'os-stop': {}}} Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked Jul 26 04:57:14.063921 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.070301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 409 to user: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 is locked {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:14.070301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9668ce63-3d85-4eb3-b61f-59869730b565 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 409 len: 107 microversion: 2.1 time: 0.117981 Jul 26 04:57:14.070301 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2836/5753] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:13 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 107 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:57:14.075111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:14.075657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.091017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.091487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.094822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.095286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.208577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Unlocking {{(pid=119488) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 04:57:14.309122 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58d69fe4-b333-475d-9e7c-beeb02540e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.238278 Jul 26 04:57:14.320233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1116cc33-0ea8-419a-a65e-a973096a45c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:14.322680 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2918/5754] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:14 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:14.328688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1116cc33-0ea8-419a-a65e-a973096a45c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.329485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1116cc33-0ea8-419a-a65e-a973096a45c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.360101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1116cc33-0ea8-419a-a65e-a973096a45c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 04:57:14.392094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:14.393249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.401233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.405688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.407696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.408769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.439771 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1116cc33-0ea8-419a-a65e-a973096a45c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.125074 Jul 26 04:57:14.445088 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2837/5755] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:14 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:14.450786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 HTTP/1.1 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3b02c4a8-d8cb-47b8-a296-4489c3aba916'} Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:14.453744 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.458759 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.459782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:14.460731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.461536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:14.480190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-190721d9-f9f8-4714-88ef-513f63392b7f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 404 len: 111 microversion: 2.1 time: 0.092175 Jul 26 04:57:14.483732 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2919/5756] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:57:14 2022] DELETE /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:14.492081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:14.494665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.497958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.499777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.500330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 3b02c4a8-d8cb-47b8-a296-4489c3aba916] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.506826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.521737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.523859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.525779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.526996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.567082 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 HTTP/1.1 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '3b02c4a8-d8cb-47b8-a296-4489c3aba916'} Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.568980 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. Jul 26 04:57:14.572970 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.574047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 3b02c4a8-d8cb-47b8-a296-4489c3aba916 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:14.575038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d01fcc2-00c4-4dae-832e-d9626f4f6e0e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916" status: 404 len: 111 microversion: 2.1 time: 0.089007 Jul 26 04:57:14.579905 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2920/5757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:14 2022] GET /compute/v2.1/servers/3b02c4a8-d8cb-47b8-a296-4489c3aba916 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:14.589885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:14.591529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.604637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.609275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.610481 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.611149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.647887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 HTTP/1.1 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '0744f394-0d00-4534-a634-12ca3afaaa48'} Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:14.653783 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2c0a05e6-9f1b-46d6-a231-8dbbf91463c0 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 404 len: 111 microversion: 2.1 time: 0.071089 Jul 26 04:57:14.657864 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2921/5758] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:57:14 2022] DELETE /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:57:14.669826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:14.674712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: 0744f394-0d00-4534-a634-12ca3afaaa48] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:14.690614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.691800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.692683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:14.694537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:14.723919 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 HTTP/1.1 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '0744f394-0d00-4534-a634-12ca3afaaa48'} Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:14.749190 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance 0744f394-0d00-4534-a634-12ca3afaaa48 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8478cc7e-f072-42ee-87f1-92452a744d4e tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48" status: 404 len: 111 microversion: 2.1 time: 0.089910 Jul 26 04:57:14.752966 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2922/5759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:14 2022] GET /compute/v2.1/servers/0744f394-0d00-4534-a634-12ca3afaaa48 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:15.196207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:15.218255 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe6edc23-2bff-4e3d-8365-70f279b0ef96 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.758424 Jul 26 04:57:15.219047 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2838/5760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:14 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:16.244212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:16.245618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:16.261410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:16.269987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:16.272220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:16.280348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:16.749705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:16.761058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c46ce9ce-e95c-4761-8223-1e49e228f1b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.521011 Jul 26 04:57:16.779838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2923/5761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:16 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:17.789439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:17.790076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:17.804463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:17.806094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:17.811846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:17.813038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:17.813518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:18.360665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:18.385824 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7bd5e0ab-9c8c-464b-b38d-14ef8bb223a4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.592159 Jul 26 04:57:18.389741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2839/5762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:17 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:19.417097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:19.417872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:19.442979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:19.443450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:19.444295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:19.463850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:20.180218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:20.206703 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ccba09bb-3761-4fb3-9ef4-2da97c144642 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.793529 Jul 26 04:57:20.235292 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2924/5763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:19 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:21.235109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:21.236795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:21.259504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:21.263553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:21.264660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:21.266258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:21.737764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:21.757922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed466699-9d48-481a-a752-7c276800aeae tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.532966 Jul 26 04:57:21.763365 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2840/5764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:21 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:22.471600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1141553157", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3f3d57c3-e6d4-4eaa-adfc-a5c139d3eaa4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:22.636100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:57:22.786209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:22.786828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:22.809173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:22.809657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:22.818602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:22.820092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:23.412053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:23.423226 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a2dd040-f4c4-423a-8a8e-52520ad28129 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.641518 Jul 26 04:57:23.423868 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2841/5765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:22 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:23.441705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:23.442403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:23.463947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:23.464421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:23.468382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:23.468887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:23.512770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 HTTP/1.1 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ea37c0c6-911a-4726-ae3a-2b6b55b4a019'} Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:23.528540 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.533165 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.535029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:23.536040 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79bd61cb-1cb7-4aa2-a917-64fb22fd5087 tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 404 len: 111 microversion: 2.1 time: 0.110580 Jul 26 04:57:23.536552 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2842/5766] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:57:23 2022] DELETE /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:23.549398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:23.552785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] [instance: ea37c0c6-911a-4726-ae3a-2b6b55b4a019] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:23.567308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:23.568244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:23.569276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:23.576218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:23.611970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] HTTP exception thrown: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Request method failure captured: Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 HTTP/1.1 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33Jyq_eD7LdywT6661nMSeSY2kUdoRHRu-ptDwDOZQyiRv5uHkllhcB4uPDGyzwyZG9BHRB9bMAgCn1GTr0xx-JXgi00kBlzXisiQBcRVzxEJ0OzLlxgBL1BmZ4A8qe_590L1RsRdmlo5DmFhFBXnhUxsslCDyaMX3GRZ6uF2UIuK_4 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69de1118038a4055a134e0a2f2514233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69de1118038a4055a134e0a2f2514233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69de1118038a4055a134e0a2f2514233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 69de1118038a4055a134e0a2f2514233 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-687738697 Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 6a85740a13db4102a29eca16c84a6b1e Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeNegativeTest-687738697-project Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ea37c0c6-911a-4726-ae3a-2b6b55b4a019'} Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:23.614383 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. Jul 26 04:57:23.618517 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:23.619648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] Returning 404 to user: Instance ea37c0c6-911a-4726-ae3a-2b6b55b4a019 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:23.621234 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e9cb17b-4804-4ed3-b312-e672c2ed9a3f tempest-AttachVolumeNegativeTest-687738697 tempest-AttachVolumeNegativeTest-687738697-project] 10.222.0.43 "GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019" status: 404 len: 111 microversion: 2.1 time: 0.079611 Jul 26 04:57:23.625635 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2843/5767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:23 2022] GET /compute/v2.1/servers/ea37c0c6-911a-4726-ae3a-2b6b55b4a019 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:57:24.452758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:24.453445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:24.470119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:24.471083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:24.472369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:24.475306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:24.679113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:57:24.679689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:57:24.680280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:57:24.681013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:57:24.681439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:57:24.700771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:24.709986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:24.711349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:24.715515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:24.775231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:57:24.794258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:57:24.971171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:57:24.973583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f3d57c3-e6d4-4eaa-adfc-a5c139d3eaa4',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:57:25.336785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-503e7f3e-9fd2-420f-8491-a933ce8696cc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.869160 Jul 26 04:57:25.350811 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2925/5768] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:57:25.364817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efdf72ce-110d-4456-b4b3-8169b1d87109 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:25.365389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-efdf72ce-110d-4456-b4b3-8169b1d87109 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:25.517685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:25.536500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b983517a-2c0c-429a-bd96-b982f4481248 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 1.093657 Jul 26 04:57:25.538595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2844/5769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:24 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:25.650647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-efdf72ce-110d-4456-b4b3-8169b1d87109 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:25.705112 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efdf72ce-110d-4456-b4b3-8169b1d87109 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1071 microversion: 2.1 time: 0.346779 Jul 26 04:57:25.705728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2926/5770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:25 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1071 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:26.559275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:26.559908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:26.581898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:26.584641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:26.587798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:26.588283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:26.741369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:26.742023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:26.775950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:26.776410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:26.777329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:26.777803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:27.025630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:27.045858 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c28d974-5e19-4365-a9b3-67495da7073b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1113 microversion: 2.1 time: 0.308683 Jul 26 04:57:27.048235 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2927/5771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:26 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1113 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:28.072570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:28.073913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:28.090591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:28.092521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:28.093510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:28.098870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:28.104188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:28.226962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:28.244713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-794fbfd9-8daa-4077-ab52-8039ba047ea3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1187 microversion: 2.1 time: 0.179667 Jul 26 04:57:28.248576 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2928/5772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:28 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1187 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:28.797313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:28.809735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-735a5f0d-dd9f-429c-b185-91181f36a0ed tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1655 microversion: 2.1 time: 2.254602 Jul 26 04:57:28.812866 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2845/5773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:26 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1655 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:28.838098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4fdbd50-50ce-4fdd-8596-be358ef470f9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:28.859054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4fdbd50-50ce-4fdd-8596-be358ef470f9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:28.859523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4fdbd50-50ce-4fdd-8596-be358ef470f9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:28.938515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4fdbd50-50ce-4fdd-8596-be358ef470f9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Going to try to start instance {{(pid=119488) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 04:57:29.019284 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4fdbd50-50ce-4fdd-8596-be358ef470f9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.185242 Jul 26 04:57:29.025003 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2929/5774] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:28 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:29.031200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:29.032514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:29.040264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:29.041083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:29.042725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:29.043432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:29.266951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:29.267668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:29.283318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:29.283768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:29.289341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:29.291708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:29.505402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:29.516945 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c5263da3-86d9-4103-aef9-5cee3f8a9043 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1187 microversion: 2.1 time: 0.255570 Jul 26 04:57:29.518092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2930/5775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:29 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1187 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:30.550171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:30.551078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:30.595833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:30.596742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:30.599978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:30.601960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:30.788178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:30.796928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-07224594-0d40-4f9a-ab14-556fe4f6a1e3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1187 microversion: 2.1 time: 0.261367 Jul 26 04:57:30.801370 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2931/5776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:30 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1187 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:31.362837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:31.401843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-370aa3d6-f955-42d7-9848-caed7fda2094 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1664 microversion: 2.1 time: 2.366469 Jul 26 04:57:31.403344 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2846/5777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:29 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1664 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:31.818352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:31.819918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:31.834120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:31.835441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:31.838019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:31.840829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:32.204394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:32.213644 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a3dc014d-8171-476b-ba47-14f99369f15d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1187 microversion: 2.1 time: 0.399308 Jul 26 04:57:32.236189 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2932/5778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:31 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1187 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:32.435022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:32.435641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:32.458488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:32.458948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:32.460165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:32.460621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:33.240882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:33.241403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:33.256528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:33.256995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:33.257795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:33.258265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:33.481200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:33.492143 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-47e66c13-0c24-4373-93e9-1c52cb5caca3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1229 microversion: 2.1 time: 0.259891 Jul 26 04:57:33.493202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2933/5779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:33 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1229 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:34.297348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:34.301879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:34.330102 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8e60881-af7b-4c90-85d3-0fd5a3852dba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.902496 Jul 26 04:57:34.330820 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2847/5780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:32 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:34.355676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:34.356910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:34.368530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:34.370744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:34.372064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:34.375980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:34.522909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:34.524642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:34.546388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:34.547153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:34.548141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:34.548756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:34.749449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:35.155796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:35.164962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1c063c8a-5bb2-4aa0-97b5-356b7128c554 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.813108 Jul 26 04:57:35.166300 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2934/5781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:34 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:35.192716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:35.194505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:35.210981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:35.211444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:35.212228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:35.212675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:35.304604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Unlocking {{(pid=119488) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 04:57:35.424334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:35.453568 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-07a88d01-6d66-4eba-97b8-67d776f506b2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1229 microversion: 2.1 time: 0.934561 Jul 26 04:57:35.457565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2848/5782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:34 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1229 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:35.494185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0843d470-6069-47d2-a82a-d0670f99dc8c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.309773 Jul 26 04:57:35.496034 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2935/5783] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:35 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:35.506979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:35.507606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:35.532461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:35.532927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:35.533774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:35.534284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.063786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:36.073783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e994d738-9aad-4995-98a9-dee3ded70e69 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.571554 Jul 26 04:57:36.098485 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2849/5784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:35 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:36.105710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:36.106370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:36.125091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:36.127278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.127969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.130808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.131266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.477496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:36.478227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:36.493749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.499934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.504466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.505043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.714885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:36.741965 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e682f48-702f-4651-9ac3-a4dc8d2a95be tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.640379 Jul 26 04:57:36.742869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2936/5785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:36 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:36.781823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:36.782750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:36.822199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.824506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:36.825489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:36.828034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:38.370850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:38.386873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb757525-5415-4a5c-a249-e6ee9fc34c3b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.614063 Jul 26 04:57:38.418331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2937/5786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:36 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:38.426887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:38.427805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:38.434640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:38.441073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:38.442302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:38.442911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:38.717202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b713250-a49a-41bb-8f7a-22d4b7e55adf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.296442 Jul 26 04:57:38.721256 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2938/5787] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:38 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:38.732759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:38.734981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:38.746305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:38.747189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:38.748862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:38.749979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:38.817886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:38.848802 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8047a36-5e2c-4d96-8805-f9d4fefa31a9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1229 microversion: 2.1 time: 2.378102 Jul 26 04:57:38.853254 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2850/5788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:36 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1229 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:39.035825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:39.073798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09aaf1cf-e597-4d8f-a0d1-180dfb2e0648 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1673 microversion: 2.1 time: 0.350245 Jul 26 04:57:39.077723 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2939/5789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:39.879915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:39.885186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:39.906032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:39.909958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:39.911975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:39.912643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.096204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:40.097697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:40.133543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.137821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.139638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.142275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.203903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:40.629936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:40.649157 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4beb7cda-62e0-43f5-bf3b-2b2086be31dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.775903 Jul 26 04:57:40.650705 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2851/5790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:39 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:40.656842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:40.659690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:40.667376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.668989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.670025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.671053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.792745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d0ac130-9871-4e63-8099-dbe55ddc936c tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.140723 Jul 26 04:57:40.802254 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2852/5791] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Jul 26 04:57:40 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:40.807912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ff3862aa-9113-4339-96ea-e141b8fc3fe7 req-64758ec5-0e13-4729-bd2d-664637f8730f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fb9481-b808-483b-bb20-9b3ad449786e", "tag": "8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:40.831849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:40.833012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff3862aa-9113-4339-96ea-e141b8fc3fe7 req-64758ec5-0e13-4729-bd2d-664637f8730f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.834700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff3862aa-9113-4339-96ea-e141b8fc3fe7 req-64758ec5-0e13-4729-bd2d-664637f8730f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.864313 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c6c3590a-39c8-4fec-8176-42d4b8331239 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1653 microversion: 2.1 time: 0.756070 Jul 26 04:57:40.864313 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2940/5792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1653 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:40.876106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:40.876938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:40.880458 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ff3862aa-9113-4339-96ea-e141b8fc3fe7 req-64758ec5-0e13-4729-bd2d-664637f8730f service nova] Creating event network-changed:8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd for instance 54fb9481-b808-483b-bb20-9b3ad449786e on n-h2-848886-16 Jul 26 04:57:40.882061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:40.888124 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ff3862aa-9113-4339-96ea-e141b8fc3fe7 req-64758ec5-0e13-4729-bd2d-664637f8730f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083967 Jul 26 04:57:40.888749 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2853/5793] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:40.899632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.902835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.904504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.910684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.952620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:40.953299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:40.968297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.969055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:40.970034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:40.970663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.029273 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a9cf4e7-1b9c-4c1e-a924-fd97897cdde5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.157291 Jul 26 04:57:41.030881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2941/5794] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:40 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:57:41.035088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:57:41.082249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:41.086370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:41.098352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.108213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.109411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.110835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.275753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-859f0e55-7d12-465f-b591-277f475f8060 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 204 len: 0 microversion: 2.20 time: 0.327217 Jul 26 04:57:41.281865 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2854/5795] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:57:40 2022] DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:57:41.297730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:41.316819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:41.342402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.343230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.344277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.346561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.741128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:41.749809 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34ce07c2-a342-46bb-96fb-9942a5670dcc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1660 microversion: 2.1 time: 0.693709 Jul 26 04:57:41.770516 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2942/5796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1660 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:41.777085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:41.783268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:41.793875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.801356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.802685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:41.803373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:41.875560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:41.885143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:41.886675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:41.889127 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dac0b871-bfec-4508-9f4c-cf7543598be6 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.602353 Jul 26 04:57:41.889782 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2855/5797] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:41 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:57:42.445616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:42.467438 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9a94acc-49bd-486c-98f1-b168eccb6f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.695396 Jul 26 04:57:42.468627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2943/5798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:41 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:42.777932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:42.780673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:42.797442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:42.798371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:42.801298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:42.803490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:42.917334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:42.917953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:42.927484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:42.931954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:42.932995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:42.933437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:43.306256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:43.319571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b1840b79-59b4-4f28-a936-c20c23142447 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.543865 Jul 26 04:57:43.335242 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2856/5799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:42 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:43.347004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:43.347985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:43.363825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:43.364443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:43.365470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:43.366224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:43.666031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:43.680922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-319b14ca-31cd-47d6-b7cb-e72728c1cb43 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.340186 Jul 26 04:57:43.696025 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2857/5800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:43 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:43.712917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:43.720126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:43.723803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:43.727874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:43.729386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:43.731260 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3f0f3cd3-1ee7-4b7b-93e8-5669bbebbd59 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 0.818007 Jul 26 04:57:43.735304 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2944/5801] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:42 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:57:43.754788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:43.757506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:43.764748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:43.765998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:44.085208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:44.100134 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65bf8a19-7916-45f3-b935-d6f2d26f00e5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.390064 Jul 26 04:57:44.101209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2858/5802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:43 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:44.113258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:44.114047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:44.125394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:44.130033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:44.131498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:44.132160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:44.134099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0d5412e-02c5-4301-97a8-988177de0bcf tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Action: 'create', calling method: .version_select at 0x7f38bad5a430>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1519229170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBj8nDmQGeIlwKUOG763Wc9BHdZT18c8fUa1wj/GpMd71Xc3YfbfLRGMpozNDZxH65l0Kr5bUhDOBRx1Scin6NC+buaGTL2guOxGYcTPSBX+Cr582qlVFJXuWmZpmdLcQ=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:44.173340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b0d5412e-02c5-4301-97a8-988177de0bcf tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:57:44.188788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b0d5412e-02c5-4301-97a8-988177de0bcf tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for user 48e492bbf2be418eae18aeffd28c5a65 and project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:57:44.257264 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0d5412e-02c5-4301-97a8-988177de0bcf tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.520645 Jul 26 04:57:44.258474 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2945/5803] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:57:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:44.770249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:44.770249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:44.778975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:44.779432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:44.783789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:44.784356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:44.981316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:44.990533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ac16371-0ac2-41f8-b9de-2e8d2d947f22 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.888119 Jul 26 04:57:44.993529 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2859/5804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:44 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:45.014395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:45.015185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:45.025174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:45.028183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:45.030510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:45.031043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:45.423792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:45.477139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c37fecf5-0cef-406b-adb5-090e79d8a943 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.458667 Jul 26 04:57:45.478323 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2860/5805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:45 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:45.499143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:45.500465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:45.519128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:45.522648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:45.524929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:45.525636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:46.080884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:46.096360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:46.097970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:46.119929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8601fe57-f626-419e-9144-129920e49e5a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1722 microversion: 2.20 time: 1.363750 Jul 26 04:57:46.120538 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2946/5806] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:44 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1722 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:57:46.137352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:46.137975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:46.158210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:46.158606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:46.159395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:46.159841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:46.233726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:46.254629 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6349c6d-d4c9-4abb-a97e-6bc20903ea18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.773127 Jul 26 04:57:46.257355 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2861/5807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:45 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:47.149620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:47.150278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:47.170584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.171347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.172423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.173945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.405183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:47.414524 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-00f54e4d-6ef1-47e3-ab53-e06a185557b3 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.292886 Jul 26 04:57:47.424505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2947/5808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:46 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:47.428038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:47.452471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:47.454012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:47.462202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33d9f078-f913-476e-8976-d9cd38c9156b tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1655 microversion: 2.20 time: 0.317410 Jul 26 04:57:47.464108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:47.464783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:47.468304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2862/5809] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:47 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1655 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:57:47.496150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:47.496865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:47.509286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.510042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.511103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.512201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.525432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.525911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.526776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:47.527210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:47.595657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:47.858416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:47.872514 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ae2eafa-035e-4589-aa34-39b7b5d79bf6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.389931 Jul 26 04:57:47.875156 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2863/5810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:47 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:48.145266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:48.156745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9c53a31e-fc79-479a-a48e-395c390e980b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.732881 Jul 26 04:57:48.159632 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2948/5811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:47 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:48.497289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:48.497906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:48.502322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:48.517102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:48.518638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:48.519898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:48.520503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:48.648981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:48.663045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:48.664588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:48.665794 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a98d81ab-bb92-4380-a65d-4d6df999cdb2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1655 microversion: 2.20 time: 0.172961 Jul 26 04:57:48.666380 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2864/5812] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:48 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:57:49.183558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:49.184269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:49.201853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.202350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.208967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.213552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.434526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4e955d57-9019-49f4-8c09-2ba34e4bd2e7 req-9d27a832-c3f8-4264-b553-cc0b08fcf9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16310c20-bccb-40ea-96e8-8f0eabf5ef23", "name": "network-vif-deleted", "tag": "e8df97ef-40c1-46ba-bb81-913fd6f95d25"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:49.459274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4e955d57-9019-49f4-8c09-2ba34e4bd2e7 req-9d27a832-c3f8-4264-b553-cc0b08fcf9db service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.459720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4e955d57-9019-49f4-8c09-2ba34e4bd2e7 req-9d27a832-c3f8-4264-b553-cc0b08fcf9db service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.504522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4e955d57-9019-49f4-8c09-2ba34e4bd2e7 req-9d27a832-c3f8-4264-b553-cc0b08fcf9db service nova] Creating event network-vif-deleted:e8df97ef-40c1-46ba-bb81-913fd6f95d25 for instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 on n-h2-848886-16 Jul 26 04:57:49.529894 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4e955d57-9019-49f4-8c09-2ba34e4bd2e7 req-9d27a832-c3f8-4264-b553-cc0b08fcf9db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.545269 Jul 26 04:57:49.531291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2949/5813] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:49.691870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:49.692628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:49.715299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.715772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.717904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.718383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.824391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:49.826587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:49.829541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lazy-loading 'fault' on Instance uuid 16310c20-bccb-40ea-96e8-8f0eabf5ef23 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:57:49.899879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:49.924830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-924b3854-f1e0-4e1c-9a34-00d6fee79b3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.744557 Jul 26 04:57:49.926974 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2865/5814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:49 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:49.980967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:50.006446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:50.011205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18807cad26884822b91771a618f32f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c559fd94d4c0ca41c0ae7ee163690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:50.015732 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8007f01a-9223-4f3c-8060-021302e6de74 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 200 len: 1371 microversion: 2.20 time: 0.330090 Jul 26 04:57:50.023813 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2950/5815] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:49 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:57:50.496431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1681258736", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1519229170", "security_groups": [{"name": "tempest-secgroup-smoke-59094297"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3881b47e-1c30-47b4-bf41-ed7e25e6fd9e"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:50.788282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] validate_networks() for [('3881b47e-1c30-47b4-bf41-ed7e25e6fd9e', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:57:50.957490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:50.958308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:50.992146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:51.002590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:51.002854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:51.006963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:51.755744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:51.773655 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8878d41f-8da0-4211-b59c-76dfd1ebe4b0 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.824172 Jul 26 04:57:51.794546 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2951/5816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:50 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:51.806631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:51.808648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:51.825328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:51.826888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:51.827944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:51.829501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:51.870429 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 HTTP/1.1 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '16310c20-bccb-40ea-96e8-8f0eabf5ef23'} Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:51.874672 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:51.880096 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:57:51.882542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:51.885647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3112705b-4a4e-4fd7-a561-9f58bcbbaf90 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 404 len: 111 microversion: 2.20 time: 0.089743 Jul 26 04:57:51.886447 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2952/5817] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:51 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:57:51.900406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27361b49-09a6-4e6e-90ed-a18d8d406c57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '.version_select at 0x7f38b452c430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:51.946929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27361b49-09a6-4e6e-90ed-a18d8d406c57 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659574143" status: 204 len: 0 microversion: 2.20 time: 0.055646 Jul 26 04:57:51.948122 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2953/5818] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Jul 26 04:57:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659574143 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 04:57:52.139668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4008d579-a0f2-403a-b772-25c8774d4c0c tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b48e45e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:52.211263 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4008d579-a0f2-403a-b772-25c8774d4c0c tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a7d02311-b88b-46bf-a885-dcb674536e01" status: 200 len: 351 microversion: 2.1 time: 0.076724 Jul 26 04:57:52.212701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2954/5819] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:57:52 2022] GET /compute/v2.1/os-volumes/a7d02311-b88b-46bf-a885-dcb674536e01 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:57:52.473607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:57:52.487971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for user 48e492bbf2be418eae18aeffd28c5a65 and project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: dict_keys(['metadata_items']) {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:57:52.531432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:57:52.532153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:57:52.533189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:57:52.533618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:57:52.534045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:57:52.547006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.548786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:52.550440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.551085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:52.588197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:57:52.600102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Getting quotas for user 48e492bbf2be418eae18aeffd28c5a65 and project 2d0f798fe28141a193b59f0ecd2b0cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:57:52.635258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:57:52.637940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:57:52.739622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ab41c5f-7c7c-4e37-aa7f-422b2ce14b67 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.247686 Jul 26 04:57:52.748758 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2866/5820] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:57:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:57:52.758796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f5d3711-9b4b-4600-892d-df31a5251d08 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:52.759671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f5d3711-9b4b-4600-892d-df31a5251d08 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:52.797054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:52.797651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:52.811103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.811569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:52.812381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.812832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:53.077422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f5d3711-9b4b-4600-892d-df31a5251d08 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:53.100199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:53.104190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f5d3711-9b4b-4600-892d-df31a5251d08 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1303 microversion: 2.1 time: 0.352780 Jul 26 04:57:53.118407 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2955/5821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:52 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1303 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:53.118621 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-008b94c2-91cd-4612-902d-878539258df7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.317685 Jul 26 04:57:53.118621 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2867/5822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:52 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:54.124993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:54.125624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:54.136492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:54.136981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:54.137859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:54.138354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:54.151021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:54.151697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:54.160437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:54.161222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:54.162208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:54.162814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:54.375941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:54.409167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d029270-700d-49fd-8857-e33265dfd426 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1355 microversion: 2.1 time: 0.282011 Jul 26 04:57:54.410114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2956/5823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:54 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1355 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:54.515386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:54.532712 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c97bc6ba-1a21-4c60-b179-7e5b54b59530 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.400550 Jul 26 04:57:54.534545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2868/5824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:54 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:54.800911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-086ecc28-1eff-4358-bf48-ead3ac5102b1 req-026e39d9-9976-4092-832d-1efb1ddb7c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fb9481-b808-483b-bb20-9b3ad449786e", "name": "network-vif-plugged", "status": "completed", "tag": "8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:54.821759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-086ecc28-1eff-4358-bf48-ead3ac5102b1 req-026e39d9-9976-4092-832d-1efb1ddb7c15 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:54.823526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-086ecc28-1eff-4358-bf48-ead3ac5102b1 req-026e39d9-9976-4092-832d-1efb1ddb7c15 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:54.856813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-086ecc28-1eff-4358-bf48-ead3ac5102b1 req-026e39d9-9976-4092-832d-1efb1ddb7c15 service nova] Creating event network-vif-plugged:8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd for instance 54fb9481-b808-483b-bb20-9b3ad449786e on n-h2-848886-16 Jul 26 04:57:54.863538 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-086ecc28-1eff-4358-bf48-ead3ac5102b1 req-026e39d9-9976-4092-832d-1efb1ddb7c15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200198 Jul 26 04:57:54.864849 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2957/5825] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:54.948658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f8d2788-46c7-4b6a-aa60-b80b8c5a7d01 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b51835e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:55.042491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f8d2788-46c7-4b6a-aa60-b80b8c5a7d01 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/71c6fdc5-be14-4f77-8ece-f4720f86cfe5" status: 200 len: 351 microversion: 2.1 time: 0.097175 Jul 26 04:57:55.057748 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2869/5826] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:57:54 2022] GET /compute/v2.1/os-volumes/71c6fdc5-be14-4f77-8ece-f4720f86cfe5 => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:55.464540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:55.466409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:55.488819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:55.489478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:55.491309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:55.492571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:55.555078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:55.555774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:55.583586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:55.598402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:55.602607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:55.604687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:55.771832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:55.781983 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7c7b8f7-14e5-412f-82d4-c192d7aef5db tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1361 microversion: 2.1 time: 0.348299 Jul 26 04:57:55.800830 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2958/5827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:55 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:56.044573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:56.054107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba245c05-d8d3-4d51-a856-9441aa7c7a9b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1217 microversion: 2.1 time: 0.503640 Jul 26 04:57:56.071964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2870/5828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:55 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1217 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:57:56.809884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:56.810653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:56.828137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:56.828693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:56.831316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:56.832004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:57.079371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:57.080059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:57.098849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:57.099310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:57.100109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:57.100561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:57.312015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:57.324416 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73afc837-7bd0-4330-90c0-bcdbbde1b252 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.518077 Jul 26 04:57:57.326978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2959/5829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:56 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:57.470450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:57.487752 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5d13bde-9b1a-4400-b1be-1c7d233a58a1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1404 microversion: 2.1 time: 0.412205 Jul 26 04:57:57.499160 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2871/5830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:57 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:57.512345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:57.533849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:57.558991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:57.559208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:57.561398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:57.567476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:57.973116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:57.983384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40fae8dd-6570-4a39-888f-a235f190defd tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b6074f70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:57.987218 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c8b7724-0bd0-4e70-a5bd-8152ac40ea71 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1404 microversion: 2.1 time: 0.475143 Jul 26 04:57:57.988376 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2960/5831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:57 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:58.012695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-190095811"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:58.020848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:58.036974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:58.037363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:58.048785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:58.049379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:58.085552 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40fae8dd-6570-4a39-888f-a235f190defd tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7dc56ebb-57a7-4775-baf4-2d27849cad96" status: 200 len: 350 microversion: 2.1 time: 0.112055 Jul 26 04:57:58.086171 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2872/5832] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 04:57:57 2022] GET /compute/v2.1/os-volumes/7dc56ebb-57a7-4775-baf4-2d27849cad96 => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:58.087770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:58.123694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cb87623e-4e77-43e6-a9a8-243074078632 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b52551f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:58.263842 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Attempting to quiesce instance before volume snapshot. Jul 26 04:57:58.301096 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cb87623e-4e77-43e6-a9a8-243074078632 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.201926 Jul 26 04:57:58.302319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2873/5833] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Jul 26 04:57:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:58.316344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a42327cd-a148-4d36-bed4-e7747c2bf1cb tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b5255700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:58.332880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 26 04:57:58.511309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Creating snapshot from volume 3f3d57c3-e6d4-4eaa-adfc-a5c139d3eaa4. {{(pid=119488) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 26 04:57:58.572665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a42327cd-a148-4d36-bed4-e7747c2bf1cb tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.260929 Jul 26 04:57:58.574105 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2874/5834] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Jul 26 04:57:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:58.579049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:58.580696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:58.593590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:58.598844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:58.599923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:58.600538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.259558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:57:59.272651 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81a840e5-703e-4f4b-b0e9-08d0f6d34175 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.697248 Jul 26 04:57:59.280496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2875/5835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:57:58 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:59.293253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2c57f83f-a393-4624-a5a4-cc7d5e0e94ed req-50967d05-3950-4f5d-abe5-199c766d1c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee03564-ebad-4f62-93fb-36b87f9a6a26", "tag": "1516612f-2259-4697-bb02-4ed14889665d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:57:59.328863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2c57f83f-a393-4624-a5a4-cc7d5e0e94ed req-50967d05-3950-4f5d-abe5-199c766d1c6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:59.331625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2c57f83f-a393-4624-a5a4-cc7d5e0e94ed req-50967d05-3950-4f5d-abe5-199c766d1c6b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.351829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2c57f83f-a393-4624-a5a4-cc7d5e0e94ed req-50967d05-3950-4f5d-abe5-199c766d1c6b service nova] Creating event network-changed:1516612f-2259-4697-bb02-4ed14889665d for instance bee03564-ebad-4f62-93fb-36b87f9a6a26 on n-h1-848886-16 Jul 26 04:57:59.358658 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2c57f83f-a393-4624-a5a4-cc7d5e0e94ed req-50967d05-3950-4f5d-abe5-199c766d1c6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076544 Jul 26 04:57:59.362218 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2876/5836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:59.370040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:59.370897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:59.387849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:59.388804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.389755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:59.390664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.409251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 HTTP/1.1 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '16310c20-bccb-40ea-96e8-8f0eabf5ef23'} Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:59.411791 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d812e61f-2ec0-40c2-9db4-d00b2f1875cf tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 404 len: 111 microversion: 2.20 time: 0.049645 Jul 26 04:57:59.416544 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2877/5837] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:57:59 2022] DELETE /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:57:59.420176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5ee5e597-c1d1-4d4f-a9ab-b20d58856317 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b60f3b80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:59.621808 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5ee5e597-c1d1-4d4f-a9ab-b20d58856317 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.206028 Jul 26 04:57:59.622846 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2878/5838] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Jul 26 04:57:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:59.629469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:59.632695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: 16310c20-bccb-40ea-96e8-8f0eabf5ef23] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:57:59.664083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:59.665688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.666890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:59.668671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:59.710930 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 HTTP/1.1 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '16310c20-bccb-40ea-96e8-8f0eabf5ef23'} Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.715339 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. Jul 26 04:57:59.719832 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:57:59.723092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance 16310c20-bccb-40ea-96e8-8f0eabf5ef23 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:57:59.724428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5a0f0ac-e6b1-42cd-8164-4c05a637f31a tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23" status: 404 len: 111 microversion: 2.20 time: 0.100059 Jul 26 04:57:59.725813 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2879/5839] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:57:59 2022] GET /compute/v2.1/servers/16310c20-bccb-40ea-96e8-8f0eabf5ef23 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:57:59.733449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fee6cec7-d636-490c-99f8-5e1b47630940 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b5d8ae50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:59.965306 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fee6cec7-d636-490c-99f8-5e1b47630940 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.237270 Jul 26 04:57:59.966620 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2880/5840] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Jul 26 04:57:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:59.981830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a55f75a5-0df8-49de-a397-77eb20385dd8 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b49b3670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:00.189935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a55f75a5-0df8-49de-a397-77eb20385dd8 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.212145 Jul 26 04:58:00.191825 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2881/5841] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 26 04:57:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:00.210882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4eae59fa-5d37-4771-a20e-4c9fd6e13bdc tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b5d8a1f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:00.343892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4eae59fa-5d37-4771-a20e-4c9fd6e13bdc tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.137177 Jul 26 04:58:00.359166 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2882/5842] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:58:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:00.369790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:00.372935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:00.390132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:00.390598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:00.399225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:00.399822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:00.487731 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4f715a1-2105-4fbb-8e8c-8ab058a79eec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e/action" status: 202 len: 0 microversion: 2.1 time: 2.481321 Jul 26 04:58:00.489421 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2961/5843] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:57:58 2022] POST /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e/action => generated 0 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 04:58:00.537969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34663d08-264b-439b-931b-4a7144fb438d tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b50a4af0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:00.714838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:00.730508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9fa23165-e41d-45a5-80e5-9d9f0ec6b892 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.367919 Jul 26 04:58:00.731120 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2883/5844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:00 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:00.741937 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34663d08-264b-439b-931b-4a7144fb438d tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.249984 Jul 26 04:58:00.743897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2962/5845] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Jul 26 04:58:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:00.757889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9181a9f3-5e51-4bd0-a5f2-38360e5f9f54 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] Calling method '.version_select at 0x7f38b5a42940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:00.885716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9181a9f3-5e51-4bd0-a5f2-38360e5f9f54 tempest-VolumesTestJSON-681738345 tempest-VolumesTestJSON-681738345-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.131587 Jul 26 04:58:00.895981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2884/5846] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Jul 26 04:58:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:01.753740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:01.755524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:01.777677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:01.778703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:01.779794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:01.780476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:01.988748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:02.002220 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62b59303-acb3-4f08-b5b7-fcf292fbd999 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.252301 Jul 26 04:58:02.015736 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2963/5847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:01 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:02.852340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:02.854844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:02.860075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2056010057", "imageRef": "6943f827-0631-4f3c-97ea-e645e9660733", "flavorRef": "452", "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:02.936885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:58:02.944216 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:58:02.944419 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 04:58:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Jul 26 04:58:03.023666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:03.024865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:03.032894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:03.033608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:03.037497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:03.038138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:03.103951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:03.337161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:03.348565 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6373a431-60bc-4d29-83de-c3bb272d0816 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.328542 Jul 26 04:58:03.355859 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2964/5848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:03 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:58:03.808055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:58:03.808856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:58:03.809561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:58:03.810265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:58:03.810902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:58:03.866856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:03.867345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:03.871331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:03.871819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:03.920335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:58:03.933294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:58:03.969413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:58:03.976318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ba21f80f-4bd6-4bd9-a397-5604a625d91e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:58:04.185528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5947d64-2369-4858-83cc-d625cb40487f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334956 Jul 26 04:58:04.189682 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2885/5849] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:58:04.206600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c769462b-8b9e-477a-95ea-c073bcdf5a3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:04.207399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c769462b-8b9e-477a-95ea-c073bcdf5a3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:04.374063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:04.374899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:04.390652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:04.390951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:04.403399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:04.403954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:04.408742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c769462b-8b9e-477a-95ea-c073bcdf5a3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:04.420086 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c769462b-8b9e-477a-95ea-c073bcdf5a3a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1230 microversion: 2.1 time: 0.223083 Jul 26 04:58:04.423787 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2965/5850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:04 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1230 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:05.366305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:05.382529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a66a275d-58f3-41bf-bb7c-688d920b1191 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 1.013681 Jul 26 04:58:05.397319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2886/5851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:04 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:05.445520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:05.446145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:05.463462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:05.466853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:05.467919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:05.468674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:05.681229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:05.708008 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f63ec7d-b69f-455b-8dfd-547567b1fcb4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1234 microversion: 2.1 time: 0.265004 Jul 26 04:58:05.718579 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2966/5852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:05 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1234 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:06.404488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:06.405809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:06.426928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.429863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.430913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.431628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.739214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:06.740362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:06.741594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:06.747634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4d3ac15-e9e7-4472-b11c-a1aa1d7952a0 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 0.347251 Jul 26 04:58:06.748229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2887/5853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:06 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:06.761285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.762518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.764475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.767872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.979130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:06.993274 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b78394d-941d-4164-b069-3ecaa6407d50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1300 microversion: 2.1 time: 0.256887 Jul 26 04:58:07.007000 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2967/5854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:06 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1300 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:07.629207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e3a76d97-9e2c-48b8-9566-e8abe4c38e48 req-1e759fa8-030e-465e-b5af-0abebefb9239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee03564-ebad-4f62-93fb-36b87f9a6a26", "name": "network-vif-plugged", "status": "completed", "tag": "1516612f-2259-4697-bb02-4ed14889665d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:07.687903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e3a76d97-9e2c-48b8-9566-e8abe4c38e48 req-1e759fa8-030e-465e-b5af-0abebefb9239 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:07.694819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e3a76d97-9e2c-48b8-9566-e8abe4c38e48 req-1e759fa8-030e-465e-b5af-0abebefb9239 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:07.753711 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e3a76d97-9e2c-48b8-9566-e8abe4c38e48 req-1e759fa8-030e-465e-b5af-0abebefb9239 service nova] Creating event network-vif-plugged:1516612f-2259-4697-bb02-4ed14889665d for instance bee03564-ebad-4f62-93fb-36b87f9a6a26 on n-h1-848886-16 Jul 26 04:58:07.778412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:07.779051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:07.796227 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e3a76d97-9e2c-48b8-9566-e8abe4c38e48 req-1e759fa8-030e-465e-b5af-0abebefb9239 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171862 Jul 26 04:58:07.796563 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2888/5855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:07.798678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:07.799228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:07.800079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:07.800471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:08.018004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:08.019334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:08.035599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:08.036229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:08.041332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:08.042749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:08.169817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:08.183643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd0c3b4f-0b4c-4794-aefe-1a29751d7506 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1300 microversion: 2.1 time: 0.171296 Jul 26 04:58:08.199223 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2889/5856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:08 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:08.746677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:08.781585 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34749bcb-3cd8-4543-9acf-c283e76bdb64 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1427 microversion: 2.1 time: 1.016248 Jul 26 04:58:08.783869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2968/5857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:07 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1427 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:08.949167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:08.949765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:08.966462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:08.966992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:08.968056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:08.971951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.037383 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 HTTP/1.1 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b50b4dc7-d31c-4f5b-ac74-19367dfe1b58'} Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:58:09.039379 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.044743 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.049584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:58:09.053694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-900f2fe8-ce9f-4ec2-9439-92b9b79ebef2 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 404 len: 111 microversion: 2.20 time: 0.108664 Jul 26 04:58:09.056828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2890/5858] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Jul 26 04:58:08 2022] DELETE /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:58:09.064447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:09.065341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] [instance: b50b4dc7-d31c-4f5b-ac74-19367dfe1b58] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:09.081030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.082130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.085009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.087019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.127461 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] HTTP exception thrown: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Request method failure captured: Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 HTTP/1.1 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33IZkoakBg9t4RxqA2dzqnq5lylAJukDPg3KWrjWsyXkGvSQJ7mlW37pU1WQvNOh4X5MgsFPtlAmoaDyjDVOfhIvnqsDjgRZ6TG91FcQT_tLV4c_w9aNLldkU_p6j3RchTzQEeiK1gclfxlYC2986SLs406UDZMWFdjCQ1WOLiuQcJk Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c02c559fd94d4c0ca41c0ae7ee163690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: c02c559fd94d4c0ca41c0ae7ee163690 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1737479429 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 18807cad26884822b91771a618f32f71 Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1737479429-project Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b50b4dc7-d31c-4f5b-ac74-19367dfe1b58'} Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.130578 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. Jul 26 04:58:09.135154 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:58:09.136624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] Returning 404 to user: Instance b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:58:09.138952 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90340849-41e9-4983-87aa-6e8a060d98c9 tempest-AttachVolumeShelveTestJSON-1737479429 tempest-AttachVolumeShelveTestJSON-1737479429-project] 10.222.0.43 "GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58" status: 404 len: 111 microversion: 2.20 time: 0.079924 Jul 26 04:58:09.143314 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2969/5859] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jul 26 04:58:09 2022] GET /compute/v2.1/servers/b50b4dc7-d31c-4f5b-ac74-19367dfe1b58 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:58:09.208515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:09.209417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:09.239937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.242959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.244007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.249581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.475236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:09.484355 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2f06d86-acd7-4c8a-af32-cba746e93f02 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1300 microversion: 2.1 time: 0.280739 Jul 26 04:58:09.496156 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2891/5860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:09 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:09.805675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:09.806943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:09.839321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.839737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:09.842822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:09.843292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:10.517603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:10.518582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:10.536196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:10.536984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:10.538249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:10.540664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:10.663324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:10.673368 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-069f89b1-cd32-48a1-a0a4-bf57ac0236f6 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1607 microversion: 2.1 time: 0.872948 Jul 26 04:58:10.692589 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2970/5861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:09 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1607 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:10.705111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:10.707074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:10.728865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:10.731333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:10.732485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:10.733169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:10.936149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:10.947275 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5954ce69-4bd8-4436-9d9c-de0a20ad8b86 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.434096 Jul 26 04:58:10.950063 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2892/5862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:10 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:58:11.350044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:11.363675 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5996e8f2-9fff-498c-a23b-8ea7da91a4d8 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1607 microversion: 2.1 time: 0.665017 Jul 26 04:58:11.382513 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2971/5863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:10 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1607 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:11.390098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:11.390795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:11.402100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:11.407547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:11.416421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:11.417126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:11.971850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:11.972896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:11.976562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:11.999330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:12.004968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:12.006269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:12.006949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:12.066290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:12.068852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:12.089093 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-946ca27f-257c-4368-bd3a-1d19d587c003 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1607 microversion: 2.1 time: 0.698540 Jul 26 04:58:12.096683 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2893/5864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:11 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1607 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:12.957063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:12.968543 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a8b3479-cd19-4b18-8c6a-14e65a8a6f46 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 1.001189 Jul 26 04:58:12.971541 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2972/5865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:11 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:13.650095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3f1b86ff-fd1e-4ccf-b022-f2048a021179 req-5671458f-fb1c-4aab-b6cc-02af2ab9f777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1d92ab-516c-4a21-b084-97fc7d69d78b", "tag": "00d20f33-4749-45ff-b69e-8d4a6fb4e97d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:13.679033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3f1b86ff-fd1e-4ccf-b022-f2048a021179 req-5671458f-fb1c-4aab-b6cc-02af2ab9f777 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:13.683154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3f1b86ff-fd1e-4ccf-b022-f2048a021179 req-5671458f-fb1c-4aab-b6cc-02af2ab9f777 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:13.714441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3f1b86ff-fd1e-4ccf-b022-f2048a021179 req-5671458f-fb1c-4aab-b6cc-02af2ab9f777 service nova] Creating event network-changed:00d20f33-4749-45ff-b69e-8d4a6fb4e97d for instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b on n-h2-848886-16 Jul 26 04:58:13.729016 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3f1b86ff-fd1e-4ccf-b022-f2048a021179 req-5671458f-fb1c-4aab-b6cc-02af2ab9f777 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084347 Jul 26 04:58:13.745340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2894/5866] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:13.997234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:13.998070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:14.021605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:14.022474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:14.024217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:14.025059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:14.414000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:15.802236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:15.811948 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a31a7eb-b829-4dce-aa7d-c112a8249a4e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 1.819842 Jul 26 04:58:15.834246 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2973/5867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:13 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:16.845231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:16.845977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:16.868642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:16.873705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:16.878116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:16.878722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:16.882188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:16.882633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:18.099659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:18.112562 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7a99cfe-86be-47bd-ba12-f8c960723d6c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 1.274264 Jul 26 04:58:18.120530 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2895/5868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:16 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:19.154449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:19.154449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:19.165409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:19.169256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:19.170662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:19.172927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:19.408317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:19.427252 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40290718-5bcd-434a-83d9-b8f99b39a756 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.278304 Jul 26 04:58:19.428029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2974/5869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:19 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:20.455241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:20.456017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:20.484070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:20.485796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:20.486281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:20.490965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:20.494392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:21.283365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:21.301094 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-980bfe51-8d8b-4d36-9a88-37f0990c0615 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.850720 Jul 26 04:58:21.305435 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2896/5870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:20 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:21.325950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d77b6914-f7a1-4559-993b-1cd25f917204 req-50faf843-1021-4c8b-8476-224157d18b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee03564-ebad-4f62-93fb-36b87f9a6a26", "tag": "1516612f-2259-4697-bb02-4ed14889665d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:21.355515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d77b6914-f7a1-4559-993b-1cd25f917204 req-50faf843-1021-4c8b-8476-224157d18b88 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:21.355911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d77b6914-f7a1-4559-993b-1cd25f917204 req-50faf843-1021-4c8b-8476-224157d18b88 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:21.377678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d77b6914-f7a1-4559-993b-1cd25f917204 req-50faf843-1021-4c8b-8476-224157d18b88 service nova] Creating event network-changed:1516612f-2259-4697-bb02-4ed14889665d for instance bee03564-ebad-4f62-93fb-36b87f9a6a26 on n-h1-848886-16 Jul 26 04:58:21.404763 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d77b6914-f7a1-4559-993b-1cd25f917204 req-50faf843-1021-4c8b-8476-224157d18b88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.798430 Jul 26 04:58:21.409415 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2975/5871] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:22.331194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:22.332146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:22.359824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:22.362781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:22.364044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:22.364748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:22.931085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:22.946782 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9a6e7594-70f8-4252-8205-3c6968688ee2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.620128 Jul 26 04:58:22.947396 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2897/5872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:22 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:23.969876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:23.972623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:23.989359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:23.992407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:23.993282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:23.993917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:24.778582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:24.791097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb80a80d-ed5c-4aa2-801c-2199d9c23bdc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.826280 Jul 26 04:58:24.794392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2976/5873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:23 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:25.816412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:25.817032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:25.838540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:25.838994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:25.839790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:25.841701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:26.081805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:26.095524 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-718cf88c-1f27-4cb2-83b5-dbdde25e5119 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.283026 Jul 26 04:58:26.096643 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2898/5874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:25 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:27.120759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:27.122412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:27.130745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:27.131892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:27.133017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:27.133865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:27.686307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:27.697489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f351d416-00d9-49c8-8793-7016907e41a5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.577643 Jul 26 04:58:27.713656 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2977/5875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:27 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:28.721753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:28.722405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:28.741541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:28.742011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:28.742838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:28.751419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:29.150509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:29.166340 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-03a3b13b-34cb-4be9-bf16-f4730be51470 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.449160 Jul 26 04:58:29.168678 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2899/5876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:28 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:29.304181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b9597e0-2b0a-4971-babb-b6b06b57b1c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: .version_select at 0x7f38b4691670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-278334804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsxmmSxseCNXUR3p4cLRsq5PoimTz46va1h9oO5/BQtpKHoYJNXSatvRk4+FwP5fzWmZJvsWak1VqO3CWxRVVQEy6H5saTkcF9oOvwvFZ28KNjuY7Qa/YpP8weaOL+/mQ=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:29.327206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8b9597e0-2b0a-4971-babb-b6b06b57b1c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:58:29.363379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8b9597e0-2b0a-4971-babb-b6b06b57b1c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:58:29.428259 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b9597e0-2b0a-4971-babb-b6b06b57b1c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.693951 Jul 26 04:58:29.429870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2978/5877] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:58:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:30.026968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:30.029524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:30.043768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.046121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.049011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.049834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.193270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:30.194710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:30.198474 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2e4326d-3cf6-43e5-8eb1-5688aa9141cd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.175502 Jul 26 04:58:30.212601 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2900/5878] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:58:30 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 04:58:30.225222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:30.227500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:30.229851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.237823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.238809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.238966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.241631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.241755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:30.242267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.242767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:30.255627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:30.580485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:30.591900 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ebaa38f-d204-4c5f-bf76-ec6ffbde6766 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1670 microversion: 2.1 time: 0.375721 Jul 26 04:58:30.593437 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2901/5879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:30 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:30.693649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:30.705516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e907558b-7296-4aac-b527-dedc9de6476a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1342 microversion: 2.1 time: 0.516541 Jul 26 04:58:30.722975 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2979/5880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:30 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1342 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:31.617213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:31.619346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:31.629428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:31.630402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:31.631866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:31.632748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:31.743352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:31.744000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:31.765752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:31.766452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:31.767270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:31.767728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:32.041015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:32.054483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2082f09-7973-43bc-ba45-24a73b392641 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1670 microversion: 2.1 time: 0.443182 Jul 26 04:58:32.055863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2902/5881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:31 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1670 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:32.291226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:32.308598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8fb07c30-aa40-45e1-af02-d7b816372baa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.577728 Jul 26 04:58:32.308598 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2980/5882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:31 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:33.091357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:33.093822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:33.108029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:33.109693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:33.111462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:33.112810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:33.336306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:33.336933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:33.348453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:33.349279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:33.350403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:33.350886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:33.405025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:33.420584 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d8612fc1-ba6a-4c5d-b2b5-304375696894 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1675 microversion: 2.1 time: 0.339137 Jul 26 04:58:33.421333 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2903/5883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:33 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1675 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:33.682675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:33.693155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09eb8f84-78c6-469c-8f43-75e91099392c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.361719 Jul 26 04:58:33.694006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2981/5884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:33 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:34.450970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:34.454842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:34.467938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:34.469004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:34.470722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:34.471657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:34.720991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:34.722973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:34.734866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:34.735789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:34.737341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:34.739267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:34.793784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:34.804522 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46d69621-4016-449c-9da4-8bb612608057 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.362489 Jul 26 04:58:34.805983 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2904/5885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:34 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:35.408632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:35.422920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a1b7bf0-776f-4723-98fd-e5d10ff44c11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.710659 Jul 26 04:58:35.437544 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2982/5886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:34 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:58:36.447380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:36.447999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:36.479617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:36.480482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:36.481729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:36.485824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:36.873279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:36.889944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-70647fc1-0319-48cc-bad4-dbb0d5651c2f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.449385 Jul 26 04:58:36.920202 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2905/5887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:36 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:37.953752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:37.957465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:37.985254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:37.988155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:37.992361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:37.993795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:38.273492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:38.286372 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4b14e3c-572f-4bbe-8cb1-7a7350f03ac4 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.358592 Jul 26 04:58:38.287123 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2983/5888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:37 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:39.310473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:39.311116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:39.334860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:39.336945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:39.340189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:39.342007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:40.016125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:40.033720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e7aeca4-fe0e-4816-b171-a482bb6663f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.727000 Jul 26 04:58:40.036268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2906/5889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:39 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:41.057459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:41.062476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:41.066326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:41.097063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:41.097796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:41.098762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:41.099231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:41.532298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:41.563634 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d59e839-e0f0-4eb5-9b7a-e7d998adc9eb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.506502 Jul 26 04:58:41.567148 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2984/5890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:41 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:41.574063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-502793176", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "8a12f377-e940-48e3-a100-3208014f707f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-278334804", "security_groups": [{"name": "tempest-secgroup-smoke-1609993549"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:41.848903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] validate_networks() for [('8a12f377-e940-48e3-a100-3208014f707f', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:58:42.589377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:42.592085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:42.614184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:42.618919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:42.621906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:42.630603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:42.633917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:43.034119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:43.045988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9976f699-b7f1-4cf5-a90e-5cf93e2fba18 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.461041 Jul 26 04:58:43.047689 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2985/5891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:42 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:43.900585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:58:43.901167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:58:43.901664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:58:43.902069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:58:43.902516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:58:43.929360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:43.933514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:43.934454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:43.936938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:43.949327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:44.011950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:58:44.020001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:58:44.047307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:58:44.050640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:58:44.072167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:44.084684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:44.140915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:44.142267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:44.145802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:44.148399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:44.258173 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e312ea33-5e59-4a89-856f-e5900f5c000b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.697947 Jul 26 04:58:44.266739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2907/5892] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:58:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:58:44.276882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a701bc7b-6826-4df1-8d39-4d8d7cf51110 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:44.278051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a701bc7b-6826-4df1-8d39-4d8d7cf51110 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:44.421813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a701bc7b-6826-4df1-8d39-4d8d7cf51110 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:44.432545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a701bc7b-6826-4df1-8d39-4d8d7cf51110 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1265 microversion: 2.1 time: 0.164399 Jul 26 04:58:44.447296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2908/5893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:44 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:44.802097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:44.811868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-702e5883-20b8-4145-84c6-339f32dc9a12 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.747040 Jul 26 04:58:44.813218 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2986/5894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:44 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:45.458632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74faafe5-e294-4602-a96c-9f5aabb8d6cc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:45.460770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74faafe5-e294-4602-a96c-9f5aabb8d6cc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:45.823940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-74faafe5-e294-4602-a96c-9f5aabb8d6cc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:45.833499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:45.833921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74faafe5-e294-4602-a96c-9f5aabb8d6cc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1265 microversion: 2.1 time: 0.379259 Jul 26 04:58:45.834125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:45.846674 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2909/5895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:45 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:45.867487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:45.868036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:45.868874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:45.869369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:46.363405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:46.378579 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44bb839f-97eb-4754-9404-cfa2976c9d6f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.548004 Jul 26 04:58:46.380519 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2987/5896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:45 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:46.857595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:46.859577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:46.876982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:46.877985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:46.879900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:46.883086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:47.401098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:47.401740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:47.422556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:47.423565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:47.424433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:47.424899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:47.435378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:47.449660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34c7c61a-49b0-4036-be45-9eb76b683f4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1317 microversion: 2.1 time: 0.596599 Jul 26 04:58:47.450294 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2910/5897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:46 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:47.721227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-93f93f54-06d2-40e0-81b2-22d892277abe req-b0bf93a1-0570-463d-8120-a270cfc985aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1d92ab-516c-4a21-b084-97fc7d69d78b", "name": "network-vif-plugged", "status": "completed", "tag": "00d20f33-4749-45ff-b69e-8d4a6fb4e97d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:47.747805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-93f93f54-06d2-40e0-81b2-22d892277abe req-b0bf93a1-0570-463d-8120-a270cfc985aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:47.751635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-93f93f54-06d2-40e0-81b2-22d892277abe req-b0bf93a1-0570-463d-8120-a270cfc985aa service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:47.793518 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-93f93f54-06d2-40e0-81b2-22d892277abe req-b0bf93a1-0570-463d-8120-a270cfc985aa service nova] Creating event network-vif-plugged:00d20f33-4749-45ff-b69e-8d4a6fb4e97d for instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b on n-h2-848886-16 Jul 26 04:58:47.806217 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-93f93f54-06d2-40e0-81b2-22d892277abe req-b0bf93a1-0570-463d-8120-a270cfc985aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091021 Jul 26 04:58:47.809996 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2911/5898] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:48.145568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:48.155363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8dc253e9-84c9-40f8-a1b0-c856fc406e91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.758651 Jul 26 04:58:48.159198 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2988/5899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:47 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:48.472267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:48.472971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:48.496558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:48.497345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:48.501484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:48.502426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:48.796882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:48.808375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0aad6530-f007-42de-babb-750d47750fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1323 microversion: 2.1 time: 0.340382 Jul 26 04:58:48.808977 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2912/5900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:48 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:49.183007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:49.184452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:49.204287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:49.206778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:49.208960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:49.211251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:49.667401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:49.679861 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb11b488-0c4e-4ad9-9890-9b83a7faa5d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1376 microversion: 2.1 time: 0.501251 Jul 26 04:58:49.681160 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2989/5901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:49 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1376 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:49.835490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:49.836435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:49.848220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:49.848817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:49.850802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:49.851443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:50.308016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:50.309583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:50.324229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:50.326389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:50.328980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:50.329636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:50.392385 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8bf2bffd-9e52-4891-9134-6523ab93bbf3 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.090389 Jul 26 04:58:50.393781 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2990/5902] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Jul 26 04:58:50 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26/os-server-password => generated 116 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:50.603035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f3c660ef-e51f-4991-bd5d-cbaa233b1fc5 req-5ea9131f-ffcc-4636-a4c9-0b1d5753a2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:50.654569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f3c660ef-e51f-4991-bd5d-cbaa233b1fc5 req-5ea9131f-ffcc-4636-a4c9-0b1d5753a2de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:50.658674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f3c660ef-e51f-4991-bd5d-cbaa233b1fc5 req-5ea9131f-ffcc-4636-a4c9-0b1d5753a2de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:50.668054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:50.680760 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67bc5fe6-0a5a-47c8-8eab-f80186b93794 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.851062 Jul 26 04:58:50.695606 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2913/5903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:49 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:50.702935 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f3c660ef-e51f-4991-bd5d-cbaa233b1fc5 req-5ea9131f-ffcc-4636-a4c9-0b1d5753a2de service nova] Creating event network-changed:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h1-848886-16 Jul 26 04:58:50.714972 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f3c660ef-e51f-4991-bd5d-cbaa233b1fc5 req-5ea9131f-ffcc-4636-a4c9-0b1d5753a2de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118533 Jul 26 04:58:50.715222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:50.715641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:50.716640 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2991/5904] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:50.724216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:50.740704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:50.741177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:50.741995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:50.742541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.061286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:51.079061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81f875cc-8984-46e5-b30c-5f151458db94 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1564 microversion: 2.1 time: 0.379540 Jul 26 04:58:51.083945 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2914/5905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:50 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1564 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:51.106828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:51.108170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:51.116268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.117009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.118039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.118665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.399039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:51.409244 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3b22fc26-01da-4c23-8cf3-93185d919bc2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1564 microversion: 2.1 time: 0.306923 Jul 26 04:58:51.431644 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2992/5906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:51 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:51.543929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:51.544760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:51.563711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.564373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.565377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.569644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.616019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:58:51.720682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:51.724523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:51.737804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89f1a750-ee06-4b7c-a5a6-194707e15c30 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 204 len: 0 microversion: 2.1 time: 0.201471 Jul 26 04:58:51.739734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.741289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.742732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.743626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.746025 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2915/5907] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:58:51 2022] DELETE /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:58:51.758494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:51.759456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:51.768257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.769046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.771388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:51.772527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:51.977884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:51.994329 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6192d65-9060-42b5-b0d1-fef8da9285cb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.289168 Jul 26 04:58:51.995054 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2993/5908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:51 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:52.094108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:52.110550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1d0b0050-1bc2-4ec5-b9e7-0087b8256c4f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1570 microversion: 2.1 time: 0.359264 Jul 26 04:58:52.119878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2916/5909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:51 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1570 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:53.018624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:53.019564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:53.035000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:53.037577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:53.038429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:53.041499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:53.136798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:53.138511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:53.150095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:53.152024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:53.153392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:53.153927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:53.379839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:53.394394 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a58fef9-6beb-4385-85fa-574a05d5a178 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.381141 Jul 26 04:58:53.395700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2994/5910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:53 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:53.442829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:53.457202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3d3b624-0b47-4a40-bddd-3986313b14f6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1570 microversion: 2.1 time: 0.325168 Jul 26 04:58:53.458142 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2917/5911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:53 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1570 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:54.277964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d25a0ecf-6334-46a1-8c3a-f6405687fde2 req-fabd5484-f228-42fa-876e-5fa1768fb907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1d92ab-516c-4a21-b084-97fc7d69d78b", "name": "network-vif-deleted", "tag": "00d20f33-4749-45ff-b69e-8d4a6fb4e97d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:54.311186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d25a0ecf-6334-46a1-8c3a-f6405687fde2 req-fabd5484-f228-42fa-876e-5fa1768fb907 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:54.311542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d25a0ecf-6334-46a1-8c3a-f6405687fde2 req-fabd5484-f228-42fa-876e-5fa1768fb907 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:54.353267 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d25a0ecf-6334-46a1-8c3a-f6405687fde2 req-fabd5484-f228-42fa-876e-5fa1768fb907 service nova] Creating event network-vif-deleted:00d20f33-4749-45ff-b69e-8d4a6fb4e97d for instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b on n-h2-848886-16 Jul 26 04:58:54.364803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d25a0ecf-6334-46a1-8c3a-f6405687fde2 req-fabd5484-f228-42fa-876e-5fa1768fb907 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091569 Jul 26 04:58:54.367677 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2995/5912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:54.421508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:54.422428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:54.430236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:54.434007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:54.434798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:54.436971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:54.437921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:54.485856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:54.487012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:54.501517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:54.502252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:54.503761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:54.504497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:54.633750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:54.648743 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b01c5b2e-6477-4a6e-8b44-10762afc3780 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.166202 Jul 26 04:58:54.649410 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2996/5913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:54 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:54.895984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:54.904910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17fe6275-c21c-4fde-942f-9dfc2c911bae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.488640 Jul 26 04:58:54.908479 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2918/5914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:54 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:55.651871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a6fdacd-ba34-4dde-a379-253fb1182eaf req-e0fa3035-25c0-43f2-b620-26d004d8a4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "name": "network-vif-plugged", "status": "completed", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:58:55.672472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:55.673727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:55.679739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a6fdacd-ba34-4dde-a379-253fb1182eaf req-e0fa3035-25c0-43f2-b620-26d004d8a4e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:55.680418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a6fdacd-ba34-4dde-a379-253fb1182eaf req-e0fa3035-25c0-43f2-b620-26d004d8a4e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:55.689449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:55.690259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:55.691246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:55.691711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:55.711081 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a6fdacd-ba34-4dde-a379-253fb1182eaf req-e0fa3035-25c0-43f2-b620-26d004d8a4e8 service nova] Creating event network-vif-plugged:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h1-848886-16 Jul 26 04:58:55.723089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a6fdacd-ba34-4dde-a379-253fb1182eaf req-e0fa3035-25c0-43f2-b620-26d004d8a4e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075897 Jul 26 04:58:55.726526 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2997/5915] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:58:55.836568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:55.889561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:55.920039 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a0be35b7-3cfc-4a2f-9bd8-66e331629efd tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.249680 Jul 26 04:58:55.922623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2919/5916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:55 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:55.933556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:55.934533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:55.946620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:55.947495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:55.949384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:55.951789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:56.024196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:56.520689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:56.533921 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aff418bb-6069-4808-b617-f89911ba6572 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.604369 Jul 26 04:58:56.562494 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2998/5917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:55 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:56.945705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:56.946877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:56.971826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:56.976521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:56.981683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:56.983780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:57.153008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:57.179737 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca0918da-bf2f-4056-abf1-a527907a0f17 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.239454 Jul 26 04:58:57.181641 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2920/5918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:56 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:57.558081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:57.559380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:57.575726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:57.576973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:57.579190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:57.581672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:57.965292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:57.978760 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-38689f6e-710a-4e3a-8feb-5a54e9244c6e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1391 microversion: 2.1 time: 0.425371 Jul 26 04:58:57.993527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 2999/5919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:57 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:58.207719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:58.209099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:58.231871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:58.235654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:58.237771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:58.238747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:58.602413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:58.613998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c86515b7-b752-4f75-b91e-880d4841b735 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.410482 Jul 26 04:58:58.616490 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2921/5920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:58 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:59.001666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:59.002346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:59.010073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.010578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:59.011383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.011841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:59.636864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:59.637687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:59.652088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.652940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:59.657811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.658609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:59.712344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:58:59.722187 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8f9ce862-2fcd-43ed-8bab-3ff5ecac8cf3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1563 microversion: 2.1 time: 0.725741 Jul 26 04:58:59.725728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3000/5921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:58 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1563 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:58:59.748985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:59.753157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:58:59.773379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.774737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:59.775822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:59.776516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:00.148943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:00.161361 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33ceb870-b217-4673-822e-3b6637329827 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.528346 Jul 26 04:59:00.164024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2922/5922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:59 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:00.233682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:00.250480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5fd2f260-726c-4617-99bb-d6fa56aa16f5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1563 microversion: 2.1 time: 0.504167 Jul 26 04:59:00.253725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3001/5923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:58:59 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1563 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:01.191906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:01.192534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:01.207525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:01.208005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:01.208850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:01.210781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:01.459670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:01.474080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20a17623-7634-4eb8-8393-a1e9912ad995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1361 microversion: 2.1 time: 0.286436 Jul 26 04:59:01.479137 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2923/5924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:01 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:02.503663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:02.504304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:02.515694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:02.516187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:02.520156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:02.521984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:02.673231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:02.673707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:02.675929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 4f1d92ab-516c-4a21-b084-97fc7d69d78b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:59:02.849105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:02.857455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5a4cdb1-7e79-437f-aaea-8db511028efb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 200 len: 1320 microversion: 2.1 time: 0.357340 Jul 26 04:59:02.880007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3002/5925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:02 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:03.879871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:03.880559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:03.897041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:03.897531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:03.898291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:03.898729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:03.924112 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b HTTP/1.1 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4f1d92ab-516c-4a21-b084-97fc7d69d78b'} Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:03.926556 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:03.933113 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:03.939318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:03.941812 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65e82baa-c2a2-4778-b640-9b6a2589f9f7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 404 len: 111 microversion: 2.1 time: 0.065783 Jul 26 04:59:03.942738 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2924/5926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:03 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:05.580325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:05.581532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:05.594425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:05.596551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:05.599391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:05.600108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:05.615862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3650040b-98ee-447c-8466-e59a22ae6904 req-8b5735db-b34d-4379-87ab-54b637c9f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:05.630687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3650040b-98ee-447c-8466-e59a22ae6904 req-8b5735db-b34d-4379-87ab-54b637c9f0e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:05.631542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3650040b-98ee-447c-8466-e59a22ae6904 req-8b5735db-b34d-4379-87ab-54b637c9f0e7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:05.647560 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3650040b-98ee-447c-8466-e59a22ae6904 req-8b5735db-b34d-4379-87ab-54b637c9f0e7 service nova] Creating event network-changed:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h1-848886-16 Jul 26 04:59:05.653192 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3650040b-98ee-447c-8466-e59a22ae6904 req-8b5735db-b34d-4379-87ab-54b637c9f0e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044319 Jul 26 04:59:05.655310 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2925/5927] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:06.024450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:06.039678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71733b4f-bd0f-441d-9838-ca2f0ad131d0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1563 microversion: 2.1 time: 0.463758 Jul 26 04:59:06.041609 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3003/5928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:05 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1563 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:08.443594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:08.444924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:08.454235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.454950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.456089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.456702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.500242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 04:59:08.509790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:08.614072 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1870868d-3bcc-4b81-83aa-93902bab6874 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 204 len: 0 microversion: 2.1 time: 0.173993 Jul 26 04:59:08.615881 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2926/5929] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:59:08 2022] DELETE /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 04:59:08.626468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:08.628031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:08.635615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.636188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.636989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.637443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.918661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:08.932829 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c9ca0eb-c726-40fb-9893-2a215eee4fa5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1410 microversion: 2.1 time: 0.311095 Jul 26 04:59:08.950111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3004/5930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:08 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1410 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:09.958128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:09.959497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:09.966626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:09.967090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:09.967995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:09.968446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:10.126478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:10.135882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8f84114-b5aa-42b0-abc8-d517ce42f8b1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1410 microversion: 2.1 time: 0.181842 Jul 26 04:59:10.137101 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2927/5931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:09 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1410 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:11.072704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2eb71593-cbd6-414f-a107-af84b1d94d13 req-4afd2e04-a1d9-415a-af16-cb578e6cc3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fb9481-b808-483b-bb20-9b3ad449786e", "name": "network-vif-deleted", "tag": "8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:11.089179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2eb71593-cbd6-414f-a107-af84b1d94d13 req-4afd2e04-a1d9-415a-af16-cb578e6cc3a0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:11.090052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2eb71593-cbd6-414f-a107-af84b1d94d13 req-4afd2e04-a1d9-415a-af16-cb578e6cc3a0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:11.105409 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2eb71593-cbd6-414f-a107-af84b1d94d13 req-4afd2e04-a1d9-415a-af16-cb578e6cc3a0 service nova] Creating event network-vif-deleted:8378a65d-8f6e-4eb6-a83a-31b9bbfe48cd for instance 54fb9481-b808-483b-bb20-9b3ad449786e on n-h2-848886-16 Jul 26 04:59:11.111463 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2eb71593-cbd6-414f-a107-af84b1d94d13 req-4afd2e04-a1d9-415a-af16-cb578e6cc3a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044550 Jul 26 04:59:11.112633 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3005/5932] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:11.158442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:11.159065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:11.175090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:11.175710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:11.176544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:11.178734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:11.301036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:11.310546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa9e3588-dea5-4202-b9bf-411932b17051 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1202 microversion: 2.1 time: 0.156849 Jul 26 04:59:11.311460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2928/5933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:11 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:12.333051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:12.334609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:12.359786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:12.360351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:12.364524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:12.367456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:12.490274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:12.498219 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01e09f61-c6f2-42f1-ae3b-1329e2e37128 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1202 microversion: 2.1 time: 0.169380 Jul 26 04:59:12.511038 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3006/5934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:12 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:13.524335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:13.524335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:13.542135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:13.544598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:13.545903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:13.548333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:13.644751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:13.656922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8cfacf0d-4023-4081-9dcc-b395893b6919 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1202 microversion: 2.1 time: 0.138315 Jul 26 04:59:13.657739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2929/5935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:13 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1202 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:14.679729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:14.681109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:14.685587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=46 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:14.699435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:14.700885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:14.702211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:14.703455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:14.848164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:14.862203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d58620d2-4c35-4a8f-80f4-aa832acb21fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1202 microversion: 2.1 time: 0.185666 Jul 26 04:59:14.863526 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3007/5936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:14 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:15.886182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:15.888929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:15.912718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:15.913251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:15.914824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:15.918449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:16.096081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:16.105124 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-091ea14e-15de-4cc9-8e9c-e96519135f5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1202 microversion: 2.1 time: 0.224455 Jul 26 04:59:16.105984 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2930/5937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:15 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1202 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:17.128802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:17.129483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:17.143339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:17.143870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:17.147740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:17.150389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:17.198692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:17.200146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:17.201506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 54fb9481-b808-483b-bb20-9b3ad449786e {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 04:59:17.266938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:17.284661 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3030f27b-6e69-45a6-8648-35dd57115a91 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 200 len: 1207 microversion: 2.1 time: 0.160180 Jul 26 04:59:17.285260 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3008/5938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:17 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 1207 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:18.307636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:18.312802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:18.323956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:18.324422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:18.325774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:18.326248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:18.366505 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e HTTP/1.1 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '54fb9481-b808-483b-bb20-9b3ad449786e'} Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:18.369481 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:18.375542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5cc4f34e-877b-4704-9725-d4859a4e62a3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 404 len: 111 microversion: 2.1 time: 0.069685 Jul 26 04:59:18.377300 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2931/5939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:18 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:21.687679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:21.688840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:21.701787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:21.702625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:21.703684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:21.706755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:21.727612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b HTTP/1.1 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '4f1d92ab-516c-4a21-b084-97fc7d69d78b'} Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:21.729793 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.733874 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.736565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:21.739300 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d1c84f0f-e657-47f9-a67c-7591936ed83f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 404 len: 111 microversion: 2.1 time: 0.055240 Jul 26 04:59:21.740133 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3009/5940] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:59:21 2022] DELETE /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:21.750540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:21.751903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 4f1d92ab-516c-4a21-b084-97fc7d69d78b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:21.758029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:21.766292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:21.766593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:21.767871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:21.768491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:21.785699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b HTTP/1.1 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '4f1d92ab-516c-4a21-b084-97fc7d69d78b'} Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:21.787301 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 4f1d92ab-516c-4a21-b084-97fc7d69d78b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b4dc7bb-6bb6-47d3-988e-7256f38621f5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b" status: 404 len: 111 microversion: 2.1 time: 0.044279 Jul 26 04:59:21.794489 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2932/5941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:21 2022] GET /compute/v2.1/servers/4f1d92ab-516c-4a21-b084-97fc7d69d78b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:23.206876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:23.208051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:23.229831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.230654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.232219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.232835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.253294 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e HTTP/1.1 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '54fb9481-b808-483b-bb20-9b3ad449786e'} Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:23.258354 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.263572 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.265609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:23.266899 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2ca4aea3-81cf-492d-9a71-c579133bd6ec tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 404 len: 111 microversion: 2.1 time: 0.065228 Jul 26 04:59:23.268153 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3010/5942] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 04:59:23 2022] DELETE /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:23.284159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:23.288931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 54fb9481-b808-483b-bb20-9b3ad449786e] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:23.306079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.306391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.307045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.310086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.345401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e HTTP/1.1 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '54fb9481-b808-483b-bb20-9b3ad449786e'} Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:23.348676 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. Jul 26 04:59:23.358443 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 04:59:23.361521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 54fb9481-b808-483b-bb20-9b3ad449786e could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:23.363408 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6631a91-3d63-439d-ad06-f01b5452a74b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e" status: 404 len: 111 microversion: 2.1 time: 0.087390 Jul 26 04:59:23.366424 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2933/5943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:23 2022] GET /compute/v2.1/servers/54fb9481-b808-483b-bb20-9b3ad449786e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:23.494796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e500bda5-cd9e-40bd-9c16-761e499984d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: .version_select at 0x7f38b51ae8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2035241856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQKRq7ugbbsKKkP/OFluEg6Vn7PVltWa6fRUCF/boZyP6T4AJBqM/GBzpMZ0PT86CRgiXTul+o4o2yQnYpGBw5/lFp9l/vIALvCTFj8/VJ7ZAqoAw5l4y2wNVvX4HrGgQ=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:23.538099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e500bda5-cd9e-40bd-9c16-761e499984d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:59:23.551342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e500bda5-cd9e-40bd-9c16-761e499984d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:59:23.561551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:23.567100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:23.583672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.591112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.593065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:23.593528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:23.630532 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e500bda5-cd9e-40bd-9c16-761e499984d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.139678 Jul 26 04:59:23.630943 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3011/5944] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 04:59:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:23.656989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-333f3ec6-8993-4cf5-a0dd-0958ef817fd6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action" status: 200 len: 24565 microversion: 2.1 time: 0.101537 Jul 26 04:59:23.665585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2934/5945] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:59:23 2022] POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action => generated 24565 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:59:29.995852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:29.998611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:30.017288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:30.018392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:30.020735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:30.022667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:30.040742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=70 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:31.125412 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88cba83a-55ba-4aac-9b86-5dea2947f5c9 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1835 microversion: 2.1 time: 1.131518 Jul 26 04:59:31.129217 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3012/5946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:29 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1835 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:31.156786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:31.157488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:31.169715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.182109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.183259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.184468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.447765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:31.460317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-982f4514-7a7f-4df9-ba02-1440ecf7e85e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1682 microversion: 2.1 time: 0.310572 Jul 26 04:59:31.461495 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2935/5947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:31 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1682 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:31.571884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:31.574545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:31.585682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.586130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.592336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.592797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.687968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d0ac4fb-63bb-43df-97b0-607aed32acc6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action" status: 200 len: 32638 microversion: 2.1 time: 0.118641 Jul 26 04:59:31.689454 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3013/5948] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:59:31 2022] POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action => generated 32638 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:59:31.903675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:31.907689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:31.929142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.929929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.931262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:31.931985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:31.989099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '30f12f556f4943b6967f02801a9cf580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26d7d51e354ceaac99cc0bc0e4e226', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:31.989973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: b1262225-0111-4d12-8b08-31257dcbef43] flavor_id is None. Assuming migration. {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 04:59:31.990525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 04:59:32.435714 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9e1688b-d040-43d9-9dac-b32e24a8d330 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action" status: 202 len: 0 microversion: 2.1 time: 0.538826 Jul 26 04:59:32.436283 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2936/5949] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 04:59:31 2022] POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:59:32.446491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:32.447672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:32.467300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:32.469139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:32.470307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:32.470953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:32.709656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:32.718114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cae1d6e6-0db3-4e5c-8ee3-649696f01d12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1691 microversion: 2.1 time: 0.277092 Jul 26 04:59:32.721221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3014/5950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:32 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:33.747044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:33.748574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:33.760470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:33.761554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:33.764853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:33.766727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:34.235239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:34.256002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3b123b13-91a4-4b3a-83b5-d1fd333cfdc2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1691 microversion: 2.1 time: 0.515268 Jul 26 04:59:34.272689 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2937/5951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:33 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1691 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:35.284597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:35.285382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:35.291145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:35.299721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:35.300298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:35.302015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:35.302743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:35.503251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:35.517779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a347a7a-f52e-4c3d-850b-d9bdaedcdc79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1691 microversion: 2.1 time: 0.238500 Jul 26 04:59:35.520041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3015/5952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:35 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:36.541169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:36.543216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:36.554210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:36.555769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:36.558111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:36.561995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:36.977334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:37.017224 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f45af3a4-4751-49b6-91f5-4d1cca83e790 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1691 microversion: 2.1 time: 0.477754 Jul 26 04:59:37.021525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2938/5953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:36 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1691 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:37.923962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:37.926246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:37.953691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:37.964951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:37.969025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:37.970544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.038346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:38.039637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:38.060329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.061102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.062094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.062741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.284985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:38.306067 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfbaf024-d1e2-46b8-ba56-0213958238c9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.272423 Jul 26 04:59:38.309126 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2939/5954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:38 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:38.371473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:38.392494 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3042cff-b8d2-4167-a496-71b6e2cc9306 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.468863 Jul 26 04:59:38.395100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3016/5955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:37 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:38.428426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:38.429200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:38.437354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.437870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.438758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.439404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.630998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:38.639308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:38.643201 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68dbda62-14d4-4e95-b25f-11d1df058096 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.219582 Jul 26 04:59:38.664393 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2940/5956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:38.678103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:38.678826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:38.691463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.692917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:38.695835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:38.702910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:39.030856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:39.053134 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e07dd741-2c95-425c-acbf-4b363331df0f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.385651 Jul 26 04:59:39.058711 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3017/5957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:38 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:39.076930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:39.079360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:39.104230 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:39.106571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:39.121382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:39.123407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:39.330623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:39.331491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:39.340246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:39.342029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:39.343673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:39.345887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:39.523329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:39.534464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2bb236d-76c0-4233-9d0a-1fa705d38b7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.463012 Jul 26 04:59:39.535310 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2941/5958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:39.884461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-805740074", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "167545a1-7614-488e-b0ff-7dc229109bb2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:39.904821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:39.920508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d6a0993-2da3-4299-baa4-ab976af8fd92 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.591053 Jul 26 04:59:39.923088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3018/5959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:39 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:40.013315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] validate_networks() for [('167545a1-7614-488e-b0ff-7dc229109bb2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:59:40.920035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:59:40.921330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:59:40.922004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:59:40.922667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:59:40.923287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:59:40.944386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:40.947318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:40.948380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:40.950808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:40.951567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:40.951870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:40.971718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:40.975061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:40.975892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:40.978576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:40.999526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:59:41.009881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:59:41.051908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:59:41.062865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:59:41.206676 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-140e5055-18c0-4bff-89b8-ad0cb6c69779 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329081 Jul 26 04:59:41.210836 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2942/5960] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 04:59:41.236572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-545bf57b-ccc3-47af-8af3-9e6e39e6ce65 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:41.236689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-545bf57b-ccc3-47af-8af3-9e6e39e6ce65 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:41.370087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-545bf57b-ccc3-47af-8af3-9e6e39e6ce65 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:41.381921 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-545bf57b-ccc3-47af-8af3-9e6e39e6ce65 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1214 microversion: 2.1 time: 0.149924 Jul 26 04:59:41.385913 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2943/5961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:41 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:41.534304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:41.550094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-468321fc-6127-4063-89db-2f4690f72cea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.604519 Jul 26 04:59:41.551881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3019/5962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:40 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:42.409557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:42.410274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:42.444527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:42.445071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:42.445923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:42.450443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:42.576825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:42.579200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:42.603357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:42.606563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:42.609381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:42.613358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:42.655119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:42.670998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb100d86-449d-4249-b0a4-2c1100c7f3d1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1210 microversion: 2.1 time: 0.265867 Jul 26 04:59:42.680485 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2944/5963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:42 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:42.957467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:42.967016 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfa4199a-c0d8-4e31-b715-c88a61113f1b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.395570 Jul 26 04:59:42.968939 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3020/5964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:42 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:43.702339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:43.703114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:43.729981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:43.732315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:43.734748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:43.736993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:43.913589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:43.935980 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0682af47-1ac3-4f00-aae5-a48ae259bbad tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1272 microversion: 2.1 time: 0.237782 Jul 26 04:59:43.937606 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2945/5965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:43 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:43.995882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:43.999364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:44.017338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:44.017338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:44.021613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:44.022377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:44.963398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:44.964657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:44.974165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:44.974835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:44.975747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:44.976364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:45.179336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:45.208517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b06f2c09-a605-43ba-bee8-e64e99b9b087 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 1.208053 Jul 26 04:59:45.210563 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3021/5966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:43 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:45.255993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:45.264330 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9e92a88-9cc7-42f5-b69e-17844b700e41 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.308156 Jul 26 04:59:45.270006 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2946/5967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:44 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:46.232607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:46.234041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:46.241299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:46.243597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:46.244703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:46.246498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:46.247668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:46.296904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:46.297700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:46.308550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:46.309454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:46.310775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:46.311480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:46.554396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:46.563989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c2af7d7d-20c8-45ed-98b2-db0308285a77 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.272757 Jul 26 04:59:46.564545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2947/5968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:46 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:46.755409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:46.775121 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57fa6fd0-cd3b-4a47-b129-91ad613a08b9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.547907 Jul 26 04:59:46.775729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3022/5969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:46 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:47.583999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:47.584619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:47.596051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:47.596519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:47.597311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:47.597755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:47.615105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-20cf52f4-96af-49a2-ae59-663b428100b7 req-8c7a601f-25d5-47c8-bfe5-50ba3e9d8d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca43ea8-240e-468c-90a9-53d9c4b2ccae", "tag": "dbbbeed5-24fb-421d-9a58-303c35da6388"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:47.636713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20cf52f4-96af-49a2-ae59-663b428100b7 req-8c7a601f-25d5-47c8-bfe5-50ba3e9d8d05 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:47.637364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20cf52f4-96af-49a2-ae59-663b428100b7 req-8c7a601f-25d5-47c8-bfe5-50ba3e9d8d05 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:47.658465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-20cf52f4-96af-49a2-ae59-663b428100b7 req-8c7a601f-25d5-47c8-bfe5-50ba3e9d8d05 service nova] Creating event network-changed:dbbbeed5-24fb-421d-9a58-303c35da6388 for instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae on n-h2-848886-16 Jul 26 04:59:47.673772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-20cf52f4-96af-49a2-ae59-663b428100b7 req-8c7a601f-25d5-47c8-bfe5-50ba3e9d8d05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062248 Jul 26 04:59:47.674613 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3023/5970] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:47.802576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:47.803289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:47.817929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:47.818423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:47.819213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:47.819876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:47.962100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:47.980571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe9db3a7-40a2-4667-9442-b22bdd75615c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.400232 Jul 26 04:59:47.981183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2948/5971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:47 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:48.249147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:48.261344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-513efb9f-a1bc-4f22-a1ca-fa7813c900b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.462687 Jul 26 04:59:48.263106 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3024/5972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:47 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:49.010273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:49.012698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:49.023250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:49.023790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:49.024661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:49.025181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:49.288912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:49.290047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:49.331681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:49.332451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:49.333467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:49.334146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:49.360307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:49.381529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d586fe06-3fe5-4fe5-a45b-064fb7d7ddcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.382564 Jul 26 04:59:49.382658 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2949/5973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:48 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:49.547624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:49.555575 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c131afaf-79b0-4f12-9d15-3561b70c37b6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.274729 Jul 26 04:59:49.556158 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3025/5974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:49 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:50.404385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:50.404935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:50.414469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:50.415832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:50.420221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:50.422342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:50.577581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:50.578229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:50.585530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:50.586616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:50.587049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:50.587676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:50.820239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:50.833497 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-040dd081-e89e-40fc-b9d9-d02bbd89fcf0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.433028 Jul 26 04:59:50.838197 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2950/5975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:50 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:50.916878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:50.926931 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ae2adf4-2949-4e8f-9619-704d110ce878 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.353762 Jul 26 04:59:50.941975 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3026/5976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:50 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:51.858437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:51.859149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:51.868771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:51.870994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:51.875105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:51.878287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:51.880988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:51.881940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:51.882542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:51.950001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:51.950751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:51.962018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:51.967623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:51.968695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:51.980522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:52.258048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:52.271144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f02272b-86df-45f5-830a-3d904b0f8533 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.418055 Jul 26 04:59:52.272112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2951/5977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:51 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:52.804708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:52.820728 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-379375c6-4851-467d-9b07-2321b70e2275 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.875623 Jul 26 04:59:52.823412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3027/5978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:51 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:53.297828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:53.299087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:53.316750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:53.317217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:53.318005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:53.318473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:53.795780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:53.808608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f034f7e-cc7c-411e-a83f-46bfec4f84ec tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.516598 Jul 26 04:59:53.809579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2952/5979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:53 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:53.846733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:53.847548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:53.866076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:53.866730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:53.867675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:53.871279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:54.467307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:54.480137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d9ceb2c-151c-4731-81bd-2530b8591ec9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1696 microversion: 2.1 time: 0.636409 Jul 26 04:59:54.481353 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3028/5980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:53 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1696 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:54.831539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:54.833164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:54.845702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:54.856138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:54.858066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:54.864850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:55.288931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:55.306993 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0136879-0549-49fb-ab51-b0ff9d4cb9a7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.480410 Jul 26 04:59:55.308052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2953/5981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:54 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:55.501517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:55.502777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:55.515095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:55.516411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:55.520379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:55.521017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:56.131633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:56.139332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:56.144966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87f2e174-af1e-479d-ac81-d8c4484067db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1695 microversion: 2.1 time: 0.647268 Jul 26 04:59:56.149006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3029/5982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:55 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1695 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:56.330181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:56.330806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:56.346419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:56.347814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:56.350022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:56.351186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:56.579613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1070509531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035241856", "security_groups": [{"name": "tempest-secgroup-smoke-825398454"}], "block_device_mapping_v2": [{"uuid": "af3c4c8e-92e5-4507-bbf5-970459e95d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:57.096839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:57.105347 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b36b1243-5429-4de6-b895-550bbe6d89db tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.779907 Jul 26 04:59:57.113382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2954/5983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:56 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:57.119078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "name": "network-vif-unplugged", "status": "completed", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:57.145492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:57.149490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:57.177328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] Creating event network-vif-unplugged:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h2-848886-16 Jul 26 04:59:57.195797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] Instance b1262225-0111-4d12-8b08-31257dcbef43 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:59:57.224077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-36a0a9c2-126e-4fb9-b537-bba4037c2075 req-adb8a7f9-6dbc-4578-b8c9-03f901422cb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109016 Jul 26 04:59:57.233898 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2955/5984] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:57.248196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:57.249097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:57.261635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:57.262377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:57.263378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:57.264360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:57.354579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 04:59:57.760439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:57.799376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4426300e-836c-43ab-be11-4c2511c39732 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1695 microversion: 2.1 time: 0.563821 Jul 26 04:59:57.802453 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2956/5985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:57 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1695 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:58.020939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-df1f07f4-f2ee-499f-8718-e58f351814dc req-e5d5217f-f268-4786-b3a0-78550f6acc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca43ea8-240e-468c-90a9-53d9c4b2ccae", "name": "network-vif-plugged", "status": "completed", "tag": "dbbbeed5-24fb-421d-9a58-303c35da6388"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:58.053001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df1f07f4-f2ee-499f-8718-e58f351814dc req-e5d5217f-f268-4786-b3a0-78550f6acc22 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:58.053585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-df1f07f4-f2ee-499f-8718-e58f351814dc req-e5d5217f-f268-4786-b3a0-78550f6acc22 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:58.080991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-df1f07f4-f2ee-499f-8718-e58f351814dc req-e5d5217f-f268-4786-b3a0-78550f6acc22 service nova] Creating event network-vif-plugged:dbbbeed5-24fb-421d-9a58-303c35da6388 for instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae on n-h2-848886-16 Jul 26 04:59:58.096783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-df1f07f4-f2ee-499f-8718-e58f351814dc req-e5d5217f-f268-4786-b3a0-78550f6acc22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086600 Jul 26 04:59:58.100475 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2957/5986] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:59:58.138797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:58.139824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:58.153441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:58.156535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:58.158558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:58.161315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:58.629621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:58.642236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31340dae-6499-4410-8a04-fa2f402f9c04 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.506207 Jul 26 04:59:58.648399 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2958/5987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:58 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:59:58.824272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:58.824905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:58.838013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:58.847729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:58.849578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:58.850233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.082568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 04:59:59.083790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 04:59:59.084479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 04:59:59.085637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 04:59:59.086261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 04:59:59.098858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:59.100077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.101074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:59.101727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.127427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 04:59:59.134548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 04:59:59.237710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 04:59:59.240518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af3c4c8e-92e5-4507-bbf5-970459e95d7f',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 04:59:59.398455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1841b669-c2ed-4885-812b-02692d335be9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.823589 Jul 26 04:59:59.399608 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3030/5988] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 04:59:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 04:59:59.405084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:59.416462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:59.417107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.454808 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] Creating event network-changed:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h2-848886-16 Jul 26 04:59:59.462801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] Instance b1262225-0111-4d12-8b08-31257dcbef43 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 04:59:59.493516 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-140d452c-4865-49b5-9070-2549675b0b8d req-85ce55d3-c58f-40cf-b32b-82126f5851ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092460 Jul 26 04:59:59.496672 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3031/5989] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 04:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:59.503678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18c91bc3-bec9-45c7-8ae8-87b2e5658cb9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:59.504966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18c91bc3-bec9-45c7-8ae8-87b2e5658cb9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:59.667490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18c91bc3-bec9-45c7-8ae8-87b2e5658cb9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:59.667893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 04:59:59.674424 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18c91bc3-bec9-45c7-8ae8-87b2e5658cb9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1095 microversion: 2.1 time: 0.176342 Jul 26 04:59:59.675192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3032/5990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:59 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1095 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:59:59.680255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:59.681153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 04:59:59.700180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:59.700895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.701909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:59.702541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:59.703971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f82528ac-0c6e-4b88-9e5d-ba5b7f73c499 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1695 microversion: 2.1 time: 0.886923 Jul 26 04:59:59.704577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2959/5991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:58 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1695 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:00.247960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:00.259692 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76a19c9d-6ad4-464c-9575-1bd31969f9b6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1314 microversion: 2.1 time: 0.580519 Jul 26 05:00:00.260667 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3033/5992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 04:59:59 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:00.699195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:00.700427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:00.716031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:00.716749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:00.717763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:00.718408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:00.729501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:00.730869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:00.802733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:00.804288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:00.808537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:00.813397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:00.855985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:01.002965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:01.011632 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-587a903d-4d2c-404c-b877-563c9d6f1595 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1201 microversion: 2.1 time: 0.317263 Jul 26 05:00:01.012782 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2960/5993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:00 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1201 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:01.292915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:01.293941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:01.311029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:01.311699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:01.320359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:01.321224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:01.324693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:01.325195 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9d62200-8b50-42b0-8e41-45d8bc2b2819 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1693 microversion: 2.1 time: 0.597306 Jul 26 05:00:01.340717 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3034/5994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:00 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1693 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:01.796315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:01.811043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-12752a6b-7659-448d-a628-e4a955de1ddb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1502 microversion: 2.1 time: 0.533025 Jul 26 05:00:01.814208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2961/5995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:01 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1502 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:01.835657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:01.836262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:01.847682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:01.851504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:01.852520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:01.855061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.033692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.035193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:02.042957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.043778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.045145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.045830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.194388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:02.204033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-951bf977-40c1-4b5b-a6d4-7cd3b7826e62 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1211 microversion: 2.1 time: 0.174203 Jul 26 05:00:02.204992 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2962/5996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:02.281812 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.network.security_group_api [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Removing security group 33904573-fc9f-46ae-9cca-7fba0f6f4f8b from port dbbbeed5-24fb-421d-9a58-303c35da6388 Jul 26 05:00:02.351285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.352355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:02.365359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.366108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.367537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.368173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.895276 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-861d0a50-a947-410d-8911-e7483b8016ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae/action" status: 202 len: 0 microversion: 2.1 time: 1.064041 Jul 26 05:00:02.896742 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3035/5997] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:01 2022] POST /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:00:02.907801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.909050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:02.932759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.937309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:02.938873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:02.939439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:03.038610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:03.052279 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33424a4a-7ce3-439b-b3ce-6bc617c62f14 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1693 microversion: 2.1 time: 0.705636 Jul 26 05:00:03.055537 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2963/5998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1693 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:03.064243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-31ef85c4-ddc8-4da5-9320-90582fd2f3f5 req-24579e64-c82f-49d5-937b-6db5ac2aebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca43ea8-240e-468c-90a9-53d9c4b2ccae", "tag": "dbbbeed5-24fb-421d-9a58-303c35da6388"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:03.081000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-31ef85c4-ddc8-4da5-9320-90582fd2f3f5 req-24579e64-c82f-49d5-937b-6db5ac2aebd7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:03.081844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-31ef85c4-ddc8-4da5-9320-90582fd2f3f5 req-24579e64-c82f-49d5-937b-6db5ac2aebd7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:03.168114 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-31ef85c4-ddc8-4da5-9320-90582fd2f3f5 req-24579e64-c82f-49d5-937b-6db5ac2aebd7 service nova] Creating event network-changed:dbbbeed5-24fb-421d-9a58-303c35da6388 for instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae on n-h2-848886-16 Jul 26 05:00:03.182396 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-31ef85c4-ddc8-4da5-9320-90582fd2f3f5 req-24579e64-c82f-49d5-937b-6db5ac2aebd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121461 Jul 26 05:00:03.220780 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2964/5999] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:03.248273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:03.252069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:03.278355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:03.280381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:03.282289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:03.285939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:03.293190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a02f5659-e5e5-42df-baf3-aceaf16672c1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1460 microversion: 2.1 time: 0.390155 Jul 26 05:00:03.297067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:03.299484 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3036/6000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1460 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:03.321264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:03.322141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:03.336235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:03.338782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:03.342473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:03.345624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.215576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:04.228252 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d36be8f6-1551-46ed-863d-ad2be83ee0c2 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1278 microversion: 2.1 time: 1.002301 Jul 26 05:00:04.233109 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2965/6001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:03 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1278 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:04.239880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:04.240797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:04.255058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.257900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.260245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.261131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.340484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:04.352362 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6bc6a94c-38cf-4afa-893a-6234123e0c7d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 1.035242 Jul 26 05:00:04.370440 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3037/6002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:03 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:04.396218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:04.397065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:04.432128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.432914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.434387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.434852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.607172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:04.625615 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac15dcf7-f419-4612-a377-e3c6e15cf3ae tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1690 microversion: 2.1 time: 0.391195 Jul 26 05:00:04.626585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2966/6003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:04 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1690 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:04.654378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:04.658821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:04.676252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.678964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.679988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.683418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.801611 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5473391-9e7b-42f9-adc0-ce12854d7a2d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action" status: 204 len: 0 microversion: 2.1 time: 0.154171 Jul 26 05:00:04.807022 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2967/6004] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:04 2022] POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:00:04.818379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:04.819930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:04.840374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.841088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:04.842330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:04.843012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:05.756442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:05.791483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9d64b814-e9a6-45e7-9546-53651ea0a639 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1690 microversion: 2.1 time: 0.981726 Jul 26 05:00:05.794429 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2968/6005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:04 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1690 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:05.805569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:05.808657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:05.836934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:05.838033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:05.839074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:05.846252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:06.843817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:06.857534 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-afa7baf5-986e-4c31-8f83-57269055e61d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1278 microversion: 2.1 time: 1.056295 Jul 26 05:00:06.863706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2969/6006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:05 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1278 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:06.889354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:06.891735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:06.911840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:06.912541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:06.916090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:06.917264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:07.096645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:07.119754 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e2cf3b2-864e-4194-874b-a433ae357cb5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 2.736149 Jul 26 05:00:07.134776 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3038/6007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:04 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:07.172735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:07.177991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:07.203265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:07.210054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:07.211293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:07.214601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:07.299441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:07.308631 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea706a06-cab7-46c1-95a9-fd745f6ba63a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1690 microversion: 2.1 time: 0.443743 Jul 26 05:00:07.312745 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2970/6008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:06 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:07.881693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:07.882975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:07.897579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:07.898336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:07.899377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:07.900005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.102023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:08.115778 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0827ede1-60a3-4347-b159-abfdb33c143d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.965948 Jul 26 05:00:08.116388 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3039/6009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:07 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:08.144938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:08.145968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:08.156204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:08.156967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.158107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:08.158759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.493009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:08.505794 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64b4f7ed-886b-4bcb-993a-6c831182d605 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.365834 Jul 26 05:00:08.507423 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3040/6010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:08 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:08.517704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:08.518380 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:08.532234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:08.532710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.536035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:08.538026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.619688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:08.631471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c13f971-9afd-43db-8aef-81277f53188b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1278 microversion: 2.1 time: 0.755025 Jul 26 05:00:08.638448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2971/6011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:07 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1278 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:08.662024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ddc356c4-bb26-4c3b-8654-fda3ea816420 req-96f9055a-e7f5-4933-a290-01170ae7bd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd7c39-d3e0-4d4a-b781-64a569873457", "tag": "dda09ef5-1fdb-4e0d-95ec-e763a0376dac"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:08.718675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ddc356c4-bb26-4c3b-8654-fda3ea816420 req-96f9055a-e7f5-4933-a290-01170ae7bd65 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:08.720512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ddc356c4-bb26-4c3b-8654-fda3ea816420 req-96f9055a-e7f5-4933-a290-01170ae7bd65 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:08.809665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ddc356c4-bb26-4c3b-8654-fda3ea816420 req-96f9055a-e7f5-4933-a290-01170ae7bd65 service nova] Creating event network-changed:dda09ef5-1fdb-4e0d-95ec-e763a0376dac for instance 75dd7c39-d3e0-4d4a-b781-64a569873457 on n-h1-848886-16 Jul 26 05:00:08.829881 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ddc356c4-bb26-4c3b-8654-fda3ea816420 req-96f9055a-e7f5-4933-a290-01170ae7bd65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184626 Jul 26 05:00:08.832619 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2972/6012] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:08.845891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1298895631", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "167545a1-7614-488e-b0ff-7dc229109bb2"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:09.015650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] validate_networks() for [('167545a1-7614-488e-b0ff-7dc229109bb2', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:09.079284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:09.087477 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46c74b0f-23b0-4a8e-af73-10763fa6a4a3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1690 microversion: 2.1 time: 0.578912 Jul 26 05:00:09.102768 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3041/6013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:08 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1690 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:09.663746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:09.664748 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:09.673619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:09.680771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:09.685789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:09.687017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:09.689025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:09.695970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:09.878416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:09.879132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:09.880810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:09.881404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:09.882117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:09.895369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:09.896297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:09.897312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:09.898059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:09.927372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:09.936236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Getting quotas for user 4e7736f1deb34149a4e223da1c710a62 and project 4f8821a95bd54577a5c9ee6b5c216754. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:09.964028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:09.967503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:10.099753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00db1d53-439d-4872-bd7a-055bd6804638 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265632 Jul 26 05:00:10.107312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2973/6014] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:00:10.112548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-aee45d64-d8a9-4254-b161-9b15fcde8116 req-bd9cf176-71af-4a3a-aa57-6c035c860010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "name": "network-vif-plugged", "status": "completed", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:10.137468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aee45d64-d8a9-4254-b161-9b15fcde8116 req-bd9cf176-71af-4a3a-aa57-6c035c860010 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:10.137859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-aee45d64-d8a9-4254-b161-9b15fcde8116 req-bd9cf176-71af-4a3a-aa57-6c035c860010 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:10.162543 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-aee45d64-d8a9-4254-b161-9b15fcde8116 req-bd9cf176-71af-4a3a-aa57-6c035c860010 service nova] Creating event network-vif-plugged:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h2-848886-16 Jul 26 05:00:10.174145 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-aee45d64-d8a9-4254-b161-9b15fcde8116 req-bd9cf176-71af-4a3a-aa57-6c035c860010 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063889 Jul 26 05:00:10.176096 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2974/6015] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:10.190245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:10.191189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:10.204327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:10.205513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:10.210371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:10.210937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:10.536534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:10.548155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eb156ecb-4bee-4569-98b5-67c0b42df6c3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1278 microversion: 2.1 time: 0.888619 Jul 26 05:00:10.554269 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3042/6016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:09 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1278 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:10.571536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-718d45c7-d953-4ec1-97fe-ff0d26875ee2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:10.575525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-718d45c7-d953-4ec1-97fe-ff0d26875ee2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:10.734878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-718d45c7-d953-4ec1-97fe-ff0d26875ee2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:10.752626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-718d45c7-d953-4ec1-97fe-ff0d26875ee2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1215 microversion: 2.1 time: 0.196943 Jul 26 05:00:10.755208 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3043/6017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:10 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:10.774114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:10.788215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1861590d-4587-4307-9121-37158674795f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1682 microversion: 2.1 time: 0.609263 Jul 26 05:00:10.790466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2975/6018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:10 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1682 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:11.577952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:11.579264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:11.602000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:11.602663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:11.604284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:11.604816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:11.775506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:11.776164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:11.794787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:11.795245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:11.796028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:11.796652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:12.004531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:12.014441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6c5515f-c6b0-4060-b470-b52a6932a4a2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1267 microversion: 2.1 time: 0.241068 Jul 26 05:00:12.015060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2976/6019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:11 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:12.020766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:12.038976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-340098c6-96ac-4ec8-8ea3-7c42dc73f461 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1278 microversion: 2.1 time: 0.464537 Jul 26 05:00:12.039604 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3044/6020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:11 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1278 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:13.035481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:13.036723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:13.044268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:13.044978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:13.045937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:13.046561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:13.060206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:13.061126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:13.074856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:13.076924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:13.079127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:13.082075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:13.152249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:13.164580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3ec1736-a22c-4acf-9b22-fcbe69e5c18a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1273 microversion: 2.1 time: 0.132700 Jul 26 05:00:13.167476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2977/6021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:13 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:13.451305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:13.460041 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33392f93-23d3-4c2e-9e06-d3e07f362785 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.404097 Jul 26 05:00:13.466409 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3045/6022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:13 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:14.188017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:14.188646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:14.201970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:14.202469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:14.203282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:14.203736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:14.209516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:14.487847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:14.489231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:14.496638 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:14.497465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:14.498732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:14.499425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:14.521589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:14.540315 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-396b08cb-99ea-4a65-a9da-39628c173940 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.354087 Jul 26 05:00:14.543162 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2978/6023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:14 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:14.835250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:14.850719 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa7bbce1-c255-4e4e-8a3e-66cc4c4c43bc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.366658 Jul 26 05:00:14.852420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3046/6024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:14 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:15.327599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-65e8ade7-ca57-43b1-bc10-93263000a125 req-bb43122c-559b-4278-9688-b4fb8cf86009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7a25db-aa04-48ab-94aa-bf445cbd598b", "tag": "e03be364-a185-458e-88bb-e63e2d41c3a8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:15.352027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65e8ade7-ca57-43b1-bc10-93263000a125 req-bb43122c-559b-4278-9688-b4fb8cf86009 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:15.354909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-65e8ade7-ca57-43b1-bc10-93263000a125 req-bb43122c-559b-4278-9688-b4fb8cf86009 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:15.367663 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-65e8ade7-ca57-43b1-bc10-93263000a125 req-bb43122c-559b-4278-9688-b4fb8cf86009 service nova] Creating event network-changed:e03be364-a185-458e-88bb-e63e2d41c3a8 for instance ad7a25db-aa04-48ab-94aa-bf445cbd598b on n-h2-848886-16 Jul 26 05:00:15.373807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-65e8ade7-ca57-43b1-bc10-93263000a125 req-bb43122c-559b-4278-9688-b4fb8cf86009 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050797 Jul 26 05:00:15.375051 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2979/6025] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:15.563630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:15.565126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:15.584800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:15.587726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:15.588558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:15.589029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:15.875338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:15.876052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:15.892114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:15.892570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:15.893351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:15.893795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:16.010631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:16.020751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8f49423-a3a0-43e2-83ee-117e3e05c0c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.461265 Jul 26 05:00:16.023999 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3047/6026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:15 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:16.216943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:16.226490 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9dfa9b0a-2d88-4696-a099-14cc26a53763 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.356231 Jul 26 05:00:16.230187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2980/6027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:15 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:17.049863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:17.052004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:17.055603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:17.068594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:17.080524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:17.087412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:17.091250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:17.251488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:17.252807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:17.267765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:17.268832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:17.269809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:17.270453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:17.434404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:17.452806 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8dfbec6-7556-4d59-a914-98222683a650 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.407440 Jul 26 05:00:17.453761 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3048/6028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:17 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:17.965081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:17.979303 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f98477f-4cf4-4593-857f-c18d89885099 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.731367 Jul 26 05:00:17.980295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2981/6029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:17 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:18.483946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:18.484542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:18.497138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:18.497606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:18.498433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:18.498886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:19.001453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:19.002072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:19.016442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:19.019363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:19.022789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:19.023301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:19.358684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:19.372402 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-84062ff6-157f-42ac-acd0-4208bd1bdc5e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.372971 Jul 26 05:00:19.373389 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2982/6030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:18 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:19.396533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:19.399681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:19.410225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c269aab3-86a0-4c40-891f-35d099a0ff8e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.930099 Jul 26 05:00:19.411536 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3049/6031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:18 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:20.394497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:20.395745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:20.397757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:20.398451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:20.405822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.406577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.407550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.408163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.432583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:20.433995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:20.449107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.450691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.452013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.452700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.741843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:20.746296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:20.769667 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b44400cf-c810-4807-96e8-0c1d06619edb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.379256 Jul 26 05:00:20.774219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2983/6032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:20 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:20.833564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:20.845306 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20a91bb5-10ca-4017-9392-e4e37ffb561b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.416270 Jul 26 05:00:20.848300 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3050/6033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:20 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:21.793159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:21.793718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:21.808120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:21.808590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:21.809404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:21.809856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:21.871106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:21.872361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:21.886685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:21.887444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:21.888411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:21.889388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:22.179223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:22.192550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5e59e84-da1d-48eb-abc9-e6f634828cc1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.325375 Jul 26 05:00:22.194479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3051/6034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:21 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:22.203790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ca2d462a-2da5-4c21-bf63-32da640e3c89 req-edba87fa-e065-4e13-a841-df1c85237e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7a25db-aa04-48ab-94aa-bf445cbd598b", "name": "network-vif-plugged", "status": "completed", "tag": "e03be364-a185-458e-88bb-e63e2d41c3a8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:22.225305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca2d462a-2da5-4c21-bf63-32da640e3c89 req-edba87fa-e065-4e13-a841-df1c85237e11 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:22.225754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca2d462a-2da5-4c21-bf63-32da640e3c89 req-edba87fa-e065-4e13-a841-df1c85237e11 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:22.253776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ca2d462a-2da5-4c21-bf63-32da640e3c89 req-edba87fa-e065-4e13-a841-df1c85237e11 service nova] Creating event network-vif-plugged:e03be364-a185-458e-88bb-e63e2d41c3a8 for instance ad7a25db-aa04-48ab-94aa-bf445cbd598b on n-h2-848886-16 Jul 26 05:00:22.272953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:22.279281 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ca2d462a-2da5-4c21-bf63-32da640e3c89 req-edba87fa-e065-4e13-a841-df1c85237e11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079105 Jul 26 05:00:22.279893 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3052/6035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:22.285976 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a175dc1-2063-4672-a1d4-2e7767aa504f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.496914 Jul 26 05:00:22.299045 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2984/6036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:21 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:23.220217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:23.221043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:23.236302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.238757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.239614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.240264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.309594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:23.310226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:23.327598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:23.329656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.330392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.331440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.332081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.591787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:23.599799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6761235e-00d9-4c11-8334-910c2d94b8bf tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.294831 Jul 26 05:00:23.600279 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2985/6037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:23 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:23.638589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:23.650344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4afaafee-7763-4bcd-928f-0776f800e897 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1315 microversion: 2.1 time: 0.433389 Jul 26 05:00:23.651219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3053/6038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:23 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:24.318907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ca1b7487-345a-4d14-9f7e-92e95e670e5c req-bd0011a5-a05a-4262-ad74-6ba0b8a162e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd7c39-d3e0-4d4a-b781-64a569873457", "name": "network-vif-plugged", "status": "completed", "tag": "dda09ef5-1fdb-4e0d-95ec-e763a0376dac"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:24.338657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ca1b7487-345a-4d14-9f7e-92e95e670e5c req-bd0011a5-a05a-4262-ad74-6ba0b8a162e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:24.339112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ca1b7487-345a-4d14-9f7e-92e95e670e5c req-bd0011a5-a05a-4262-ad74-6ba0b8a162e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:24.352211 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ca1b7487-345a-4d14-9f7e-92e95e670e5c req-bd0011a5-a05a-4262-ad74-6ba0b8a162e8 service nova] Creating event network-vif-plugged:dda09ef5-1fdb-4e0d-95ec-e763a0376dac for instance 75dd7c39-d3e0-4d4a-b781-64a569873457 on n-h1-848886-16 Jul 26 05:00:24.359336 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ca1b7487-345a-4d14-9f7e-92e95e670e5c req-bd0011a5-a05a-4262-ad74-6ba0b8a162e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Jul 26 05:00:24.361746 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2986/6039] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:24.623025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:24.623814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:24.636195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:24.638640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:24.639659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:24.642522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:24.675081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:24.675956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:24.692008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:24.694920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:24.696756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:24.698884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.270304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:25.285251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8c2fcc4-2a10-4054-9315-8362e994836c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1503 microversion: 2.1 time: 0.615220 Jul 26 05:00:25.288000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2987/6040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:24 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1503 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:25.303882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:25.326756 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5519074e-4c33-4197-9d42-dbab10a041c9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1266 microversion: 2.1 time: 0.708057 Jul 26 05:00:25.329910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3054/6041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:24 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1266 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:25.332822 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:25.334133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:25.344179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.345081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.346471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.347195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.454769 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8da9e0f-bf91-49a9-9c83-9da97bbeaa7b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b/action" status: 202 len: 0 microversion: 2.1 time: 0.133770 Jul 26 05:00:25.456217 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2988/6042] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:25 2022] POST /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:00:25.465980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:25.466997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:25.480174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.480804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.484700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.485668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.823156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:25.841652 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a018e198-6f81-4fd6-a062-8fcc6cce7c87 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1508 microversion: 2.1 time: 0.381331 Jul 26 05:00:25.846855 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3055/6043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:25 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:26.361949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:26.362788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:26.370930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.371796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.372952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.373795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.594323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.614787 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-611ecb9a-f29b-4ecc-9194-6e2e0c73d519 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1454 microversion: 2.1 time: 0.251644 Jul 26 05:00:26.615450 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2989/6044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:26 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1454 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:26.635509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:26.636359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:26.656816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.658384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.660308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.662618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.877194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:26.877721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:26.892916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.893379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.894181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:26.894803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:26.959158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.970885 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-763e0c9a-7305-4cc5-ba71-fd28a7908795 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1454 microversion: 2.1 time: 0.339664 Jul 26 05:00:26.973898 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3056/6045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:26 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1454 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:27.261586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:27.271618 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c11f4ba-7d28-4ed4-b2d2-f1e6d01ab2ce tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1488 microversion: 2.1 time: 0.398485 Jul 26 05:00:27.272192 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2990/6046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:26 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1488 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:27.299476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:27.301183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:27.311796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.315322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.316427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.319705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.391461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lazy-loading 'flavor' on Instance uuid ad7a25db-aa04-48ab-94aa-bf445cbd598b {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:00:27.732347 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e57bb42-8324-44f7-b170-76867019f986 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b/action" status: 202 len: 0 microversion: 2.1 time: 0.437908 Jul 26 05:00:27.734921 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3057/6047] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:27 2022] POST /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:00:27.743422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:27.744586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:27.759132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.761794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.763782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.767722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:28.287328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:28.299220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-be901a24-0432-431c-b675-6cef03d075d7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1494 microversion: 2.1 time: 0.561559 Jul 26 05:00:28.299821 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2991/6048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:27 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1494 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:29.336291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:29.339377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:29.400348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.401311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.402423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.403137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.745522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:29.755916 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44749e10-bbc4-4085-bad2-30f713a5bf44 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1494 microversion: 2.1 time: 0.436218 Jul 26 05:00:29.757123 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3058/6049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:29 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1494 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:30.784275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:30.787535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:30.831271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.831984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.837121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.837121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:31.095823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:31.109720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b344992b-b03f-4e96-ab99-bce3be2de74e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1515 microversion: 2.1 time: 0.332222 Jul 26 05:00:31.111782 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2992/6050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:30 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:31.330028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-637459c0-77ad-4acf-82d4-041b5f5ef28b req-196f8908-1c7b-40a2-afb8-e7a96e448c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd7c39-d3e0-4d4a-b781-64a569873457", "tag": "dda09ef5-1fdb-4e0d-95ec-e763a0376dac"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:31.344884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-637459c0-77ad-4acf-82d4-041b5f5ef28b req-196f8908-1c7b-40a2-afb8-e7a96e448c32 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:31.345751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-637459c0-77ad-4acf-82d4-041b5f5ef28b req-196f8908-1c7b-40a2-afb8-e7a96e448c32 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:31.361823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-637459c0-77ad-4acf-82d4-041b5f5ef28b req-196f8908-1c7b-40a2-afb8-e7a96e448c32 service nova] Creating event network-changed:dda09ef5-1fdb-4e0d-95ec-e763a0376dac for instance 75dd7c39-d3e0-4d4a-b781-64a569873457 on n-h1-848886-16 Jul 26 05:00:31.378703 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-637459c0-77ad-4acf-82d4-041b5f5ef28b req-196f8908-1c7b-40a2-afb8-e7a96e448c32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044197 Jul 26 05:00:31.381264 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3059/6051] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:32.135737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:32.137294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:32.154305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:32.155287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:32.156312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:32.157164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:32.373804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:32.385806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-016d41ca-9998-4401-89e6-cc4b90e3b66c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1515 microversion: 2.1 time: 0.254444 Jul 26 05:00:32.387257 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2993/6052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:32 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:33.410554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:33.411275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:33.426082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:33.426600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:33.427431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:33.427925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:33.768777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:33.786679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5df99f85-0903-493e-abc5-aadb97335c9d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1515 microversion: 2.1 time: 0.381369 Jul 26 05:00:33.798215 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3060/6053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:33 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1515 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:34.059937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3ca9be4d-b016-494d-97bd-73f449bceada req-873c5555-a8cc-44de-80b2-9853e3c41c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7a25db-aa04-48ab-94aa-bf445cbd598b", "name": "network-vif-plugged", "status": "completed", "tag": "e03be364-a185-458e-88bb-e63e2d41c3a8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:34.081575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3ca9be4d-b016-494d-97bd-73f449bceada req-873c5555-a8cc-44de-80b2-9853e3c41c7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:34.082385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3ca9be4d-b016-494d-97bd-73f449bceada req-873c5555-a8cc-44de-80b2-9853e3c41c7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:34.115389 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3ca9be4d-b016-494d-97bd-73f449bceada req-873c5555-a8cc-44de-80b2-9853e3c41c7f service nova] Creating event network-vif-plugged:e03be364-a185-458e-88bb-e63e2d41c3a8 for instance ad7a25db-aa04-48ab-94aa-bf445cbd598b on n-h2-848886-16 Jul 26 05:00:34.125686 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3ca9be4d-b016-494d-97bd-73f449bceada req-873c5555-a8cc-44de-80b2-9853e3c41c7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068855 Jul 26 05:00:34.131655 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2994/6054] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:00:34.811735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:34.813259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:34.826008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:34.827198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:34.828734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:34.829304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:35.143082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:35.159753 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0574d1ac-e79e-4872-9676-c5d9544c5ba1 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1515 microversion: 2.1 time: 0.354852 Jul 26 05:00:35.160350 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3061/6055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:34 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:36.182704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:36.183414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:36.201978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.201978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.203013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.203616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.583734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:36.595513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:36.599068 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5aa23c50-5b41-4ed6-a186-1e643520ecd9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.421974 Jul 26 05:00:36.616276 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2995/6056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:36 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:37.625743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:37.627067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:37.641992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:37.643290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:37.645801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:37.648062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:37.951739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:37.964703 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b5f650d3-e657-4941-aa92-81c4bea68b62 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.343296 Jul 26 05:00:37.965755 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3062/6057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:37 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:38.988415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:38.989647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:39.004091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.007022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.011308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.014331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.309737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:39.323660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb028d6b-9d79-44b3-aafc-19b960d5d231 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.339525 Jul 26 05:00:39.340466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2996/6058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:38 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:40.344919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:40.345548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:40.361521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.364209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.365198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.369686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.908982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:40.920978 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67f35db4-df7e-4885-bbcf-0f63d325ac38 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.579950 Jul 26 05:00:40.922268 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3063/6059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:40 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:41.425493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Calling method '.version_select at 0x7f38b49f0a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:41.426444 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:00:41.426444 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 05:00:41.427623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.428078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.456184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.464595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.484163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.485768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.495419 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e01d7ce2-b237-4735-b13a-4458a414c0cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642737763-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.409492 Jul 26 05:00:41.502248 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2997/6060] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 05:00:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:41.602042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:41.621160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:41.659878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.660376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.661207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.664835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.791900 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7fc1c63-f514-449d-88b1-15f2031d4af5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action" status: 200 len: 24579 microversion: 2.1 time: 0.195068 Jul 26 05:00:41.794068 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3064/6061] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:41 2022] POST /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43/action => generated 24579 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:00:41.977772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:41.979061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:41.987013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.987724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.988811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.989530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:42.283580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:42.293014 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81c6880a-4c2a-4dce-8577-141c393ca96e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.320519 Jul 26 05:00:42.293848 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2998/6062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:41 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:43.317274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:43.318002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:43.328825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:43.329557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:43.330389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:43.330852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:43.697752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:43.709497 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d2ab312-5f34-4d88-b1b0-572cd8a6c903 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.396621 Jul 26 05:00:43.711799 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3065/6063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:43 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:44.733788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:44.735724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:44.750248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.752150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.754786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.755426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.142968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:45.155011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2356bfc-4347-4e4e-8c50-045f5ffe0f7c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.423690 Jul 26 05:00:45.158356 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 2999/6064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:44 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:46.180162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:46.181461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:46.209633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.215304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.218019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.218553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.267095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:46.766430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.776102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f65de100-17ad-4798-a8bd-469e95117b34 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.603946 Jul 26 05:00:46.794637 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3066/6065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:46 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:47.801644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:47.802373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:47.813307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.814105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.816596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.819010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.158941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:48.167503 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cec93f12-980f-4f1c-841e-b9e1095c3f13 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.369855 Jul 26 05:00:48.168162 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3000/6066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:47 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:49.197587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:49.200614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:49.213595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=38 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:49.215841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.216953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.217792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.218278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.535765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:49.555144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-721c9ccb-4c8b-4a74-a2ab-d9214487d256 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.362781 Jul 26 05:00:49.562701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3067/6067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:49 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:50.596038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:50.601375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:50.643421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.645595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.648287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.650931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.950619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.959735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f21ce17-5d91-444b-8314-e95b1aa52490 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.382665 Jul 26 05:00:50.977033 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3001/6068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:50 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:51.989178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:51.990674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:52.010047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.015630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:52.017285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.021462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:52.407641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.417773 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ef07173-197a-4523-b0fe-2edf895df13c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.433292 Jul 26 05:00:52.419186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3068/6069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:51 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:53.447590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:53.450070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:53.455789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=36 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:53.463981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.465957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.467263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.467916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.704886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.715656 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-be2d2e5b-a6af-46ad-8714-84f717d0048d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1510 microversion: 2.1 time: 0.272948 Jul 26 05:00:53.718199 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3002/6070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:53 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:54.740929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:54.741793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:54.748983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.749727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.750753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.751384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.343841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.354883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-707751cc-c0d8-4d28-98a8-8e94548ae1a0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1507 microversion: 2.1 time: 0.617754 Jul 26 05:00:55.356099 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3069/6071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:54 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1507 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:56.379133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:56.380443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:56.390022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.390934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.392686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.393135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.657695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:56.677643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e9190fc-20fc-48c4-843e-b2fab20af32d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1507 microversion: 2.1 time: 0.302324 Jul 26 05:00:56.679397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3003/6072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:56 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:57.709599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:57.711546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:57.721031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.721685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:57.722858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.723488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.030016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.041912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27f9f40d-6a9d-4332-aac8-a4cf8cc48c47 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 200 len: 1450 microversion: 2.1 time: 0.335368 Jul 26 05:00:58.042853 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3070/6073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:57 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 1450 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:58.065785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.066435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.086001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.086482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.087891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.088522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.191261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e61008fc-4b67-4e53-ae98-0ae13271aeab req-0409ab31-575b-4e08-a774-764fcb54d7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7a25db-aa04-48ab-94aa-bf445cbd598b", "name": "network-vif-unplugged", "status": "completed", "tag": "e03be364-a185-458e-88bb-e63e2d41c3a8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:58.218998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e61008fc-4b67-4e53-ae98-0ae13271aeab req-0409ab31-575b-4e08-a774-764fcb54d7d8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.223379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e61008fc-4b67-4e53-ae98-0ae13271aeab req-0409ab31-575b-4e08-a774-764fcb54d7d8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.273061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.compute.server_external_events [req-e61008fc-4b67-4e53-ae98-0ae13271aeab req-0409ab31-575b-4e08-a774-764fcb54d7d8 service nova] Unable to find a host for instance ad7a25db-aa04-48ab-94aa-bf445cbd598b. Dropping event network-vif-unplugged {{(pid=119488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 05:00:58.276874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e61008fc-4b67-4e53-ae98-0ae13271aeab req-0409ab31-575b-4e08-a774-764fcb54d7d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089623 Jul 26 05:00:58.280266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3071/6074] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 05:00:58.425073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.436697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a089309-992c-47e1-bfb7-b10f41c475c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.374655 Jul 26 05:00:58.437657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3004/6075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:58.469348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.470088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.476641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.477113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.478131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.478633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.916246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.925609 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae4a2316-2194-4e56-9e38-e4556bd06e25 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.461331 Jul 26 05:00:58.927308 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3072/6076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:58.956452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.958376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.967729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.968905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.969820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.970308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.205403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.217422 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95b25ea6-ba68-478c-a7da-b71fb4fad70c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.269450 Jul 26 05:00:59.231884 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3005/6077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:59.247239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.247878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.261817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.262937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.264357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.266437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.711304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.727279 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b75024b-0415-4e48-8bcc-3303f8d1b4ba tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.484010 Jul 26 05:00:59.728429 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3073/6078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:59.751743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3a8c0b21-c438-44d5-abae-63c76b011dcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:59.760272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b21-c438-44d5-abae-63c76b011dcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.761337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b21-c438-44d5-abae-63c76b011dcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.793730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3a8c0b21-c438-44d5-abae-63c76b011dcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 05:00:59.877777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3a8c0b21-c438-44d5-abae-63c76b011dcb tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.130785 Jul 26 05:00:59.881833 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3006/6079] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:00:59 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:00:59.889831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.891662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.909589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.923003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.923935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.924349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.154671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.167024 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c0801d5e-de6c-4ce8-956a-cfcd2f0d82c2 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.283521 Jul 26 05:01:00.167615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3074/6080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:01.192840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:01.195969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:01.221371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.222076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.223241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.224473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.637408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.647676 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11ba0a87-1519-4d9b-8acc-3a8bc0b2f8c8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.461787 Jul 26 05:01:01.649382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3007/6081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:01 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:02.674375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:02.675883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:02.690118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.691662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.692793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.693483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.042120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.055141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e87dc645-82db-4ea1-8f3b-767ccb3ad30a tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.388860 Jul 26 05:01:03.056103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3075/6082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:02 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:04.078222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:04.079509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:04.088012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.089038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.090074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.090709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.316453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.325998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3f8c57b-942a-491c-ad5e-fd6ff3fb9f4b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.251629 Jul 26 05:01:04.327158 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3008/6083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:04 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:04.646562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:04.648152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:04.656436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.657343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.658567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.659309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.999175 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5a59203-63a3-4799-adac-561221f9ca11 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1835 microversion: 2.1 time: 0.356619 Jul 26 05:01:05.002182 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3076/6084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:04 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1835 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:05.352792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:05.353413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:05.364421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.365184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.366713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.368399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.779335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.791805 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f48269a2-b621-4624-9c02-e40b6376f204 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.444606 Jul 26 05:01:05.792959 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3009/6085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:05 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:06.652992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f68fd627-c287-41e2-a1b5-a224b509cc0c req-920abf4a-a5f8-43aa-be69-c07e4c151bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:06.656111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.663482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.672935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.676518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.679964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f68fd627-c287-41e2-a1b5-a224b509cc0c req-920abf4a-a5f8-43aa-be69-c07e4c151bc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.681083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.681724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.687935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f68fd627-c287-41e2-a1b5-a224b509cc0c req-920abf4a-a5f8-43aa-be69-c07e4c151bc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.713144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f68fd627-c287-41e2-a1b5-a224b509cc0c req-920abf4a-a5f8-43aa-be69-c07e4c151bc6 service nova] Creating event network-changed:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h2-848886-16 Jul 26 05:01:06.727796 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f68fd627-c287-41e2-a1b5-a224b509cc0c req-920abf4a-a5f8-43aa-be69-c07e4c151bc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078649 Jul 26 05:01:06.729028 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3010/6086] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:06.750670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:06.816496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.817840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.832292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.833503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.840507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.841838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.900674 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a7b82c3-234d-4573-aca0-9548b16f2adb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 204 len: 0 microversion: 2.1 time: 0.254902 Jul 26 05:01:06.901840 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3077/6087] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:06 2022] DELETE /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:06.913550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.914791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.924987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.925790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.927237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.928707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.179633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.188447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-05bc88e8-67ff-4c5c-9352-3f4e1ea7bd64 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.376759 Jul 26 05:01:07.192152 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3011/6088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:06 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:07.278581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.293782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-692f30fb-7858-4604-9c84-b74e439d18e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1688 microversion: 2.1 time: 0.387215 Jul 26 05:01:07.295706 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3078/6089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:06 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1688 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:08.218439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.219696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.246950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.247390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.251194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.253640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.278212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:08.321276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.323070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.339302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.339962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.342190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.342937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.536886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.547377 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-86adf99b-c59f-432f-bffc-a7ab7b04ef4f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.334361 Jul 26 05:01:08.547970 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3012/6090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:08.823122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.837055 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85a81950-ce7e-422e-b8f4-06d3c5db38e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 200 len: 1688 microversion: 2.1 time: 0.519655 Jul 26 05:01:08.838703 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3079/6091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 1688 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:09.219957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f01a5062-1b25-43e9-bbcf-a5e575953015 req-2b4d057a-6871-425f-8ff6-45d4a086967a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1262225-0111-4d12-8b08-31257dcbef43", "name": "network-vif-deleted", "tag": "4151093e-e1ae-490e-b041-1e8ff17d21ec"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:09.231403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f01a5062-1b25-43e9-bbcf-a5e575953015 req-2b4d057a-6871-425f-8ff6-45d4a086967a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.231832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f01a5062-1b25-43e9-bbcf-a5e575953015 req-2b4d057a-6871-425f-8ff6-45d4a086967a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.251505 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f01a5062-1b25-43e9-bbcf-a5e575953015 req-2b4d057a-6871-425f-8ff6-45d4a086967a service nova] Creating event network-vif-deleted:4151093e-e1ae-490e-b041-1e8ff17d21ec for instance b1262225-0111-4d12-8b08-31257dcbef43 on n-h2-848886-16 Jul 26 05:01:09.251505 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f01a5062-1b25-43e9-bbcf-a5e575953015 req-2b4d057a-6871-425f-8ff6-45d4a086967a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033924 Jul 26 05:01:09.251505 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3013/6092] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:09.582398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:09.583732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:09.607937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.608732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.610022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.610816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.861599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:09.862416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: b1262225-0111-4d12-8b08-31257dcbef43] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:09.873877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.874452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.875147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.875589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.897032 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] HTTP exception thrown: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Request method failure captured: Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 HTTP/1.1 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33RymeSjWnJQ555P7Axyt9qq2be7AliA7vnGSdm_9U1MboSxRCePG7Gjoub0klmO0Ye6K0eXxpbdagulI1QA0ws0aCcUZgieRg72PtIh5nD7YCStF6qHTSnJYJR9J5AgbMUIBpYAm_COhmZMERcqJ-gUpWSTKlsx64dn2fEEgjqKzpI Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: cc3616211d754718b64b2d011a5342b7 Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b1262225-0111-4d12-8b08-31257dcbef43'} Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:09.899152 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Returning 404 to user: Instance b1262225-0111-4d12-8b08-31257dcbef43 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:09.906918 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f39747d5-8b51-4fb2-aad0-2748aacc1aeb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43" status: 404 len: 111 microversion: 2.1 time: 0.047848 Jul 26 05:01:09.909325 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3014/6093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:09 2022] GET /compute/v2.1/servers/b1262225-0111-4d12-8b08-31257dcbef43 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:01:09.978974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:09.989064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67066f5e-f49f-4192-9290-0a1adf1e2a48 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1678 microversion: 2.1 time: 0.416360 Jul 26 05:01:09.991535 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3080/6094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:09 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1678 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:11.013085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:11.013700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:11.026741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.027208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.028019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.028502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.546127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:11.559436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e05b079-7f37-4820-aac0-915987f060b4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1655 microversion: 2.1 time: 0.547464 Jul 26 05:01:11.561569 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3015/6095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:11 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1655 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:11.582927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f28dfbae-8e68-487b-90b4-84fd2dc97b74 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:11.600168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f28dfbae-8e68-487b-90b4-84fd2dc97b74 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.601144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f28dfbae-8e68-487b-90b4-84fd2dc97b74 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.636254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f28dfbae-8e68-487b-90b4-84fd2dc97b74 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Going to try to start instance {{(pid=119488) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 05:01:11.642372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:11.723212 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f28dfbae-8e68-487b-90b4-84fd2dc97b74 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.144147 Jul 26 05:01:11.724085 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3081/6096] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:01:11 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:01:11.739313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:11.740167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:11.759049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.761942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.763160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.765777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.514639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:12.524066 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48a7b817-dc57-46ed-80d0-dc7e3aa83168 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1664 microversion: 2.1 time: 0.794916 Jul 26 05:01:12.538792 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3016/6097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:11 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1664 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:13.548599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:13.549370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:13.571352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.571928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.572861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.573370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.907558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:13.924004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cab1aa2-e92c-4e16-b966-315ad6cc85e7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1664 microversion: 2.1 time: 0.380728 Jul 26 05:01:13.924923 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3082/6098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:13 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1664 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:14.948493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:14.949261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:14.972946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:14.973744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:14.982141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:14.982952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:15.772870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:15.780695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffbc69b5-e20d-463c-b8e5-455f68916fc0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.838943 Jul 26 05:01:15.781288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3017/6099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:14 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:15.804911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:15.805908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:15.816003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:15.817945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:15.819412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:15.819873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:16.651961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:16.660201 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6001b21b-cd34-4df3-80b4-8f055f841186 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.859823 Jul 26 05:01:16.661475 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3083/6100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:15 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:16.683217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:16.684466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:16.692455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:16.693164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:16.694276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:16.694884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:16.965561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:16.979481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-21a0309d-1231-428f-8954-389af83a2849 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.297740 Jul 26 05:01:16.982460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3018/6101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:16 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:17.007041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:17.008939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:17.022943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de90f851-7ae2-4e97-9b30-4d3ce84a858c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '.version_select at 0x7f38b49f00d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:17.032094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.032987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:17.034022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.035264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:17.039208 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de90f851-7ae2-4e97-9b30-4d3ce84a858c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [143e6f2d-a594-44cd-b85f-3a2337b73336] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:01:17.777546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:17.786738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea0d6882-236a-4b82-a1ea-245315cb43cc tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.785749 Jul 26 05:01:17.788084 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3084/6102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:16 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:17.808374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:17.815880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:17.830650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.831124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:17.831926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.833613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.059159 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [None req-de90f851-7ae2-4e97-9b30-4d3ce84a858c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [143e6f2d-a594-44cd-b85f-3a2337b73336] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40248. Jul 26 05:01:18.089503 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de90f851-7ae2-4e97-9b30-4d3ce84a858c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-278334804" status: 202 len: 0 microversion: 2.1 time: 1.079215 Jul 26 05:01:18.092614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3019/6103] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 05:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-278334804 => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:01:18.124276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cdeba87c-0b0a-41dc-bdbe-e02e9b6b8528 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: .version_select at 0x7f38b60f3c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1019272676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjjy+johizudrTgagl+ELVGXZmB/VfMg1H1zMcIosR7mccxzxLmH1rwg4i4RhSqPk4lh9Qwrf98X8ng9SzVAn5iZeXBNq9/XQoW/cQS0WSinQG5wyqeRJ+2wLx2UGU6Tg=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:18.144732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-cdeba87c-0b0a-41dc-bdbe-e02e9b6b8528 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:01:18.164799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-cdeba87c-0b0a-41dc-bdbe-e02e9b6b8528 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:01:18.166646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:18.178108 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f5caf4b-faf9-490a-9519-e587243133d6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.370417 Jul 26 05:01:18.180782 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3085/6104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:17 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:18.202647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:18.203327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:18.215619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.216362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.217348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.218289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.237812 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cdeba87c-0b0a-41dc-bdbe-e02e9b6b8528 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.117728 Jul 26 05:01:18.245726 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3020/6105] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:01:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:18.250632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lazy-loading 'flavor' on Instance uuid b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:01:18.356308 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c3aa3cea-4d88-48dd-8c90-0fec48229fc5 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.157417 Jul 26 05:01:18.359378 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3086/6106] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:01:18 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:01:18.367907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:18.368714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:18.379620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.381959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.385070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.388251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.641324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:18.651717 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1e81663-1a98-42b2-95fe-015dd4c5c85d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1676 microversion: 2.1 time: 0.286666 Jul 26 05:01:18.656387 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3021/6107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:18 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:19.675847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:19.676584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:19.680689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:19.685307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.686123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:19.687177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.687860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:19.913405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:19.921914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08b655a9-957e-4c5d-9b3b-e348b5fba2f6 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1659 microversion: 2.1 time: 0.250979 Jul 26 05:01:19.923507 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3087/6108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:19 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1659 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:19.945246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:19.945867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:19.953928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.954432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:19.955237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.955789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:20.042013 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a188a1b0-4a4c-4663-ba26-9c4873456861 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action" status: 202 len: 0 microversion: 2.1 time: 0.102184 Jul 26 05:01:20.046755 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3022/6109] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:01:19 2022] POST /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:01:20.064596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:20.066777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:20.085573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:20.088257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:20.089365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:20.090082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:20.474494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:20.488339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2397ffc-0685-40e5-9b74-0e37dfa8a6b7 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1665 microversion: 2.1 time: 0.438164 Jul 26 05:01:20.492067 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3088/6110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:20 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1665 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:21.518623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:21.519613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:21.530335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:21.531005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:21.531977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:21.532724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:21.681538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:21.690456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c96afb78-d271-45e5-8ecf-01296cefbc32 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1665 microversion: 2.1 time: 0.177438 Jul 26 05:01:21.691189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3023/6111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:21 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:22.714127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:22.716606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:22.726223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:22.727527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:22.728525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:22.729184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:23.572721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:23.584167 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-026d61f5-70c4-4b55-9af7-d132a34d741d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.875220 Jul 26 05:01:23.585679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3089/6112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:22 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:23.608209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:23.610403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:23.622464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:23.636154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:23.637015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:23.638316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:23.639539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:24.025652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:24.038256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f1bea5d-7783-4ed6-b641-a5c4549c4ed4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1668 microversion: 2.1 time: 0.431990 Jul 26 05:01:24.053626 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3024/6113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:23 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1668 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:24.067187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:24.067768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:24.080309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:24.080782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:24.081582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:24.086907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:24.153502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:24.167311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Working on deleting snapshot 374fc24e-c516-418e-a2fa-8f6d6c804a73 from shelved instance... Jul 26 05:01:25.259887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Doing local delete in cell 3697a559-3b1c-45d0-8c70-03664cf0eccb(cell1) {{(pid=119488) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 05:01:25.267277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:25.269412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:25.269958 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 05:01:25.283588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] deallocate_for_instance() {{(pid=119488) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 05:01:27.609123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Updating instance_info_cache with network_info: [] {{(pid=119488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 05:01:27.633141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-80167bae-0832-4fa1-a00d-9803539e4e0f req-d286fd0d-1d8f-40f7-bc0a-369d7bdbaf64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7a25db-aa04-48ab-94aa-bf445cbd598b", "name": "network-vif-deleted", "tag": "e03be364-a185-458e-88bb-e63e2d41c3a8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:27.657946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-80167bae-0832-4fa1-a00d-9803539e4e0f req-d286fd0d-1d8f-40f7-bc0a-369d7bdbaf64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:27.658777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-80167bae-0832-4fa1-a00d-9803539e4e0f req-d286fd0d-1d8f-40f7-bc0a-369d7bdbaf64 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:27.701180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.server_external_events [req-80167bae-0832-4fa1-a00d-9803539e4e0f req-d286fd0d-1d8f-40f7-bc0a-369d7bdbaf64 service nova] Unable to find a host for instance ad7a25db-aa04-48ab-94aa-bf445cbd598b. Dropping event network-vif-deleted {{(pid=119487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 05:01:27.702129 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-80167bae-0832-4fa1-a00d-9803539e4e0f req-d286fd0d-1d8f-40f7-bc0a-369d7bdbaf64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.074767 Jul 26 05:01:27.706832 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3025/6114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 05:01:28.425633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=12,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:28.477074 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f03aae8e-3f06-4308-b598-a6dcebee9e5b tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 204 len: 0 microversion: 2.1 time: 4.414506 Jul 26 05:01:28.482253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3090/6115] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:24 2022] DELETE /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 0 bytes in 4417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:28.487555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:28.489079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: ad7a25db-aa04-48ab-94aa-bf445cbd598b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:28.493069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:28.500351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.501330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.502327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.503040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.519104 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b HTTP/1.1 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'ad7a25db-aa04-48ab-94aa-bf445cbd598b'} Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:28.522093 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. Jul 26 05:01:28.527436 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:28.530455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 404 to user: Instance ad7a25db-aa04-48ab-94aa-bf445cbd598b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:28.531732 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb4b0882-c057-4538-8f29-a01ecd8374ac tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b" status: 404 len: 111 microversion: 2.1 time: 0.048273 Jul 26 05:01:28.535862 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3026/6116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:28 2022] GET /compute/v2.1/servers/ad7a25db-aa04-48ab-94aa-bf445cbd598b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:28.545044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:28.545704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:28.555828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.557077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.558001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.559025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.590248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:28.721283 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f700ec0a-6a5b-41a3-8b3f-645da43177e8 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 204 len: 0 microversion: 2.1 time: 0.182918 Jul 26 05:01:28.723315 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3091/6117] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:28 2022] DELETE /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:28.731545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:28.732175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:28.739219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.740482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.741823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.742762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.895565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:28.904625 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ea27660-f714-4497-b0b5-6618419cd789 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1466 microversion: 2.1 time: 0.176924 Jul 26 05:01:28.923187 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3027/6118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:28 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1466 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:29.932882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:29.934289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:29.955574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:29.956811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:29.957811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:29.958718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:30.190772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:30.200289 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f7fe898-0c88-4f6c-8d86-32b07eee7359 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 200 len: 1466 microversion: 2.1 time: 0.274119 Jul 26 05:01:30.220596 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3092/6119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:29 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 1466 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:30.806951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1689185234", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "f67660de-326a-409e-86c2-8e44984ce649"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1019272676", "security_groups": [{"name": "tempest-secgroup-smoke-218397457"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:31.053846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] validate_networks() for [('f67660de-326a-409e-86c2-8e44984ce649', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:01:31.644189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1668208101", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "7451f80d-a106-465b-ba92-e055b287bf76"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:31.747506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] validate_networks() for [('7451f80d-a106-465b-ba92-e055b287bf76', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:01:32.720011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:01:32.720651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:01:32.721539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:01:32.725101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:01:32.727540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:01:32.748069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:32.751033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:32.752684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:32.753405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:32.783349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:01:32.792446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:01:32.819977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:01:32.825092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:01:32.965474 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b199f37-6426-4a13-9507-de6df1c4301d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.163397 Jul 26 05:01:32.966235 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3028/6120] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:01:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:01:32.980281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:32.981246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 8ca43ea8-240e-468c-90a9-53d9c4b2ccae] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:32.990225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:32.992189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:32.992189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:32.992189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.058203 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae HTTP/1.1 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '8ca43ea8-240e-468c-90a9-53d9c4b2ccae'} Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:33.062602 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 404 to user: Instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:33.068445 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b4f7781-e286-4a53-b0df-d7faad2a75bd tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae" status: 404 len: 111 microversion: 2.1 time: 0.099084 Jul 26 05:01:33.069158 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3029/6121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:32 2022] GET /compute/v2.1/servers/8ca43ea8-240e-468c-90a9-53d9c4b2ccae => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:33.081141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f655fab3-6b54-474b-a690-189e06422e87 req-e41c3b7f-978a-49fa-975d-deb3bfef5fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca43ea8-240e-468c-90a9-53d9c4b2ccae", "name": "network-vif-deleted", "tag": "dbbbeed5-24fb-421d-9a58-303c35da6388"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:33.092330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f655fab3-6b54-474b-a690-189e06422e87 req-e41c3b7f-978a-49fa-975d-deb3bfef5fa9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.093205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f655fab3-6b54-474b-a690-189e06422e87 req-e41c3b7f-978a-49fa-975d-deb3bfef5fa9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.109088 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f655fab3-6b54-474b-a690-189e06422e87 req-e41c3b7f-978a-49fa-975d-deb3bfef5fa9 service nova] Creating event network-vif-deleted:dbbbeed5-24fb-421d-9a58-303c35da6388 for instance 8ca43ea8-240e-468c-90a9-53d9c4b2ccae on n-h2-848886-16 Jul 26 05:01:33.118842 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f655fab3-6b54-474b-a690-189e06422e87 req-e41c3b7f-978a-49fa-975d-deb3bfef5fa9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045544 Jul 26 05:01:33.119734 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3030/6122] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:33.126199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a391966-b962-49d8-adc5-c7fc5a40ddcb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:33.127193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a391966-b962-49d8-adc5-c7fc5a40ddcb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:33.208517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a391966-b962-49d8-adc5-c7fc5a40ddcb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:33.215695 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a391966-b962-49d8-adc5-c7fc5a40ddcb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1267 microversion: 2.1 time: 0.094496 Jul 26 05:01:33.219377 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3031/6123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:33 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:33.227432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:33.228359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:33.240618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.241091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.241900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.242435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.293638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:33.459072 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-18f8c56c-b21c-44b8-b6c2-1c0cee358b5e tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 204 len: 0 microversion: 2.1 time: 0.237630 Jul 26 05:01:33.460467 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3032/6124] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:33 2022] DELETE /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:33.478528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:33.479876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:33.488138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.488655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.489517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.490287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.722428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:33.727209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:33.738378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd414f96-aa94-443d-a0d7-8d014a2e35cf tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1508 microversion: 2.1 time: 0.273496 Jul 26 05:01:33.740614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3033/6125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:33 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:33.914037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:01:33.914612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:01:33.914989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:01:33.915682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:01:33.916123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:01:33.927154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.927689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.928636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.929186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.961867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Getting quotas for project f3e7e5ff6eee446a8933daebab3c59e9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:01:33.972128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Getting quotas for user c6a935512175421b93fd4146dd5cc3bf and project f3e7e5ff6eee446a8933daebab3c59e9. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:01:33.997229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:01:33.999666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:01:34.063084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f3e6486b-8a62-4e3c-bd48-6cf5df4d22e9 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.935015 Jul 26 05:01:34.064259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3093/6126] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:01:34.076197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9e4befac-1e79-4e40-b56a-3f4d0f53359e tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:34.076825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9e4befac-1e79-4e40-b56a-3f4d0f53359e tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:34.189383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9e4befac-1e79-4e40-b56a-3f4d0f53359e tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:34.203444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9e4befac-1e79-4e40-b56a-3f4d0f53359e tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1214 microversion: 2.1 time: 0.127841 Jul 26 05:01:34.226048 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3034/6127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:34 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:34.251714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:34.252482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:34.290291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.292817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:34.295484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.296315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:34.445641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:34.468235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0ea9077-27de-4896-935f-cfbf13650131 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1319 microversion: 2.1 time: 0.231043 Jul 26 05:01:34.469724 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3094/6128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:34 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:34.760908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:34.763175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:34.795752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.796541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:34.798527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.800863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.226053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:35.227461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:35.235877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.236600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.237674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.238428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.259342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:35.276229 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-47427de7-6483-4567-ab73-f53d849c7b61 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 200 len: 1508 microversion: 2.1 time: 0.514135 Jul 26 05:01:35.277973 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3035/6129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:34 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 1508 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:35.362195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:35.380560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b3d64d1-7eed-4b7d-99f6-c44a22e12c30 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1210 microversion: 2.1 time: 0.151156 Jul 26 05:01:35.390320 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3095/6130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:35 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:35.462571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f0f610cd-ae48-4daa-9a93-a91d0ed7ce5b req-4d57bdee-57c6-43cc-8380-aa5df702db6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d76b4b-460e-4c54-ae75-2c53a69c4e62", "name": "network-vif-deleted", "tag": "86c90808-445b-4994-94b1-30a74bc426a7"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:35.475200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f0f610cd-ae48-4daa-9a93-a91d0ed7ce5b req-4d57bdee-57c6-43cc-8380-aa5df702db6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.475997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f0f610cd-ae48-4daa-9a93-a91d0ed7ce5b req-4d57bdee-57c6-43cc-8380-aa5df702db6d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.492028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:35.492845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:35.510176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.510588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.512711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.514928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.528722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f0f610cd-ae48-4daa-9a93-a91d0ed7ce5b req-4d57bdee-57c6-43cc-8380-aa5df702db6d service nova] Creating event network-vif-deleted:86c90808-445b-4994-94b1-30a74bc426a7 for instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 on n-h1-848886-16 Jul 26 05:01:35.540926 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f0f610cd-ae48-4daa-9a93-a91d0ed7ce5b req-4d57bdee-57c6-43cc-8380-aa5df702db6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083728 Jul 26 05:01:35.546283 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3036/6131] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:35.644287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:35.655648 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71189728-f0a8-4448-93fb-0429beb4f59f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1325 microversion: 2.1 time: 0.168821 Jul 26 05:01:35.658854 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3096/6132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:35 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:36.302540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.303243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 99d76b4b-460e-4c54-ae75-2c53a69c4e62] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.322080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.322967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.324256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.324926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.341294 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 HTTP/1.1 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '99d76b4b-460e-4c54-ae75-2c53a69c4e62'} Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:36.343362 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. Jul 26 05:01:36.349686 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:36.350807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 404 to user: Instance 99d76b4b-460e-4c54-ae75-2c53a69c4e62 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:36.351922 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d39cf6f-842a-44ae-b679-7a83c4fe6f1d tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62" status: 404 len: 111 microversion: 2.1 time: 0.055576 Jul 26 05:01:36.355859 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3037/6133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:36 2022] GET /compute/v2.1/servers/99d76b4b-460e-4c54-ae75-2c53a69c4e62 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:36.363598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.365049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.375424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.376129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.378574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.379222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.398674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.399442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.416150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.416611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.417399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.417844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.427720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:36.547058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:36.565018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7b3b0925-5187-4202-b9e9-3ad9bc63b8cf tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1272 microversion: 2.1 time: 0.170835 Jul 26 05:01:36.576322 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3038/6134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:36 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:36.580964 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b3013208-93aa-48bc-a8bf-14b9a2d69337 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 204 len: 0 microversion: 2.1 time: 0.223105 Jul 26 05:01:36.583895 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3097/6135] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:36 2022] DELETE /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:36.593756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.594567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.602406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.602905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.603797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.604735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.682029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.683033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.692499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.693137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.694344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.700903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:37.028202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:37.039219 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-986d4b73-a167-41c7-9223-2c69d482504c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1495 microversion: 2.1 time: 0.450210 Jul 26 05:01:37.041814 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3039/6136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:36 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1495 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:37.086933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:37.104505 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-536bf1d4-9e78-482b-a6b1-e6d29e5e18e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.427129 Jul 26 05:01:37.119501 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3098/6137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:36 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:37.588483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:37.589967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:37.597522 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:37.598327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:37.599764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:37.600210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:37.717212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:37.732666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3eea2c85-bed7-416d-b238-d08f4796c984 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1272 microversion: 2.1 time: 0.148278 Jul 26 05:01:37.739872 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3040/6138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:37 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:38.070630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:38.072132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:38.081230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.082030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.083731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.084438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.124998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:38.125615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:38.133518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.133981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.144768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.145413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.274443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:38.279165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f65d848-9495-47bd-9f21-5ddb5fb9a7a9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 200 len: 1453 microversion: 2.1 time: 0.215163 Jul 26 05:01:38.285040 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3099/6139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:38 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:38.427641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-19769b5c-bb85-4cb9-b891-2f3e0c5ae207 req-503048c9-395e-4b22-9cd6-5175c6d5148d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49de5b37-7837-4acd-9051-776e76d91e2c", "name": "network-vif-deleted", "tag": "c63b9656-1c39-457d-906e-e13a2e384220"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:38.449533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-19769b5c-bb85-4cb9-b891-2f3e0c5ae207 req-503048c9-395e-4b22-9cd6-5175c6d5148d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.452187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-19769b5c-bb85-4cb9-b891-2f3e0c5ae207 req-503048c9-395e-4b22-9cd6-5175c6d5148d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.482379 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-19769b5c-bb85-4cb9-b891-2f3e0c5ae207 req-503048c9-395e-4b22-9cd6-5175c6d5148d service nova] Creating event network-vif-deleted:c63b9656-1c39-457d-906e-e13a2e384220 for instance 49de5b37-7837-4acd-9051-776e76d91e2c on n-h1-848886-16 Jul 26 05:01:38.495246 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-19769b5c-bb85-4cb9-b891-2f3e0c5ae207 req-503048c9-395e-4b22-9cd6-5175c6d5148d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072771 Jul 26 05:01:38.497266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3100/6140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:38.643835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:38.671936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5749392-667a-48ad-bb19-efc98e5aaee1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.550668 Jul 26 05:01:38.675180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3041/6141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:38 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:38.756543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:38.758019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:38.767114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.767805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.769062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.769689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.937466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ded67f7a-e251-4603-9442-723764b8b9bc req-05f1a887-7502-4b8c-8b3f-e08532117a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:38.970111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ded67f7a-e251-4603-9442-723764b8b9bc req-05f1a887-7502-4b8c-8b3f-e08532117a06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:38.970602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ded67f7a-e251-4603-9442-723764b8b9bc req-05f1a887-7502-4b8c-8b3f-e08532117a06 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.003324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ded67f7a-e251-4603-9442-723764b8b9bc req-05f1a887-7502-4b8c-8b3f-e08532117a06 service nova] Creating event network-changed:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:01:39.010571 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ded67f7a-e251-4603-9442-723764b8b9bc req-05f1a887-7502-4b8c-8b3f-e08532117a06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077749 Jul 26 05:01:39.012281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3042/6142] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:39.149142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:39.157276 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d6bfe85-5699-4fa2-93ae-3b9318bd91d6 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.405841 Jul 26 05:01:39.158570 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3101/6143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:38 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:39.307897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:39.309025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: 49de5b37-7837-4acd-9051-776e76d91e2c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:39.330252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.333826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.335437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.337419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.360781 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c HTTP/1.1 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '49de5b37-7837-4acd-9051-776e76d91e2c'} Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:39.362825 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 404 to user: Instance 49de5b37-7837-4acd-9051-776e76d91e2c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:39.367722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d991559-8b0b-4d0d-831a-14c4d653ce56 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c" status: 404 len: 111 microversion: 2.1 time: 0.063319 Jul 26 05:01:39.368487 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3043/6144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:39 2022] GET /compute/v2.1/servers/49de5b37-7837-4acd-9051-776e76d91e2c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:39.374242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:39.375032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:39.382450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.394642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.395978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.396500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.433483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:39.493501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:UPDATE=10,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:39.547180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ff26258-9229-4fb3-9e7c-7f8e91132ef4 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 204 len: 0 microversion: 2.1 time: 0.172062 Jul 26 05:01:39.551960 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3102/6145] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:39 2022] DELETE /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:39.562439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:39.563491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:39.574706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.575619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.576638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.577231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.693847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:39.696110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:39.703589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.704806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.705947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.706607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.767830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:39.780297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19a28d01-d3a4-49d0-a202-71be3c4e064f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1674 microversion: 2.1 time: 0.224337 Jul 26 05:01:39.781004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3044/6146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:39 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:40.017994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:40.025854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e4f4bb8-a850-4f9a-99ee-3f141f1de99e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.336375 Jul 26 05:01:40.026475 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3103/6147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:39 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:40.180397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:40.181049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:40.188446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.188917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.189706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.190415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.356731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:40.365716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-424b1351-aea0-4a91-b52e-6532d4e1fded tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.190006 Jul 26 05:01:40.370631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3045/6148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:40 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:40.530139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f22b03e2-7052-40f9-8136-655fa4d77502 req-9cc23d71-a304-4480-aa91-1841c65d288c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47211c9-f384-44a8-bd27-033249456760", "tag": "474e8ad0-51c1-418e-a37f-0e8197dbd317"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:40.542674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f22b03e2-7052-40f9-8136-655fa4d77502 req-9cc23d71-a304-4480-aa91-1841c65d288c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.543142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f22b03e2-7052-40f9-8136-655fa4d77502 req-9cc23d71-a304-4480-aa91-1841c65d288c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.555788 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f22b03e2-7052-40f9-8136-655fa4d77502 req-9cc23d71-a304-4480-aa91-1841c65d288c service nova] Creating event network-changed:474e8ad0-51c1-418e-a37f-0e8197dbd317 for instance b47211c9-f384-44a8-bd27-033249456760 on n-h2-848886-16 Jul 26 05:01:40.560716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f22b03e2-7052-40f9-8136-655fa4d77502 req-9cc23d71-a304-4480-aa91-1841c65d288c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034298 Jul 26 05:01:40.561583 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3104/6149] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:40.801748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:40.802894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:40.809948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.810512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.811380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.811989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.965229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:40.973932 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6ee6d39c-458f-4837-8676-e0bcccb29388 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1674 microversion: 2.1 time: 0.176015 Jul 26 05:01:40.974831 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3046/6150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:40 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:41.048408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:41.049653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:41.056585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.057137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.057939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.058426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.262592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:41.272782 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d16e1111-bc1a-439d-bd53-37293128dcde tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.228268 Jul 26 05:01:41.288351 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3105/6151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:41 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:41.386549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:41.387328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:41.394404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.395536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.396607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.397154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.555160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:41.563783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-adbe655e-3e7e-4a61-a566-7c14e7431a0d tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.181425 Jul 26 05:01:41.566105 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3047/6152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:41 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:41.996938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:41.998233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:42.006377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.006825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.007897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.008341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.253204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:42.262824 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8918d32-0b88-49e3-9afe-c289731d7684 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1674 microversion: 2.1 time: 0.269625 Jul 26 05:01:42.263488 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3106/6153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:41 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1674 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:42.296262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:42.297485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:42.305546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.306015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.306828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.307278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.578014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:42.587859 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba1ff27e-9654-4fe2-8588-92d8c9f3a86b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.295447 Jul 26 05:01:42.601804 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3048/6154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:42 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.602054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.755313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:42.763468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-823f3e4d-32e5-4269-a29e-077c4d74e3ec tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.176981 Jul 26 05:01:42.764257 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3107/6155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:42 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:43.285291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.286571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.292177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:43.294241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.295031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.296068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.296508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.616283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.616965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.640641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.641107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.647920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.648425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.945556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:43.946109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:43.955420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca6006e5-47bb-4843-b79e-4a13fad114b0 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1674 microversion: 2.1 time: 0.675044 Jul 26 05:01:43.959931 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3049/6156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:43 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1674 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:43.982268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.982973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.984943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:43.990105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.990589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.991380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.991828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:44.099782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:44.108860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22272bfd-9511-4834-870e-f62b98c00bbb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.501298 Jul 26 05:01:44.109710 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3108/6157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:43 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:44.199158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:44.356719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:44.370120 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3cb1da78-2bb9-4aa1-b302-e4fdbe541629 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.408772 Jul 26 05:01:44.371082 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3050/6158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:43 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:44.679095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-76b80bf3-2572-4064-9bd8-d1832a37c6c4 req-40a9acb3-acd6-4f3b-be73-1340240dc577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86", "name": "network-vif-deleted", "tag": "2c3261b7-9fea-4c06-8b86-a16d5f6ec342"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:44.717103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-76b80bf3-2572-4064-9bd8-d1832a37c6c4 req-40a9acb3-acd6-4f3b-be73-1340240dc577 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:44.718699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-76b80bf3-2572-4064-9bd8-d1832a37c6c4 req-40a9acb3-acd6-4f3b-be73-1340240dc577 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:44.794742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-76b80bf3-2572-4064-9bd8-d1832a37c6c4 req-40a9acb3-acd6-4f3b-be73-1340240dc577 service nova] Creating event network-vif-deleted:2c3261b7-9fea-4c06-8b86-a16d5f6ec342 for instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 on n-h2-848886-16 Jul 26 05:01:44.808882 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-76b80bf3-2572-4064-9bd8-d1832a37c6c4 req-40a9acb3-acd6-4f3b-be73-1340240dc577 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135826 Jul 26 05:01:44.811864 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3109/6159] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:44.984995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:44.985671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:44.995761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:44.997031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:44.999150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.000433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.053138 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.053792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.054581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lazy-loading 'fault' on Instance uuid b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:01:45.112905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:45.122146 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5a88418-aa9d-45a0-b06f-46cf0823156c tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1328 microversion: 2.1 time: 0.145502 Jul 26 05:01:45.124049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3051/6160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:44 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1328 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:45.132678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:45.134094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:45.143622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.144457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.145488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.146236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.355622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:45.363869 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99e86e75-5e39-430e-b867-d265811b106d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.236036 Jul 26 05:01:45.365266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3110/6161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:45 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:45.392305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:45.393583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:45.401764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.402647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.403622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.404234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.630918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:45.639595 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a3ce3ca-4f11-43b9-af24-2fb403bc4e69 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.251293 Jul 26 05:01:45.642199 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3052/6162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:45 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:46.149023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:46.150667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:46.171829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.175220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.176368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.176934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.257327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.259276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.259945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lazy-loading 'fault' on Instance uuid b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:01:46.315080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:46.329747 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36b30e28-9346-46fc-be63-a07968ca7251 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1328 microversion: 2.1 time: 0.185453 Jul 26 05:01:46.332979 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3111/6163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:46 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:46.386246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:46.387007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:46.400535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.401193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.403427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.405334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.436431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7084bddb-0cfa-4f3e-97d0-45a88bc5e8b0 req-2ebbdc15-4649-4cf9-801f-6a9ffc04b64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-plugged", "status": "completed", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:46.450689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7084bddb-0cfa-4f3e-97d0-45a88bc5e8b0 req-2ebbdc15-4649-4cf9-801f-6a9ffc04b64f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.451572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7084bddb-0cfa-4f3e-97d0-45a88bc5e8b0 req-2ebbdc15-4649-4cf9-801f-6a9ffc04b64f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.468178 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7084bddb-0cfa-4f3e-97d0-45a88bc5e8b0 req-2ebbdc15-4649-4cf9-801f-6a9ffc04b64f service nova] Creating event network-vif-plugged:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:01:46.476574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7084bddb-0cfa-4f3e-97d0-45a88bc5e8b0 req-2ebbdc15-4649-4cf9-801f-6a9ffc04b64f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043926 Jul 26 05:01:46.477195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3112/6164] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:46.623626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:46.630558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:46.637131 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf91c84d-fe6e-4441-bb94-1170d0c8f6bb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.255240 Jul 26 05:01:46.657119 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3053/6165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:46 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:46.661069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:46.662504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:46.669060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.669664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.671127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.671694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.819766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:46.828465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a72eb061-bbd5-4719-a9b8-b873e72d211a tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.171803 Jul 26 05:01:46.829135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3113/6166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:46 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:47.356356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:47.357403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:47.374105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.375575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.377239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.378348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.419355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.420643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.421360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lazy-loading 'fault' on Instance uuid b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:01:47.503928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7736f1deb34149a4e223da1c710a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8821a95bd54577a5c9ee6b5c216754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:47.519370 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0ef0deec-5e7e-446f-a0b3-2615959007c9 tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 200 len: 1328 microversion: 2.1 time: 0.171885 Jul 26 05:01:47.520570 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3054/6167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:47 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:47.659691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:47.660873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:47.672564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.673441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.674563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.675015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.856608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:47.857700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:47.867407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.868111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.870173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.870653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.896228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:47.906979 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f7288ac-b0c2-4a81-82a9-9f667d024d46 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1392 microversion: 2.1 time: 0.251359 Jul 26 05:01:47.915064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3114/6168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:47 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:48.057174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:48.071321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae07bb39-4f92-4a05-a157-0497a043d2cc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.219808 Jul 26 05:01:48.072135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3055/6169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:47 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:48.095729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-725374418", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "dd721698-80b9-43c2-84b3-0b98cb1ba102"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:48.158717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] validate_networks() for [('dd721698-80b9-43c2-84b3-0b98cb1ba102', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:01:48.538572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:01:48.539265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:01:48.539934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:01:48.540684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:01:48.542249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:01:48.543786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.544695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] [instance: b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:48.546224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:48.555126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.555817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.556740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.557412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.559597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.560282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.561291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.562232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.577829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] HTTP exception thrown: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Request method failure captured: Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 HTTP/1.1 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LECJ2JkQShwAN-oHfUHZ29PBoSZSzZFgIlKHlXFC24M7gJML6EV2RPBbU9d2ROYxhQ_RUarxZ1sYkamEUvftJgoTlhoMuyotXmbYoSPaj6iL_1-M4mwt2mu3LEiNhZBOa_A89XbvEyI6pdViVdR6qiDxqjFDB1FsHDbP2rRuYzrjg Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4f8821a95bd54577a5c9ee6b5c216754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4f8821a95bd54577a5c9ee6b5c216754 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-871031094 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4e7736f1deb34149a4e223da1c710a62 Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-871031094-project Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86'} Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:48.580606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. Jul 26 05:01:48.587220 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:01:48.588869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Getting quotas for project b96378e2ab49496ba3f52e5d1f5c11c7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:01:48.589481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Returning 404 to user: Instance b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:48.595660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6bb2f5ba-88c7-4223-826f-9bc421760cff tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86" status: 404 len: 111 microversion: 2.1 time: 0.058626 Jul 26 05:01:48.596073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Getting quotas for user 9a8ba4fd944e4f279ba1727e4ec8cd6a and project b96378e2ab49496ba3f52e5d1f5c11c7. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:01:48.597419 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3056/6170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:48 2022] GET /compute/v2.1/servers/b68e0983-fe1d-4cdb-bc4e-f4d2cb9ffd86 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:48.605344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-deb8d46a-8f64-4d19-bbc6-a0a004288f5f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] Calling method '.version_select at 0x7f38b5b75c10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.629336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:01:48.633614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:01:48.634496 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-deb8d46a-8f64-4d19-bbc6-a0a004288f5f tempest-ServerActionsTestJSON-871031094 tempest-ServerActionsTestJSON-871031094-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725916150" status: 202 len: 0 microversion: 2.1 time: 0.032667 Jul 26 05:01:48.635561 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3057/6171] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 05:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725916150 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:01:48.701848 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e91a6fd-f629-4b23-88eb-7e0548e4eda8 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609925 Jul 26 05:01:48.703028 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3115/6172] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:01:48.716271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-736c1433-1e14-48c4-85d4-64b18a434a6f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.717117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-736c1433-1e14-48c4-85d4-64b18a434a6f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:48.719438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:48.869750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-736c1433-1e14-48c4-85d4-64b18a434a6f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:48.879570 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-736c1433-1e14-48c4-85d4-64b18a434a6f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1213 microversion: 2.1 time: 0.168585 Jul 26 05:01:48.881001 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3058/6173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:48 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:48.930055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.930805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:48.946630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.947615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.948508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.953532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.096005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:49.096850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:49.104520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.105241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.106233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.106867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.251521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:49.261813 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-287a6589-230d-42f5-b805-9bb8174e4fd5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1563 microversion: 2.1 time: 0.336270 Jul 26 05:01:49.261992 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3116/6174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:48 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1563 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:49.282760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:49.283909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:49.291557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.292046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.293000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.293651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.418300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:49.430938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-51490d3a-7504-4551-b71f-9bb4f2910803 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.338718 Jul 26 05:01:49.431568 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3059/6175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:49 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:49.520426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:49.528526 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41aabc77-48f4-48be-b47d-9a46a61d4d5e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1563 microversion: 2.1 time: 0.249768 Jul 26 05:01:49.535882 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3117/6176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:49 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:49.902275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:49.904016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:49.915586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.916644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.917866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.919494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.117983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-58aadd96-5b8d-4a95-803c-72748dab4da7 req-9103b3f0-d88a-411d-980a-99a0c7304f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47211c9-f384-44a8-bd27-033249456760", "name": "network-vif-plugged", "status": "completed", "tag": "474e8ad0-51c1-418e-a37f-0e8197dbd317"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:50.140135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-58aadd96-5b8d-4a95-803c-72748dab4da7 req-9103b3f0-d88a-411d-980a-99a0c7304f3c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.141099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-58aadd96-5b8d-4a95-803c-72748dab4da7 req-9103b3f0-d88a-411d-980a-99a0c7304f3c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.148191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:50.155660 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-58aadd96-5b8d-4a95-803c-72748dab4da7 req-9103b3f0-d88a-411d-980a-99a0c7304f3c service nova] Creating event network-vif-plugged:474e8ad0-51c1-418e-a37f-0e8197dbd317 for instance b47211c9-f384-44a8-bd27-033249456760 on n-h2-848886-16 Jul 26 05:01:50.157896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eff0f086-235c-4436-9069-9d31f57fd4ba tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1273 microversion: 2.1 time: 0.260154 Jul 26 05:01:50.162699 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-58aadd96-5b8d-4a95-803c-72748dab4da7 req-9103b3f0-d88a-411d-980a-99a0c7304f3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050479 Jul 26 05:01:50.164197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3118/6177] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:50.175465 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3060/6178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:49 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:50.453716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:50.454444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:50.461349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.462073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.463187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.463843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.840811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:50.850697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e02fb6f-65c1-49ec-a53c-c11d20ba9136 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1314 microversion: 2.1 time: 0.402637 Jul 26 05:01:50.852040 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3119/6179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:50 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:51.186196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:51.186809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:51.194606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.195056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.196041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.196482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.323439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:51.331773 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78b39e6e-2f0d-4ee7-aa34-25f41abd5909 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1271 microversion: 2.1 time: 0.149318 Jul 26 05:01:51.332799 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3061/6180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:51 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:51.873613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:51.874971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:51.898882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.902115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.903030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.905403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.265100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:52.275515 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2dd7c514-edc0-40c2-9eb0-38d57817ded2 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1497 microversion: 2.1 time: 0.406020 Jul 26 05:01:52.276114 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3120/6181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:51 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:52.352396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:52.352987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:52.360266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.361035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.362021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.362668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.079288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:53.089821 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3eb2dd1f-5ac5-4c9a-b17b-363e8ab31e78 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.741392 Jul 26 05:01:53.093725 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3062/6182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:52 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:53.560187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:53.564093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:53.575665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d42a1490-05cb-49d6-9ea5-29e577df72fb req-8df300bc-3566-441d-ac6d-cbc28a0ed6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:53.599649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.603079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.606090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.609724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.615599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d42a1490-05cb-49d6-9ea5-29e577df72fb req-8df300bc-3566-441d-ac6d-cbc28a0ed6c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.616439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d42a1490-05cb-49d6-9ea5-29e577df72fb req-8df300bc-3566-441d-ac6d-cbc28a0ed6c8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.653924 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d42a1490-05cb-49d6-9ea5-29e577df72fb req-8df300bc-3566-441d-ac6d-cbc28a0ed6c8 service nova] Creating event network-changed:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:01:53.674281 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d42a1490-05cb-49d6-9ea5-29e577df72fb req-8df300bc-3566-441d-ac6d-cbc28a0ed6c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103876 Jul 26 05:01:53.675073 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3063/6183] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:53.895691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cad419cc-3fe8-4ed1-8c8b-e29b4055879c req-01e3d13e-d31a-4c68-a05e-6ed79e950378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c5f4e5-20e1-4adc-aecf-acd39fd55097", "tag": "0858a4ca-a5f3-49ed-baae-756941f95a69"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:53.918764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cad419cc-3fe8-4ed1-8c8b-e29b4055879c req-01e3d13e-d31a-4c68-a05e-6ed79e950378 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.921894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cad419cc-3fe8-4ed1-8c8b-e29b4055879c req-01e3d13e-d31a-4c68-a05e-6ed79e950378 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.944777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cad419cc-3fe8-4ed1-8c8b-e29b4055879c req-01e3d13e-d31a-4c68-a05e-6ed79e950378 service nova] Creating event network-changed:0858a4ca-a5f3-49ed-baae-756941f95a69 for instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 on n-h1-848886-16 Jul 26 05:01:53.963618 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cad419cc-3fe8-4ed1-8c8b-e29b4055879c req-01e3d13e-d31a-4c68-a05e-6ed79e950378 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072814 Jul 26 05:01:53.964607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3064/6184] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:54.114116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:54.115120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:54.121757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.122437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.124734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.125198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.355838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:54.358249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:54.370743 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4d789822-db71-455a-8499-6c300736b96f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1563 microversion: 2.1 time: 0.814599 Jul 26 05:01:54.374904 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a157bbd1-a93a-466a-829e-157cc7b4cdf3 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.265686 Jul 26 05:01:54.376547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3065/6185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:54 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:54.390178 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3121/6186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:53 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1563 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:55.401472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:55.402249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:55.410063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:55.410915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:55.411999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:55.412668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:55.707089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:55.719582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c187a08-c0dd-4c4e-a565-516d687af634 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.322023 Jul 26 05:01:55.720177 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3066/6187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:55 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:56.028969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:56.030222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:56.040742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.042060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.043140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.043809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.049091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:56.395990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:56.508089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c97beebe-91d6-4f6f-9fd7-2e0a6210d683 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 204 len: 0 microversion: 2.1 time: 0.482209 Jul 26 05:01:56.508728 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3122/6188] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:56 2022] DELETE /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:56.518398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:56.519764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:56.527041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.527610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.528458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.529131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.743134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:56.744514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:56.760201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.763006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.764870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.765392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.799753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:56.811194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ef1995f-5c7e-4138-925d-98d905577c2b tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1503 microversion: 2.1 time: 0.297779 Jul 26 05:01:56.812172 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3067/6189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:56 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:57.126041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:57.138718 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-074aa53d-cf04-4d13-a7f0-1400c33b2acb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.401227 Jul 26 05:01:57.141931 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3123/6190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:56 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:57.836199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:57.836949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:57.844259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:57.844717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:57.845491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:57.846141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:57.994559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:58.003155 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1503 microversion: 2.1 time: 0.173339 Jul 26 05:01:58.004860 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3068/6191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:57 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:58.165555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:58.166195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:58.174216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:58.175000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:58.177083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:58.177995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:58.392251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:58.405327 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-39594002-09e7-42b8-b090-000f4bebe872 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.243412 Jul 26 05:01:58.419677 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3124/6192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:58 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:58.586501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:58.587480 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89ae4094-88f5-45a5-b689-65b66c6abbbc tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001352 Jul 26 05:01:58.588021 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3069/6193] 10.222.0.43 () {56 vars in 886 bytes} [Tue Jul 26 05:01:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 05:01:59.026617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:59.027598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:59.031788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:59.033842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:59.045323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.046310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.047402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.048186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.086527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a595dbcf-8bbd-4d32-aed6-0350d265c8d8 req-67895622-4232-443a-acb0-b78e71e1861f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47211c9-f384-44a8-bd27-033249456760", "name": "network-vif-deleted", "tag": "474e8ad0-51c1-418e-a37f-0e8197dbd317"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:59.131979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:59.149824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a595dbcf-8bbd-4d32-aed6-0350d265c8d8 req-67895622-4232-443a-acb0-b78e71e1861f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.150345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a595dbcf-8bbd-4d32-aed6-0350d265c8d8 req-67895622-4232-443a-acb0-b78e71e1861f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.174035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a935512175421b93fd4146dd5cc3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e5ff6eee446a8933daebab3c59e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:59.184668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a595dbcf-8bbd-4d32-aed6-0350d265c8d8 req-67895622-4232-443a-acb0-b78e71e1861f service nova] Creating event network-vif-deleted:474e8ad0-51c1-418e-a37f-0e8197dbd317 for instance b47211c9-f384-44a8-bd27-033249456760 on n-h2-848886-16 Jul 26 05:01:59.187320 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ccab2cc-634d-4d31-be9e-54f835ae8a38 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 200 len: 1461 microversion: 2.1 time: 0.166110 Jul 26 05:01:59.198097 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3125/6194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:59 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 1461 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:59.204582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a595dbcf-8bbd-4d32-aed6-0350d265c8d8 req-67895622-4232-443a-acb0-b78e71e1861f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124739 Jul 26 05:01:59.211691 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3070/6195] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:59.428097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:59.429091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:59.435616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.436346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.437208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.437729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.709096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:59.746230 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25cd6d7d-bdff-44cf-9a08-2a356f18b1e0 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.319310 Jul 26 05:01:59.746837 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3126/6196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:59 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:00.218097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:00.219249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] [instance: b47211c9-f384-44a8-bd27-033249456760] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:00.232950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:00.233620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.234618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:00.235224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.250788 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] HTTP exception thrown: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Request method failure captured: Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 HTTP/1.1 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33UmCB9YaydZJtVmtnYLgME2NTxgn7ymg6WFDuVwA4i2SM-dLpm_YKMxB9Ueu9KRA6ek_uPj_486L46AbjchArNFxPZZz1IMh3lSYURBtDAyofi0Lnj6Gx4XyNE1JFsC8zecQuJQP-UbknIV0WGyoMB__KOSV1Divw1uj-MtIVPtb30 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f3e7e5ff6eee446a8933daebab3c59e9 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesActionsTest-1544810749 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f3e7e5ff6eee446a8933daebab3c59e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f3e7e5ff6eee446a8933daebab3c59e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f3e7e5ff6eee446a8933daebab3c59e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f3e7e5ff6eee446a8933daebab3c59e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesActionsTest-1544810749 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f3e7e5ff6eee446a8933daebab3c59e9 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesActionsTest-1544810749 Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesActionsTest-1544810749-project Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: c6a935512175421b93fd4146dd5cc3bf Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesActionsTest-1544810749-project Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b47211c9-f384-44a8-bd27-033249456760'} Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:00.252462 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. Jul 26 05:02:00.257696 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:00.262968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] Returning 404 to user: Instance b47211c9-f384-44a8-bd27-033249456760 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:00.264296 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-902d186f-b2a8-42a0-b040-fc65e853f612 tempest-VolumesActionsTest-1544810749 tempest-VolumesActionsTest-1544810749-project] 10.222.0.43 "GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760" status: 404 len: 111 microversion: 2.1 time: 0.054251 Jul 26 05:02:00.269550 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3071/6197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:00 2022] GET /compute/v2.1/servers/b47211c9-f384-44a8-bd27-033249456760 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:00.742181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-6e0272f4-7dd0-4a7b-a895-20fb6f18b745 req-e10690fb-cebb-437f-8803-a3ff579764ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c5f4e5-20e1-4adc-aecf-acd39fd55097", "name": "network-vif-plugged", "status": "completed", "tag": "0858a4ca-a5f3-49ed-baae-756941f95a69"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:00.765655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6e0272f4-7dd0-4a7b-a895-20fb6f18b745 req-e10690fb-cebb-437f-8803-a3ff579764ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:00.766107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-6e0272f4-7dd0-4a7b-a895-20fb6f18b745 req-e10690fb-cebb-437f-8803-a3ff579764ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.808420 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-6e0272f4-7dd0-4a7b-a895-20fb6f18b745 req-e10690fb-cebb-437f-8803-a3ff579764ea service nova] Creating event network-vif-plugged:0858a4ca-a5f3-49ed-baae-756941f95a69 for instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 on n-h1-848886-16 Jul 26 05:02:00.822356 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-6e0272f4-7dd0-4a7b-a895-20fb6f18b745 req-e10690fb-cebb-437f-8803-a3ff579764ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083595 Jul 26 05:02:00.824237 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3072/6198] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:00.834143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:00.834891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:00.849699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:00.850259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.851047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:00.851490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.916872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3d386255-1aaf-4d1e-9c02-80dbc54d411a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Action: 'create', calling method: .version_select at 0x7f38b441ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-956169356"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:01.183853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:01.191991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-231a4e72-8400-40e5-bf38-4f337ca4fa33 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1313 microversion: 2.1 time: 0.366307 Jul 26 05:02:01.192571 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3073/6199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:00 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:01.533155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3d386255-1aaf-4d1e-9c02-80dbc54d411a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.907684 Jul 26 05:02:01.542014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3127/6200] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 26 05:02:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 917 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 05:02:01.546956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d097e52-0f65-41f8-8535-cac0a57bf04d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b5a1ec10>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:01.612804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d097e52-0f65-41f8-8535-cac0a57bf04d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 200 len: 344 microversion: 2.1 time: 0.069721 Jul 26 05:02:01.618278 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3074/6201] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:01 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:02.214367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:02.219268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:02.235339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:02.235898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:02.236727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:02.237186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:02.481017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:02.489683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfa6b646-8d45-4bf1-a4b9-22030e13034b tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1496 microversion: 2.1 time: 0.279978 Jul 26 05:02:02.490630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3128/6202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:02 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1496 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:02.627824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-112d13be-a45d-4043-9221-01216bdba2e0 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b5fdd5e0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:02.689853 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-112d13be-a45d-4043-9221-01216bdba2e0 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 200 len: 345 microversion: 2.1 time: 0.066650 Jul 26 05:02:02.690520 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3075/6203] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:02 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:02.703203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f93fbad6-3409-4c49-b83e-7fddddf965c7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Action: 'create', calling method: .version_select at 0x7f38b4487d30>, body: {"snapshot": {"volume_id": "7db4475c-c9be-42ff-8d7c-cbdae6b83849", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1095755583"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:02.939364 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f93fbad6-3409-4c49-b83e-7fddddf965c7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.239957 Jul 26 05:02:02.940164 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3129/6204] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Jul 26 05:02:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:02.955624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed3ca131-de12-4cd9-8fe2-df1df0f88258 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b48e1670>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.025809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.026272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:03.034304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.035027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.036800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.037533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.057409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed3ca131-de12-4cd9-8fe2-df1df0f88258 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 287 microversion: 2.1 time: 0.109844 Jul 26 05:02:03.057987 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3076/6205] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:02 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:03.069611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f8f278f-8c0b-4fbb-9a95-30f9ae2536e5 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b48e18b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.109217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:02:03.119430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f8f278f-8c0b-4fbb-9a95-30f9ae2536e5 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054001 Jul 26 05:02:03.120111 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3077/6206] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Jul 26 05:02:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:03.131847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9322b34a-f0dc-4f8a-8e24-b95b650efa35 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b53ef1f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.215293 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9322b34a-f0dc-4f8a-8e24-b95b650efa35 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 287 microversion: 2.1 time: 0.088164 Jul 26 05:02:03.215951 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3078/6207] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:03 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:03.308206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e805df30-8c7e-40e5-964c-8d02a40dccc9 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 204 len: 0 microversion: 2.1 time: 0.287958 Jul 26 05:02:03.309514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3130/6208] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:02:03 2022] DELETE /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:02:03.323501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.324381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:03.332770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.333514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.335293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.336878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.566620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:03.575622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7b11349-604d-466d-99b0-693ac201da0d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1502 microversion: 2.1 time: 0.260412 Jul 26 05:02:03.589599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3079/6209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:03 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:04.229571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a6b306bf-8c0c-4951-b5d1-3c7d566806e6 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38babc0940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:04.274378 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a6b306bf-8c0c-4951-b5d1-3c7d566806e6 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 287 microversion: 2.1 time: 0.049336 Jul 26 05:02:04.280044 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3131/6210] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:04 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:04.607298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:04.608712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:04.689656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:04.690450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:04.691856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:04.695193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:05.106706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:05.119878 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5aa4ce69-ed6b-42dd-bac3-6673ce85f4d1 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 200 len: 1502 microversion: 2.1 time: 0.525602 Jul 26 05:02:05.121734 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3080/6211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:04 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 1502 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:05.290279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54db6aaa-0c2b-4b4e-b963-c5c73b4ff0d7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b44a1280>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:05.330977 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54db6aaa-0c2b-4b4e-b963-c5c73b4ff0d7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 288 microversion: 2.1 time: 0.047270 Jul 26 05:02:05.339339 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3132/6212] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:05 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 288 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:05.344176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d93376e4-6d03-46be-ba55-7dc3906235ac tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b5a1e940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:05.447428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d93376e4-6d03-46be-ba55-7dc3906235ac tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 202 len: 0 microversion: 2.1 time: 0.108305 Jul 26 05:02:05.450954 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3081/6213] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Jul 26 05:02:05 2022] DELETE /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:02:05.459233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-525304ed-4373-4a9b-a788-ccabd723d786 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b44a15e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:05.530113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-525304ed-4373-4a9b-a788-ccabd723d786 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 287 microversion: 2.1 time: 0.077060 Jul 26 05:02:05.531380 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3133/6214] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:05 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:05.538440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-91332d52-5df2-46ce-953c-4c3201b94b5f req-4c4bda4d-f178-4f07-a0d2-ef0cfb7972de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c5f4e5-20e1-4adc-aecf-acd39fd55097", "name": "network-vif-deleted", "tag": "0858a4ca-a5f3-49ed-baae-756941f95a69"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:05.553926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-91332d52-5df2-46ce-953c-4c3201b94b5f req-4c4bda4d-f178-4f07-a0d2-ef0cfb7972de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:05.553926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-91332d52-5df2-46ce-953c-4c3201b94b5f req-4c4bda4d-f178-4f07-a0d2-ef0cfb7972de service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:05.584079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-91332d52-5df2-46ce-953c-4c3201b94b5f req-4c4bda4d-f178-4f07-a0d2-ef0cfb7972de service nova] Creating event network-vif-deleted:0858a4ca-a5f3-49ed-baae-756941f95a69 for instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 on n-h1-848886-16 Jul 26 05:02:05.600365 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-91332d52-5df2-46ce-953c-4c3201b94b5f req-4c4bda4d-f178-4f07-a0d2-ef0cfb7972de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075378 Jul 26 05:02:05.600978 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3082/6215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:06.147507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:06.148291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: f7c5f4e5-20e1-4adc-aecf-acd39fd55097] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:06.155427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:06.156142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:06.157115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:06.157855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:06.174920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] HTTP exception thrown: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Request method failure captured: Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 HTTP/1.1 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33U6pD9pBRS5xNFAn8ZWJETTea0p5zp26tyQ6Q5eG-Ebwc8jvPK4kQQU_K1w1EDHy9pxAYn1pxo_9uVzf-Ynwb4Sb0emmuP1bbMlq_gPHuzNWNF0m32LuaJCnWIM6Rc299-su-blFnM1Rb0f2pfEPqt0O2Vi1EQg0v0UP06iKSrrwDo Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b96378e2ab49496ba3f52e5d1f5c11c7 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesActionsTest-164343081 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesActionsTest-164343081 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b96378e2ab49496ba3f52e5d1f5c11c7 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesActionsTest-164343081 Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesActionsTest-164343081-project Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 9a8ba4fd944e4f279ba1727e4ec8cd6a Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesActionsTest-164343081-project Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'f7c5f4e5-20e1-4adc-aecf-acd39fd55097'} Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:06.177610 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. Jul 26 05:02:06.182456 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:06.184282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Returning 404 to user: Instance f7c5f4e5-20e1-4adc-aecf-acd39fd55097 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:06.185275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0540d8d-ac7b-43f1-abcc-f297983c32da tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097" status: 404 len: 111 microversion: 2.1 time: 0.046303 Jul 26 05:02:06.185915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3134/6216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:06 2022] GET /compute/v2.1/servers/f7c5f4e5-20e1-4adc-aecf-acd39fd55097 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:06.320622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-849051648", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "dd721698-80b9-43c2-84b3-0b98cb1ba102"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:06.383718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] validate_networks() for [('dd721698-80b9-43c2-84b3-0b98cb1ba102', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:02:06.544936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-420fbd48-88df-45eb-83b4-bbcceb620680 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b44a10d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:06.589033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-420fbd48-88df-45eb-83b4-bbcceb620680 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 200 len: 287 microversion: 2.1 time: 0.048451 Jul 26 05:02:06.594429 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3135/6217] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:06 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:07.026095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:02:07.027017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:02:07.027697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:02:07.028984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:02:07.030590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:02:07.075391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:07.086893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:07.088074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:07.089350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:07.143053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Getting quotas for project b96378e2ab49496ba3f52e5d1f5c11c7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:02:07.151150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Getting quotas for user 9a8ba4fd944e4f279ba1727e4ec8cd6a and project b96378e2ab49496ba3f52e5d1f5c11c7. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:02:07.167483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:02:07.171516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:02:07.243139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b9c10d30-fdc0-4124-9cf6-fd9de2870766 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926816 Jul 26 05:02:07.258502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-80af2417-1494-42c0-9b00-d629ecdaa345 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:07.259968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-80af2417-1494-42c0-9b00-d629ecdaa345 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:07.267223 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3083/6218] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:02:07.408540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-80af2417-1494-42c0-9b00-d629ecdaa345 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:07.417944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-80af2417-1494-42c0-9b00-d629ecdaa345 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1213 microversion: 2.1 time: 0.165684 Jul 26 05:02:07.419632 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3136/6219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:07 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:07.603102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1a07c38-c2f1-4d75-aef1-5ea76c57466a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b4902430>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:07.653950 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-c1a07c38-c2f1-4d75-aef1-5ea76c57466a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] HTTP exception thrown: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1a07c38-c2f1-4d75-aef1-5ea76c57466a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Request method failure captured: Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 HTTP/1.1 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33VI0wKNc-Q_Zy4O4Jq0ERMMZ_ACzMhG3gUpjza6RcVyDBfEHzpgHIsRsrshhabgtZe9V2wvXkUtEsD_TvZX55FRO3oCX1iI3tHlagZ3S1eHzB73imnFYeHAKmB0De9atRKziuJzGM1PvBXWJlJ3P-vB4FiMA5cUkFo_alNxwpebvTU Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 33c8b9ac566f41b091459d3c189fbfb6 Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: exception: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '49108eaf-63ed-4079-808e-eb9fa7390559'} Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. (HTTP 404) (Request-ID: req-2847d8ac-9d11-4164-b874-815bbdaf0969) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:07.673482 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. Jul 26 05:02:07.678930 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:07.687589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1a07c38-c2f1-4d75-aef1-5ea76c57466a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Returning 404 to user: Snapshot 49108eaf-63ed-4079-808e-eb9fa7390559 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:07.688744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1a07c38-c2f1-4d75-aef1-5ea76c57466a tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559" status: 404 len: 111 microversion: 2.1 time: 0.090211 Jul 26 05:02:07.689578 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3084/6220] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:02:07 2022] GET /compute/v2.1/os-snapshots/49108eaf-63ed-4079-808e-eb9fa7390559 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:02:07.698935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7027a462-cb98-4e38-a8c9-60ad02e28bee tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b44a13a0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:07.804070 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7027a462-cb98-4e38-a8c9-60ad02e28bee tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 202 len: 0 microversion: 2.1 time: 0.108919 Jul 26 05:02:07.805410 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3137/6221] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 05:02:07 2022] DELETE /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:02:07.818826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6b443ff-b90c-4dea-8cc6-eb90a2f001e7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b49020d0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:07.915958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6b443ff-b90c-4dea-8cc6-eb90a2f001e7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 200 len: 344 microversion: 2.1 time: 0.106096 Jul 26 05:02:07.917547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3085/6222] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:07 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:08.443185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:08.443832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:08.452556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:08.454693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:08.455524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:08.456528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:08.550051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:08.558484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64a470e7-d0c4-49b8-9d32-c4682cd7fa0f tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1265 microversion: 2.1 time: 0.121403 Jul 26 05:02:08.570258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3138/6223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:08 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:08.931470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-04b60558-3f4c-40ed-9b79-23eb7e29d4c7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b5245790>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:08.998719 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-04b60558-3f4c-40ed-9b79-23eb7e29d4c7 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 200 len: 344 microversion: 2.1 time: 0.071878 Jul 26 05:02:08.999281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3086/6224] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:08 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:09.581368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:09.581992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:09.594828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:09.595652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:09.597316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:09.598206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:09.839925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:09.851030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c01e89e3-e26b-4db6-8f93-98d1580d782d tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.273947 Jul 26 05:02:09.851878 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3139/6225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:09 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:10.016738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-383f8819-53de-4230-aa2d-163d0fbe81f8 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b4902940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:10.116360 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-383f8819-53de-4230-aa2d-163d0fbe81f8 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 200 len: 344 microversion: 2.1 time: 0.104207 Jul 26 05:02:10.123053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3087/6226] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:10 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:10.553351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6e981b6c-4929-4186-9a87-563ee631a05e req-3f7b7e3f-0760-4bac-a0d8-709b889e5768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0178ecac-286f-4368-9674-2eb7fb968e8c", "tag": "2d5cc196-a8e9-459f-987d-3de1184bd440"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:10.574133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6e981b6c-4929-4186-9a87-563ee631a05e req-3f7b7e3f-0760-4bac-a0d8-709b889e5768 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:10.576415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6e981b6c-4929-4186-9a87-563ee631a05e req-3f7b7e3f-0760-4bac-a0d8-709b889e5768 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:10.606976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6e981b6c-4929-4186-9a87-563ee631a05e req-3f7b7e3f-0760-4bac-a0d8-709b889e5768 service nova] Creating event network-changed:2d5cc196-a8e9-459f-987d-3de1184bd440 for instance 0178ecac-286f-4368-9674-2eb7fb968e8c on n-h1-848886-16 Jul 26 05:02:10.623409 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6e981b6c-4929-4186-9a87-563ee631a05e req-3f7b7e3f-0760-4bac-a0d8-709b889e5768 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075822 Jul 26 05:02:10.624759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3140/6227] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:10.872662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:10.873406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:10.883492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:10.884885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:10.887477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:10.887996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:10.923406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:11.132525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:11.133348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dad6d38e-df30-4bb1-bb44-642fd4eebbb3 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b48e4b80>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:11.152614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c012313d-5fc3-4ea2-b8be-dad933730bfc tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.283580 Jul 26 05:02:11.153213 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3088/6228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:10 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:11.180434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-dad6d38e-df30-4bb1-bb44-642fd4eebbb3 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] HTTP exception thrown: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dad6d38e-df30-4bb1-bb44-642fd4eebbb3 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Request method failure captured: Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 HTTP/1.1 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33VI0wKNc-Q_Zy4O4Jq0ERMMZ_ACzMhG3gUpjza6RcVyDBfEHzpgHIsRsrshhabgtZe9V2wvXkUtEsD_TvZX55FRO3oCX1iI3tHlagZ3S1eHzB73imnFYeHAKmB0De9atRKziuJzGM1PvBXWJlJ3P-vB4FiMA5cUkFo_alNxwpebvTU Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 33c8b9ac566f41b091459d3c189fbfb6 Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7db4475c-c9be-42ff-8d7c-cbdae6b83849'} Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. (HTTP 404) (Request-ID: req-b8f415cd-eb3b-482b-afa2-e6f7e271dd2b) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:11.182631 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dad6d38e-df30-4bb1-bb44-642fd4eebbb3 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Returning 404 to user: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dad6d38e-df30-4bb1-bb44-642fd4eebbb3 tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 404 len: 109 microversion: 2.1 time: 0.056898 Jul 26 05:02:11.187620 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3141/6229] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:11 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:02:11.196495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4efaa38e-7c0b-466d-854d-439a9c721d9d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b4902940>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:11.231026 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4efaa38e-7c0b-466d-854d-439a9c721d9d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] HTTP exception thrown: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4efaa38e-7c0b-466d-854d-439a9c721d9d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Request method failure captured: Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 HTTP/1.1 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33VI0wKNc-Q_Zy4O4Jq0ERMMZ_ACzMhG3gUpjza6RcVyDBfEHzpgHIsRsrshhabgtZe9V2wvXkUtEsD_TvZX55FRO3oCX1iI3tHlagZ3S1eHzB73imnFYeHAKmB0De9atRKziuJzGM1PvBXWJlJ3P-vB4FiMA5cUkFo_alNxwpebvTU Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 33c8b9ac566f41b091459d3c189fbfb6 Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: exception: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7db4475c-c9be-42ff-8d7c-cbdae6b83849'} Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. (HTTP 404) (Request-ID: req-720f4f55-2672-45d6-8ced-09c1d1a24ffa) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:11.233171 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.238935 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.244586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4efaa38e-7c0b-466d-854d-439a9c721d9d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Returning 404 to user: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:11.244586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4efaa38e-7c0b-466d-854d-439a9c721d9d tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 404 len: 109 microversion: 2.1 time: 0.051868 Jul 26 05:02:11.244586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3089/6230] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 05:02:11 2022] DELETE /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:11.252627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81d41302-39d1-471b-8ac7-b35bf8564ece tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Calling method '.version_select at 0x7f38b493bf70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:11.281526 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-81d41302-39d1-471b-8ac7-b35bf8564ece tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] HTTP exception thrown: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81d41302-39d1-471b-8ac7-b35bf8564ece tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Request method failure captured: Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 HTTP/1.1 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33VI0wKNc-Q_Zy4O4Jq0ERMMZ_ACzMhG3gUpjza6RcVyDBfEHzpgHIsRsrshhabgtZe9V2wvXkUtEsD_TvZX55FRO3oCX1iI3tHlagZ3S1eHzB73imnFYeHAKmB0De9atRKziuJzGM1PvBXWJlJ3P-vB4FiMA5cUkFo_alNxwpebvTU Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_875f5cce7fd34efa88f2ecbabe66f327"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 875f5cce7fd34efa88f2ecbabe66f327 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041856377 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 33c8b9ac566f41b091459d3c189fbfb6 Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041856377-project Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7db4475c-c9be-42ff-8d7c-cbdae6b83849'} Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. (HTTP 404) (Request-ID: req-d30ee462-989f-4fc4-b877-afbba6722b9b) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:11.283989 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81d41302-39d1-471b-8ac7-b35bf8564ece tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] Returning 404 to user: Volume 7db4475c-c9be-42ff-8d7c-cbdae6b83849 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:11.288643 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81d41302-39d1-471b-8ac7-b35bf8564ece tempest-VolumesSnapshotsTestJSON-1041856377 tempest-VolumesSnapshotsTestJSON-1041856377-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849" status: 404 len: 109 microversion: 2.1 time: 0.037083 Jul 26 05:02:11.295306 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3142/6231] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:11 2022] GET /compute/v2.1/os-volumes/7db4475c-c9be-42ff-8d7c-cbdae6b83849 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:12.177434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:12.178029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:12.191224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.196530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.198285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.200887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.523434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:12.556083 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3fb11214-30d4-4345-96cf-a86d60b18b7c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.386734 Jul 26 05:02:12.560154 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3090/6232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:12 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:13.581698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:13.582571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:13.591653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:13.592063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:13.592907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:13.593848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:13.820566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:13.832097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-908ea669-b5b6-49de-83bb-be6a565800e6 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.255477 Jul 26 05:02:13.834094 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3143/6233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:13 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:14.073777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f85f5e0-aaf8-4e84-902a-110ed12c4892 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Action: 'create', calling method: .version_select at 0x7f38b4981790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-85616910", "metadata": {"Type": "work"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f85f5e0-aaf8-4e84-902a-110ed12c4892 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 120 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-85616910", "metadata": {"Type": "work"}}} Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-85616910', 'metadata': {'Type': 'work'}}}} Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 05:02:14.077958 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f85f5e0-aaf8-4e84-902a-110ed12c4892 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f85f5e0-aaf8-4e84-902a-110ed12c4892 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168197 Jul 26 05:02:14.085281 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3091/6234] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Jul 26 05:02:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:02:14.092226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50a92492-9975-482f-828b-67187ceb58cf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Action: 'create', calling method: .version_select at 0x7f38b48e48b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633612399", "metadata": {"Type": "work"}}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50a92492-9975-482f-828b-67187ceb58cf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 120 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633612399", "metadata": {"Type": "work"}}} Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1633612399', 'metadata': {'Type': 'work'}}}} Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi '0' Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 05:02:14.096948 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50a92492-9975-482f-828b-67187ceb58cf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50a92492-9975-482f-828b-67187ceb58cf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011711 Jul 26 05:02:14.102994 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3144/6235] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Jul 26 05:02:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:02:14.111093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c967159b-4e85-4347-acfb-55a5aeabb1e1 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Action: 'create', calling method: .version_select at 0x7f38b490b430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-894637301", "metadata": {"Type": "work"}}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c967159b-4e85-4347-acfb-55a5aeabb1e1 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 118 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-894637301", "metadata": {"Type": "work"}}} Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-894637301', 'metadata': {'Type': 'work'}}}} Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise error Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi '' Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 05:02:14.116690 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c967159b-4e85-4347-acfb-55a5aeabb1e1 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c967159b-4e85-4347-acfb-55a5aeabb1e1 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011278 Jul 26 05:02:14.122241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3092/6236] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Jul 26 05:02:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:02:14.132811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01d9d5e8-e2fe-4895-9b64-b31460bf3b19 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Calling method '.version_select at 0x7f38b4992d30>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:14.163603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-01d9d5e8-e2fe-4895-9b64-b31460bf3b19 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] HTTP exception thrown: Volume tempest-invalid-1327239164 could not be found. Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01d9d5e8-e2fe-4895-9b64-b31460bf3b19 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1327239164 HTTP/1.1 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume tempest-invalid-1327239164 could not be found. Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'tempest-invalid-1327239164'} Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1327239164 could not be found. (HTTP 404) (Request-ID: req-a6e109a7-5847-40c3-ae9f-708ef49fd85c) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.166561 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1327239164 could not be found. Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1327239164 could not be found. Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1327239164 could not be found. Jul 26 05:02:14.171943 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.177528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01d9d5e8-e2fe-4895-9b64-b31460bf3b19 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 404 to user: Volume tempest-invalid-1327239164 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.178551 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01d9d5e8-e2fe-4895-9b64-b31460bf3b19 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1327239164" status: 404 len: 99 microversion: 2.1 time: 0.051110 Jul 26 05:02:14.179338 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3145/6237] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 05:02:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1327239164 => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 05:02:14.188540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d867cc1a-f51f-4429-93d7-f5514b94d712 tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004042 Jul 26 05:02:14.189539 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3093/6238] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Jul 26 05:02:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 05:02:14.199501 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3aeb3a9b-47a9-4ccb-8c33-cb2a89dab25e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004168 Jul 26 05:02:14.200250 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3146/6239] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Jul 26 05:02:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 05:02:14.210061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0142fef-716c-414f-86cf-aff5e145602e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Calling method '.version_select at 0x7f38b4902700>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:14.240289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d0142fef-716c-414f-86cf-aff5e145602e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] HTTP exception thrown: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0142fef-716c-414f-86cf-aff5e145602e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/os-volumes/c7e495e0-3b50-4651-974f-3a971b663b82 HTTP/1.1 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: method: Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: exception: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c7e495e0-3b50-4651-974f-3a971b663b82'} Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. (HTTP 404) (Request-ID: req-0e5859a3-64f0-4140-8a5c-4bc452c3fbbd) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:14.242422 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d0142fef-716c-414f-86cf-aff5e145602e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 404 to user: Volume c7e495e0-3b50-4651-974f-3a971b663b82 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.247940 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d0142fef-716c-414f-86cf-aff5e145602e tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/c7e495e0-3b50-4651-974f-3a971b663b82" status: 404 len: 109 microversion: 2.1 time: 0.038093 Jul 26 05:02:14.252623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3094/6240] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Jul 26 05:02:14 2022] DELETE /compute/v2.1/os-volumes/c7e495e0-3b50-4651-974f-3a971b663b82 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:14.256513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36683dce-7b82-4ff5-a41d-9ce3ed7cabcf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Calling method '.version_select at 0x7f38bad5a820>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:14.288409 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-36683dce-7b82-4ff5-a41d-9ce3ed7cabcf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] HTTP exception thrown: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36683dce-7b82-4ff5-a41d-9ce3ed7cabcf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Request method failure captured: Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/os-volumes/16d228c8-e7ba-4672-862c-2261097d31fa HTTP/1.1 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33VV4ZPsHx70ct1Y7nwccuolKcsI5PdpLw4TMRBlpZd0LDZJ5kKKi21K3C4epsikDhbi0dJJ3sCjaeMMLc7_f4c8boyhoYvmBF8ct47hVrA99bSjRa8u73RCQ6nFdr17Jp7BaJe36p56NPzBm_XeSk-Uw4CLBeWCDGl5L5ILcrT6u5E Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/396a774a2bd24b2da20470ff200854e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_396a774a2bd24b2da20470ff200854e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 396a774a2bd24b2da20470ff200854e2 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesNegativeTest-109133797 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 1be76371c93f4100af92efc2569730b6 Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesNegativeTest-109133797-project Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: method: Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: exception: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '16d228c8-e7ba-4672-862c-2261097d31fa'} Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. (HTTP 404) (Request-ID: req-1e645d5d-c64f-4b4b-9dde-e1ce630612f9) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:02:14.290468 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. Jul 26 05:02:14.295678 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:02:14.299273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36683dce-7b82-4ff5-a41d-9ce3ed7cabcf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] Returning 404 to user: Volume 16d228c8-e7ba-4672-862c-2261097d31fa could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:14.300496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36683dce-7b82-4ff5-a41d-9ce3ed7cabcf tempest-VolumesNegativeTest-109133797 tempest-VolumesNegativeTest-109133797-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/16d228c8-e7ba-4672-862c-2261097d31fa" status: 404 len: 109 microversion: 2.1 time: 0.048302 Jul 26 05:02:14.302797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3147/6241] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Jul 26 05:02:14 2022] GET /compute/v2.1/os-volumes/16d228c8-e7ba-4672-862c-2261097d31fa => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:14.748027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-61846e8f-8f50-4632-a702-15faed540cec req-0d4bb19f-0521-4427-9538-6990b8bc611b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0178ecac-286f-4368-9674-2eb7fb968e8c", "name": "network-vif-plugged", "status": "completed", "tag": "2d5cc196-a8e9-459f-987d-3de1184bd440"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:14.762750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61846e8f-8f50-4632-a702-15faed540cec req-0d4bb19f-0521-4427-9538-6990b8bc611b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:14.763258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61846e8f-8f50-4632-a702-15faed540cec req-0d4bb19f-0521-4427-9538-6990b8bc611b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:14.776142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-61846e8f-8f50-4632-a702-15faed540cec req-0d4bb19f-0521-4427-9538-6990b8bc611b service nova] Creating event network-vif-plugged:2d5cc196-a8e9-459f-987d-3de1184bd440 for instance 0178ecac-286f-4368-9674-2eb7fb968e8c on n-h1-848886-16 Jul 26 05:02:14.781912 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-61846e8f-8f50-4632-a702-15faed540cec req-0d4bb19f-0521-4427-9538-6990b8bc611b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038327 Jul 26 05:02:14.782850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3095/6242] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:14.855339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:14.856848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:14.868266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:14.869110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:14.870232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:14.870899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:15.128597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:15.140138 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be565ab6-de48-4f6c-8b24-88b1f5d7f348 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.288720 Jul 26 05:02:15.142199 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3148/6243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:14 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:16.163898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:16.164793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:16.181041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:16.181725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:16.182946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:16.183598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:16.371789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:16.384641 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-47ba7a61-127b-42b2-b040-e281b517341c tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1313 microversion: 2.1 time: 0.227123 Jul 26 05:02:16.385884 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3096/6244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:16 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:17.408965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:17.418946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:17.422300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:17.435849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:17.437470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:17.439291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:17.440785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:17.637534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:17.647827 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e3df165-aa28-4b73-b499-16aea561bcfb tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1497 microversion: 2.1 time: 0.244878 Jul 26 05:02:17.664525 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3149/6245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:17 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:18.458496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:18.459005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:18.475629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:18.476985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:18.479270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.479818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.480654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.481067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.570301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:02:18.704085 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0fb42578-695b-4bc8-8194-4e52e09bb4cf tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 204 len: 0 microversion: 2.1 time: 0.249444 Jul 26 05:02:18.705003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3097/6246] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:02:18 2022] DELETE /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:02:18.714966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:18.715826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:18.729356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:18.733458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.733941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.740379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.740867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.963221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:18.965908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:18.975684 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-238fbd2b-792c-4234-bec1-35e3ee61b026 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1503 microversion: 2.1 time: 0.265114 Jul 26 05:02:18.976871 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3150/6247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:18 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:20.001384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:20.003315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:20.006720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:20.012511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.012977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.014035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.014523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.229754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8ba4fd944e4f279ba1727e4ec8cd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96378e2ab49496ba3f52e5d1f5c11c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:20.245678 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea7251d9-3d69-4c16-b122-cafc408339a5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 200 len: 1503 microversion: 2.1 time: 0.248286 Jul 26 05:02:20.247201 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3098/6248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:19 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:20.729017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4fa6d106-aa22-4fcd-b254-814918d480ad req-9f264029-d095-4215-b22f-21e53de7a32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0178ecac-286f-4368-9674-2eb7fb968e8c", "name": "network-vif-deleted", "tag": "2d5cc196-a8e9-459f-987d-3de1184bd440"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:20.745191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4fa6d106-aa22-4fcd-b254-814918d480ad req-9f264029-d095-4215-b22f-21e53de7a32c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.745929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4fa6d106-aa22-4fcd-b254-814918d480ad req-9f264029-d095-4215-b22f-21e53de7a32c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.766033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4fa6d106-aa22-4fcd-b254-814918d480ad req-9f264029-d095-4215-b22f-21e53de7a32c service nova] Creating event network-vif-deleted:2d5cc196-a8e9-459f-987d-3de1184bd440 for instance 0178ecac-286f-4368-9674-2eb7fb968e8c on n-h1-848886-16 Jul 26 05:02:20.771779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4fa6d106-aa22-4fcd-b254-814918d480ad req-9f264029-d095-4215-b22f-21e53de7a32c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050361 Jul 26 05:02:20.772717 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3151/6249] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:21.270218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:21.271041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] [instance: 0178ecac-286f-4368-9674-2eb7fb968e8c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:21.277816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.278993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.279950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.280589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.299144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] HTTP exception thrown: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Request method failure captured: Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c HTTP/1.1 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33U6pD9pBRS5xNFAn8ZWJETTea0p5zp26tyQ6Q5eG-Ebwc8jvPK4kQQU_K1w1EDHy9pxAYn1pxo_9uVzf-Ynwb4Sb0emmuP1bbMlq_gPHuzNWNF0m32LuaJCnWIM6Rc299-su-blFnM1Rb0f2pfEPqt0O2Vi1EQg0v0UP06iKSrrwDo Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: b96378e2ab49496ba3f52e5d1f5c11c7 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesActionsTest-164343081 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b96378e2ab49496ba3f52e5d1f5c11c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesActionsTest-164343081 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: b96378e2ab49496ba3f52e5d1f5c11c7 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesActionsTest-164343081 Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesActionsTest-164343081-project Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 9a8ba4fd944e4f279ba1727e4ec8cd6a Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesActionsTest-164343081-project Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '0178ecac-286f-4368-9674-2eb7fb968e8c'} Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:21.300940 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] Returning 404 to user: Instance 0178ecac-286f-4368-9674-2eb7fb968e8c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f82cfc70-0e32-49b8-a532-2f766a91a5e5 tempest-VolumesActionsTest-164343081 tempest-VolumesActionsTest-164343081-project] 10.222.0.43 "GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c" status: 404 len: 111 microversion: 2.1 time: 0.037056 Jul 26 05:02:21.308729 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3099/6250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:21 2022] GET /compute/v2.1/servers/0178ecac-286f-4368-9674-2eb7fb968e8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:25.840512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:25.844138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:25.856321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.857160 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.858592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.859362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.958673 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b38347a6-93ad-4adb-979d-115ef4d2f9c6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action" status: 200 len: 24565 microversion: 2.1 time: 0.122234 Jul 26 05:02:25.967034 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3152/6251] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:25 2022] POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action => generated 24565 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:02:28.853828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:28.855091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:28.863319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:28.864765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:28.865872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:28.866580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:28.935190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:02:29.240371 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b7a057ae-90ba-481f-a7a6-f548935b776f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 204 len: 0 microversion: 2.1 time: 0.779778 Jul 26 05:02:29.241496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3100/6252] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:02:28 2022] DELETE /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:02:29.254854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:29.255575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:29.273484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.274043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.275053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.275677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.471301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.480780 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a6ac604-ce1a-4d3e-92c4-7e35a06dd5ba tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1578 microversion: 2.1 time: 0.234602 Jul 26 05:02:29.493131 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3153/6253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:29 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:30.514131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:30.518644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:30.541147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.541648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.542428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.542883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.982932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:31.000385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-450dd17b-df97-49ff-a880-b1494fd69130 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1578 microversion: 2.1 time: 0.498906 Jul 26 05:02:31.002629 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3101/6254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:30 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1578 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:32.025818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:32.027930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:32.040038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.042243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.043505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.044205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:33.088092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:33.102270 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-868d9a8c-48c5-42ae-b139-00e98739c5d5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1578 microversion: 2.1 time: 1.081002 Jul 26 05:02:33.118627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3154/6255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:32 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1578 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:34.130914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:34.132865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:34.161420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.162818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.169736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.170770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.540313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.554938 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e6b18838-aba5-42cd-a5f3-bf0529008f57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1511 microversion: 2.1 time: 0.428452 Jul 26 05:02:34.564302 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3102/6256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:34 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:35.033081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c78a6ca9-db24-4da4-9494-ba5ff71ab38e req-c0fb9d79-852b-4cd4-97c6-0a675c65f14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd7c39-d3e0-4d4a-b781-64a569873457", "name": "network-vif-deleted", "tag": "dda09ef5-1fdb-4e0d-95ec-e763a0376dac"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:35.055155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c78a6ca9-db24-4da4-9494-ba5ff71ab38e req-c0fb9d79-852b-4cd4-97c6-0a675c65f14d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.056367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c78a6ca9-db24-4da4-9494-ba5ff71ab38e req-c0fb9d79-852b-4cd4-97c6-0a675c65f14d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.088981 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c78a6ca9-db24-4da4-9494-ba5ff71ab38e req-c0fb9d79-852b-4cd4-97c6-0a675c65f14d service nova] Creating event network-vif-deleted:dda09ef5-1fdb-4e0d-95ec-e763a0376dac for instance 75dd7c39-d3e0-4d4a-b781-64a569873457 on n-h1-848886-16 Jul 26 05:02:35.101012 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c78a6ca9-db24-4da4-9494-ba5ff71ab38e req-c0fb9d79-852b-4cd4-97c6-0a675c65f14d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094530 Jul 26 05:02:35.101823 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3155/6257] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 05:02:35.598202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:35.601603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:35.624541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.626267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.631378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.634858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.969563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.979008 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1292aa2b-11c0-4b98-97f7-d1b5c5141925 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.405746 Jul 26 05:02:35.984174 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3103/6258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:35 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:37.010899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:37.012567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:37.043707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.044552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:37.045515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.046732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:37.230234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:37.241382 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b7fbd1f-c488-4ca2-977a-b7070af98797 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.240000 Jul 26 05:02:37.249492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3156/6259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:36 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:38.271089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:38.273279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:38.287142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:38.290931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:38.292171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:38.294746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:38.402536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.412609 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e3cd4c5-cfd2-41a2-9959-34a4e28a7316 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.147222 Jul 26 05:02:38.439055 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3104/6260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:38 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:39.446816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:39.448080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:39.462517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.465312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.466812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.467523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.633073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.647304 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-389362ee-690f-4af3-9d73-b94102e39f11 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.205373 Jul 26 05:02:39.651587 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3157/6261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:39 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:40.679642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:40.680355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:40.696351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.698838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.699902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.703337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.957647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.961043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:40.980058 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-287faf47-61f1-4573-b12c-8e1d481ae8cb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.306612 Jul 26 05:02:40.982269 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3105/6262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:40 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:42.003690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:42.004955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:42.023595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:42.024453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:42.025457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:42.026098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:42.166833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.182222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4f87e94-c37c-4654-965e-179f6a027e7d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.184650 Jul 26 05:02:42.193297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3158/6263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:41 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:43.208272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:43.208779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:43.232706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.233914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.238184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.238783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.441362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.453566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2ddb4298-76a4-4f72-a9e2-04452e4dd50a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.250699 Jul 26 05:02:43.457944 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3106/6264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:43 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:44.477130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:44.478338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:44.496683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.499653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.502104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.503563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.723410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.742742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a63b27d-63bb-444c-8cec-bc1c517f7a2c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 200 len: 1226 microversion: 2.1 time: 0.269419 Jul 26 05:02:44.744395 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3159/6265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:44 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 1226 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:45.773435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:45.774556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:45.793190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.796355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.798528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.799693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.852460 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 HTTP/1.1 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '75dd7c39-d3e0-4d4a-b781-64a569873457'} Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:45.857403 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:02:45.865562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:45.867485 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0cb4e444-5229-4157-a575-7d74fab6a7fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 404 len: 111 microversion: 2.1 time: 0.099617 Jul 26 05:02:45.868415 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3107/6266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:45 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:02:46.178261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1298401713", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035241856", "security_groups": [{"name": "tempest-secgroup-smoke-825398454"}], "block_device_mapping_v2": [{"uuid": "af3c4c8e-92e5-4507-bbf5-970459e95d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:46.486453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:02:47.695271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:02:47.696794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:02:47.697412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:02:47.698565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:02:47.699066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:02:47.714311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:47.716867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.718933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:47.722089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.789493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:02:47.800069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:02:47.884873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:02:47.888483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af3c4c8e-92e5-4507-bbf5-970459e95d7f',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:02:48.186486 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d78d7be-1850-47a0-ba9a-3b426f4e3270 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.016383 Jul 26 05:02:48.188195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3160/6267] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:02:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:02:48.200584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-500d6766-de4f-4cf8-b138-418b62acf77b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:48.201273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-500d6766-de4f-4cf8-b138-418b62acf77b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:48.326687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-500d6766-de4f-4cf8-b138-418b62acf77b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.333972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-500d6766-de4f-4cf8-b138-418b62acf77b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1095 microversion: 2.1 time: 0.139030 Jul 26 05:02:48.353803 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3108/6268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:48 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1095 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:49.362317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:49.363506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.375054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:49.381873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.382623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.387008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.387542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.575641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:49.586595 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aa543182-a8d9-4570-ae78-92bff39dae6e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1137 microversion: 2.1 time: 0.230241 Jul 26 05:02:49.591049 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3161/6269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:49 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1137 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:50.612643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:50.614449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:50.658348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:50.665525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.666451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.668492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.672654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.817758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:50.833649 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4968f129-bb03-4ac0-b0fc-aa61c1cde1d9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1211 microversion: 2.1 time: 0.225944 Jul 26 05:02:50.851292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3109/6270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:50 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:51.857829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:51.859271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:51.872764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.874229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.877254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.879686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.885850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=54 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:52.317071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:52.329716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25a3ec12-9741-4e63-b151-8618e9cc2e6a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 0.475185 Jul 26 05:02:52.333052 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3162/6271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:51 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.391156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.868010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.892385 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96b4a1c9-2bf2-419d-8e08-d0069175ea0f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 0.540607 Jul 26 05:02:53.893338 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3110/6272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:53 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:54.259794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3a3cce45-0d13-49ae-96f3-74c3237bf5bb req-2b79fcf6-24b2-459e-bb2f-b42ff26c213a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46e818-3c43-4be4-8019-c1116ecea300", "tag": "6ae6303f-5e89-4dc9-ae17-d5d81311a723"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:54.288493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3a3cce45-0d13-49ae-96f3-74c3237bf5bb req-2b79fcf6-24b2-459e-bb2f-b42ff26c213a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.290625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3a3cce45-0d13-49ae-96f3-74c3237bf5bb req-2b79fcf6-24b2-459e-bb2f-b42ff26c213a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.345305 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3a3cce45-0d13-49ae-96f3-74c3237bf5bb req-2b79fcf6-24b2-459e-bb2f-b42ff26c213a service nova] Creating event network-changed:6ae6303f-5e89-4dc9-ae17-d5d81311a723 for instance 1e46e818-3c43-4be4-8019-c1116ecea300 on n-h2-848886-16 Jul 26 05:02:54.366672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3a3cce45-0d13-49ae-96f3-74c3237bf5bb req-2b79fcf6-24b2-459e-bb2f-b42ff26c213a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110667 Jul 26 05:02:54.367495 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3111/6273] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:54.499726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.501249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.518448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.518877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.529829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.530807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.592166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:02:54.838597 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13ab89f1-503b-4a12-a798-776680f95421 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 204 len: 0 microversion: 2.1 time: 0.991104 Jul 26 05:02:54.839724 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3163/6274] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:02:53 2022] DELETE /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:02:54.854543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.856032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.865575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.866267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.867221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.867972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.920001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.921352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.946616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.947040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.947844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.963251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:55.235802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:55.246678 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e323737f-77e4-47f4-ad04-30703c86ce5b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1732 microversion: 2.1 time: 0.402581 Jul 26 05:02:55.247866 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3112/6275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:54 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1732 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:55.357150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:55.371160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b481249-64d3-4a9b-97df-14a87b87b992 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 0.457543 Jul 26 05:02:55.373592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3164/6276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:54 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:56.270770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:56.271386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:56.288105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.295313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.296670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.303752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.367798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:56.369558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:56.393788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.394663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.398030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.401328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.407860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cc70a31b-7711-43da-b012-1e4d108acad1 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1833 microversion: 2.1 time: 1.042062 Jul 26 05:02:57.426364 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3165/6277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:56 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1833 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:57.432177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:57.433178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:57.441270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.442105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.443219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.443909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.444649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.454304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f55b62ce-4f3e-4f95-832e-5360dd8bbdc7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1732 microversion: 2.1 time: 1.188910 Jul 26 05:02:57.471757 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3113/6278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:56 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1732 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:57.479322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:57.480174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:57.489486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.490239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.491324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.491942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.744582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:57.813647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:57.980819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:58.022934 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10276678-54f8-47c8-9d01-a971cf61ba59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1680 microversion: 2.1 time: 0.549483 Jul 26 05:02:58.027295 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3114/6279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:57 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1680 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:58.354857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:58.357202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:58.370229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:58.372242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.380895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.381756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.382255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.475593 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f4cdcec-a744-43e7-a2e8-499bae82e50f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action" status: 200 len: 32635 microversion: 2.1 time: 0.125712 Jul 26 05:02:58.477296 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3115/6280] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:58 2022] POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action => generated 32635 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 05:02:58.487529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:58.488956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:58.496366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.497077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.498471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.499083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.552785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:58.564542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ec22c36-d3ad-42cd-9a5a-77edaf8c33d1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 1.136471 Jul 26 05:02:58.566566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3166/6281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:57 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:58.686366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:58.687318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:58.697744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.707739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.709201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.715067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.813714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:58.822619 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fe558991-db24-4321-b36c-9fee65c7ec85 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1732 microversion: 2.1 time: 0.343637 Jul 26 05:02:58.823208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3116/6282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:58 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1732 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:58.979846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '30f12f556f4943b6967f02801a9cf580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de26d7d51e354ceaac99cc0bc0e4e226', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:58.981195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] flavor_id is None. Assuming migration. {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 05:02:58.981712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:02:59.596458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:59.596992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:59.610206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:59.611638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:59.614930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:59.615726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.070271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.078689 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-849a283c-37bb-4bd5-9f9e-cb76ee2d22ea tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 0.487207 Jul 26 05:03:00.091410 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3117/6283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:59 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:00.104091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:00.104934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:00.112880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.113573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.115216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.115792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.272347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.280754 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16eaf1b4-c1fb-4fae-bf6a-73e2cb616ea7 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1666 microversion: 2.1 time: 0.187994 Jul 26 05:03:00.284350 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3118/6284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:00 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1666 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:00.303901 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e41b848-eeea-4f1f-a558-2f1e4ba32e84 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action" status: 202 len: 0 microversion: 2.1 time: 1.621123 Jul 26 05:03:00.310652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3167/6285] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:58 2022] POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action => generated 0 bytes in 1629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:03:00.334331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:00.335895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:00.379205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.379906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.381604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.384287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.850019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.866304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e2bf627-512f-4780-93bb-b5e3b06da09a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1689 microversion: 2.1 time: 0.548333 Jul 26 05:03:00.884473 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3119/6286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:00 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1689 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:01.107788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:01.108722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:01.126852 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.128438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.131233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.133926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.440236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e4600f9f-3bdb-47a7-af8d-5203303d32d9 req-54b0c9c7-1941-47be-b108-4e824653656c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee03564-ebad-4f62-93fb-36b87f9a6a26", "name": "network-vif-deleted", "tag": "1516612f-2259-4697-bb02-4ed14889665d"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:01.504397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e4600f9f-3bdb-47a7-af8d-5203303d32d9 req-54b0c9c7-1941-47be-b108-4e824653656c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.504873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e4600f9f-3bdb-47a7-af8d-5203303d32d9 req-54b0c9c7-1941-47be-b108-4e824653656c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.556044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e4600f9f-3bdb-47a7-af8d-5203303d32d9 req-54b0c9c7-1941-47be-b108-4e824653656c service nova] Creating event network-vif-deleted:1516612f-2259-4697-bb02-4ed14889665d for instance bee03564-ebad-4f62-93fb-36b87f9a6a26 on n-h1-848886-16 Jul 26 05:03:01.576089 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e4600f9f-3bdb-47a7-af8d-5203303d32d9 req-54b0c9c7-1941-47be-b108-4e824653656c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.743834 Jul 26 05:03:01.589559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3168/6287] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:01.603155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:01.607187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:01.623074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:01.638796 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a5a26ba-d4fd-4352-b17f-b0d1d53c8dee tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 0.537284 Jul 26 05:03:01.643352 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3120/6288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:01 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:01.646017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.651387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.661220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.661925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.790019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.803598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.807391 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lazy-loading 'fault' on Instance uuid bee03564-ebad-4f62-93fb-36b87f9a6a26 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:03:01.889660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:01.891596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:01.912557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.922217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.924644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.927589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:02.193637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e492bbf2be418eae18aeffd28c5a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0f798fe28141a193b59f0ecd2b0cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:02.201819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-954e67d7-2498-4fa7-8b93-fd6d51fd5ffd tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 200 len: 1389 microversion: 2.1 time: 0.603140 Jul 26 05:03:02.204216 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3169/6289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:01 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 1389 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:02.379891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:02.393989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cfb82b2a-7fa2-485b-80fd-e4c320cbd205 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1689 microversion: 2.1 time: 0.504453 Jul 26 05:03:02.394970 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3121/6290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:01 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1689 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:02.663328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:02.663964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:02.678796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:02.679268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:02.680093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:02.680653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.239228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:03.241081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:03.253484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.254360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.255639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.256960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.297935 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] HTTP exception thrown: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Request method failure captured: Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 HTTP/1.1 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33QxdfohRdxkUq1xXP7CX2-8Tf8MaDR250LoIUfstXkkVBvWZd1k4qWtDfO5yYMVb16OEn1WTEQpaFc43nUdrnFB1VJHJyC4Q_caLhJPK5nNoXALC3n-qbLkVqHKGJqiau2CDUPBW0c1UKlY4ne4G4NpjsA3Bfk14dOrGx5nR1nLvDg Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 48e492bbf2be418eae18aeffd28c5a65 Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bee03564-ebad-4f62-93fb-36b87f9a6a26'} Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:03.319606 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:03.323071 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:03.325357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Returning 404 to user: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:03:03.328033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97672b43-2701-4af6-a5e6-d7a8b4d5ad2b tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 404 len: 111 microversion: 2.1 time: 0.102326 Jul 26 05:03:03.333673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3122/6291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:03 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:03:03.415565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:03.416471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:03.436714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.441323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.444208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.453277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:04.165187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.180890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8b53f06-eccb-4575-b52f-5553bba12552 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1278 microversion: 2.1 time: 1.515430 Jul 26 05:03:04.183993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3170/6292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:02 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1278 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:04.468582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.479618 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4cee64c-b254-4d54-b666-ff0fc57567b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1689 microversion: 2.1 time: 1.068105 Jul 26 05:03:04.484577 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3123/6293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:03 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1689 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:05.208856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.209494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:05.226249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.226955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.228618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.229339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.505922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.507754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:05.531941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.532804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.535110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.535796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.846249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:05.859522 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b92a1dd-67d2-43a5-afd5-e81751c14ca7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1689 microversion: 2.1 time: 0.357594 Jul 26 05:03:05.875649 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3124/6294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:05 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1689 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:05.882205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.882984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:05.909743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.912768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.913755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.914080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.962071 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] HTTP exception thrown: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Request method failure captured: Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 HTTP/1.1 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33QxdfohRdxkUq1xXP7CX2-8Tf8MaDR250LoIUfstXkkVBvWZd1k4qWtDfO5yYMVb16OEn1WTEQpaFc43nUdrnFB1VJHJyC4Q_caLhJPK5nNoXALC3n-qbLkVqHKGJqiau2CDUPBW0c1UKlY4ne4G4NpjsA3Bfk14dOrGx5nR1nLvDg Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 48e492bbf2be418eae18aeffd28c5a65 Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bee03564-ebad-4f62-93fb-36b87f9a6a26'} Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:03:05.967526 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:05.971744 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:05.974835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Returning 404 to user: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:03:05.976936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3103b065-0766-4e2a-9b07-80adf7429c1c tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 404 len: 111 microversion: 2.1 time: 0.099292 Jul 26 05:03:05.978053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3125/6295] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:03:05 2022] DELETE /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:03:05.989039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.990242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] [instance: bee03564-ebad-4f62-93fb-36b87f9a6a26] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:06.000060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.001205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.002715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.003382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.026650 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] HTTP exception thrown: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Request method failure captured: Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 HTTP/1.1 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33QxdfohRdxkUq1xXP7CX2-8Tf8MaDR250LoIUfstXkkVBvWZd1k4qWtDfO5yYMVb16OEn1WTEQpaFc43nUdrnFB1VJHJyC4Q_caLhJPK5nNoXALC3n-qbLkVqHKGJqiau2CDUPBW0c1UKlY4ne4G4NpjsA3Bfk14dOrGx5nR1nLvDg Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d0f798fe28141a193b59f0ecd2b0cc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 2d0f798fe28141a193b59f0ecd2b0cc0 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestServerBasicOps-1193543879 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 48e492bbf2be418eae18aeffd28c5a65 Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestServerBasicOps-1193543879-project Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bee03564-ebad-4f62-93fb-36b87f9a6a26'} Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:03:06.028827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. Jul 26 05:03:06.033079 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:03:06.052053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Returning 404 to user: Instance bee03564-ebad-4f62-93fb-36b87f9a6a26 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:03:06.053146 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-70a7f62b-d172-40fc-ab42-9887e7418201 tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26" status: 404 len: 111 microversion: 2.1 time: 0.070644 Jul 26 05:03:06.058926 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3126/6296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:05 2022] GET /compute/v2.1/servers/bee03564-ebad-4f62-93fb-36b87f9a6a26 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:03:06.357690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ebe4ba62-de7c-4197-ae39-45be29b30eac tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] Calling method '.version_select at 0x7f38b4998a60>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:06.413839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ebe4ba62-de7c-4197-ae39-45be29b30eac tempest-TestServerBasicOps-1193543879 tempest-TestServerBasicOps-1193543879-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1519229170" status: 202 len: 0 microversion: 2.1 time: 0.060692 Jul 26 05:03:06.414464 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3127/6297] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Jul 26 05:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1519229170 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:03:06.787903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:06.808960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c956b95-6f27-4b3e-a3ad-906415d9c234 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 1.593402 Jul 26 05:03:06.823091 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3171/6298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:05 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:06.885389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:06.886780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:06.904778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.906330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.907560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.910714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.918193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:07.530768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:07.547791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c24bc31a-5c3a-4def-9306-1b15eeb73006 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1689 microversion: 2.1 time: 0.667342 Jul 26 05:03:07.551127 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3128/6299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:06 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1689 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:07.836987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:07.837617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:07.860279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:07.861805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:07.865737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:07.867575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:08.242078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:08.254771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-019e76d3-6ce8-46ee-8cdb-3733750aa75a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.422651 Jul 26 05:03:08.255200 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3172/6300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:07 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:08.579013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:08.579628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:08.609688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.617612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:08.618994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.622183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:09.124410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.136758 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-88ecab1a-2103-4dfa-8ae1-ac37deddbf59 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.564825 Jul 26 05:03:09.140760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3129/6301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:08 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:09.276830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:09.277520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:09.299554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:09.302179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:09.304813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:09.305537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:09.637458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.655944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8495ef8e-6ef0-4926-b7a2-eec2f7538a97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.382689 Jul 26 05:03:09.656818 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3173/6302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:09 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:10.161684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:10.162508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:10.176603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.180594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.183700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.187850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.650795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:10.677755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:10.679368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:10.684881 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f774bac-0864-444d-9425-f523921c67da tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.511764 Jul 26 05:03:10.689163 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3130/6303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:10 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:10.697907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.698599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.699871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.700482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:11.092318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:11.113919 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae8c14da-a807-466c-8726-1db24550f427 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.440008 Jul 26 05:03:11.114564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3174/6304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:10 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:11.708327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:11.709135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:11.722850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.723173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:11.723959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.724402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:12.103013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.119122 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4be52fc0-4aff-4768-88e7-22af99161983 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.414370 Jul 26 05:03:12.121124 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3131/6305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:11 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:12.144833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:12.145707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:12.160519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:12.162494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:12.163430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:12.164793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:12.499861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.502317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:12.515363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9a0b9f69-1c9f-4511-a060-43313ad50dd3 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.375214 Jul 26 05:03:12.516465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3175/6306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:12 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:13.144812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:13.146173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:13.156311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.159790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.162019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.163531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.530310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:13.541981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:13.543501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:13.587297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-49aeb208-ed67-4629-894b-5e4446128aea tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.448058 Jul 26 05:03:13.593803 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3132/6307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:13 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:13.600356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.601092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.602145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.602734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:14.111203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:14.121892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d30b86f-9f9f-4f98-ba25-807621572ee8 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.585561 Jul 26 05:03:14.122831 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3176/6308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:13 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:14.617550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:14.619186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:14.637200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:14.639019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:14.656443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:14.667965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.011412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.024215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6a93076-8c12-4494-880c-e686d301ed79 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.412893 Jul 26 05:03:15.026622 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3133/6309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:14 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:15.148635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:15.150129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:15.166871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:15.171334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.173763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:15.175298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.778262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.797887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2c242a1c-3ca1-443f-b593-4b50d5eabd5b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.653814 Jul 26 05:03:15.814333 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3177/6310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:15 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:16.048732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:16.050471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:16.080651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.081921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.085207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.086334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.607530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:16.623188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab1e7748-5240-42f3-95a1-142a5ac0a33a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.579086 Jul 26 05:03:16.629709 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3134/6311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:16 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:16.828682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:16.829982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:16.849159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.850465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.853116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.856091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.291749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:17.304398 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec3152d3-394f-40f9-8049-c9457799524b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.482520 Jul 26 05:03:17.306856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3178/6312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:16 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:17.429602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e7990362-d246-4078-8aa3-4dbb1856e056 req-a8e32dbe-c073-4094-9baa-3895d5b5df0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46e818-3c43-4be4-8019-c1116ecea300", "name": "network-vif-plugged", "status": "completed", "tag": "6ae6303f-5e89-4dc9-ae17-d5d81311a723"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:17.449440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e7990362-d246-4078-8aa3-4dbb1856e056 req-a8e32dbe-c073-4094-9baa-3895d5b5df0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.450974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e7990362-d246-4078-8aa3-4dbb1856e056 req-a8e32dbe-c073-4094-9baa-3895d5b5df0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.480667 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e7990362-d246-4078-8aa3-4dbb1856e056 req-a8e32dbe-c073-4094-9baa-3895d5b5df0b service nova] Creating event network-vif-plugged:6ae6303f-5e89-4dc9-ae17-d5d81311a723 for instance 1e46e818-3c43-4be4-8019-c1116ecea300 on n-h2-848886-16 Jul 26 05:03:17.490091 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e7990362-d246-4078-8aa3-4dbb1856e056 req-a8e32dbe-c073-4094-9baa-3895d5b5df0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428837 Jul 26 05:03:17.496008 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3135/6313] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:17.645890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:17.646589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:17.669062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.671570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.672579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.673342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:18.002963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:18.012120 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1b3ab02-a279-4604-a44c-8207e4615fec tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.371896 Jul 26 05:03:18.012989 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3179/6314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:17 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:18.328694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:18.329783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:18.351565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:18.356635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:18.359564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:18.360320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.006940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.043081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:19.043644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9815179e-2a32-4be4-ae51-95ae15d1b724 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1266 microversion: 2.1 time: 0.719744 Jul 26 05:03:19.044610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:19.056506 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3136/6315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:18 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1266 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:19.098123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:19.101168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.102029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:19.102544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.438915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.452904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-039ad917-cff7-46f6-a77f-da2d931cb8b3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.415706 Jul 26 05:03:19.466914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3180/6316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:19 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:20.073193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:20.075766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:20.082358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:20.099505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.099984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.101528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.101995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.344566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea7f4e3b-63c8-4180-942a-77ae3a3d6f9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Action: 'create', calling method: .version_select at 0x7f38b5384790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-106058943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUujkTzWMgLzXNvaSlysSVdmrdOzNN1T2c4to35krTGIxuk7wMhnFdMb8r3T6h8/v8AAxX6HNzQw7f1aW2jcG2SzCRQkDYw1dEi26ApHMX3joHTl2Y+5Rm4oBsa0NFH8w=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:20.381553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ea7f4e3b-63c8-4180-942a-77ae3a3d6f9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:03:20.388827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ea7f4e3b-63c8-4180-942a-77ae3a3d6f9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for user 3dcb2fab3cef4ce6b2579f042d02aefc and project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:03:20.392998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.408023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b1dd3bb6-0fa6-4bfb-864a-1e4cb08f9899 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1454 microversion: 2.1 time: 0.339417 Jul 26 05:03:20.411248 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3181/6317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:20 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1454 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:20.434682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:20.435528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:20.441668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea7f4e3b-63c8-4180-942a-77ae3a3d6f9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.602447 Jul 26 05:03:20.445555 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3137/6318] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:03:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:20.454863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.455345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.457017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.460179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.478811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:20.478982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:20.504424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.505027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.506897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.508239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.940616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.950029 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38ed37d8-3f97-4bc7-9a3c-52ef1470a31d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1694 microversion: 2.1 time: 0.475998 Jul 26 05:03:20.953340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3138/6319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:20 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1694 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:21.456459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:21.470293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e2d1cc7-4736-4da7-a0be-1afaab5c4e15 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1454 microversion: 2.1 time: 1.036585 Jul 26 05:03:21.471179 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3182/6320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:20 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1454 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:21.977921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:21.981937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:21.990354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:22.014818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:22.016086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:22.019457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:22.021201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:22.394648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:22.412727 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63f90156-afb2-49cd-9762-39683c0220d5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1693 microversion: 2.1 time: 0.438998 Jul 26 05:03:22.413923 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3139/6321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:21 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1693 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:23.176036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-unplugged", "status": "completed", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:23.210610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.211134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:23.238097 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] Creating event network-vif-unplugged:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h1-848886-16 Jul 26 05:03:23.249360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:03:23.283931 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a4568ea7-29f3-4556-877f-1c5fe8b0a77f req-bac3f330-a592-41b8-ae4d-c89d4f99c264 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120263 Jul 26 05:03:23.285109 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3183/6322] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:23.439820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:23.441789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:23.453454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.454110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:23.455250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.455844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:24.157320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:24.175007 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67ea0e1d-99be-4fd7-a941-3a9c93c71032 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1693 microversion: 2.1 time: 0.737314 Jul 26 05:03:24.190183 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3140/6323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:23 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1693 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:25.204196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:25.205633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:25.218847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.219329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.226527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.227064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.363361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:25.384396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.385135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.401116 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] Creating event network-changed:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h1-848886-16 Jul 26 05:03:25.409425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:03:25.423894 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c871faca-b2f4-44af-afa6-7e0f4b19136d req-8df96982-68f4-44f0-8d84-70394f187fc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067454 Jul 26 05:03:25.425209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3141/6324] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:25.853913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:25.866382 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10cbed7b-a72b-4dc4-b908-ee4574c7e887 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1693 microversion: 2.1 time: 0.668437 Jul 26 05:03:25.869850 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3184/6325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:25 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1693 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:26.893169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:26.894532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:26.917003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.921707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.925577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.926052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.989897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b6afae7d-cda9-4a3c-9a87-b3dfcf71472b req-87220348-5224-4916-8ad6-7e2019750c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46e818-3c43-4be4-8019-c1116ecea300", "tag": "6ae6303f-5e89-4dc9-ae17-d5d81311a723"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:27.022563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b6afae7d-cda9-4a3c-9a87-b3dfcf71472b req-87220348-5224-4916-8ad6-7e2019750c71 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.024558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b6afae7d-cda9-4a3c-9a87-b3dfcf71472b req-87220348-5224-4916-8ad6-7e2019750c71 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.063672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b6afae7d-cda9-4a3c-9a87-b3dfcf71472b req-87220348-5224-4916-8ad6-7e2019750c71 service nova] Creating event network-changed:6ae6303f-5e89-4dc9-ae17-d5d81311a723 for instance 1e46e818-3c43-4be4-8019-c1116ecea300 on n-h2-848886-16 Jul 26 05:03:27.083774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b6afae7d-cda9-4a3c-9a87-b3dfcf71472b req-87220348-5224-4916-8ad6-7e2019750c71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.633898 Jul 26 05:03:27.085271 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3142/6326] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:27.823109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:27.844328 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-269c189f-4753-46fa-8907-ec9f72f68b07 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1693 microversion: 2.1 time: 0.955982 Jul 26 05:03:27.845056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3185/6327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:26 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1693 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:29.614409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:29.615170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:29.636836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:29.637550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:29.644273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:29.644919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.018605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:30.039541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0bde4009-15e5-4f3b-a4d9-48e09b65edbe tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1688 microversion: 2.1 time: 1.171497 Jul 26 05:03:30.041981 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3143/6328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:28 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1688 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:30.063180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:30.063751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:30.085477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.085931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.086801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.087259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.433034 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d381b7a6-be20-44a4-8397-0b5beedba9a7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action" status: 202 len: 0 microversion: 2.1 time: 0.374294 Jul 26 05:03:30.433935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3186/6329] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:03:30 2022] POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:03:30.450882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:30.451784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:30.463856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:30.499927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.500403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.501215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.501662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:31.598379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:31.612686 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d15938e-5432-4494-a4a6-237974652617 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 1.173449 Jul 26 05:03:31.613661 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3144/6330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:30 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:31.898753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-plugged", "status": "completed", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:31.960034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:31.960986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:32.006033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] Creating event network-vif-plugged:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h1-848886-16 Jul 26 05:03:32.055917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:03:32.103489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-dec5940a-bbb4-43a2-bf74-42fcc71b7a6d req-9d61acfc-747e-40fc-9583-252cdf7454cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216873 Jul 26 05:03:32.103931 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3187/6331] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:32.643450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:32.644074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:32.661976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:32.663790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:32.672932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:32.674873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:33.502299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:33.512630 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f3d1f06-cce2-4016-8d1d-318498184249 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.876283 Jul 26 05:03:33.514251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3145/6332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:32 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:34.536594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:34.537743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:34.549062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:34.549548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:34.554668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:34.555119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:34.979626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:35.012811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9af6e3e6-d9fe-44ad-bdb5-c4446c39e19a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.479573 Jul 26 05:03:35.017730 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3188/6333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:34 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:36.044452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:36.045084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:36.052618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.053076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.053873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.054353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.424812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-unplugged", "status": "completed", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:36.447608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.450985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.477646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] Creating event network-vif-unplugged:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:03:36.502113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:03:36.532312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-65414105-5380-4d66-b442-f8ffc037f134 req-84745a73-0004-45ca-b566-7804f3e5c0c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111496 Jul 26 05:03:36.534277 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3189/6334] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:36.633751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:36.647501 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed064bf3-d80b-473a-a1b0-cf454148b54f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.610574 Jul 26 05:03:36.660962 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3146/6335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:36 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:37.671135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:37.671864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:37.693086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.699106 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:37.710130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.711272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:37.760941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-255744159-access_point-1562503938", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "e94db67c-d1c7-498c-9636-9a7e0c4cb55b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-106058943", "security_groups": [{"name": "tempest-secgroup_access--949023308"}, {"name": "tempest-secgroup_general--610514970"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:38.024900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:38.042444 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6904ebe1-9a00-4d60-9a3e-58ec889e8f18 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.377409 Jul 26 05:03:38.046201 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3190/6336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:37 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:38.144147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] validate_networks() for [('e94db67c-d1c7-498c-9636-9a7e0c4cb55b', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:03:38.568508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:38.607179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:38.607647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:38.658343 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] Creating event network-changed:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:03:38.671034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:38.687212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:03:38.741047 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-304bcf99-7250-4197-8161-3d366909603a req-a9755250-19cf-4e70-8811-69c82b431fb3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171089 Jul 26 05:03:38.745664 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3191/6337] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:39.067873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:39.068664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:39.086596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.094517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.095712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.097913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.608672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:39.618191 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36967340-0534-4566-85bd-80c89c44ad9b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.554453 Jul 26 05:03:39.623486 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3192/6338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:39 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:39.764455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:03:39.764980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:03:39.765723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:03:39.766480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:03:39.767065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:03:39.792203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.793014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.799304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.799764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.822383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:39.840274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:03:39.849776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for user 3dcb2fab3cef4ce6b2579f042d02aefc and project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:03:39.867269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:03:39.870480 n-d-848886-16 devstack@n-api.service[119487]: WARNING nova.utils [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-255744159-access_point-1562503938 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-255744159-acc Jul 26 05:03:39.871588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:03:39.950043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89a8fc9e-aa9c-49da-a58b-921d613d9b14 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.193243 Jul 26 05:03:39.951871 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3147/6339] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:03:37 2022] POST /compute/v2.1/servers => generated 456 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:03:39.963557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-82deeaa7-ebf4-4fd7-891a-bc39c7a5ab13 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:39.964749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-82deeaa7-ebf4-4fd7-891a-bc39c7a5ab13 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:40.153713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-82deeaa7-ebf4-4fd7-891a-bc39c7a5ab13 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:40.171414 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-82deeaa7-ebf4-4fd7-891a-bc39c7a5ab13 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1293 microversion: 2.1 time: 0.211801 Jul 26 05:03:40.175240 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3193/6340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:39 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1293 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:40.646245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:40.647117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:40.662356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.663088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:40.663971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.665303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:41.030549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:41.039585 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e917f87-a6e6-4981-b853-cd666420d91b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.399256 Jul 26 05:03:41.040801 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3148/6341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:40 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:41.201535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:41.202119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:41.217374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:41.219856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:41.223957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:41.225947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:41.406845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:41.425892 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61f0c44d-a249-476c-98a9-b082f7f052f3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1345 microversion: 2.1 time: 0.229601 Jul 26 05:03:41.426978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3194/6342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:41 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:42.062758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:42.063405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:42.078089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.079035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.080072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.080751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.306804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:42.327464 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96db2597-4125-4fbc-99f7-b04d91b02dc5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.269645 Jul 26 05:03:42.328935 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3149/6343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:42 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:42.448944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:42.450053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:42.467457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.467926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.468924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.469530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.568498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:42.581452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb897530-82e2-457c-a144-ee624811c115 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1351 microversion: 2.1 time: 0.137296 Jul 26 05:03:42.582270 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3195/6344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:42 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:43.349229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:43.349855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:43.365493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.366113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.370292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.370864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.607181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:43.608768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:43.622054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.627896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.628993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.629634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.916768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:43.929328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a655866e-5bc4-41de-907b-eeb05267e8e8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1687 microversion: 2.1 time: 0.584195 Jul 26 05:03:43.930677 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3150/6345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:43 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1687 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:44.573284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:44.584065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-603aaf92-0f6d-453d-b596-101fc8431772 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.982687 Jul 26 05:03:44.584913 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3196/6346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:43 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:44.822491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a105e453-a5f6-414d-8697-e77a42f41994 req-0c18f193-1728-4561-871f-49f67841b928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094cccd6-007a-4900-bd6e-3225b90f2a37", "tag": "570a43ee-b733-4ccc-a43f-8b8181b136b0"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:44.841591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a105e453-a5f6-414d-8697-e77a42f41994 req-0c18f193-1728-4561-871f-49f67841b928 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:44.844912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a105e453-a5f6-414d-8697-e77a42f41994 req-0c18f193-1728-4561-871f-49f67841b928 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:44.873884 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a105e453-a5f6-414d-8697-e77a42f41994 req-0c18f193-1728-4561-871f-49f67841b928 service nova] Creating event network-changed:570a43ee-b733-4ccc-a43f-8b8181b136b0 for instance 094cccd6-007a-4900-bd6e-3225b90f2a37 on n-h1-848886-16 Jul 26 05:03:44.890643 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a105e453-a5f6-414d-8697-e77a42f41994 req-0c18f193-1728-4561-871f-49f67841b928 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065413 Jul 26 05:03:44.891979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3151/6347] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:44.966427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:44.967972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:44.984982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:44.985859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:44.992556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:44.993830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.251524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-007536a3-fb46-4c24-b4de-fee210a3bd43 req-345622b5-733f-4c4d-a106-85ec5e6d95e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-plugged", "status": "completed", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:45.279768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-007536a3-fb46-4c24-b4de-fee210a3bd43 req-345622b5-733f-4c4d-a106-85ec5e6d95e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:45.280291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-007536a3-fb46-4c24-b4de-fee210a3bd43 req-345622b5-733f-4c4d-a106-85ec5e6d95e2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.302422 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-007536a3-fb46-4c24-b4de-fee210a3bd43 req-345622b5-733f-4c4d-a106-85ec5e6d95e2 service nova] Creating event network-vif-plugged:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:03:45.315624 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-007536a3-fb46-4c24-b4de-fee210a3bd43 req-345622b5-733f-4c4d-a106-85ec5e6d95e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068153 Jul 26 05:03:45.327817 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3152/6348] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:45.609278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:45.612035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:45.632296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:45.635606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.640767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:45.642843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.817730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:45.836271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13757e19-a062-44ba-b308-0624c58efb39 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1680 microversion: 2.1 time: 0.874453 Jul 26 05:03:45.839619 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3197/6349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:44 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1680 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:45.982965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:45.999622 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b3131a14-c8d1-4c7d-8334-99a9fbf7da4d tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.397206 Jul 26 05:03:46.000496 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3153/6350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:45 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:47.025782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:47.026524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:47.042502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:47.043096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:47.043977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:47.045813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:47.369990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:47.386640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ad11c57-202f-4b87-b317-7323f2748952 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.357444 Jul 26 05:03:47.394799 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3198/6351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:47 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:48.410529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:48.411702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:48.423320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.423779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.424917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.425366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.609996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:48.618386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3229836c-6767-4ac0-aab3-8bcaba2762e1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.214076 Jul 26 05:03:48.619392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3154/6352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:48 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:49.641374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:49.642073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:49.654320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.655985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.657528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.658169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.826617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:49.834839 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6b6371ae-fb14-4f9f-87ac-c54df13fdc17 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.198341 Jul 26 05:03:49.835750 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3199/6353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:49 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:50.859049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:50.860171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:50.863341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:50.864015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:50.876210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.876210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:50.876930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.877374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:51.070496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:51.078668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9396b282-ed93-45c3-bf89-96bc064574f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.224319 Jul 26 05:03:51.080013 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3155/6354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:50 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:51.191108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4b9b1d6c-3f68-4148-84af-9e8f4bccb4ea req-0d3bdc91-015e-417b-b455-f7eba5d52284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094cccd6-007a-4900-bd6e-3225b90f2a37", "name": "network-vif-plugged", "status": "completed", "tag": "570a43ee-b733-4ccc-a43f-8b8181b136b0"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:51.203038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:51.204962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=44 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:51.207689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b9b1d6c-3f68-4148-84af-9e8f4bccb4ea req-0d3bdc91-015e-417b-b455-f7eba5d52284 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:51.209239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b9b1d6c-3f68-4148-84af-9e8f4bccb4ea req-0d3bdc91-015e-417b-b455-f7eba5d52284 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:51.225773 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4b9b1d6c-3f68-4148-84af-9e8f4bccb4ea req-0d3bdc91-015e-417b-b455-f7eba5d52284 service nova] Creating event network-vif-plugged:570a43ee-b733-4ccc-a43f-8b8181b136b0 for instance 094cccd6-007a-4900-bd6e-3225b90f2a37 on n-h1-848886-16 Jul 26 05:03:51.231033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4b9b1d6c-3f68-4148-84af-9e8f4bccb4ea req-0d3bdc91-015e-417b-b455-f7eba5d52284 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047826 Jul 26 05:03:51.232444 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3200/6355] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:52.099923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:52.101297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:52.109158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.109617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.110423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.110889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.274466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:52.281408 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc963e4a-7f1d-4b87-8fa3-7fde67064e23 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1469 microversion: 2.1 time: 0.185480 Jul 26 05:03:52.282092 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3156/6356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:52 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:53.307415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:53.309829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:53.319741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.320467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.321548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.322561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.530473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:53.541063 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f1cc8c09-5f3f-490f-969e-e91bd7c674b8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1641 microversion: 2.1 time: 0.238649 Jul 26 05:03:53.554710 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3201/6357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:53 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1641 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:53.569868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:53.571033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:53.573784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:53.587173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.587173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.587173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.587173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.780655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:53.789829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf1a2210-61e8-4816-99cb-5c0b0369be28 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1641 microversion: 2.1 time: 0.223626 Jul 26 05:03:53.794896 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3157/6358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:53 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1641 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:53.815047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:53.816691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:53.823288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.824058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.825449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:53.827272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:54.151397 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4156b242-0c61-4149-952e-691e9850e68f tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1794 microversion: 2.1 time: 0.340992 Jul 26 05:03:54.152212 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3202/6359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:53 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1794 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:56.767024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-76d27876-453a-46ef-9dd7-52c7906edd7b req-9d76c84c-b347-4061-9fac-394cd951107b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094cccd6-007a-4900-bd6e-3225b90f2a37", "tag": "570a43ee-b733-4ccc-a43f-8b8181b136b0"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:56.785299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-76d27876-453a-46ef-9dd7-52c7906edd7b req-9d76c84c-b347-4061-9fac-394cd951107b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:56.785664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-76d27876-453a-46ef-9dd7-52c7906edd7b req-9d76c84c-b347-4061-9fac-394cd951107b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:56.802185 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-76d27876-453a-46ef-9dd7-52c7906edd7b req-9d76c84c-b347-4061-9fac-394cd951107b service nova] Creating event network-changed:570a43ee-b733-4ccc-a43f-8b8181b136b0 for instance 094cccd6-007a-4900-bd6e-3225b90f2a37 on n-h1-848886-16 Jul 26 05:03:56.815081 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-76d27876-453a-46ef-9dd7-52c7906edd7b req-9d76c84c-b347-4061-9fac-394cd951107b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052627 Jul 26 05:03:56.816754 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3158/6360] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:16.151179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:16.154500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=56 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:16.161811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:16.165446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:16.175585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:16.176411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:16.177444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:16.177997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:16.247049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-603c2819-5179-4ad2-ab1a-e29e43d7f196 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action" status: 200 len: 63190 microversion: 2.1 time: 0.095098 Jul 26 05:04:16.254617 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3203/6361] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:04:16 2022] POST /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c/action => generated 63190 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:04:26.730237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:26.731182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=55 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:26.736774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c255ce90-464f-4b28-a3cf-9c08cad5a3ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: .version_select at 0x7f38b48590d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1942085835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzxvcevtS+VK+0uOUEF/QjxGv4wNNzKszs0cYpKwfGov71hnDDGVnxPV1bZOgjEk9uP68uFBlgUfp+KQ4OJJ/yGnW1Bpr/QZ6ENarRyr0muUfuGhO81r54Lg8IlqbA0zw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:26.763610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c255ce90-464f-4b28-a3cf-9c08cad5a3ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:26.773544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c255ce90-464f-4b28-a3cf-9c08cad5a3ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:26.814453 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c255ce90-464f-4b28-a3cf-9c08cad5a3ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.088007 Jul 26 05:04:26.815490 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3159/6362] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:04:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:28.541955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-13831824", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "c01ce90c-de17-4a7c-84b3-bee02daa5f62"}], "key_name": "tempest-TestNetworkBasicOps-1942085835", "security_groups": [{"name": "tempest-secgroup-smoke-1968691813"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:28.565296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:28.576717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:28.797284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] validate_networks() for [('c01ce90c-de17-4a7c-84b3-bee02daa5f62', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:04:29.528557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:04:29.529000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:04:29.529485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:04:29.529904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:04:29.530361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:04:29.545445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:29.546074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:29.546769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:29.547396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:29.575617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:29.581885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:29.598124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:04:29.600894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:04:29.672646 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aec88ccf-b959-4c19-b304-307689b2786a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.136903 Jul 26 05:04:29.678886 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3204/6363] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:04:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:04:29.686211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1b2dc275-b010-4ab9-8ff7-9a505418c16d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:29.687609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1b2dc275-b010-4ab9-8ff7-9a505418c16d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:30.108696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1b2dc275-b010-4ab9-8ff7-9a505418c16d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:30.116059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1b2dc275-b010-4ab9-8ff7-9a505418c16d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1247 microversion: 2.1 time: 0.435206 Jul 26 05:04:30.130273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3160/6364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:29 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1247 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:31.147127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:31.152051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:31.164965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.168285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.169415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.171756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.351863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:31.368004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6d9c77d8-b2c8-4cd3-8fef-b0452839cc78 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1299 microversion: 2.1 time: 0.230609 Jul 26 05:04:31.390517 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3205/6365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:31 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:32.395057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:32.395681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:32.423710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:32.424177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:32.427001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:32.427510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:32.565357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:32.577087 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1cb31e38-d282-46ce-804c-7a0398ce23f3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1305 microversion: 2.1 time: 0.187291 Jul 26 05:04:32.589716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3161/6366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:32 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:33.028673 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:04:33.029118 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c (ip 10.222.0.43) !!! Jul 26 05:04:33.078239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:33.078406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:33.091037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.094831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.097025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.097713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.571953 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01d68a81-6692-4a55-a968-44465f6e0565 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1833 microversion: 2.1 time: 0.950390 Jul 26 05:04:33.573159 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3206/6367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:32 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1833 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:33.600409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:33.601171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:33.615586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.616030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.616808 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.619988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.959462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:33.968282 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d0ce811-54ba-4c9c-856c-98f852d8c070 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.372215 Jul 26 05:04:33.970262 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3162/6368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:33 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:34.996642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:34.997965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:35.013747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.014714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.016216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.016896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.412086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:35.421772 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1d3cba37-40a7-458b-ab81-ab9e1136074d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.433131 Jul 26 05:04:35.425253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3207/6369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:34 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:36.112819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-755cbbad-e786-4abd-9737-3a757de9d29d req-83bb69a2-841f-446b-aa7f-facb330ac076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d479dd-f402-42b1-a3f1-0e453d574cb1", "tag": "c3697091-331d-4117-b731-82f4ddabc5eb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:36.142653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-755cbbad-e786-4abd-9737-3a757de9d29d req-83bb69a2-841f-446b-aa7f-facb330ac076 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.145501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-755cbbad-e786-4abd-9737-3a757de9d29d req-83bb69a2-841f-446b-aa7f-facb330ac076 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.164811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:36.165324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.180500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.180972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.181900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.182431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.183064 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-755cbbad-e786-4abd-9737-3a757de9d29d req-83bb69a2-841f-446b-aa7f-facb330ac076 service nova] Creating event network-changed:c3697091-331d-4117-b731-82f4ddabc5eb for instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 on n-h1-848886-16 Jul 26 05:04:36.194928 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-755cbbad-e786-4abd-9737-3a757de9d29d req-83bb69a2-841f-446b-aa7f-facb330ac076 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096496 Jul 26 05:04:36.198630 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3163/6370] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:36.228896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ebe040e8-3ac2-4b5a-a0f3-d79330c7dce4 req-b05c11ce-ef82-43a5-b321-06e10bffe80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:36.246956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:04:36.257214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ebe040e8-3ac2-4b5a-a0f3-d79330c7dce4 req-b05c11ce-ef82-43a5-b321-06e10bffe80f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.260895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ebe040e8-3ac2-4b5a-a0f3-d79330c7dce4 req-b05c11ce-ef82-43a5-b321-06e10bffe80f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.299068 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ebe040e8-3ac2-4b5a-a0f3-d79330c7dce4 req-b05c11ce-ef82-43a5-b321-06e10bffe80f service nova] Creating event network-changed:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:04:36.308051 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ebe040e8-3ac2-4b5a-a0f3-d79330c7dce4 req-b05c11ce-ef82-43a5-b321-06e10bffe80f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107637 Jul 26 05:04:36.308667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3164/6371] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:36.416939 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-436292fd-ee58-4f7a-a5b4-1de036099e71 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 204 len: 0 microversion: 2.1 time: 0.255117 Jul 26 05:04:36.417542 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3208/6372] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:04:36 2022] DELETE /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:04:36.427396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:36.428157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.439323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.446228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:36.447011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.447134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.448289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.449010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.460635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.461343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.462350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.463531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.793060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.805717 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4c93660-96a7-4151-8fcb-b9821d95bcb0 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.363870 Jul 26 05:04:36.806383 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3209/6373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:36 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:36.958804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.971089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-17b0de20-1c37-4b55-9aa7-9f4bce4bf421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1686 microversion: 2.1 time: 0.548794 Jul 26 05:04:36.974694 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3165/6374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:36 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1686 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:37.830884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:37.832410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:37.849569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.851631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.855208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.855686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.995882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:38.003128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:38.017626 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.018094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.021539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.025793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.781607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:38.795792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8cd06b0e-9cc9-43bc-83f2-0a03ee424f3a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.966468 Jul 26 05:04:38.798698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3210/6375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:37 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:39.276187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:39.288042 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fddf1ee3-c489-4c0e-a2ad-d22557522cdb tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1686 microversion: 2.1 time: 1.296395 Jul 26 05:04:39.290131 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3166/6376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:37 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1686 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:39.821101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:39.822280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:39.832100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:39.832847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:39.842223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:39.842679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:39.843493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:39.844121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.316788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:40.317957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:40.332487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:40.338439 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.339226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.340231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.340819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.554937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.566468 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-19fbebd4-b7b1-428d-8c7c-c276a63613ab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.749848 Jul 26 05:04:40.567698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3211/6377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:39 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:40.893666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-debb8cd8-c2b2-4d5a-a86e-f14fecfaa9cc req-1b73990f-0b49-43e7-b03e-c8355445bd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e2bfb8-f57c-48eb-a42d-56e0f702916c", "name": "network-vif-deleted", "tag": "5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:40.903251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.913618 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a4855c7-c3c7-4436-b778-b9d6e4c982c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 200 len: 1502 microversion: 2.1 time: 0.600675 Jul 26 05:04:40.918781 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3167/6378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:40 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 1502 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:40.936555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-debb8cd8-c2b2-4d5a-a86e-f14fecfaa9cc req-1b73990f-0b49-43e7-b03e-c8355445bd68 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.948258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-debb8cd8-c2b2-4d5a-a86e-f14fecfaa9cc req-1b73990f-0b49-43e7-b03e-c8355445bd68 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.991841 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-debb8cd8-c2b2-4d5a-a86e-f14fecfaa9cc req-1b73990f-0b49-43e7-b03e-c8355445bd68 service nova] Creating event network-vif-deleted:5f2b4b4d-2676-47d1-ba7f-e6aa6538e41f for instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c on n-h2-848886-16 Jul 26 05:04:41.013985 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-debb8cd8-c2b2-4d5a-a86e-f14fecfaa9cc req-1b73990f-0b49-43e7-b03e-c8355445bd68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125869 Jul 26 05:04:41.020986 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3212/6379] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:04:41.590498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.591336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.604064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.607373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.608279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.611509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.937245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.938585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 95e2bfb8-f57c-48eb-a42d-56e0f702916c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.960724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.960724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.970310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.970797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:42.011095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] HTTP exception thrown: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Request method failure captured: Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c HTTP/1.1 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33RymeSjWnJQ555P7Axyt9qq2be7AliA7vnGSdm_9U1MboSxRCePG7Gjoub0klmO0Ye6K0eXxpbdagulI1QA0ws0aCcUZgieRg72PtIh5nD7YCStF6qHTSnJYJR9J5AgbMUIBpYAm_COhmZMERcqJ-gUpWSTKlsx64dn2fEEgjqKzpI Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cc3616211d754718b64b2d011a5342b7 Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '95e2bfb8-f57c-48eb-a42d-56e0f702916c'} Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:42.012786 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. Jul 26 05:04:42.016788 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:04:42.032265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Returning 404 to user: Instance 95e2bfb8-f57c-48eb-a42d-56e0f702916c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:04:42.033495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f2be3656-36e1-4b9c-98eb-a59fbe93bd5d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c" status: 404 len: 111 microversion: 2.1 time: 0.101380 Jul 26 05:04:42.034927 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3213/6380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/95e2bfb8-f57c-48eb-a42d-56e0f702916c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:04:42.483466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:42.504159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f34556d9-dec1-4fa8-abb3-3df157126d60 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.917697 Jul 26 05:04:42.518405 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3168/6381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:43.371503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1391684286", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "b7f8f879-b1b9-487c-bf9f-3685dc44175e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-106058943", "security_groups": []}, "os:scheduler_hints": {"different_host": ["094cccd6-007a-4900-bd6e-3225b90f2a37"]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:43.480398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] validate_networks() for [('b7f8f879-b1b9-487c-bf9f-3685dc44175e', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:04:43.535924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:43.536854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:43.544701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.545158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.545931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.546886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.788131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:43.798569 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bbd7437a-e425-40bb-9871-bfd5e20db907 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.273258 Jul 26 05:04:43.813621 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3169/6382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:43 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:44.820923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:44.823036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:44.864829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:44.865294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:44.866092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:44.866729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.083406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:45.094515 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-273e0a95-3d70-4092-bc47-6a245bb1b72f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.276776 Jul 26 05:04:45.095545 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3170/6383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:44 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:45.241598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:04:45.242083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:04:45.242561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:04:45.242976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:04:45.244271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:04:45.255406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.255883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.256816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.257485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.284890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:45.292604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Getting quotas for user 3dcb2fab3cef4ce6b2579f042d02aefc and project 4fe39ac42b974b9e87e8e17d83a90f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:45.307561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:04:45.310698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:04:45.426816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-03cd0a2c-8923-49d4-b49a-bc363616347f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.059655 Jul 26 05:04:45.431479 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3214/6384] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:04:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:04:45.441261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cbe41df5-0554-4410-8024-1e5a471e73fd tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:45.441868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cbe41df5-0554-4410-8024-1e5a471e73fd tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:45.668648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cbe41df5-0554-4410-8024-1e5a471e73fd tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:45.686580 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cbe41df5-0554-4410-8024-1e5a471e73fd tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1241 microversion: 2.1 time: 0.246510 Jul 26 05:04:45.687231 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3171/6385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:45 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1241 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:46.116599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:46.117523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:46.143446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.144113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.152364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.153081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.646807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:46.670801 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a8dfcc5-70f8-44a5-9712-2b35f733958b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 0.554045 Jul 26 05:04:46.671471 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3215/6386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:46 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:46.717253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:46.718860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:46.743213 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.746399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.751363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.753510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.918189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:46.930033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6d94aecc-2b15-410f-8c76-ff385aa98d83 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1237 microversion: 2.1 time: 0.220401 Jul 26 05:04:46.931546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3172/6387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:46 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1237 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:47.548868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-79db494f-0f19-44f5-81b2-2c223922d38c req-d31bee82-b475-421d-a344-48843be2f071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d479dd-f402-42b1-a3f1-0e453d574cb1", "name": "network-vif-plugged", "status": "completed", "tag": "c3697091-331d-4117-b731-82f4ddabc5eb"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:47.568474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-79db494f-0f19-44f5-81b2-2c223922d38c req-d31bee82-b475-421d-a344-48843be2f071 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:47.568946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-79db494f-0f19-44f5-81b2-2c223922d38c req-d31bee82-b475-421d-a344-48843be2f071 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:47.600561 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-79db494f-0f19-44f5-81b2-2c223922d38c req-d31bee82-b475-421d-a344-48843be2f071 service nova] Creating event network-vif-plugged:c3697091-331d-4117-b731-82f4ddabc5eb for instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 on n-h1-848886-16 Jul 26 05:04:47.607972 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-79db494f-0f19-44f5-81b2-2c223922d38c req-d31bee82-b475-421d-a344-48843be2f071 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062844 Jul 26 05:04:47.608605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3216/6388] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:47.692844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:47.693722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:47.707722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:47.711609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:47.713308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:47.721431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:47.952243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:47.952980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:47.961804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:47.966873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:47.967884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:47.968494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:48.110938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:48.121887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1685d0e-8c9c-4899-a4d6-954dccf57dd6 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.174233 Jul 26 05:04:48.135561 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3217/6389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:47 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:04:49.032925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:49.046640 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3e8fd795-fbe3-4390-86ba-7002725e8a20 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1373 microversion: 2.1 time: 1.357565 Jul 26 05:04:49.059760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3173/6390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:47 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1373 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:49.145606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:49.147284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:49.159991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:49.160462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:49.161255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:49.161712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:49.261062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:49.269668 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43c66a4f-b55e-4dc7-ad8d-a227e9b16f64 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.127925 Jul 26 05:04:49.271163 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3218/6391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:49 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:50.080481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:50.081993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:50.109939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.129920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.135129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.135910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.300965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:50.301618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:50.320383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.321811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.323607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.324650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.577443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:50.593679 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96dc927d-f5ee-427c-98c0-2507b3d653ce tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.299774 Jul 26 05:04:50.595091 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3219/6392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:50 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:04:50.600445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-95074492-c3a4-4138-ad5d-29d8a368f7e7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '.version_select at 0x7f38b44a1040>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:50.689755 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-95074492-c3a4-4138-ad5d-29d8a368f7e7 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1019272676" status: 202 len: 0 microversion: 2.1 time: 0.092345 Jul 26 05:04:50.693411 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3220/6393] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Jul 26 05:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1019272676 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:04:50.731662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a08a77d0-c1ef-426a-b8a0-d02fd4312046 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: .version_select at 0x7f38b59b8b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1982932695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLnv+SXT0Hil8KJIuexn5E35ElZAwyGRYFNh5YOaAOQHTJjz9E8DCK51wPRWz4xOrl65dyZuSTXARVjriPBik1p2cBXE24rwhy2oY7YOCOQp3DiLDPTUA1pj/MBqGPDXg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:50.776982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a08a77d0-c1ef-426a-b8a0-d02fd4312046 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:50.786989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-a08a77d0-c1ef-426a-b8a0-d02fd4312046 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:50.844224 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a08a77d0-c1ef-426a-b8a0-d02fd4312046 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.117693 Jul 26 05:04:50.851112 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3221/6394] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:04:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:04:51.155415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:51.164632 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ff6b9d2-918e-4792-ad13-0fa070bd7ae4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1545 microversion: 2.1 time: 1.100861 Jul 26 05:04:51.171665 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3174/6395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:50 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1545 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:51.192699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:51.193906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:51.216852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.224572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:51.225616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.230399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:51.563158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:51.573268 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba8b21d5-8505-4100-83ea-f892520e2251 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1545 microversion: 2.1 time: 0.385696 Jul 26 05:04:51.578909 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3222/6396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:51 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1545 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:51.617544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:51.619466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:51.635517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.641537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:51.642627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.643231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:51.934720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:51.952559 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9f8e29f-be54-49d0-aa62-c7279aae33a3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.338809 Jul 26 05:04:51.957878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3175/6397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:51 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:52.978994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:52.980295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:52.994524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:52.995342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:53.000970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:53.001642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:53.181633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:53.189833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7095dadf-a9de-4f7b-86f8-3ecacb2998aa tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.215600 Jul 26 05:04:53.203173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3223/6398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:52 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:53.647433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0571f48c-becd-46f6-9891-cde104988245 req-a25a7f34-b846-40de-8ebc-942babaf73ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fea3faa4-e611-4c8f-9024-43c80a9420e0", "tag": "b97ed0d0-05cf-438c-a42e-f42926f99642"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:53.674013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0571f48c-becd-46f6-9891-cde104988245 req-a25a7f34-b846-40de-8ebc-942babaf73ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:53.674871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0571f48c-becd-46f6-9891-cde104988245 req-a25a7f34-b846-40de-8ebc-942babaf73ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:53.702811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0571f48c-becd-46f6-9891-cde104988245 req-a25a7f34-b846-40de-8ebc-942babaf73ce service nova] Creating event network-changed:b97ed0d0-05cf-438c-a42e-f42926f99642 for instance fea3faa4-e611-4c8f-9024-43c80a9420e0 on n-h2-848886-16 Jul 26 05:04:53.714185 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0571f48c-becd-46f6-9891-cde104988245 req-a25a7f34-b846-40de-8ebc-942babaf73ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067528 Jul 26 05:04:53.715796 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3176/6399] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:54.210839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:54.211896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:54.225240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:54.225965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:54.233075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:54.233793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:54.239110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:54.462598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:54.479390 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-721b61c7-6a4e-417b-b9bc-a324976897c3 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.271871 Jul 26 05:04:54.482282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3224/6400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:54 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:54.880396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-95369e9d-0858-4592-b02c-efde0ebfb135 req-5efeb45e-eb33-4cb6-ae7d-3cd7be0b50cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d479dd-f402-42b1-a3f1-0e453d574cb1", "tag": "c3697091-331d-4117-b731-82f4ddabc5eb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:54.906528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-95369e9d-0858-4592-b02c-efde0ebfb135 req-5efeb45e-eb33-4cb6-ae7d-3cd7be0b50cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:54.907331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-95369e9d-0858-4592-b02c-efde0ebfb135 req-5efeb45e-eb33-4cb6-ae7d-3cd7be0b50cc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:54.939446 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-95369e9d-0858-4592-b02c-efde0ebfb135 req-5efeb45e-eb33-4cb6-ae7d-3cd7be0b50cc service nova] Creating event network-changed:c3697091-331d-4117-b731-82f4ddabc5eb for instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 on n-h1-848886-16 Jul 26 05:04:54.956558 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-95369e9d-0858-4592-b02c-efde0ebfb135 req-5efeb45e-eb33-4cb6-ae7d-3cd7be0b50cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082413 Jul 26 05:04:54.957189 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3177/6401] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:55.503203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:55.507401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:55.509977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:55.525048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:55.525920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:55.525920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:55.528473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:55.719833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:55.728185 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ede499c3-3e4b-4fe0-8146-4a9990ee3ec5 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.228983 Jul 26 05:04:55.742221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3225/6402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:55 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:56.746730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:56.752511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:56.753459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:56.758426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:56.767896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:56.768645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:56.769441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:56.770046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:56.778037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=81 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:56.918381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:56.926329 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f90d96f2-49b1-4ad8-aadd-1fcc73504a7a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.180612 Jul 26 05:04:56.927115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3178/6403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:56 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:57.960433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:57.962545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:57.983612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:57.984718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:57.985540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:57.986277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:58.253109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:58.263864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f78b426a-ce06-4fd1-a525-3b56589ad411 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.315244 Jul 26 05:04:58.268558 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3226/6404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:57 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:59.296557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:59.297177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:59.313862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:59.314377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:59.315183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:59.315628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:59.634467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:59.645915 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42077087-1606-4b29-bf45-19e6f4c90c8c tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.353093 Jul 26 05:04:59.650905 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3179/6405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:59 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:59.868918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4afdb7b5-992f-45d1-9369-f22fcd6dc377 req-734b4996-106c-40e3-8c41-a9dd1d8f7718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea3faa4-e611-4c8f-9024-43c80a9420e0", "name": "network-vif-plugged", "status": "completed", "tag": "b97ed0d0-05cf-438c-a42e-f42926f99642"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:59.880031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:59.903784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4afdb7b5-992f-45d1-9369-f22fcd6dc377 req-734b4996-106c-40e3-8c41-a9dd1d8f7718 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:59.904542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4afdb7b5-992f-45d1-9369-f22fcd6dc377 req-734b4996-106c-40e3-8c41-a9dd1d8f7718 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:59.940568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4afdb7b5-992f-45d1-9369-f22fcd6dc377 req-734b4996-106c-40e3-8c41-a9dd1d8f7718 service nova] Creating event network-vif-plugged:b97ed0d0-05cf-438c-a42e-f42926f99642 for instance fea3faa4-e611-4c8f-9024-43c80a9420e0 on n-h2-848886-16 Jul 26 05:04:59.956842 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4afdb7b5-992f-45d1-9369-f22fcd6dc377 req-734b4996-106c-40e3-8c41-a9dd1d8f7718 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092245 Jul 26 05:04:59.957770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3227/6406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:00.675823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:00.678175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:00.708543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.709263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.710666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.712601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.854723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:00.869811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa5ef193-8446-40f3-ad32-0e54f77ffa9b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1299 microversion: 2.1 time: 0.200393 Jul 26 05:05:00.874759 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3180/6407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:00 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:01.895722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:01.896445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:01.911476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:01.916712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:01.917187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:01.917999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:01.918473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.167456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:02.186606 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c82c5fd6-f450-4164-9cd7-440048bcd0f4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1472 microversion: 2.1 time: 0.295218 Jul 26 05:05:02.190392 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3228/6408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:01 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:02.215627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:02.216806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:02.232405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.233109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.234083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.234695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.397798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:02.405511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-28ca3fc1-e4e4-49ab-860d-982ac6c2f3b0 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1472 microversion: 2.1 time: 0.193615 Jul 26 05:05:02.410215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3181/6409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:02 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:02.429553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:02.431385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:02.442238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.448255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.449308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.449922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.670542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-64361913-8d5d-4aae-8cbd-7bebe4d9acc7 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1625 microversion: 2.1 time: 0.244714 Jul 26 05:05:02.671359 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3229/6410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:02 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1625 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:02.693435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:02.697221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:02.709185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.709643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:02.710449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:02.710882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:03.201215 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d405034-d536-40cb-9f85-68a46849a8f3 tempest-TestSecurityGroupsBasicOps-744742488 tempest-TestSecurityGroupsBasicOps-744742488-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1913 microversion: 2.1 time: 0.513005 Jul 26 05:05:03.202448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3182/6411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:02 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1913 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:03.406580 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:03.407091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:03.419292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:03.428461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:03.432239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:03.433731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:03.502836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:03.684033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be74c0ec-bdf4-4502-8a2a-1e6da402772b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 204 len: 0 microversion: 2.1 time: 0.281104 Jul 26 05:05:03.685319 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3230/6412] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:03 2022] DELETE /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:05:03.693936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:03.695108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:03.712669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:03.713124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:03.713912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:03.714382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:03.873363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:03.886125 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7952159c-5b75-4dc1-8b28-40e7dab369f1 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1478 microversion: 2.1 time: 0.192766 Jul 26 05:05:03.886818 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3183/6413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:03 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1478 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:04.920684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:04.923101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:04.948033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:04.951342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:04.952964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:04.955384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:05.385485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:05.400863 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33b2519b-ea1c-4700-b84f-7e9e67debacb tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1478 microversion: 2.1 time: 0.491534 Jul 26 05:05:05.401468 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3231/6414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:04 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1478 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:05.847945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-98512795", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "4fb860c0-be57-4b65-bc27-ad5300bbfd2d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1982932695", "security_groups": [{"name": "tempest-secgroup-smoke-2113611332"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:06.118044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] validate_networks() for [('4fb860c0-be57-4b65-bc27-ad5300bbfd2d', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:05:06.434298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:06.434940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:06.441431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:06.441905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:06.449956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:06.450497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:06.782260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:06.792430 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ae42fb3a-4372-4bf8-afb5-a014ce773c84 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 200 len: 1478 microversion: 2.1 time: 0.372411 Jul 26 05:05:06.800713 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3232/6415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:06 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 1478 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:06.806306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-54b3db72-8f70-4f2f-8cf0-e820f53439a4 req-8a1ebbde-fc52-4359-81ce-de4710b3cb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea3faa4-e611-4c8f-9024-43c80a9420e0", "name": "network-vif-deleted", "tag": "b97ed0d0-05cf-438c-a42e-f42926f99642"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:06.829493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54b3db72-8f70-4f2f-8cf0-e820f53439a4 req-8a1ebbde-fc52-4359-81ce-de4710b3cb80 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:06.830248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-54b3db72-8f70-4f2f-8cf0-e820f53439a4 req-8a1ebbde-fc52-4359-81ce-de4710b3cb80 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:06.856580 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-54b3db72-8f70-4f2f-8cf0-e820f53439a4 req-8a1ebbde-fc52-4359-81ce-de4710b3cb80 service nova] Creating event network-vif-deleted:b97ed0d0-05cf-438c-a42e-f42926f99642 for instance fea3faa4-e611-4c8f-9024-43c80a9420e0 on n-h2-848886-16 Jul 26 05:05:06.876095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-54b3db72-8f70-4f2f-8cf0-e820f53439a4 req-8a1ebbde-fc52-4359-81ce-de4710b3cb80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073916 Jul 26 05:05:06.876976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3233/6416] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:07.326762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:05:07.327410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:05:07.327645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:05:07.328055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:05:07.328464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:05:07.341344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:07.341802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:07.342631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:07.343071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:07.389767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:05:07.402537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:05:07.444022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:05:07.447505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:05:07.568401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8494b61b-a427-42ae-89c4-312ec5c2374b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.724577 Jul 26 05:05:07.571365 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3184/6417] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:05:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:05:07.584360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44183815-2359-49bb-b434-1113ae55c6c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:07.586651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44183815-2359-49bb-b434-1113ae55c6c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:07.817437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:07.818480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: fea3faa4-e611-4c8f-9024-43c80a9420e0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:07.830062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:07.830550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:07.831337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:07.831768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:07.858504 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] HTTP exception thrown: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Request method failure captured: Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 HTTP/1.1 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33WU0MO44W514KAJcLR65Dg1Vy74_Ys0CippPdSgYGDnzygzco1qiQ6LG6Ph1-zzeh4k-z4GAbJvV4B2s8Ztopv3hNe-R6BVBL-k-MmqWkDr2hU76iMmpfAhB-tOuukudghvMjk-Au--biqi4vK73noTYqCc50IUEVgZbsn_7JJVgHY Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4fe39ac42b974b9e87e8e17d83a90f7a Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4fe39ac42b974b9e87e8e17d83a90f7a Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestSecurityGroupsBasicOps-255744159-project Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dcb2fab3cef4ce6b2579f042d02aefc Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestSecurityGroupsBasicOps-255744159-project Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'fea3faa4-e611-4c8f-9024-43c80a9420e0'} Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:07.860758 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. Jul 26 05:05:07.864218 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:07.887491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Returning 404 to user: Instance fea3faa4-e611-4c8f-9024-43c80a9420e0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:07.888665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cccf2616-eebe-4beb-81ec-caf90d5e107e tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0" status: 404 len: 111 microversion: 2.1 time: 0.075876 Jul 26 05:05:07.889845 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3185/6418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:07 2022] GET /compute/v2.1/servers/fea3faa4-e611-4c8f-9024-43c80a9420e0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:05:07.960302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-44183815-2359-49bb-b434-1113ae55c6c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:07.974974 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44183815-2359-49bb-b434-1113ae55c6c4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1265 microversion: 2.1 time: 0.397621 Jul 26 05:05:07.978280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3234/6419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:07 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1265 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:08.998060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:08.999633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:09.034017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:09.035433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:09.036490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:09.038474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:09.539682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:09.584006 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3ba931b-31ac-41bc-9bd4-ee946be714f0 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1269 microversion: 2.1 time: 0.590345 Jul 26 05:05:09.598416 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3186/6420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:08 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1269 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:10.621320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:10.622420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:10.656984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:10.657773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:10.658703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:10.659172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:11.127225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:11.140146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77304b0c-5541-47cc-8f0d-19b62e98eccf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1335 microversion: 2.1 time: 0.523764 Jul 26 05:05:11.150760 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3235/6421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:10 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1335 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:12.174489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:12.181814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:12.197167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:12.221788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:12.226047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:12.228651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:12.590187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:12.609476 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65b13223-00ef-4b2a-aff2-1b245b12381a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1323 microversion: 2.1 time: 0.439966 Jul 26 05:05:12.617422 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3187/6422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:12 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:13.637483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:13.651530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:13.689904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:13.690501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:13.691387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:13.691845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:13.922233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:13.930992 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-989657df-e633-4902-8aa0-75282ecd6947 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1323 microversion: 2.1 time: 0.297569 Jul 26 05:05:13.950593 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3236/6423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:13 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1323 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:14.955518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:14.956725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:14.973290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:14.973999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:14.976435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:14.977473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.354459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:15.356710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:15.388549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.389017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.389827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.392331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.434448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:15.451382 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad53f9be-5027-455c-b314-ef382b1784f2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.499957 Jul 26 05:05:15.452224 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3188/6424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:14 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:15.621633 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfe0e27f-55b0-4b78-bf5e-d5eb37716a69 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1/action" status: 200 len: 24573 microversion: 2.1 time: 0.272411 Jul 26 05:05:15.639542 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3237/6425] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:05:15 2022] POST /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1/action => generated 24573 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:05:16.477971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:16.479339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:16.518239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:16.522560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:16.525074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:16.528899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.150499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-075701f5-5d02-4ba2-b280-d180ed5a31b5 req-e707ad80-3869-4756-a0ef-a7c1adb33421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:17.173982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-075701f5-5d02-4ba2-b280-d180ed5a31b5 req-e707ad80-3869-4756-a0ef-a7c1adb33421 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.177373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-075701f5-5d02-4ba2-b280-d180ed5a31b5 req-e707ad80-3869-4756-a0ef-a7c1adb33421 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.214094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-075701f5-5d02-4ba2-b280-d180ed5a31b5 req-e707ad80-3869-4756-a0ef-a7c1adb33421 service nova] Creating event network-changed:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:05:17.238314 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-075701f5-5d02-4ba2-b280-d180ed5a31b5 req-e707ad80-3869-4756-a0ef-a7c1adb33421 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092979 Jul 26 05:05:17.249079 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3238/6426] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:05:17.343734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:17.363738 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68292dd8-4c02-47cc-8856-e49b40338b40 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.889182 Jul 26 05:05:17.365841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3189/6427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:16 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:17.980437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:17.985028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1227098073", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035241856", "security_groups": [{"name": "tempest-secgroup-smoke-825398454"}], "block_device_mapping_v2": [{"uuid": "3ea6a46b-c2c3-4c5d-a3ec-44a4a870ddd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62b3158f-720a-47cc-83ae-c0a67ac51f57"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:18.390843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:18.391470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:18.403387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:18.406445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:18.411116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:18.412114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:18.413492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:18.414335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:18.693414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] validate_networks() for [('62b3158f-720a-47cc-83ae-c0a67ac51f57', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:05:18.706650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:18.728566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b17aa09e-62dd-472a-bb39-9785e3e4b764 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.337841 Jul 26 05:05:18.730287 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3190/6428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:18 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:19.687496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:05:19.688259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:05:19.689023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:05:19.689570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:05:19.690104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:05:19.701692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:19.703423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:19.704607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:19.705500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:19.734504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:05:19.750319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:19.751012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:19.755857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Getting quotas for user 44bbee74a3194f88a8f73f59fa79203f and project 5345427623634a379b03773966a8ddc0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:05:19.776182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:19.781195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:19.783160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:19.784344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:19.900387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:05:19.904237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ea6a46b-c2c3-4c5d-a3ec-44a4a870ddd8',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:05:20.169819 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7891a0b3-da53-461d-9ca8-d1e44d05084e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.190562 Jul 26 05:05:20.181232 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3239/6429] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:05:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:05:20.187624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73de702e-a8b5-4f4c-858b-4ce53fd71a9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:20.188773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73de702e-a8b5-4f4c-858b-4ce53fd71a9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:20.337813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73de702e-a8b5-4f4c-858b-4ce53fd71a9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:20.346680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73de702e-a8b5-4f4c-858b-4ce53fd71a9d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1095 microversion: 2.1 time: 0.164001 Jul 26 05:05:20.369845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3240/6430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:20 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1095 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:20.448733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:20.470799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7d362c7-0991-40e6-b4c6-2aa6699e27d8 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.722364 Jul 26 05:05:20.472551 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3191/6431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:19 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:21.379498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:21.380171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:21.396343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.397534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.398792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.399679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.497732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:21.499008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:21.521234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.522276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.527107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.527763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.857336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:21.869516 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-804872f8-a536-483e-a3ee-63abe72dbc7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.379355 Jul 26 05:05:21.873093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3192/6432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:21 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:22.092457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:22.102029 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-06de320f-840a-4b7d-bd97-ed25c11d5614 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1193 microversion: 2.1 time: 0.730416 Jul 26 05:05:22.109741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3241/6433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:21 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1193 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:22.780721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:22.781273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:22.788762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1a5038b7-beeb-405d-9948-781cdeaa8762 req-0d64c899-ce45-4a72-a9fb-e07f4c4960f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094cccd6-007a-4900-bd6e-3225b90f2a37", "tag": "570a43ee-b733-4ccc-a43f-8b8181b136b0"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:22.832257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.838104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.840468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.841935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1a5038b7-beeb-405d-9948-781cdeaa8762 req-0d64c899-ce45-4a72-a9fb-e07f4c4960f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.843496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1a5038b7-beeb-405d-9948-781cdeaa8762 req-0d64c899-ce45-4a72-a9fb-e07f4c4960f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.845302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.894188 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1a5038b7-beeb-405d-9948-781cdeaa8762 req-0d64c899-ce45-4a72-a9fb-e07f4c4960f6 service nova] Creating event network-changed:570a43ee-b733-4ccc-a43f-8b8181b136b0 for instance 094cccd6-007a-4900-bd6e-3225b90f2a37 on n-h1-848886-16 Jul 26 05:05:22.895123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:22.912070 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1a5038b7-beeb-405d-9948-781cdeaa8762 req-0d64c899-ce45-4a72-a9fb-e07f4c4960f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125888 Jul 26 05:05:22.915183 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3242/6434] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:22.931631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:22.935910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:22.967821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.969059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.970965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.973288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.037082 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd433edc-f430-4fb9-81cf-3435da39805a tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "DELETE /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 204 len: 0 microversion: 2.1 time: 0.262483 Jul 26 05:05:23.038842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3193/6435] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:22 2022] DELETE /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:05:23.074884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:23.077030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:23.097997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.101187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.107693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.108334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.136791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:23.395757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:23.411115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d4f38d6e-aabf-482a-81b0-3d15b19b3bb8 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1766 microversion: 2.1 time: 0.365837 Jul 26 05:05:23.412500 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3194/6436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:23 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1766 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:23.426995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:23.427552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:23.437555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.438221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.439265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.439995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.510289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:23.527173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:23.527344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-270c9d1f-99d8-4236-b03f-1609cb2e7ad1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.608386 Jul 26 05:05:23.527938 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3243/6437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:22 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:23.540035 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22fa8677-8edd-44c4-9a82-10ff34a2b16e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1211 microversion: 2.1 time: 0.124312 Jul 26 05:05:23.540562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3195/6438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:23 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:23.958893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-11751a29-96c6-4b3c-82c8-0ee51ac82e5f req-f19213ba-f318-445d-97f0-44c210789828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "name": "network-vif-plugged", "status": "completed", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:23.984246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-11751a29-96c6-4b3c-82c8-0ee51ac82e5f req-f19213ba-f318-445d-97f0-44c210789828 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.987436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-11751a29-96c6-4b3c-82c8-0ee51ac82e5f req-f19213ba-f318-445d-97f0-44c210789828 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.018778 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-11751a29-96c6-4b3c-82c8-0ee51ac82e5f req-f19213ba-f318-445d-97f0-44c210789828 service nova] Creating event network-vif-plugged:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:05:24.032717 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-11751a29-96c6-4b3c-82c8-0ee51ac82e5f req-f19213ba-f318-445d-97f0-44c210789828 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075737 Jul 26 05:05:24.034626 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3244/6439] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:24.435988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:24.437414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:24.468680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.472830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.476508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.477471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.556976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:24.559873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:24.580762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.582132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.589378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.604926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.609939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:25.174975 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.188890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4cc8c542-b05f-4253-99b5-4bc18351ec6d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.641080 Jul 26 05:05:25.191069 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3245/6440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:24 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:25.198418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:25.199755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:25.216427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:25.217415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:25.225188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:25.226142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:25.399424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.411500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-48e135c7-7fea-48fc-bea3-2f5da796490b tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1766 microversion: 2.1 time: 0.981585 Jul 26 05:05:25.413027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3196/6441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:24 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1766 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:25.805798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.816035 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-182b4ece-6414-417d-915c-90e3eb5504d7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1278 microversion: 2.1 time: 0.623394 Jul 26 05:05:25.819770 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3246/6442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:25 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:26.213984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.214760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.233657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.234128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.234996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.235445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.348256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-852238f7-4f93-4d8d-8ae5-1dde3c6709b8 req-3d30d2c3-1f70-4a79-a945-8dedbe1b0af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094cccd6-007a-4900-bd6e-3225b90f2a37", "name": "network-vif-deleted", "tag": "570a43ee-b733-4ccc-a43f-8b8181b136b0"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:26.409704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-852238f7-4f93-4d8d-8ae5-1dde3c6709b8 req-3d30d2c3-1f70-4a79-a945-8dedbe1b0af1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.410603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-852238f7-4f93-4d8d-8ae5-1dde3c6709b8 req-3d30d2c3-1f70-4a79-a945-8dedbe1b0af1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.447417 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-852238f7-4f93-4d8d-8ae5-1dde3c6709b8 req-3d30d2c3-1f70-4a79-a945-8dedbe1b0af1 service nova] Creating event network-vif-deleted:570a43ee-b733-4ccc-a43f-8b8181b136b0 for instance 094cccd6-007a-4900-bd6e-3225b90f2a37 on n-h1-848886-16 Jul 26 05:05:26.453366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-852238f7-4f93-4d8d-8ae5-1dde3c6709b8 req-3d30d2c3-1f70-4a79-a945-8dedbe1b0af1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108685 Jul 26 05:05:26.454978 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3247/6443] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:26.463838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.467174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.492626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.493162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.506026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.506726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.768882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dcb2fab3cef4ce6b2579f042d02aefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe39ac42b974b9e87e8e17d83a90f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.779227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04ced228-384c-423d-ad0c-5c95061302a4 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 200 len: 1378 microversion: 2.1 time: 0.322188 Jul 26 05:05:26.779827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3248/6444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:26 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 1378 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:26.805852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-63be879f-5605-4bda-82b9-a80f4c5e4ccc req-2d6725d6-37dc-41f6-96cb-d5ce0d2848c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7732d9c0-674a-4264-af50-2fc1ae2774ec", "tag": "b14c2cbc-a8b8-4d6d-aa34-d171747cea17"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:26.838263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-63be879f-5605-4bda-82b9-a80f4c5e4ccc req-2d6725d6-37dc-41f6-96cb-d5ce0d2848c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.838733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-63be879f-5605-4bda-82b9-a80f4c5e4ccc req-2d6725d6-37dc-41f6-96cb-d5ce0d2848c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.855785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-63be879f-5605-4bda-82b9-a80f4c5e4ccc req-2d6725d6-37dc-41f6-96cb-d5ce0d2848c9 service nova] Creating event network-changed:b14c2cbc-a8b8-4d6d-aa34-d171747cea17 for instance 7732d9c0-674a-4264-af50-2fc1ae2774ec on n-h1-848886-16 Jul 26 05:05:26.863101 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-63be879f-5605-4bda-82b9-a80f4c5e4ccc req-2d6725d6-37dc-41f6-96cb-d5ce0d2848c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072926 Jul 26 05:05:26.864812 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3249/6445] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:26.873182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.874334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.885446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.886857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.887984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.888594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.958946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.997301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ced0cf82-e22e-4f08-8f7f-261111552e70 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1391 microversion: 2.1 time: 0.787656 Jul 26 05:05:26.998477 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3197/6446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:26 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1391 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:27.810776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:27.812621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] [instance: 094cccd6-007a-4900-bd6e-3225b90f2a37] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:27.827586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:27.836512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.837817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:27.840065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.841017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:27.892666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] HTTP exception thrown: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Request method failure captured: Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 HTTP/1.1 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33WU0MO44W514KAJcLR65Dg1Vy74_Ys0CippPdSgYGDnzygzco1qiQ6LG6Ph1-zzeh4k-z4GAbJvV4B2s8Ztopv3hNe-R6BVBL-k-MmqWkDr2hU76iMmpfAhB-tOuukudghvMjk-Au--biqi4vK73noTYqCc50IUEVgZbsn_7JJVgHY Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 4fe39ac42b974b9e87e8e17d83a90f7a Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fe39ac42b974b9e87e8e17d83a90f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 4fe39ac42b974b9e87e8e17d83a90f7a Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-255744159 Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestSecurityGroupsBasicOps-255744159-project Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3dcb2fab3cef4ce6b2579f042d02aefc Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestSecurityGroupsBasicOps-255744159-project Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '094cccd6-007a-4900-bd6e-3225b90f2a37'} Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:27.896841 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Returning 404 to user: Instance 094cccd6-007a-4900-bd6e-3225b90f2a37 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:27.901847 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ccc2439e-ccdd-4db8-b794-44d2f6489758 tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37" status: 404 len: 111 microversion: 2.1 time: 0.096658 Jul 26 05:05:27.904904 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3198/6447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:27 2022] GET /compute/v2.1/servers/094cccd6-007a-4900-bd6e-3225b90f2a37 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:05:28.023842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.026786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:28.027618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:28.039493 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-557ec172-11a3-484b-a886-ec74a4865b50 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1278 microversion: 2.1 time: 1.170207 Jul 26 05:05:28.040524 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3250/6448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:26 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1278 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:28.042863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:28.043324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:28.044127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:28.044577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:28.515738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.531744 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc658109-e12e-4bcf-9323-c42ffddbc421 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1563 microversion: 2.1 time: 0.511428 Jul 26 05:05:28.536599 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3199/6449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:28 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1563 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:28.564048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:28.565221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:28.576998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:28.577730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:28.578877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:28.579885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.065531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:29.066805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:29.080058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.083640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.085678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.090388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.120581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.129961 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-192ffff5-66f0-41a0-b898-dca56396e36f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1563 microversion: 2.1 time: 0.572466 Jul 26 05:05:29.133578 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3251/6450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:28 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1563 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:29.966830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.983381 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6e2b9e3b-6a5f-4c32-a80d-e86b586e1cb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1278 microversion: 2.1 time: 0.920372 Jul 26 05:05:29.998707 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3200/6451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:29 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1278 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:31.020003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:31.022672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:31.030505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:31.034372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:31.038517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:31.052348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:31.054494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:31.054610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:31.055926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:31.056615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-662443e3-5f7e-4c47-95d6-6418b50d9860 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: .version_select at 0x7f38b490b700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-28917543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkrUGB1AS446TD51wj897JbAQyq4yJeWuNOg2AR+7D2mrO5BbypTi6n+C45QK7jeqoo0AvyRijq3gcpnzlV3rmOPxq0KVHacOLb0J8jkRKVxiPh+7XjZ6ajIozTzxpzmw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:31.090478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-662443e3-5f7e-4c47-95d6-6418b50d9860 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:05:31.105581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-662443e3-5f7e-4c47-95d6-6418b50d9860 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:05:31.167504 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-662443e3-5f7e-4c47-95d6-6418b50d9860 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.117324 Jul 26 05:05:31.168018 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3201/6452] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:05:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:05:31.633281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:31.649469 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b4d3994-aff6-4551-9a5d-10a3e270f881 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1278 microversion: 2.1 time: 0.635869 Jul 26 05:05:31.650112 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3252/6453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:31 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1278 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:32.672939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:32.673637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:32.683843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:32.684712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:32.686120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:32.687176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:33.174177 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:33.187984 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab4db338-fb1c-4d8b-9220-90d37262f8fa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.518812 Jul 26 05:05:33.188831 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3202/6454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:32 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:34.216003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:34.216631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:34.232760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.239795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.241819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.243781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.992980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1304184297", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "570a0e49-f382-43c6-b30f-7fef13113ae1"}], "key_name": "tempest-TestNetworkBasicOps-28917543", "security_groups": [{"name": "tempest-secgroup-smoke-1674105624"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:35.118712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] validate_networks() for [('570a0e49-f382-43c6-b30f-7fef13113ae1', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:05:35.196564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:35.211943 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e578041-807a-4128-bb24-a7ddc181e005 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 1.000746 Jul 26 05:05:35.212555 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3253/6455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:34 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:35.992493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:35.993152 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:36.005470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.006530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.007372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.007816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.295718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:36.306094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e80c894d-76bb-45b3-bef4-28f8155c0a4a tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1563 microversion: 2.1 time: 0.317518 Jul 26 05:05:36.310901 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3254/6456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:35 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1563 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:36.320473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-116fe47f-95d3-436c-b47f-681e23ee7772 req-111ca15e-393c-4372-b100-c94aa9b2881b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:36.340964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-116fe47f-95d3-436c-b47f-681e23ee7772 req-111ca15e-393c-4372-b100-c94aa9b2881b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.341439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-116fe47f-95d3-436c-b47f-681e23ee7772 req-111ca15e-393c-4372-b100-c94aa9b2881b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.363482 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-116fe47f-95d3-436c-b47f-681e23ee7772 req-111ca15e-393c-4372-b100-c94aa9b2881b service nova] Creating event network-changed:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:05:36.384110 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-116fe47f-95d3-436c-b47f-681e23ee7772 req-111ca15e-393c-4372-b100-c94aa9b2881b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071873 Jul 26 05:05:36.385267 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3255/6457] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:36.390716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:36.391681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:36.406504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.407668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.408654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.409977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.651783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:05:36.652304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:05:36.652689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:05:36.653106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:05:36.653527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:05:36.670635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.671123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.676665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.677495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.739465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:05:36.759028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:05:36.769337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:36.783776 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3696148e-9095-4c2b-b149-bd9871f432e7 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.397073 Jul 26 05:05:36.784600 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3256/6458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:36 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:36.789889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:05:36.797611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:05:36.940997 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02fdf676-67aa-4e45-b18a-bd2d27eede40 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.952835 Jul 26 05:05:36.941673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3203/6459] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:05:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:05:36.953740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e06a427d-81ae-4990-b186-82f7b1ba3a31 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:36.955252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e06a427d-81ae-4990-b186-82f7b1ba3a31 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:37.361537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e06a427d-81ae-4990-b186-82f7b1ba3a31 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:37.371033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e06a427d-81ae-4990-b186-82f7b1ba3a31 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1247 microversion: 2.1 time: 0.420329 Jul 26 05:05:37.373420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3257/6460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:36 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1247 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:37.807956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:37.809135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:37.825987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:37.827131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:37.829535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:37.831007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:38.180669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:38.195614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3d389f8-9466-4bf3-859a-69c76a6665f1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.392731 Jul 26 05:05:38.198095 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3204/6461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:37 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:38.393718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:38.394376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:38.407127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:38.420655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:38.421977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:38.422637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:38.542292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:38.550405 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee6ebedd-6c8d-4659-9e55-4e803bc1a7cd tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1299 microversion: 2.1 time: 0.160589 Jul 26 05:05:38.553811 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3258/6462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:38 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:39.217489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:39.218709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:39.226689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.227396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.228346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.228941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.582225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:39.582876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:39.595042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.595516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.596323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.596781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.679487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:39.689072 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-23341726-a99d-48c1-93bc-7c6c9839f87d tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.475335 Jul 26 05:05:39.703485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:39.704394 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3205/6463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:39 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:39.708415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e7ad69f-63d7-4e08-a7dc-0533da2aa010 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1305 microversion: 2.1 time: 0.137341 Jul 26 05:05:39.709897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3259/6464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:39 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:39.747746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-61a5fcd9-5149-4ad8-aca4-81dcc3f3606f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] Calling method '.version_select at 0x7f38b4859e50>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:39.778019 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-61a5fcd9-5149-4ad8-aca4-81dcc3f3606f tempest-TestSecurityGroupsBasicOps-255744159 tempest-TestSecurityGroupsBasicOps-255744159-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-106058943" status: 202 len: 0 microversion: 2.1 time: 0.039870 Jul 26 05:05:39.779143 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3206/6465] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:05:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-106058943 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:05:40.712513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:40.714179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:40.740261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:40.741640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:40.745165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.745703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:40.747234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.749086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:40.754215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.756294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:40.757132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.757586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:41.040585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:41.049118 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4b0c939-a170-4484-9db5-4d6c2844f11a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.341827 Jul 26 05:05:41.050416 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3260/6466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:40 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:41.684500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-64a8b2ea-cdd5-4bbf-9700-7346a0b29805 req-bd6d1d67-42b5-44ac-98cb-8eaea929727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7732d9c0-674a-4264-af50-2fc1ae2774ec", "name": "network-vif-plugged", "status": "completed", "tag": "b14c2cbc-a8b8-4d6d-aa34-d171747cea17"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:41.710650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-64a8b2ea-cdd5-4bbf-9700-7346a0b29805 req-bd6d1d67-42b5-44ac-98cb-8eaea929727c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:41.711367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-64a8b2ea-cdd5-4bbf-9700-7346a0b29805 req-bd6d1d67-42b5-44ac-98cb-8eaea929727c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:41.746583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:41.766938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-64a8b2ea-cdd5-4bbf-9700-7346a0b29805 req-bd6d1d67-42b5-44ac-98cb-8eaea929727c service nova] Creating event network-vif-plugged:b14c2cbc-a8b8-4d6d-aa34-d171747cea17 for instance 7732d9c0-674a-4264-af50-2fc1ae2774ec on n-h1-848886-16 Jul 26 05:05:41.771942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-182d82b0-154f-43b2-92db-f50ebadc7764 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 1.035861 Jul 26 05:05:41.772553 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3207/6467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:40 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:41.774190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-64a8b2ea-cdd5-4bbf-9700-7346a0b29805 req-bd6d1d67-42b5-44ac-98cb-8eaea929727c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094117 Jul 26 05:05:41.775828 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3261/6468] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:42.072825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:42.073467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:42.087517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:42.088077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:42.088985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:42.089539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:42.442487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fe8268bf-5758-4a30-8633-af83343cd48e req-5b3a8579-49bf-49d5-8d30-12bad24d5197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4bd7474-2141-4ba9-a29f-7fb687aa45c1", "tag": "6688bbfc-5092-4943-89aa-a16df5e2264a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:42.468993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe8268bf-5758-4a30-8633-af83343cd48e req-5b3a8579-49bf-49d5-8d30-12bad24d5197 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:42.469538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fe8268bf-5758-4a30-8633-af83343cd48e req-5b3a8579-49bf-49d5-8d30-12bad24d5197 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:42.489904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fe8268bf-5758-4a30-8633-af83343cd48e req-5b3a8579-49bf-49d5-8d30-12bad24d5197 service nova] Creating event network-changed:6688bbfc-5092-4943-89aa-a16df5e2264a for instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 on n-h2-848886-16 Jul 26 05:05:42.495544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:42.512223 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-00cfeea3-5754-4cd7-be30-c8a604ba2472 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1266 microversion: 2.1 time: 0.443956 Jul 26 05:05:42.519796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fe8268bf-5758-4a30-8633-af83343cd48e req-5b3a8579-49bf-49d5-8d30-12bad24d5197 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082202 Jul 26 05:05:42.520305 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3208/6469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:42 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:42.522060 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3262/6470] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:42.796005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:42.797536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:42.840601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:42.841313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:42.843903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:42.846920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.130045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:43.146764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4213aca9-7639-441c-8097-83f25bac8333 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 0.354464 Jul 26 05:05:43.149638 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3209/6471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:42 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:43.544920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:43.546297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:43.561932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.562543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.563365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.564056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.873624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:43.885069 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5efa68e-4422-4d48-aa66-efcc812e8300 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1453 microversion: 2.1 time: 0.344490 Jul 26 05:05:43.885857 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3263/6472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:43 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1453 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:43.910786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:43.913578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:43.924828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.925888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.927074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.928575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:44.182410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:44.183505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:44.190078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:44.190602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:44.191413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:44.191872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:44.390130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:44.399542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d8b234b3-0a28-4ca9-8c95-12c731fb8517 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 0.230927 Jul 26 05:05:44.400700 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3264/6473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:44 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:44.534934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:44.546056 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-47a65d54-41ab-426e-9e0d-3573e78a3ed5 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1453 microversion: 2.1 time: 0.640460 Jul 26 05:05:44.573292 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3210/6474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:43 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1453 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:45.435924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:45.437174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:45.447801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.449557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:45.450851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.452242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:46.528721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:46.538200 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-532ae759-5fea-4c9f-b406-651a470706a1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 1.107779 Jul 26 05:05:46.539019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3265/6475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:45 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:47.560940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:47.562373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:47.576640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:47.577655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:47.580711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.584913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:47.586109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.586802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:47.971837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:47.982105 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90ce5ffd-ba91-4c99-97f6-152360ef031c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 0.426414 Jul 26 05:05:47.983965 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3211/6476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:47 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:48.595148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:48.601021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c36762d7-fc18-4dcf-8b63-febeba948ab4 req-824c47a8-2e27-469c-80ed-cd9951a5fea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4bd7474-2141-4ba9-a29f-7fb687aa45c1", "name": "network-vif-plugged", "status": "completed", "tag": "6688bbfc-5092-4943-89aa-a16df5e2264a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:48.626874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c36762d7-fc18-4dcf-8b63-febeba948ab4 req-824c47a8-2e27-469c-80ed-cd9951a5fea3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:48.636155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c36762d7-fc18-4dcf-8b63-febeba948ab4 req-824c47a8-2e27-469c-80ed-cd9951a5fea3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:48.640812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:48.658814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c36762d7-fc18-4dcf-8b63-febeba948ab4 req-824c47a8-2e27-469c-80ed-cd9951a5fea3 service nova] Creating event network-vif-plugged:6688bbfc-5092-4943-89aa-a16df5e2264a for instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 on n-h2-848886-16 Jul 26 05:05:48.673446 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c36762d7-fc18-4dcf-8b63-febeba948ab4 req-824c47a8-2e27-469c-80ed-cd9951a5fea3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078797 Jul 26 05:05:48.687221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3266/6477] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:49.007986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:49.010480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:49.030301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:49.031040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:49.041272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:49.042420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:49.400263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:49.429495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60c5bcf7-2f0c-47b6-8bd5-2d52420eb75d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 0.428154 Jul 26 05:05:49.434256 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3212/6478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:48 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:50.152403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8059def3-744d-477a-850e-455340856288 req-59d7a9de-f0d1-458e-a856-4a80b6040a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7732d9c0-674a-4264-af50-2fc1ae2774ec", "tag": "b14c2cbc-a8b8-4d6d-aa34-d171747cea17"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:50.164212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8059def3-744d-477a-850e-455340856288 req-59d7a9de-f0d1-458e-a856-4a80b6040a71 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.164683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8059def3-744d-477a-850e-455340856288 req-59d7a9de-f0d1-458e-a856-4a80b6040a71 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.187644 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8059def3-744d-477a-850e-455340856288 req-59d7a9de-f0d1-458e-a856-4a80b6040a71 service nova] Creating event network-changed:b14c2cbc-a8b8-4d6d-aa34-d171747cea17 for instance 7732d9c0-674a-4264-af50-2fc1ae2774ec on n-h1-848886-16 Jul 26 05:05:50.195174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8059def3-744d-477a-850e-455340856288 req-59d7a9de-f0d1-458e-a856-4a80b6040a71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053827 Jul 26 05:05:50.196391 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3267/6479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:50.453110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:50.453731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:50.468797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.469307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.472362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.479725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.935660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:50.948132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f40e307-5c5f-468e-9a2b-dbaa99847fab tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1373 microversion: 2.1 time: 0.497872 Jul 26 05:05:50.950397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3213/6480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:50 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1373 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:51.977418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:51.977841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:51.997161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:51.998654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:52.002278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:52.003063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:52.465430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:52.479061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-eaa0cc46-1b39-48dd-85df-9f0af0e57bc3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1546 microversion: 2.1 time: 0.509546 Jul 26 05:05:52.479685 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3268/6481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:51 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1546 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:52.504403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:52.506634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:52.524037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:52.524488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:52.529393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:52.530099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:52.580571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=100 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:52.906248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:52.978882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9929893c-46aa-4a68-8afa-a27ab6f61acf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1546 microversion: 2.1 time: 0.482720 Jul 26 05:05:52.980094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3214/6482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:52 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1546 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:01.871592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:01.877712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:01.881883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=36 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:01.894436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.899557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.906982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.907855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:02.032312 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-783ee4ac-c77c-4986-aa10-947570acd406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action" status: 200 len: 24570 microversion: 2.1 time: 0.166801 Jul 26 05:06:02.040211 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3269/6483] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:06:01 2022] POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action => generated 24570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:06:06.316076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:06.320851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:06.494052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:06.495015 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:06:06.495015 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 05:06:06.496307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.496833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.497629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.498438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.530456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ad44971-98ca-4977-8944-8b18eb9abd1f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.230391 Jul 26 05:06:06.545362 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3215/6484] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Jul 26 05:06:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:06.687466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-675580558", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "availability_zone": "nova:n-h2-848886-16", "networks": [{"uuid": "b13e5cbc-3c64-4ee2-b7d8-af32df105441"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:06.820429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] validate_networks() for [('b13e5cbc-3c64-4ee2-b7d8-af32df105441', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:06:07.588628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:06:07.589073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:06:07.589568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:06:07.590051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:06:07.590520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:06:07.613277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.613901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.615174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.620962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.669905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Getting quotas for project db60a7adb16e4452bbbe62cbc7392d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:06:07.688562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Getting quotas for user 8890431df90e4ec8b7d4d581af7ee81b and project db60a7adb16e4452bbbe62cbc7392d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:06:07.721468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:06:07.730581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:06:07.876562 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d37696ef-8e30-4645-85a9-840e960c25e4 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195643 Jul 26 05:06:07.885325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3270/6485] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:06:07.890707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c357f532-f261-4718-9536-d37fe5449131 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:07.891384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c357f532-f261-4718-9536-d37fe5449131 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:08.060090 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c357f532-f261-4718-9536-d37fe5449131 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1328 microversion: 2.1 time: 0.174369 Jul 26 05:06:08.073978 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3216/6486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:07 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1328 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:09.087090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:09.088440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:09.118409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.121381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.125075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.130632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.291098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0886085d-094e-4d04-896b-8262a7ee32a9 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1345 microversion: 2.1 time: 0.209807 Jul 26 05:06:09.293904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3271/6487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:09 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:10.314774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:10.315414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:10.329500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.329968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.330862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.331318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.531119 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16a5c2a8-200b-45bb-8aef-7bef7020678b tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1423 microversion: 2.1 time: 0.219633 Jul 26 05:06:10.554812 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3217/6488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:10 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1423 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:11.604859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:11.605455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:11.624723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:11.625114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:11.633818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:11.634689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.001078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f19484a0-0ec6-4ab2-a7d8-ae7903ba1b48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.424914 Jul 26 05:06:12.003827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3272/6489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:11 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:13.030969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:13.031584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:13.041902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.042651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.043380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.043823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.562699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6cdb2bf-8704-454a-b886-6f1bbe3c89cb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.535279 Jul 26 05:06:13.570843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3218/6490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:13 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:14.579022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-798fabc8-14e7-47e6-9d2d-433c17ac0e50 req-d3db8930-d819-4dcc-bd21-843b3101e008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed76dae-b1a2-4209-8051-ddf8ec8d0078", "tag": "c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:14.591694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:14.594605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-798fabc8-14e7-47e6-9d2d-433c17ac0e50 req-d3db8930-d819-4dcc-bd21-843b3101e008 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.595797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:14.596330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-798fabc8-14e7-47e6-9d2d-433c17ac0e50 req-d3db8930-d819-4dcc-bd21-843b3101e008 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.615742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-798fabc8-14e7-47e6-9d2d-433c17ac0e50 req-d3db8930-d819-4dcc-bd21-843b3101e008 service nova] Creating event network-changed:c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c for instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 on n-h2-848886-16 Jul 26 05:06:14.620038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.620507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.621443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.622640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.622860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-798fabc8-14e7-47e6-9d2d-433c17ac0e50 req-d3db8930-d819-4dcc-bd21-843b3101e008 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054260 Jul 26 05:06:14.623984 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3273/6491] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:15.068799 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8932af4-e97a-44c4-a035-f330cd9759af tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.479475 Jul 26 05:06:15.083712 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3219/6492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:14 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:16.094777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:16.095501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:16.110996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.111499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.114963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.116544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.303302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-940b5f9c-d7a2-45b6-829d-3f4aa7de5c48 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.214290 Jul 26 05:06:16.304630 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3274/6493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:16 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:17.327415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:17.328384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:17.337725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:17.345156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.346811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:17.348445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.349065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.054677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:18.079587 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cbc2c107-00b1-450f-81cd-3c3ab4e50f6f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.753985 Jul 26 05:06:18.080491 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3220/6494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:17 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:19.101657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:19.102607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:19.105643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:19.106606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:19.126491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.126972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.127784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.128779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.155591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=36 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:19.281355 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d6695983-85ef-465f-ab75-c934aafb8536 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.184098 Jul 26 05:06:19.282487 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3275/6495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:19 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:20.304641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.305862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.321731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.322574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.323600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.324214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.811679 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-66919aa8-4eac-40b9-9498-4a9c3bad8bb6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.510248 Jul 26 05:06:20.813543 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3221/6496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:21.836786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:21.839078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:21.852949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.853845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.855324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.856004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.164020 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-203cb6ff-50f0-4e42-b054-916a178dd0bc tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.333073 Jul 26 05:06:22.164615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3276/6497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:21 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:22.504083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a6ff6f76-f6bc-472e-818e-75d5123cf52b req-f45abac8-8d67-4a87-a93d-9142cf13b11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed76dae-b1a2-4209-8051-ddf8ec8d0078", "name": "network-vif-plugged", "status": "completed", "tag": "c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:22.522881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a6ff6f76-f6bc-472e-818e-75d5123cf52b req-f45abac8-8d67-4a87-a93d-9142cf13b11d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.523351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a6ff6f76-f6bc-472e-818e-75d5123cf52b req-f45abac8-8d67-4a87-a93d-9142cf13b11d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.552285 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a6ff6f76-f6bc-472e-818e-75d5123cf52b req-f45abac8-8d67-4a87-a93d-9142cf13b11d service nova] Creating event network-vif-plugged:c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c for instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 on n-h2-848886-16 Jul 26 05:06:22.566110 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a6ff6f76-f6bc-472e-818e-75d5123cf52b req-f45abac8-8d67-4a87-a93d-9142cf13b11d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066032 Jul 26 05:06:22.569358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3222/6498] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:23.192752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:23.194416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:23.210119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.210976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.212027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.213153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.632785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-46d48f05-41a5-4e13-b335-6fddc802db7c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1465 microversion: 2.1 time: 0.451498 Jul 26 05:06:23.634092 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3277/6499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:23 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1465 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:24.655383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.656098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.670235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.671009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.672163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.677467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.902488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff263090-ae2d-4ae4-b435-9c97839e23ec tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1651 microversion: 2.1 time: 0.252275 Jul 26 05:06:24.903611 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3223/6500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1651 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:24.923937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.929490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.937899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.938409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.939214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.939670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.167022 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5737a218-954f-49b9-9a25-949ce01e9577 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1651 microversion: 2.1 time: 0.247080 Jul 26 05:06:25.168280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3278/6501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1651 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:25.190361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.191716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.199009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.199472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.200256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.200703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.433070 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-091f3960-700d-406f-addd-62d3820f5c27 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1651 microversion: 2.1 time: 0.247821 Jul 26 05:06:25.433671 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3224/6502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1651 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:25.634510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1908002283", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "availability_zone": "nova:n-h1-848886-16", "networks": [{"uuid": "b13e5cbc-3c64-4ee2-b7d8-af32df105441"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:25.707724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] validate_networks() for [('b13e5cbc-3c64-4ee2-b7d8-af32df105441', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:06:26.935279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:06:26.936488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:06:26.937294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:06:26.938353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:06:26.939025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:06:26.958861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.959382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:26.960212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.960722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:27.019218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Getting quotas for project db60a7adb16e4452bbbe62cbc7392d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:06:27.028621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Getting quotas for user 8890431df90e4ec8b7d4d581af7ee81b and project db60a7adb16e4452bbbe62cbc7392d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:06:27.048370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:06:27.052820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:06:27.164834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f93c948a-ed33-411f-8a9e-2dab6ded5a32 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535376 Jul 26 05:06:27.172023 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3279/6503] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:06:27.184494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4e5ab22d-89c4-4b8d-b000-8ba40e275632 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:27.185798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4e5ab22d-89c4-4b8d-b000-8ba40e275632 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:27.364139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4e5ab22d-89c4-4b8d-b000-8ba40e275632 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1329 microversion: 2.1 time: 0.182834 Jul 26 05:06:27.375600 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3225/6504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:27 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:28.389641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:28.390855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:28.399165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:28.399952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:28.411944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:28.413021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:28.601909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81f61adb-2ba9-45b7-82ae-d3115caeaf5a tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1426 microversion: 2.1 time: 0.216733 Jul 26 05:06:28.603174 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3280/6505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:28 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1426 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:29.430819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.435155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.452263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.453012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.454135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.454753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.491797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:29.630836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.631379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.647464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.647932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.649572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.650114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.745080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93a81759-77ab-493e-9bff-06535d9ef201 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 204 len: 0 microversion: 2.1 time: 0.318358 Jul 26 05:06:29.748778 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3226/6506] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:29 2022] DELETE /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:29.754798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.755390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.779344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.780288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.782266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.783072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:30.100831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:30.114994 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0a514308-53bb-4edd-b8cb-d340e725150c tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1552 microversion: 2.1 time: 0.364388 Jul 26 05:06:30.132360 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3227/6507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:29 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1552 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:30.428831 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-887e9a33-a75e-4741-9ab8-4a8c1646d43e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.802801 Jul 26 05:06:30.445492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3281/6508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:29 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:30.908707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1f488841-05b5-4e03-b88b-7e48d5730ec9 req-a306945a-a73a-4ae8-b31c-206c720f93dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8744cbd5-22ba-4373-b11b-fbf0e054e712", "tag": "c915a5d2-7e68-4539-b5c5-baa514621252"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:30.944833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1f488841-05b5-4e03-b88b-7e48d5730ec9 req-a306945a-a73a-4ae8-b31c-206c720f93dd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:30.945538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1f488841-05b5-4e03-b88b-7e48d5730ec9 req-a306945a-a73a-4ae8-b31c-206c720f93dd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:30.961757 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1f488841-05b5-4e03-b88b-7e48d5730ec9 req-a306945a-a73a-4ae8-b31c-206c720f93dd service nova] Creating event network-changed:c915a5d2-7e68-4539-b5c5-baa514621252 for instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 on n-h1-848886-16 Jul 26 05:06:30.967646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1f488841-05b5-4e03-b88b-7e48d5730ec9 req-a306945a-a73a-4ae8-b31c-206c720f93dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062935 Jul 26 05:06:30.968585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3228/6509] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:31.140368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:31.142503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:31.183778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.184505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.185368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.185824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.458831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:31.458831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:31.465416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.466018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.467092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.467696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.552465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:31.568059 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df4a1d0b-169d-4fa3-9b18-df147a86c5c2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1552 microversion: 2.1 time: 0.431828 Jul 26 05:06:31.568670 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3282/6510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:31 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1552 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:31.975078 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-932706c5-d38c-4255-974d-d6a0209cb8aa tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.525824 Jul 26 05:06:31.976516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3229/6511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:31 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:32.249227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-159c4b72-6237-4a9a-b76c-4a174ad51597 req-9f29148d-3847-4fc1-8e3b-807771807dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4bd7474-2141-4ba9-a29f-7fb687aa45c1", "name": "network-vif-deleted", "tag": "6688bbfc-5092-4943-89aa-a16df5e2264a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:32.283278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:32.293598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-159c4b72-6237-4a9a-b76c-4a174ad51597 req-9f29148d-3847-4fc1-8e3b-807771807dc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.294410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-159c4b72-6237-4a9a-b76c-4a174ad51597 req-9f29148d-3847-4fc1-8e3b-807771807dc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.315572 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-159c4b72-6237-4a9a-b76c-4a174ad51597 req-9f29148d-3847-4fc1-8e3b-807771807dc8 service nova] Creating event network-vif-deleted:6688bbfc-5092-4943-89aa-a16df5e2264a for instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 on n-h2-848886-16 Jul 26 05:06:32.321325 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-159c4b72-6237-4a9a-b76c-4a174ad51597 req-9f29148d-3847-4fc1-8e3b-807771807dc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079770 Jul 26 05:06:32.322869 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3283/6512] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:32.457245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:32.458111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:32.466519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.467187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.468148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.468749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.595357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:32.602292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:32.618370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.619131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.620513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.621182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.690729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.691507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.692165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lazy-loading 'fault' on Instance uuid f4bd7474-2141-4ba9-a29f-7fb687aa45c1 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:32.726261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:32.740542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5379c5a7-03f2-407c-9584-e05a7d28e556 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1681 microversion: 2.1 time: 0.287140 Jul 26 05:06:32.741508 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3230/6513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:32 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1681 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:32.807497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:32.823013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c1cddd7-631b-40bd-b3a5-831084b54fcc tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 200 len: 1337 microversion: 2.1 time: 0.237534 Jul 26 05:06:32.823633 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3284/6514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:32 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 1337 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:32.887198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:32.890699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:32.903893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.904971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.906191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.906965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.969495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed21c9bf-7b80-42a2-b542-755902d74879 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action" status: 200 len: 32643 microversion: 2.1 time: 0.086792 Jul 26 05:06:32.970289 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3231/6515] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:06:32 2022] POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action => generated 32643 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:06:32.998962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:33.000098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:33.007670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.008671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.009623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.010433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.153772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:33.154515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:33.165072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.165429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.166590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.166924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.410456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ed4b8e5-a84b-4c7d-ac7f-54ee21d84a69 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1834 microversion: 2.1 time: 0.261396 Jul 26 05:06:33.411382 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3232/6516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:33 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1834 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:33.441424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:33.444353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:33.451110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.451567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.452355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.452795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.484211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lazy-loading 'flavor' on Instance uuid c4f2ba91-f734-4103-bc08-46b8d3ad95ad {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:33.497473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Going to try to live migrate instance to another host {{(pid=119487) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 05:06:33.513119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:33.704037 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b52aefb4-361f-47ef-a021-31dfd9d60375 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.710835 Jul 26 05:06:33.705842 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3285/6517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:32 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:33.846789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:33.847516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: f4bd7474-2141-4ba9-a29f-7fb687aa45c1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:33.866126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.866625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.867499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.867957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.892483 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] HTTP exception thrown: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Request method failure captured: Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 HTTP/1.1 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33XRvfEnii5y15QNoNoTCIj-LlsokzsjpTkF0rsnf1UA1tDrwpcRdr2vzcB_uOBbtmuiyu4NvKZcuXTMcZ5DWsYER3PeKDpBIwanH7b2fXBTVlZLKHcq4tmLhGFgVFkN0BMs709R7G7TaLtsscT9OfZksi-RoFy-_2zt1GZmba_gZrY Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cf3e349129904b78b0b8f34724d8baee Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'f4bd7474-2141-4ba9-a29f-7fb687aa45c1'} Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:33.894910 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. Jul 26 05:06:33.898900 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:33.915437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Returning 404 to user: Instance f4bd7474-2141-4ba9-a29f-7fb687aa45c1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:33.932850 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-67745268-f3e0-4d4b-8766-3a812ce4f01f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1" status: 404 len: 111 microversion: 2.1 time: 0.089974 Jul 26 05:06:33.937881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3286/6518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:33 2022] GET /compute/v2.1/servers/f4bd7474-2141-4ba9-a29f-7fb687aa45c1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:06:34.303879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aefb2880-5234-43ad-8445-2908f16ac4eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '.version_select at 0x7f38b5f5e9d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:34.358434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aefb2880-5234-43ad-8445-2908f16ac4eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-28917543" status: 202 len: 0 microversion: 2.1 time: 0.073395 Jul 26 05:06:34.378567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3287/6519] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-28917543 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:06:34.727544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:34.729167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:34.744810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:34.747253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:34.750852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:34.751491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:35.115099 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7de4237c-5d9e-4141-8087-4d9dc3183e05 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.386043 Jul 26 05:06:35.115803 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3288/6520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:34 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:36.162058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:36.164034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:36.181639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.182423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.184993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.188396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.664392 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3465420-7173-4764-b9e9-9939ba6a08f7 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.528087 Jul 26 05:06:36.684976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3289/6521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:36 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:36.691218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f7cca346-4b34-48cd-b7c3-f67368595a24 req-10ec27f2-e5f2-4c41-958d-452b8779d0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744cbd5-22ba-4373-b11b-fbf0e054e712", "name": "network-vif-plugged", "status": "completed", "tag": "c915a5d2-7e68-4539-b5c5-baa514621252"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:36.702410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f7cca346-4b34-48cd-b7c3-f67368595a24 req-10ec27f2-e5f2-4c41-958d-452b8779d0c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.703198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f7cca346-4b34-48cd-b7c3-f67368595a24 req-10ec27f2-e5f2-4c41-958d-452b8779d0c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.719623 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f7cca346-4b34-48cd-b7c3-f67368595a24 req-10ec27f2-e5f2-4c41-958d-452b8779d0c1 service nova] Creating event network-vif-plugged:c915a5d2-7e68-4539-b5c5-baa514621252 for instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 on n-h1-848886-16 Jul 26 05:06:36.726554 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f7cca346-4b34-48cd-b7c3-f67368595a24 req-10ec27f2-e5f2-4c41-958d-452b8779d0c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039914 Jul 26 05:06:36.727429 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3290/6522] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:36.939132 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-776b8609-55c5-4a47-809a-d3d23ce52702 tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action" status: 202 len: 0 microversion: 2.1 time: 3.502594 Jul 26 05:06:36.940628 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3233/6523] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:06:33 2022] POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action => generated 0 bytes in 3505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:06:36.952506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:36.953379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:36.968895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.969491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.971120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.976373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:37.003288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:37.041300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:37.175963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:37.184475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1134c815-e9ab-4787-ae4e-ae2a0089933f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.237596 Jul 26 05:06:37.185056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3291/6524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:36 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:37.692877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:37.693857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:37.697216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:37.698384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:37.707634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:37.708682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:37.709969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:37.710777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.208304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:38.208929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:38.229578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.231721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.233345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.235342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.353000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a014cbe-cf84-451d-bbbc-5289d9db09c6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1466 microversion: 2.1 time: 0.666944 Jul 26 05:06:38.366658 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3234/6525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:37 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1466 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:38.563627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:38.564132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:38.571180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.572119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.573081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.573682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.605352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:38.738022 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4f9f9e20-5c86-4cf6-8373-7624e75f9fc2 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 204 len: 0 microversion: 2.1 time: 0.176764 Jul 26 05:06:38.743987 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3235/6526] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:38 2022] DELETE /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:06:38.751784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-27da28de-0722-4881-89f7-eda7c1b122c5 req-b36bc466-380c-4d3c-91c3-8ce039eec287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d479dd-f402-42b1-a3f1-0e453d574cb1", "tag": "c3697091-331d-4117-b731-82f4ddabc5eb"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:38.768367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-27da28de-0722-4881-89f7-eda7c1b122c5 req-b36bc466-380c-4d3c-91c3-8ce039eec287 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.769195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-27da28de-0722-4881-89f7-eda7c1b122c5 req-b36bc466-380c-4d3c-91c3-8ce039eec287 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.791061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-27da28de-0722-4881-89f7-eda7c1b122c5 req-b36bc466-380c-4d3c-91c3-8ce039eec287 service nova] Creating event network-changed:c3697091-331d-4117-b731-82f4ddabc5eb for instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 on n-h1-848886-16 Jul 26 05:06:38.797141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-27da28de-0722-4881-89f7-eda7c1b122c5 req-b36bc466-380c-4d3c-91c3-8ce039eec287 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050131 Jul 26 05:06:38.800102 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3236/6527] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:38.806044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:38.806775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:38.813747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.814287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.816058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:38.816497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:38.833650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:38.846667 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5b677f12-ee4b-4202-93de-bfe5645759b1 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.641913 Jul 26 05:06:38.847475 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3292/6528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:38 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:39.020898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:39.030668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7178e51f-04ee-4132-a157-ec16f5086387 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1670 microversion: 2.1 time: 0.229276 Jul 26 05:06:39.038575 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3237/6529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:38 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:39.379651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:39.380916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:39.388260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.388792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.399888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.400801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.682071 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2da6999-ece1-4089-9781-0ecf085ca3fb tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1651 microversion: 2.1 time: 0.308983 Jul 26 05:06:39.683029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3293/6530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:39 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1651 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:39.706909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:39.707874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:39.721606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.730943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.730943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.730943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.869990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:39.870711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:39.878464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.878996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.879811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.880267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.094200 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73e310ae-40a9-4dc6-a352-d00762361bce tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1651 microversion: 2.1 time: 0.392568 Jul 26 05:06:40.094734 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3238/6531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:39 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1651 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:40.106643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:40.107273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:40.122497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.122497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.122497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.122497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.505164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:40.515554 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22f3ea43-d1ff-432e-acc7-b20a6675db96 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.650342 Jul 26 05:06:40.532687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3294/6532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:39 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:40.538119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:40.539029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:40.547327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.548036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.549746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.550635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.576978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=100 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:40.648745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:40.693334 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5f81cad1-fde5-458d-92ee-785985b05623 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1670 microversion: 2.1 time: 0.597075 Jul 26 05:06:40.696486 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3239/6533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:40 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1670 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:40.935576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27ad8599-7601-4e74-a657-61b774e003d1 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1651 microversion: 2.1 time: 0.401397 Jul 26 05:06:40.950547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3295/6534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:40 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1651 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:40.983779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:40.987086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:41.014269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.014823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.023762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.026032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.099353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:41.278658 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24dc991a-3c44-4d3d-a416-a8aea188fe9f tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 204 len: 0 microversion: 2.1 time: 0.322253 Jul 26 05:06:41.284411 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3240/6535] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:40 2022] DELETE /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:41.287886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:41.288575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:41.303791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.304696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.305503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.305958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.344407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-616e4bca-a3a0-4ef0-a8c9-7f406a46eb94 req-ca8fe971-c2be-4091-b63c-d020983b9680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "name": "network-vif-unplugged", "status": "completed", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:41.367256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-616e4bca-a3a0-4ef0-a8c9-7f406a46eb94 req-ca8fe971-c2be-4091-b63c-d020983b9680 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.371123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-616e4bca-a3a0-4ef0-a8c9-7f406a46eb94 req-ca8fe971-c2be-4091-b63c-d020983b9680 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.395633 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-616e4bca-a3a0-4ef0-a8c9-7f406a46eb94 req-ca8fe971-c2be-4091-b63c-d020983b9680 service nova] Creating event network-vif-unplugged:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:06:41.414512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-616e4bca-a3a0-4ef0-a8c9-7f406a46eb94 req-ca8fe971-c2be-4091-b63c-d020983b9680 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075768 Jul 26 05:06:41.418586 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3241/6536] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:06:41.544958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:41.545667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:41.560114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.560802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.565920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.566442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.945803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f5ad0da-f272-48ef-a096-44b4e2c72019 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1657 microversion: 2.1 time: 0.661563 Jul 26 05:06:41.966407 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3296/6537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:41 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1657 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:41.976205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:41.976844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:41.998172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:42.002199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.005366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:42.006824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.007304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:42.015908 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd8afae5-4f85-479b-ad05-1e98f5ef1328 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.479548 Jul 26 05:06:42.016672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3242/6538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:41 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:42.277131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:42.298005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2c42755e-a285-4193-a0ce-3ab492956712 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 200 len: 1602 microversion: 2.1 time: 0.319589 Jul 26 05:06:42.303199 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3297/6539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:41 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 1602 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:42.974286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:42.974928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:42.995968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.997135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:42.997573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.998143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.038774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:43.039600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:43.054496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.059874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.061146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.065434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.595221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:43.610335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73a4f7cc-a2e1-440a-b28e-529745a152e4 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.575363 Jul 26 05:06:43.615297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3298/6540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:43 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:43.635162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:43.636062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: b7d479dd-f402-42b1-a3f1-0e453d574cb1] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:43.658253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.661367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.662430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.663181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.721140 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] HTTP exception thrown: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Request method failure captured: Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 HTTP/1.1 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33XRvfEnii5y15QNoNoTCIj-LlsokzsjpTkF0rsnf1UA1tDrwpcRdr2vzcB_uOBbtmuiyu4NvKZcuXTMcZ5DWsYER3PeKDpBIwanH7b2fXBTVlZLKHcq4tmLhGFgVFkN0BMs709R7G7TaLtsscT9OfZksi-RoFy-_2zt1GZmba_gZrY Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cf3e349129904b78b0b8f34724d8baee Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b7d479dd-f402-42b1-a3f1-0e453d574cb1'} Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:43.724067 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. Jul 26 05:06:43.728301 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:43.730180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Returning 404 to user: Instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:43.741608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3e165b4a-15a7-4d5c-ba93-dc982bc3a851 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1" status: 404 len: 111 microversion: 2.1 time: 0.124877 Jul 26 05:06:43.746104 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3299/6541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:43 2022] GET /compute/v2.1/servers/b7d479dd-f402-42b1-a3f1-0e453d574cb1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:43.753630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d479dd-f402-42b1-a3f1-0e453d574cb1", "name": "network-vif-deleted", "tag": "c3697091-331d-4117-b731-82f4ddabc5eb"}, {"name": "network-changed", "server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:43.781225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.781958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.823844 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] Creating event network-vif-deleted:c3697091-331d-4117-b731-82f4ddabc5eb for instance b7d479dd-f402-42b1-a3f1-0e453d574cb1 on n-h1-848886-16 Jul 26 05:06:43.824633 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] Creating event network-changed:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:06:43.858943 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-052ce0f8-b03f-4607-85e3-77d89669f877 req-c71a4c75-fc06-44e8-afe7-4c1458920ec5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107263 Jul 26 05:06:43.860128 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3300/6542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:43.898376 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa4ae934-f01f-42ba-95c2-0943582562ed tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 200 len: 1657 microversion: 2.1 time: 0.924710 Jul 26 05:06:43.915632 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3243/6543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:42 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 1657 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:44.269493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c49b4f97-e7d5-4a15-a758-ddef9f0d02ed tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '.version_select at 0x7f38b49119d0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:44.307823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c49b4f97-e7d5-4a15-a758-ddef9f0d02ed tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1942085835" status: 202 len: 0 microversion: 2.1 time: 0.044092 Jul 26 05:06:44.308784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3301/6544] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Jul 26 05:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1942085835 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:06:44.648037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:44.650892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:44.680159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:44.683188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:44.685622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:44.694344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:44.925089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:44.925860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 8744cbd5-22ba-4373-b11b-fbf0e054e712] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:44.940290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:44.941073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:44.942451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:44.943166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:44.967058 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] HTTP exception thrown: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Request method failure captured: Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 HTTP/1.1 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Y-9Fi8DIjNhfZS1EHy-rH5pLhzMRjnyfSEUbwuEMI2z-sbfI9wMXDwXfHwma2DuGzb1DaFS28qqVl1JgwD9M69pMl3vMQD5gPwU3iNZ4xakh9Gf7AVDQlxUEtEUaKIlakHt6qPJEkbArxHh0lMqcFNpr8k6gerkN7eABjv9LXsEj0 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: db60a7adb16e4452bbbe62cbc7392d8f Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestServerMultinode-799469605 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestServerMultinode-799469605 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: db60a7adb16e4452bbbe62cbc7392d8f Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestServerMultinode-799469605 Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestServerMultinode-799469605-project-admin Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8890431df90e4ec8b7d4d581af7ee81b Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestServerMultinode-799469605-project-admin Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8744cbd5-22ba-4373-b11b-fbf0e054e712'} Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:44.969177 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. Jul 26 05:06:44.973428 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:44.975949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Returning 404 to user: Instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:44.977103 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5581ad57-5adc-4ecb-8d5a-c87ebdfa3e9c tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712" status: 404 len: 111 microversion: 2.1 time: 0.056071 Jul 26 05:06:44.978203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3302/6545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:44 2022] GET /compute/v2.1/servers/8744cbd5-22ba-4373-b11b-fbf0e054e712 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:44.993594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:45.000948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:45.013941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.013941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.013941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.013941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.046517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:45.170444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:45.193275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ced78ba7-7c7f-4c14-9753-a48b2024c64e tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 204 len: 0 microversion: 2.1 time: 0.203870 Jul 26 05:06:45.195843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b594bd83-a856-437a-9928-4ae721030433 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.559193 Jul 26 05:06:45.198615 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3303/6546] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:44 2022] DELETE /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:45.210052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3244/6547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:44 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:45.215211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:45.215989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:45.223057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.223740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.224679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.225287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.569720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e371c6a1-3fe4-4dc9-ab73-5379174128ff tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1657 microversion: 2.1 time: 0.364246 Jul 26 05:06:45.571597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3304/6548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:45 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1657 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:45.905315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d75fcc9f-0bcb-4e24-b2a8-030d48e6dfa4 req-b0075a67-da90-4eaa-b796-a7d42ca83a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744cbd5-22ba-4373-b11b-fbf0e054e712", "name": "network-vif-deleted", "tag": "c915a5d2-7e68-4539-b5c5-baa514621252"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:45.933707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d75fcc9f-0bcb-4e24-b2a8-030d48e6dfa4 req-b0075a67-da90-4eaa-b796-a7d42ca83a8a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.934581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d75fcc9f-0bcb-4e24-b2a8-030d48e6dfa4 req-b0075a67-da90-4eaa-b796-a7d42ca83a8a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.965511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d75fcc9f-0bcb-4e24-b2a8-030d48e6dfa4 req-b0075a67-da90-4eaa-b796-a7d42ca83a8a service nova] Creating event network-vif-deleted:c915a5d2-7e68-4539-b5c5-baa514621252 for instance 8744cbd5-22ba-4373-b11b-fbf0e054e712 on n-h1-848886-16 Jul 26 05:06:45.975439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d75fcc9f-0bcb-4e24-b2a8-030d48e6dfa4 req-b0075a67-da90-4eaa-b796-a7d42ca83a8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071613 Jul 26 05:06:45.976886 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3245/6549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:46.224604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:46.225734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:46.233968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.234735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.235520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.236766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.525157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:46.534628 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d77ca49a-b70a-4bc6-8cfa-10d659722226 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.319830 Jul 26 05:06:46.537675 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3305/6550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:46 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:46.593287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:46.594728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:46.605212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.607471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.610061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.610718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:47.111901 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-233e342a-7bb5-4547-a1a1-a77331b137e6 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1657 microversion: 2.1 time: 0.522565 Jul 26 05:06:47.127448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3246/6551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:46 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1657 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:47.596677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:47.597606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:47.624140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:47.625490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:47.630498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:47.631392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.041189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9dc68664-e7dd-4044-91b3-d06a69231f95 req-0e22844d-1c88-4f40-88c3-77d0f6b6f381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed76dae-b1a2-4209-8051-ddf8ec8d0078", "name": "network-vif-deleted", "tag": "c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:48.067826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9dc68664-e7dd-4044-91b3-d06a69231f95 req-0e22844d-1c88-4f40-88c3-77d0f6b6f381 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.068275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9dc68664-e7dd-4044-91b3-d06a69231f95 req-0e22844d-1c88-4f40-88c3-77d0f6b6f381 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.127310 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9dc68664-e7dd-4044-91b3-d06a69231f95 req-0e22844d-1c88-4f40-88c3-77d0f6b6f381 service nova] Creating event network-vif-deleted:c7bfcbb0-f7c0-49eb-b7e1-fbe6c12af82c for instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 on n-h2-848886-16 Jul 26 05:06:48.137600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9dc68664-e7dd-4044-91b3-d06a69231f95 req-0e22844d-1c88-4f40-88c3-77d0f6b6f381 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099761 Jul 26 05:06:48.140053 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3247/6552] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:48.168458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:48.170817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:48.190081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.193795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.195987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.198772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.237219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:48.263980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.265649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.266135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lazy-loading 'fault' on Instance uuid 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:48.347980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:48.362334 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9476310e-4526-4133-bedb-732cd434143c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.773557 Jul 26 05:06:48.363233 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3306/6553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:47 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:48.389828 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0afe915b-5e6f-48d5-a5b2-520b14eca259 tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 200 len: 1455 microversion: 2.1 time: 0.247675 Jul 26 05:06:48.390872 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3248/6554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:48 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 1455 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:48.539790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-20f770f8-f57c-4b6b-801e-17c9be7dc138 req-bf8dc355-ea88-41ca-bfb8-c458a5cfd411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "name": "network-vif-unplugged", "status": "completed", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:48.558085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20f770f8-f57c-4b6b-801e-17c9be7dc138 req-bf8dc355-ea88-41ca-bfb8-c458a5cfd411 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.559194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-20f770f8-f57c-4b6b-801e-17c9be7dc138 req-bf8dc355-ea88-41ca-bfb8-c458a5cfd411 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.585357 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-20f770f8-f57c-4b6b-801e-17c9be7dc138 req-bf8dc355-ea88-41ca-bfb8-c458a5cfd411 service nova] Creating event network-vif-unplugged:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h2-848886-16 Jul 26 05:06:48.596816 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-20f770f8-f57c-4b6b-801e-17c9be7dc138 req-bf8dc355-ea88-41ca-bfb8-c458a5cfd411 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060865 Jul 26 05:06:48.601029 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3307/6555] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:49.384703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:49.385279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:49.393551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.394021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.394984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.395430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.413655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:49.413790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] [instance: 7ed76dae-b1a2-4209-8051-ddf8ec8d0078] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:49.436696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.437078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.437881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.438381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.470206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] HTTP exception thrown: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Request method failure captured: Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 HTTP/1.1 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33Y-9Fi8DIjNhfZS1EHy-rH5pLhzMRjnyfSEUbwuEMI2z-sbfI9wMXDwXfHwma2DuGzb1DaFS28qqVl1JgwD9M69pMl3vMQD5gPwU3iNZ4xakh9Gf7AVDQlxUEtEUaKIlakHt6qPJEkbArxHh0lMqcFNpr8k6gerkN7eABjv9LXsEj0 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: db60a7adb16e4452bbbe62cbc7392d8f Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestServerMultinode-799469605 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db60a7adb16e4452bbbe62cbc7392d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestServerMultinode-799469605 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: db60a7adb16e4452bbbe62cbc7392d8f Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestServerMultinode-799469605 Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestServerMultinode-799469605-project-admin Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8890431df90e4ec8b7d4d581af7ee81b Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestServerMultinode-799469605-project-admin Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7ed76dae-b1a2-4209-8051-ddf8ec8d0078'} Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:49.472183 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] Returning 404 to user: Instance 7ed76dae-b1a2-4209-8051-ddf8ec8d0078 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:49.475880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3a9e8034-ac01-4c6a-948d-88c057ac7cde tempest-TestServerMultinode-799469605 tempest-TestServerMultinode-799469605-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078" status: 404 len: 111 microversion: 2.1 time: 0.065891 Jul 26 05:06:49.486540 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3308/6556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:49 2022] GET /compute/v2.1/servers/7ed76dae-b1a2-4209-8051-ddf8ec8d0078 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:50.215491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:50.235024 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dfded9d6-539f-4005-b061-55836ae94bf5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 0.854769 Jul 26 05:06:50.256116 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3249/6557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:49 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:51.263749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:51.265082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:51.285321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.285802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:51.286685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.287187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:52.253472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:52.264792 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a90136ee-8170-4516-8b33-d43a753abef3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1691 microversion: 2.1 time: 1.005638 Jul 26 05:06:52.266952 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3309/6558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:51 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1691 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:53.289005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:53.289871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:53.312205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.312996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:53.314366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.315473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:53.679210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:53.693489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30280a35-78c7-4a18-a1e1-d7b95e88c6c5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1681 microversion: 2.1 time: 0.406474 Jul 26 05:06:53.707752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3250/6559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:53 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1681 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:53.720433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:53.721679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:53.742681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.744002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:53.753675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.754948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:54.194906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f1b9b9d-ad0a-4b4d-bc34-025730e0010b tempest-TestNetworkAdvancedServerOps-2002563484 tempest-TestNetworkAdvancedServerOps-2002563484-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1834 microversion: 2.1 time: 0.480934 Jul 26 05:06:54.196195 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3310/6560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:53 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1834 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:54.222595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:54.223434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:54.235861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:54.236572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:54.237722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:54.239997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:54.598642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:54.610970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffb227f6-5791-4923-8252-36868fa56914 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1681 microversion: 2.1 time: 0.392785 Jul 26 05:06:54.634850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3251/6561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:54 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:54.999796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:55.003458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:55.021617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:55.023419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:55.027903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:55.028893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:55.140361 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52fddfef-da67-458f-921d-fa8b54dc5d48 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action" status: 200 len: 38674 microversion: 2.1 time: 0.145013 Jul 26 05:06:55.142914 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3311/6562] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:06:54 2022] POST /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad/action => generated 38674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:06:58.478597 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4b8879c3-7f03-4bbd-aa64-1dbeb619de65 req-05b3eec1-93a4-4863-b04e-d0de50880115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:58.482699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:58.483418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:58.499239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:58.505409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b8879c3-7f03-4bbd-aa64-1dbeb619de65 req-05b3eec1-93a4-4863-b04e-d0de50880115 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:58.505870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4b8879c3-7f03-4bbd-aa64-1dbeb619de65 req-05b3eec1-93a4-4863-b04e-d0de50880115 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:58.506926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:58.514473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:58.514473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:58.570323 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4b8879c3-7f03-4bbd-aa64-1dbeb619de65 req-05b3eec1-93a4-4863-b04e-d0de50880115 service nova] Creating event network-changed:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h1-848886-16 Jul 26 05:06:58.581726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4b8879c3-7f03-4bbd-aa64-1dbeb619de65 req-05b3eec1-93a4-4863-b04e-d0de50880115 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106968 Jul 26 05:06:58.602403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:58.603553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3312/6563] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:06:58.820256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4591878-277c-4b32-9829-58cc94598a28 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 204 len: 0 microversion: 2.1 time: 0.350594 Jul 26 05:06:58.821691 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3252/6564] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:58 2022] DELETE /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:58.832358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:58.833218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:58.852025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:58.852673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:58.853569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:58.854128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.268039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:59.292810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ad3954c-ae5b-41d2-9880-96e3a1bb60af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1687 microversion: 2.1 time: 0.466501 Jul 26 05:06:59.310862 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3313/6565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:58 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1687 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:00.324389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:00.326228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:00.337428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:00.342056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:00.344521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:00.347531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:01.284667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:01.311705 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2d02b67-2843-4f4b-872b-84b02d53aa82 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 200 len: 1687 microversion: 2.1 time: 0.991600 Jul 26 05:07:01.314405 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3253/6566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:00 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 1687 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:01.473553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-700e9bc8-df9d-4510-9188-a4bdb1784ed3 req-65985dcf-8cb6-442a-a9de-3cb178569b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f2ba91-f734-4103-bc08-46b8d3ad95ad", "name": "network-vif-deleted", "tag": "7c0e6485-e09e-4d16-8e76-68d981a67a9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:01.511808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-700e9bc8-df9d-4510-9188-a4bdb1784ed3 req-65985dcf-8cb6-442a-a9de-3cb178569b19 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:01.513172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-700e9bc8-df9d-4510-9188-a4bdb1784ed3 req-65985dcf-8cb6-442a-a9de-3cb178569b19 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:01.545388 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-700e9bc8-df9d-4510-9188-a4bdb1784ed3 req-65985dcf-8cb6-442a-a9de-3cb178569b19 service nova] Creating event network-vif-deleted:7c0e6485-e09e-4d16-8e76-68d981a67a9a for instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad on n-h1-848886-16 Jul 26 05:07:01.556066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-700e9bc8-df9d-4510-9188-a4bdb1784ed3 req-65985dcf-8cb6-442a-a9de-3cb178569b19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088446 Jul 26 05:07:01.559591 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3314/6567] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:02.338223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:02.338805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: c4f2ba91-f734-4103-bc08-46b8d3ad95ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:02.357404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:02.357893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:02.358696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:02.359146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:02.387041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] HTTP exception thrown: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Request method failure captured: Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad HTTP/1.1 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33RymeSjWnJQ555P7Axyt9qq2be7AliA7vnGSdm_9U1MboSxRCePG7Gjoub0klmO0Ye6K0eXxpbdagulI1QA0ws0aCcUZgieRg72PtIh5nD7YCStF6qHTSnJYJR9J5AgbMUIBpYAm_COhmZMERcqJ-gUpWSTKlsx64dn2fEEgjqKzpI Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: cc3616211d754718b64b2d011a5342b7 Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c4f2ba91-f734-4103-bc08-46b8d3ad95ad'} Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:02.388672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Returning 404 to user: Instance c4f2ba91-f734-4103-bc08-46b8d3ad95ad could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:02.393764 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79e2ed72-39bb-4f13-bb1f-697091b0307c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad" status: 404 len: 111 microversion: 2.1 time: 0.055880 Jul 26 05:07:02.405287 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3254/6568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:02 2022] GET /compute/v2.1/servers/c4f2ba91-f734-4103-bc08-46b8d3ad95ad => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:07:03.381962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41382185-d44c-46a6-94a1-23fb013edf62 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: .version_select at 0x7f38b4c4e550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-94813309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWQefNwutQuGlrYbeO6cFVZ2Pw+iWIEB/Kn0sZQi/J0WtvlFZY55CYVbXb2PhXdUUb1l6u58y3VHdscaIPGX+UuY3uRUEfBMG7qnR8nWfzdodNy8ACvw1vSmVDP7UwTUw=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:03.393771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:03.415686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-41382185-d44c-46a6-94a1-23fb013edf62 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:03.424124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-41382185-d44c-46a6-94a1-23fb013edf62 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:03.472834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41382185-d44c-46a6-94a1-23fb013edf62 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.092171 Jul 26 05:07:03.474449 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3315/6569] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:07:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:07.556244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-262968775", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "b4a76032-f9fb-4cfe-83f6-be8ef68cf79b"}], "key_name": "tempest-TestNetworkBasicOps-94813309", "security_groups": [{"name": "tempest-secgroup-smoke-324862106"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:07.834295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] validate_networks() for [('b4a76032-f9fb-4cfe-83f6-be8ef68cf79b', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:07:08.337294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:08.821617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:07:08.823130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:07:08.823794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:07:08.824375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:07:08.825284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:07:08.839014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:08.839878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:08.840987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:08.841702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:08.891001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:08.907988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Getting quotas for user cf3e349129904b78b0b8f34724d8baee and project e1818cf6e80d45ccbaf74b58d34cbc92. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:08.934538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:07:08.936274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:07:09.044262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11275a96-8906-471b-b61f-323c921e7ece tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.487446 Jul 26 05:07:09.053739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3255/6570] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:07:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:07:09.059251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bc24279-1a98-417f-8567-990ed66f66c4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:09.060073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bc24279-1a98-417f-8567-990ed66f66c4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:09.201091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0bc24279-1a98-417f-8567-990ed66f66c4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:09.216771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bc24279-1a98-417f-8567-990ed66f66c4 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1246 microversion: 2.1 time: 0.154293 Jul 26 05:07:09.222571 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3316/6571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:09 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1246 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:09.972209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a9a5b6c5-6596-4f3a-925d-d96b4a79624e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '.version_select at 0x7f38b47abca0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:10.052307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a9a5b6c5-6596-4f3a-925d-d96b4a79624e tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1982932695" status: 202 len: 0 microversion: 2.1 time: 0.084434 Jul 26 05:07:10.055195 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3256/6572] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Jul 26 05:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1982932695 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:07:10.088957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e306a811-758a-43b1-80a9-d3f922af1fb2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: .version_select at 0x7f38b6078160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1767981789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT7FoBcfw/jvvzEH0SgOr6feoU6Xke7JZ7KmT10+19k4fz76Z3WIxpiZOvUL5rWhlufNJgUWnxheE+hnbTiqeQzTkwF0mofn2IQuAcLHafwSkUSQQ/MLWhGacRzhMc0XQ=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:10.110279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e306a811-758a-43b1-80a9-d3f922af1fb2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:10.126619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-e306a811-758a-43b1-80a9-d3f922af1fb2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:10.158133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e306a811-758a-43b1-80a9-d3f922af1fb2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.072880 Jul 26 05:07:10.165729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3317/6573] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:07:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:10.245215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:10.251186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:10.271890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:10.272643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:10.273786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:10.274502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:10.443548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:10.455564 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-07ad2c36-931a-465b-9d6f-ad1bc0d67ebf tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1298 microversion: 2.1 time: 0.217311 Jul 26 05:07:10.465905 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3257/6574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:10 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:11.489150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:11.489968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:11.504806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:11.505503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:11.506358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:11.511792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:11.564317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:11.936168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:11.945407 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e87bd9d6-2824-4ce6-b29f-e99177c81861 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.467624 Jul 26 05:07:11.964612 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3318/6575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:11 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:12.620042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-28c102f2-e11a-400a-93c3-aaf06fb8abe4 req-4b27dc2a-d3e4-4a54-b87e-a81ebd3d1301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067704-b794-4585-abc1-8b3b9e27c01c", "tag": "7a7aa40d-5907-4124-aa6e-a884c1782062"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:12.639860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-28c102f2-e11a-400a-93c3-aaf06fb8abe4 req-4b27dc2a-d3e4-4a54-b87e-a81ebd3d1301 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:12.640316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-28c102f2-e11a-400a-93c3-aaf06fb8abe4 req-4b27dc2a-d3e4-4a54-b87e-a81ebd3d1301 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:12.668239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-28c102f2-e11a-400a-93c3-aaf06fb8abe4 req-4b27dc2a-d3e4-4a54-b87e-a81ebd3d1301 service nova] Creating event network-changed:7a7aa40d-5907-4124-aa6e-a884c1782062 for instance 69067704-b794-4585-abc1-8b3b9e27c01c on n-h2-848886-16 Jul 26 05:07:12.676897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-28c102f2-e11a-400a-93c3-aaf06fb8abe4 req-4b27dc2a-d3e4-4a54-b87e-a81ebd3d1301 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060448 Jul 26 05:07:12.677529 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3258/6576] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:12.975877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:12.977130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:13.004845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:13.005324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:13.006170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:13.006639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:13.317075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:13.326476 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d000087a-3060-4eeb-bc34-80cbc2e658d1 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.354737 Jul 26 05:07:13.327070 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3319/6577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:12 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:14.350787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:14.351603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:14.364016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:14.370073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:14.371301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:14.371954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:14.609029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:14.619189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-886bd87d-dc63-437c-a375-01998f90681f tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.275147 Jul 26 05:07:14.633628 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3259/6578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:14 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:15.641014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:15.641856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:15.654682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:15.659578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:15.665322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:15.665958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:16.056145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:16.078716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f23adc7-b808-429a-94db-73ef4d269427 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.437080 Jul 26 05:07:16.079679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3320/6579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:15 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:17.103118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:17.103862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:17.123435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:17.132866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:17.143353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:17.144919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:17.526027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:17.542462 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee4ccfd9-aaea-4d43-a4a3-6bb189a6ee2a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.439027 Jul 26 05:07:17.557098 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3260/6580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:17 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:18.564689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:18.565499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:18.599984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:18.605827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:18.608159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:18.611750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:19.589192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b268c102-2f1e-4019-bc6c-8ddf7bba077d req-91bb472a-be17-4003-a993-3389c4d05d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067704-b794-4585-abc1-8b3b9e27c01c", "name": "network-vif-plugged", "status": "completed", "tag": "7a7aa40d-5907-4124-aa6e-a884c1782062"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:19.622480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:19.626977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:19.636094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b268c102-2f1e-4019-bc6c-8ddf7bba077d req-91bb472a-be17-4003-a993-3389c4d05d0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:19.636692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b268c102-2f1e-4019-bc6c-8ddf7bba077d req-91bb472a-be17-4003-a993-3389c4d05d0b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:19.677729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:19.685195 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b268c102-2f1e-4019-bc6c-8ddf7bba077d req-91bb472a-be17-4003-a993-3389c4d05d0b service nova] Creating event network-vif-plugged:7a7aa40d-5907-4124-aa6e-a884c1782062 for instance 69067704-b794-4585-abc1-8b3b9e27c01c on n-h2-848886-16 Jul 26 05:07:19.723037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b268c102-2f1e-4019-bc6c-8ddf7bba077d req-91bb472a-be17-4003-a993-3389c4d05d0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142695 Jul 26 05:07:19.726534 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3261/6581] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:19.891612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-110346947", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "c799ff7c-638f-43d5-8afd-47fa82ef9fd5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1767981789", "security_groups": [{"name": "tempest-secgroup-smoke-585494820"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:19.909752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:19.934946 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-331c9318-2c95-4cc4-8797-0a12a583f626 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 1.374915 Jul 26 05:07:19.936151 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3321/6582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:18 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:20.128104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] validate_networks() for [('c799ff7c-638f-43d5-8afd-47fa82ef9fd5', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:07:20.751937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:07:20.753061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:07:20.753704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:07:20.754755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:07:20.763052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:07:20.777406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:20.778059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:20.779101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:20.779714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:20.814870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:20.844342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Getting quotas for user cc3616211d754718b64b2d011a5342b7 and project 8ec8ccec3dbf4a6ea54631cff6d97c4b. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:20.887983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:07:20.895846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:07:20.920841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:20.921431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:20.924527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:20.941528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:20.942336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:20.948681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:20.949252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:20.988744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:07:21.041783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e9ec4e1-f82a-482f-a840-233e2a82dafd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.154050 Jul 26 05:07:21.051290 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3262/6583] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:07:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:07:21.056772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f4c38bb4-1c98-4711-9bc9-a8f5eb361000 req-cdf4e076-e13e-4478-a86b-efd40fbf6229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7732d9c0-674a-4264-af50-2fc1ae2774ec", "tag": "b14c2cbc-a8b8-4d6d-aa34-d171747cea17"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:21.075553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f4c38bb4-1c98-4711-9bc9-a8f5eb361000 req-cdf4e076-e13e-4478-a86b-efd40fbf6229 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:21.076171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f4c38bb4-1c98-4711-9bc9-a8f5eb361000 req-cdf4e076-e13e-4478-a86b-efd40fbf6229 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:21.129015 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f4c38bb4-1c98-4711-9bc9-a8f5eb361000 req-cdf4e076-e13e-4478-a86b-efd40fbf6229 service nova] Creating event network-changed:b14c2cbc-a8b8-4d6d-aa34-d171747cea17 for instance 7732d9c0-674a-4264-af50-2fc1ae2774ec on n-h1-848886-16 Jul 26 05:07:21.136946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f4c38bb4-1c98-4711-9bc9-a8f5eb361000 req-cdf4e076-e13e-4478-a86b-efd40fbf6229 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088605 Jul 26 05:07:21.138141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-44f42766-3ca2-4b44-84d6-9a88c3581ec1 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 204 len: 0 microversion: 2.1 time: 0.221427 Jul 26 05:07:21.138394 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3263/6584] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:21.142991 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3322/6585] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:07:20 2022] DELETE /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:07:21.145837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:21.146957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:21.154957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-848df037-aaa4-452a-a396-db218b19b345 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:21.155172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:21.155731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-848df037-aaa4-452a-a396-db218b19b345 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:21.156231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:21.157347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:21.158556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:21.262065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-848df037-aaa4-452a-a396-db218b19b345 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:21.272190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-848df037-aaa4-452a-a396-db218b19b345 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1266 microversion: 2.1 time: 0.127692 Jul 26 05:07:21.274665 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3323/6586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:21 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:21.314419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:21.315054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:21.334464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:21.345373 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-65268ba5-1a8c-4d7b-950a-52412291a25d tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1371 microversion: 2.1 time: 0.205527 Jul 26 05:07:21.346287 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3264/6587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:21 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:21.354537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:21.355076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:21.355891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:21.356345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:21.650105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:21.663995 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-598dbdcc-0709-47cb-a03a-1d293be1ca65 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1578 microversion: 2.1 time: 0.386493 Jul 26 05:07:21.670428 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3324/6588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:21 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1578 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:22.296569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:22.297418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:22.307206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.320264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.321132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.322811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.372015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:22.373388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:22.386559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.387431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.391709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.394498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.610891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:22.643616 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1183a491-e79f-447c-a4ea-d4fb332fb5ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1270 microversion: 2.1 time: 0.351023 Jul 26 05:07:22.652648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3265/6589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:22 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1270 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:22.696732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:22.697954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:22.712711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.713882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.714916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.715744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.894980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:22.924374 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-747bb0b0-01f6-4eaf-a7a7-b78c6cae1c6a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1543 microversion: 2.1 time: 0.541226 Jul 26 05:07:22.925245 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3325/6590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:22 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1543 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:22.951311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:22.954294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:22.966007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.967695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.969215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.969939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:23.172369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:23.202382 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01b3f567-274d-4af5-9a06-724c13e3be39 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1578 microversion: 2.1 time: 0.504787 Jul 26 05:07:23.208066 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3266/6591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:22 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1578 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:23.674091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:23.674891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:23.715490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:23.717915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:23.721080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:23.721731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:23.723203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:23.737859 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b99291e2-1b0e-4081-a671-07d9995f3719 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1543 microversion: 2.1 time: 0.792619 Jul 26 05:07:23.762126 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3326/6592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:22 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1543 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:07:23.876188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:23.889053 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a73f548f-1f2e-407f-9e31-90129d5327af tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1324 microversion: 2.1 time: 0.219497 Jul 26 05:07:23.891705 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3267/6593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:23 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:07:24.225190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:24.226066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:24.232762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.233235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:24.234787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.235146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:24.920262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:24.921909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:24.937367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.939929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:24.943514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.957583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:25.101349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:25.118020 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b84856f-3f65-4dc7-af15-edcea9e91e57 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1459 microversion: 2.1 time: 0.893816 Jul 26 05:07:25.119164 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3327/6594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:24 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1459 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:25.132478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:25.154636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5bc95ca-1a4b-4aef-872a-bfe4e7d5a04d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1324 microversion: 2.1 time: 0.233693 Jul 26 05:07:25.159251 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3268/6595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:24 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:25.241690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4d38be43-d30d-47ba-806b-84e47d106275 req-0f22a2f1-37ea-46d3-9857-335800a91ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7732d9c0-674a-4264-af50-2fc1ae2774ec", "name": "network-vif-deleted", "tag": "b14c2cbc-a8b8-4d6d-aa34-d171747cea17"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:25.276209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4d38be43-d30d-47ba-806b-84e47d106275 req-0f22a2f1-37ea-46d3-9857-335800a91ca7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:25.276952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4d38be43-d30d-47ba-806b-84e47d106275 req-0f22a2f1-37ea-46d3-9857-335800a91ca7 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:25.315889 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4d38be43-d30d-47ba-806b-84e47d106275 req-0f22a2f1-37ea-46d3-9857-335800a91ca7 service nova] Creating event network-vif-deleted:b14c2cbc-a8b8-4d6d-aa34-d171747cea17 for instance 7732d9c0-674a-4264-af50-2fc1ae2774ec on n-h1-848886-16 Jul 26 05:07:25.346116 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4d38be43-d30d-47ba-806b-84e47d106275 req-0f22a2f1-37ea-46d3-9857-335800a91ca7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108319 Jul 26 05:07:25.347045 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3328/6596] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:26.150503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:26.158145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:26.176522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:26.177244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:26.184066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.186453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.192133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.193942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.200278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.209504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.210448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.210929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.335401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:26.343796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8dd128e5-1391-4a2a-b056-9b67c633e05b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1324 microversion: 2.1 time: 0.170640 Jul 26 05:07:26.354432 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3329/6597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:26 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1324 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:26.388056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:26.397594 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96ca6965-b8d8-412c-a0ff-4d5c111a8e97 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1226 microversion: 2.1 time: 0.255392 Jul 26 05:07:26.410979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3269/6598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:26 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1226 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:27.134439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-f7e1a7bb-5b00-4f8d-90dc-2edc8ab8e1ca req-3c3e30d7-92eb-4543-bff2-f93f9ff5885c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067704-b794-4585-abc1-8b3b9e27c01c", "tag": "7a7aa40d-5907-4124-aa6e-a884c1782062"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:27.152665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f7e1a7bb-5b00-4f8d-90dc-2edc8ab8e1ca req-3c3e30d7-92eb-4543-bff2-f93f9ff5885c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.153128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-f7e1a7bb-5b00-4f8d-90dc-2edc8ab8e1ca req-3c3e30d7-92eb-4543-bff2-f93f9ff5885c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.181682 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-f7e1a7bb-5b00-4f8d-90dc-2edc8ab8e1ca req-3c3e30d7-92eb-4543-bff2-f93f9ff5885c service nova] Creating event network-changed:7a7aa40d-5907-4124-aa6e-a884c1782062 for instance 69067704-b794-4585-abc1-8b3b9e27c01c on n-h2-848886-16 Jul 26 05:07:27.193552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-f7e1a7bb-5b00-4f8d-90dc-2edc8ab8e1ca req-3c3e30d7-92eb-4543-bff2-f93f9ff5885c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064956 Jul 26 05:07:27.194192 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3330/6599] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:27.365906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:27.367432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:27.379788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.383171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.384273 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.386720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.422297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:27.423021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:27.443623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.444102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.447843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.448312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.744632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:27.763879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d447553f-28cc-48a6-accb-fdebfb3e0bfa tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1226 microversion: 2.1 time: 0.341812 Jul 26 05:07:27.779272 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3331/6600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:27 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1226 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:28.293512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4a9b4cd6-8986-44df-b6f8-15725b8f7e28 req-8686fe31-e016-4a27-a75e-9192840979f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:28.335629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a9b4cd6-8986-44df-b6f8-15725b8f7e28 req-8686fe31-e016-4a27-a75e-9192840979f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:28.336561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4a9b4cd6-8986-44df-b6f8-15725b8f7e28 req-8686fe31-e016-4a27-a75e-9192840979f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:28.414274 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4a9b4cd6-8986-44df-b6f8-15725b8f7e28 req-8686fe31-e016-4a27-a75e-9192840979f1 service nova] Creating event network-changed:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:07:28.424392 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4a9b4cd6-8986-44df-b6f8-15725b8f7e28 req-8686fe31-e016-4a27-a75e-9192840979f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144151 Jul 26 05:07:28.426935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3332/6601] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:07:28.503690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:28.518955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f944abbb-35e9-4362-ba23-6cf54b05cc94 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 1.157164 Jul 26 05:07:28.523197 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3270/6602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:27 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:29.421246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:29.424317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:29.436705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:29.437712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:29.438864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:29.439823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:29.546497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:29.547132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:29.547874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:29.559869 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1e11488f-f437-4d79-a8f9-c4b0e37c46f9 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1226 microversion: 2.1 time: 0.774350 Jul 26 05:07:29.561280 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3333/6603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:28 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1226 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:29.571589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:29.571967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:29.572750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:29.573197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:29.791891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:29.800143 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-910cf1fe-52e7-48fe-8a16-1fa26ef740ad tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 0.259586 Jul 26 05:07:29.800727 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3271/6604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:29 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:30.586322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:30.586991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:30.600200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.600689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.601514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.601981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.701674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:30.711382 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e2dfd6e-3d23-4dab-a49d-2f0e492e643c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1226 microversion: 2.1 time: 0.129090 Jul 26 05:07:30.712278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3334/6605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:30 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:30.822625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:30.823462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:30.827377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:30.833819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.834613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.835625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.836409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.861891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:31.010774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:31.026929 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c7828c7-ad9f-4fcc-b2df-061979944e12 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 0.207830 Jul 26 05:07:31.028370 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3272/6606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:30 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:31.740592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:31.741213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:31.747261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:31.750965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:31.751625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:31.753085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:31.753825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:31.805982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:31.806977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:31.807536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 7732d9c0-674a-4264-af50-2fc1ae2774ec {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:07:31.854377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:31.856854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:31.863770 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a44ba35-5028-47ba-8a0e-cd211ccd5912 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 200 len: 1231 microversion: 2.1 time: 0.134821 Jul 26 05:07:31.864657 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3335/6607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:31 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 1231 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:32.048908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:32.049518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:32.067704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.068163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:32.071086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.071533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:32.255877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:32.285957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca325339-cbb5-475e-982d-58110d81764b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 0.241196 Jul 26 05:07:32.286523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3273/6608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:32 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:32.885319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:32.885945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 7732d9c0-674a-4264-af50-2fc1ae2774ec] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:32.899546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.900030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:32.901016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.901302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:32.930455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec HTTP/1.1 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7732d9c0-674a-4264-af50-2fc1ae2774ec'} Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:32.932284 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 7732d9c0-674a-4264-af50-2fc1ae2774ec could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:32.937730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bd1061c-ffdb-41f4-b0b9-efba2371559e tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec" status: 404 len: 111 microversion: 2.1 time: 0.052814 Jul 26 05:07:32.938855 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3336/6609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:32 2022] GET /compute/v2.1/servers/7732d9c0-674a-4264-af50-2fc1ae2774ec => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:07:33.322869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:33.327642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:33.353366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:33.354103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:33.355460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:33.359115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:33.611456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:33.620286 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b47809d6-c616-4c7f-8652-689e8dd7c727 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 0.314316 Jul 26 05:07:33.621613 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3274/6610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:33 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:34.211514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-67377afa-c145-4c19-b742-37b53f12b147 req-118b533f-203d-466b-9c1d-19d703481263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "name": "network-vif-plugged", "status": "completed", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:34.231589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:34.236342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-67377afa-c145-4c19-b742-37b53f12b147 req-118b533f-203d-466b-9c1d-19d703481263 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:34.239189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-67377afa-c145-4c19-b742-37b53f12b147 req-118b533f-203d-466b-9c1d-19d703481263 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:34.267934 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-67377afa-c145-4c19-b742-37b53f12b147 req-118b533f-203d-466b-9c1d-19d703481263 service nova] Creating event network-vif-plugged:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:07:34.274502 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-67377afa-c145-4c19-b742-37b53f12b147 req-118b533f-203d-466b-9c1d-19d703481263 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068145 Jul 26 05:07:34.275698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3337/6611] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:34.641570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:34.642309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:34.651041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:34.651802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:34.652814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:34.653479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:34.823245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:34.852856 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-42b5a3c8-51ac-4632-9639-1ce30d636256 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1391 microversion: 2.1 time: 0.215595 Jul 26 05:07:34.853516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3275/6612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:34 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:35.876754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:35.877671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:35.887396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.887951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:35.889103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.889999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:36.090997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:36.100172 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fed0814-d6bc-49fa-a675-fd408c7086d9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1563 microversion: 2.1 time: 0.229477 Jul 26 05:07:36.100905 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3338/6613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:35 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1563 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:36.121776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:36.125427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:36.133000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:36.133469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:36.134305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:36.134762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:36.319869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:36.328990 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c04f47c3-b533-4787-b95f-1dcd217a600c tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1563 microversion: 2.1 time: 0.212775 Jul 26 05:07:36.329804 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3276/6614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:36 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1563 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:39.005262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:39.011226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-49747830-f8bb-4431-a597-4fc44cc92c53 req-3cf59109-efea-4d51-bb60-d04d772af00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:39.012570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:39.027418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:39.030300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:39.032414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:39.033210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:39.033926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:39.038699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-49747830-f8bb-4431-a597-4fc44cc92c53 req-3cf59109-efea-4d51-bb60-d04d772af00f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:39.039459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-49747830-f8bb-4431-a597-4fc44cc92c53 req-3cf59109-efea-4d51-bb60-d04d772af00f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:39.054973 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-49747830-f8bb-4431-a597-4fc44cc92c53 req-3cf59109-efea-4d51-bb60-d04d772af00f service nova] Creating event network-changed:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:07:39.088074 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-49747830-f8bb-4431-a597-4fc44cc92c53 req-3cf59109-efea-4d51-bb60-d04d772af00f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079835 Jul 26 05:07:39.092305 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3277/6615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:39.487572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:39.500678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-59124734-78f3-4453-99cf-9ef76ae1b4f6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1563 microversion: 2.1 time: 0.499572 Jul 26 05:07:39.501282 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3339/6616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:38 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1563 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:41.672288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:41.673538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:41.675723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4977a6ac-9dec-43c7-84ea-7fa5bb6a99df req-ccbb6934-c6fe-4563-93f8-8e69845dd5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46e818-3c43-4be4-8019-c1116ecea300", "tag": "6ae6303f-5e89-4dc9-ae17-d5d81311a723"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:41.689133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4977a6ac-9dec-43c7-84ea-7fa5bb6a99df req-ccbb6934-c6fe-4563-93f8-8e69845dd5ad service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:41.689747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4977a6ac-9dec-43c7-84ea-7fa5bb6a99df req-ccbb6934-c6fe-4563-93f8-8e69845dd5ad service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:41.691003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:41.691671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:41.697449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:41.698123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:41.705964 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4977a6ac-9dec-43c7-84ea-7fa5bb6a99df req-ccbb6934-c6fe-4563-93f8-8e69845dd5ad service nova] Creating event network-changed:6ae6303f-5e89-4dc9-ae17-d5d81311a723 for instance 1e46e818-3c43-4be4-8019-c1116ecea300 on n-h2-848886-16 Jul 26 05:07:41.714906 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4977a6ac-9dec-43c7-84ea-7fa5bb6a99df req-ccbb6934-c6fe-4563-93f8-8e69845dd5ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045366 Jul 26 05:07:41.717012 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3340/6617] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:07:41.782239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:07:41.879068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:41.980822 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b6162e04-6391-4436-938f-38186213b995 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 204 len: 0 microversion: 2.1 time: 0.313073 Jul 26 05:07:41.982000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3278/6618] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:07:41 2022] DELETE /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:07:41.991468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:41.992949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:42.007154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:42.007654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:42.008776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:42.009431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:42.267929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:42.276114 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-55146320-9d57-410b-916f-40712c87be03 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1578 microversion: 2.1 time: 0.288863 Jul 26 05:07:42.282757 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3341/6619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:41 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1578 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:43.305289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:43.306789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:43.315653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:43.316292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:43.317244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:43.317840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:43.519933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:43.535583 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dfd7c766-2224-4c04-b1fa-706ceb32bbdb tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1578 microversion: 2.1 time: 0.235505 Jul 26 05:07:43.536408 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3279/6620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:43 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:44.486078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-da3a813f-69f3-4956-8cfe-d92d7ec02202 req-3b86aa50-6982-43dc-a3c6-460e4401f375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46e818-3c43-4be4-8019-c1116ecea300", "name": "network-vif-deleted", "tag": "6ae6303f-5e89-4dc9-ae17-d5d81311a723"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:44.511508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-da3a813f-69f3-4956-8cfe-d92d7ec02202 req-3b86aa50-6982-43dc-a3c6-460e4401f375 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:44.511978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-da3a813f-69f3-4956-8cfe-d92d7ec02202 req-3b86aa50-6982-43dc-a3c6-460e4401f375 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:44.524964 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-da3a813f-69f3-4956-8cfe-d92d7ec02202 req-3b86aa50-6982-43dc-a3c6-460e4401f375 service nova] Creating event network-vif-deleted:6ae6303f-5e89-4dc9-ae17-d5d81311a723 for instance 1e46e818-3c43-4be4-8019-c1116ecea300 on n-h2-848886-16 Jul 26 05:07:44.531460 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-da3a813f-69f3-4956-8cfe-d92d7ec02202 req-3b86aa50-6982-43dc-a3c6-460e4401f375 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050764 Jul 26 05:07:44.532724 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3342/6621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:44.561918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:44.562786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:44.571126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:44.571653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:44.572449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:44.572903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:44.650344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:44.659471 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8923165-0765-4370-99b2-38f64ccc7a5f tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1226 microversion: 2.1 time: 0.104399 Jul 26 05:07:44.660075 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3280/6622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:44 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:45.684440 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:45.686570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:45.696194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:45.697185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:45.698994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:45.700052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:45.788392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:45.801309 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-01647365-a390-458a-972c-cf467b7e2599 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1226 microversion: 2.1 time: 0.122665 Jul 26 05:07:45.801913 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3343/6623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:45 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:46.822986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:46.823629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:46.834869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:46.835465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:46.837003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:46.837553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:46.923824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:46.931936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5ec1e4c-9a6f-4cae-b8cd-a287b388598b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1226 microversion: 2.1 time: 0.112850 Jul 26 05:07:46.932842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3281/6624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:46 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:47.954828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:47.956252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:47.964186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:47.964985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:47.966079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:47.967054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:48.062345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:48.077550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7eb7225b-7108-41a1-887d-6589399c5fb6 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1226 microversion: 2.1 time: 0.127319 Jul 26 05:07:48.099964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3344/6625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:47 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:49.108464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:49.110214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:49.119265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:49.119727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:49.120728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:49.121855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:49.203631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:49.211551 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02046330-fe73-417d-940a-18b84f5095dc tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1226 microversion: 2.1 time: 0.112727 Jul 26 05:07:49.212135 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3282/6626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:49 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:50.232860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:50.234219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:50.243673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:50.244226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:50.245263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:50.245941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:50.284225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:50.284921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:50.285599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lazy-loading 'fault' on Instance uuid 1e46e818-3c43-4be4-8019-c1116ecea300 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:07:50.355191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44bbee74a3194f88a8f73f59fa79203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345427623634a379b03773966a8ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:50.364912 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d8b8be1-bdbc-40dc-9346-aa9f00961f4a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 200 len: 1231 microversion: 2.1 time: 0.135755 Jul 26 05:07:50.366248 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3345/6627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:50 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 1231 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:50.451582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-512730165", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "ed8090e9-8a68-45ae-a98d-b9ba9d7a5f59"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:50.511201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] validate_networks() for [('ed8090e9-8a68-45ae-a98d-b9ba9d7a5f59', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:07:50.979841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:07:50.980269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:07:50.980764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:07:50.981172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:07:50.981604 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:07:50.990946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:50.991399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:50.992195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:50.992633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:51.011011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Getting quotas for project f181e6516af24e769896fef604db4502. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:51.017200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Getting quotas for user 7536c5c978a449b3b96dabe20f1e3a8f and project f181e6516af24e769896fef604db4502. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:51.029770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:07:51.032065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:07:51.079468 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ff2a2bcb-11e8-4075-a74b-eb70e145e1db tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631955 Jul 26 05:07:51.080144 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3283/6628] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:07:51.092185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef0561d1-8740-49d2-849a-2b8b58d7310c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:51.093174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef0561d1-8740-49d2-849a-2b8b58d7310c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:51.158348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef0561d1-8740-49d2-849a-2b8b58d7310c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:51.167847 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef0561d1-8740-49d2-849a-2b8b58d7310c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1218 microversion: 2.1 time: 0.080551 Jul 26 05:07:51.176303 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3346/6629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:51 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:51.387681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:51.388458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 1e46e818-3c43-4be4-8019-c1116ecea300] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:51.399591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:51.400055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:51.400844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:51.401332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:51.426945 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 HTTP/1.1 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '1e46e818-3c43-4be4-8019-c1116ecea300'} Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:51.428755 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 1e46e818-3c43-4be4-8019-c1116ecea300 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:51.433249 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a418f34d-68ec-4aee-bd0e-4b7cff412a5c tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300" status: 404 len: 111 microversion: 2.1 time: 0.046654 Jul 26 05:07:51.445193 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3284/6630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:51 2022] GET /compute/v2.1/servers/1e46e818-3c43-4be4-8019-c1116ecea300 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:07:52.021217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:52.021719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:52.030461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.030924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.031718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.032242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.049612 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 HTTP/1.1 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '75dd7c39-d3e0-4d4a-b781-64a569873457'} Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:52.052342 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.056374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:52.057096 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b90b3e62-87a2-4dd5-b3b8-faa512c1ef2a tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 404 len: 111 microversion: 2.1 time: 0.039326 Jul 26 05:07:52.061984 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3347/6631] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:07:52 2022] DELETE /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:07:52.067377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:52.068531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] [instance: 75dd7c39-d3e0-4d4a-b781-64a569873457] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:52.077061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.077757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.078749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.079350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.100214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] HTTP exception thrown: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Request method failure captured: Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 HTTP/1.1 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33LaXuV9OPAbxGeTZyO4XN2OV2yOPf0JF2Co5WDVppcGAqlBSJhcBqlrej39cRDCgnteknK5Q8qFcNAY2XXB-81cI5FyCo0QY7Mk-DtPA_khi3txoxWHC4afj7_I5sTqkK0Dwuvt4URCL-AQ_ChZKHhV6_G_BTAu_kBLw0HaMEOJg6c Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5345427623634a379b03773966a8ddc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5345427623634a379b03773966a8ddc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5345427623634a379b03773966a8ddc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5345427623634a379b03773966a8ddc0 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestVolumeBootPattern-438531760 Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 44bbee74a3194f88a8f73f59fa79203f Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestVolumeBootPattern-438531760-project Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '75dd7c39-d3e0-4d4a-b781-64a569873457'} Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:52.101739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Returning 404 to user: Instance 75dd7c39-d3e0-4d4a-b781-64a569873457 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93b65a9c-50bb-499d-9744-078ba2105977 tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457" status: 404 len: 111 microversion: 2.1 time: 0.039772 Jul 26 05:07:52.105668 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3285/6632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:52 2022] GET /compute/v2.1/servers/75dd7c39-d3e0-4d4a-b781-64a569873457 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:07:52.191228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:52.193196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:52.208438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.209260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.214798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.218143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.330566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:52.342887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8877d323-bb6f-4c52-957c-1501f80387e3 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1278 microversion: 2.1 time: 0.155926 Jul 26 05:07:52.344323 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3348/6633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:52 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:53.365039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:53.365790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:53.382477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:53.383078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:53.384062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:53.389656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:53.579900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:53.588495 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3472275-2b21-4ed8-93e7-622bd21776e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.227817 Jul 26 05:07:53.589751 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3286/6634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:53 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:54.051097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-294a995d-9c73-4807-acc1-8f2f26d99bf0 req-aaa8fe1a-35ce-40f4-9ce6-d45475eb581d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7728e1-98d1-45f8-9078-5b653672671f", "tag": "98beb597-e4d2-41ea-a7ec-2a77dcabd0ca"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:54.063116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-294a995d-9c73-4807-acc1-8f2f26d99bf0 req-aaa8fe1a-35ce-40f4-9ce6-d45475eb581d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:54.063867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-294a995d-9c73-4807-acc1-8f2f26d99bf0 req-aaa8fe1a-35ce-40f4-9ce6-d45475eb581d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.076865 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-294a995d-9c73-4807-acc1-8f2f26d99bf0 req-aaa8fe1a-35ce-40f4-9ce6-d45475eb581d service nova] Creating event network-changed:98beb597-e4d2-41ea-a7ec-2a77dcabd0ca for instance 8a7728e1-98d1-45f8-9078-5b653672671f on n-h2-848886-16 Jul 26 05:07:54.082374 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-294a995d-9c73-4807-acc1-8f2f26d99bf0 req-aaa8fe1a-35ce-40f4-9ce6-d45475eb581d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 Jul 26 05:07:54.083539 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3349/6635] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:54.609866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:54.610650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:54.618146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:54.618629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.619404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:54.619850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.797885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:54.805729 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc8250ad-eee2-4b83-a36d-719293e95f7c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.200355 Jul 26 05:07:54.806257 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3287/6636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:54 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:55.665983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65aa0dda-1593-468a-a524-b22b383da40b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] Calling method '.version_select at 0x7f38b5a5a940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:55.689915 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65aa0dda-1593-468a-a524-b22b383da40b tempest-TestVolumeBootPattern-438531760 tempest-TestVolumeBootPattern-438531760-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2035241856" status: 202 len: 0 microversion: 2.1 time: 0.028978 Jul 26 05:07:55.691333 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3350/6637] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Jul 26 05:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2035241856 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:07:55.828738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:55.830391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:55.842442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:55.843386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:55.845435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:55.848210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:56.036017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:56.047176 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-852b1575-b618-4b88-aad9-b9c4f8e14bb9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.223926 Jul 26 05:07:56.061572 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3288/6638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:55 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:57.072107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:57.072873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:57.079517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:57.080342 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:57.081145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:57.081602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:57.370617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:57.379702 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86c7a1f4-42bb-4162-8b85-bcd76a918a8b tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.314580 Jul 26 05:07:57.380527 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3351/6639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:57 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:57.871798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:57.878844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:57.886835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:57.887539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:57.889600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:57.890241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:57.946522 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3628b963-31c8-41d4-a001-c588402c9eb8 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c/action" status: 200 len: 24567 microversion: 2.1 time: 0.078755 Jul 26 05:07:57.947580 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3289/6640] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:07:57 2022] POST /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c/action => generated 24567 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:07:58.401649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:58.402361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:58.414482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:58.415350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:58.416747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:58.417410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:58.595540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:58.605256 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-464a10cf-c4ad-4807-b690-321e2a374978 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.207832 Jul 26 05:07:58.607103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3352/6641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:58 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:59.629750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:59.630487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:59.638907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:59.639571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:59.640546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:59.641145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:59.875378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:59.896283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4137488a-1c42-4716-939b-748f7e4d286e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.271393 Jul 26 05:07:59.897020 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3290/6642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:59 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:00.918445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:00.920546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:00.928912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.929612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:00.930609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.931230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:00.937771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:00.942327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:00.949876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.950781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:00.951809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.952469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:01.008198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:01.028015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:01.037294 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea923651-5528-49cc-84bd-dd2c4024cf03 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action" status: 200 len: 24573 microversion: 2.1 time: 0.103524 Jul 26 05:08:01.038720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3291/6643] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:00 2022] POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action => generated 24573 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:08:01.048356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-350968bd-1fc0-45d2-a309-9998bd0ee189 req-70f084d4-a188-44a5-975b-4c3c976532cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7728e1-98d1-45f8-9078-5b653672671f", "name": "network-vif-plugged", "status": "completed", "tag": "98beb597-e4d2-41ea-a7ec-2a77dcabd0ca"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:01.066769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-350968bd-1fc0-45d2-a309-9998bd0ee189 req-70f084d4-a188-44a5-975b-4c3c976532cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:01.067573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-350968bd-1fc0-45d2-a309-9998bd0ee189 req-70f084d4-a188-44a5-975b-4c3c976532cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:01.086089 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-350968bd-1fc0-45d2-a309-9998bd0ee189 req-70f084d4-a188-44a5-975b-4c3c976532cd service nova] Creating event network-vif-plugged:98beb597-e4d2-41ea-a7ec-2a77dcabd0ca for instance 8a7728e1-98d1-45f8-9078-5b653672671f on n-h2-848886-16 Jul 26 05:08:01.092814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-350968bd-1fc0-45d2-a309-9998bd0ee189 req-70f084d4-a188-44a5-975b-4c3c976532cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052218 Jul 26 05:08:01.094019 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3292/6644] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:01.166505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:01.288890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:01.297452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8f3723b-35e2-4df9-9fb7-544518a6e534 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.383055 Jul 26 05:08:01.297841 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3353/6645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:00 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:02.319934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:02.321689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:02.328866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:02.329320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:02.330318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:02.330945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:02.583312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:02.599526 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97095e71-ce03-4d38-a699-4d98882d1696 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1318 microversion: 2.1 time: 0.283712 Jul 26 05:08:02.600818 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3293/6646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:02 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:03.621214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:03.622435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:03.634130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:03.635000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:03.636503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:03.637150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:03.642779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=76 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:03.946411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:03.956428 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fbbb2e2d-5944-409e-959e-b6077cda0850 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1508 microversion: 2.1 time: 0.339227 Jul 26 05:08:03.975009 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3354/6647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:03 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:12.069915 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:12.073210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.081549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:12.088643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.089147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.090732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.091416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.095004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=71 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:12.208252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:08:12.208681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:08:12.209224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:08:12.209636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:08:12.210068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:08:12.281221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.288217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.288998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.289831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.290328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.337204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c380cae5-a052-48f3-9a03-a11a368fff7d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action" status: 202 len: 1135 microversion: 2.1 time: 0.271331 Jul 26 05:08:12.350195 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3294/6648] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:12 2022] POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action => generated 1135 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 05:08:12.360025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:12.360952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.364655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:12.375953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.376428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.377239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.377926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.537517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:12.544199 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b88178dd-4e39-4cd1-94e8-312539dc5bfd tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.188695 Jul 26 05:08:12.545030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3355/6649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:12 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:13.565323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:13.565957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:13.573248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:13.574782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:13.578329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:13.579832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:13.727669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:13.739529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ab7ad9eb-2e52-44b8-9e5f-caaa7296fb87 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.177264 Jul 26 05:08:13.741084 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3295/6650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:13 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:14.762875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:14.764944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:14.772867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:14.773341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:14.774196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:14.774662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:14.925335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:14.933436 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dcfe2e24-aef9-446f-867d-3003315c98fc tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.176070 Jul 26 05:08:14.940564 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3356/6651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:14 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:15.954452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:15.955182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:15.962687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:15.963407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:15.964395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:15.964920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.109198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:16.117307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-62844dcd-bc77-4f12-9bdc-7c9d8656b8d3 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.166883 Jul 26 05:08:16.118095 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3296/6652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:15 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:17.139356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:17.140582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:17.147407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.148100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.149072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.149692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.311949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:17.320933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1efb52cb-5ded-4bc5-82a3-90efb3496e91 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.185427 Jul 26 05:08:17.336013 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3357/6653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:17 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:18.348527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:18.350619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:18.363265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:18.363810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:18.365354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:18.365941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:18.556713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:18.568362 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-915963dc-b945-4945-81dc-709f614b84e9 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.227506 Jul 26 05:08:18.574716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3297/6654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:18 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:19.592681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:19.594088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:19.601752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:19.602475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:19.603443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:19.604190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:19.770866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:19.779971 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5a8c684-5907-451a-a400-8dfd0ec35080 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.192413 Jul 26 05:08:19.786203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3358/6655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:19 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:20.802502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:20.803141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:20.812086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.812940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.814010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.814593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.972126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:20.981613 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-49cc59dc-7ebc-4d98-b447-78630cde417d tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.183603 Jul 26 05:08:20.982229 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3298/6656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:20 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:22.003286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:22.004032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:22.012322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.012937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.013806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.014356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.156136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:22.163812 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04273553-1d71-43e5-8456-947337018766 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.164994 Jul 26 05:08:22.164375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3359/6657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:21 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:22.769410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f2d8b8-a4d8-4f8f-bdee-9c9e2630083c", "device": "/dev/sdb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:22.771431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:22.778620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.779080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.779866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.780346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.028566 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-185f17b3-00c9-4222-a7dc-3fed51da1802 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "POST /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268809 Jul 26 05:08:23.034323 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3299/6658] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:08:22 2022] POST /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:23.190775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:23.194873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:23.203566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.204456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.205346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.205914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.349178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:23.357890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-61133d67-4a1b-4a56-9a79-56d756b3f0ab tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.175419 Jul 26 05:08:23.358509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3360/6659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:23 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:24.381199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:24.382091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:24.388922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.389387 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:24.390194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.391306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:24.541463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:24.551597 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02870215-2422-4738-ba5a-dc5fdceddd26 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.175836 Jul 26 05:08:24.552340 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3300/6660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:24 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:25.574747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:25.575954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:25.583339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:25.584047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:25.585072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:25.585688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:25.733786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:25.742737 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0314be6-4552-4c73-acd9-8702b138c7c2 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.172382 Jul 26 05:08:25.743712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3361/6661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:25 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:26.768143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:26.768838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:26.778707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.779102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.779889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.780527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.923875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:26.931832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c30be68b-d7f9-4bf5-a9d5-a05acb234fb6 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.170698 Jul 26 05:08:26.932637 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3301/6662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:26 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:27.953853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:27.954509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:27.962018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.962520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.963375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.964060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.107722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:28.115825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-182659ce-458e-408a-94dd-f1c814173c77 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1689 microversion: 2.1 time: 0.166591 Jul 26 05:08:28.116400 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3362/6663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:27 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:28.414809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:28.418326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:28.425322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.425905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.426720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.427167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.495278 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ec3dcb9-6c9e-4bc8-a959-18b4ea8400eb tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "POST /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c/action" status: 200 len: 32637 microversion: 2.1 time: 0.085716 Jul 26 05:08:28.496606 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3302/6664] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:28 2022] POST /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c/action => generated 32637 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:08:29.398935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:29.399695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:29.407016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.407592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.408494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.409055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.623100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:29.633933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10a5b136-7ce7-4052-8a92-8dd4dbf16406 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1695 microversion: 2.1 time: 0.499581 Jul 26 05:08:29.646389 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3363/6665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:29 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1695 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:29.713932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:29.724204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:29.743674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.744587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.746245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.746923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.795905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:08:29.938498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0a918efb-8d01-409b-8920-4cc615111460 req-67456d9b-787c-4344-92be-d870e9334de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067704-b794-4585-abc1-8b3b9e27c01c", "tag": "7a7aa40d-5907-4124-aa6e-a884c1782062"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:29.952916 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-022ac784-af05-4506-a6a3-51927cfa0b9a tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 204 len: 0 microversion: 2.1 time: 0.253057 Jul 26 05:08:29.958547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3303/6666] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:08:29 2022] DELETE /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:08:29.961197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0a918efb-8d01-409b-8920-4cc615111460 req-67456d9b-787c-4344-92be-d870e9334de5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.961679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0a918efb-8d01-409b-8920-4cc615111460 req-67456d9b-787c-4344-92be-d870e9334de5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.967026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:29.967790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:29.986612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.987328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.988506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.989858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.997189 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0a918efb-8d01-409b-8920-4cc615111460 req-67456d9b-787c-4344-92be-d870e9334de5 service nova] Creating event network-changed:7a7aa40d-5907-4124-aa6e-a884c1782062 for instance 69067704-b794-4585-abc1-8b3b9e27c01c on n-h2-848886-16 Jul 26 05:08:30.008580 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0a918efb-8d01-409b-8920-4cc615111460 req-67456d9b-787c-4344-92be-d870e9334de5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304729 Jul 26 05:08:30.009779 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3364/6667] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:30.172283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:30.185544 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df3d8725-8249-4363-874f-6c9e408678c3 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1668 microversion: 2.1 time: 0.224748 Jul 26 05:08:30.187066 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3304/6668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:29 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:30.660744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:30.661458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:30.669411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.670869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.672138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.672598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.861769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:30.871955 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8dc7940d-afcb-4db2-be4c-aec65827324b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1695 microversion: 2.1 time: 0.215796 Jul 26 05:08:30.873048 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3365/6669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:30 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.208678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.209917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.217990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.218696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.220009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.220627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.398048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3e349129904b78b0b8f34724d8baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1818cf6e80d45ccbaf74b58d34cbc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:31.407569 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bdebf4ea-a1ff-4f6d-a082-fcdff7e92510 tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 200 len: 1668 microversion: 2.1 time: 0.202923 Jul 26 05:08:31.408168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3305/6670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 1668 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.895747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.896967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.907723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.908384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.909610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.910257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.029566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-adf68cc6-e6f4-46fe-8a7b-c36e4c6e767f req-cf898ad5-54bc-4623-9f63-45e5e8ba3c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067704-b794-4585-abc1-8b3b9e27c01c", "name": "network-vif-deleted", "tag": "7a7aa40d-5907-4124-aa6e-a884c1782062"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:32.041983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-adf68cc6-e6f4-46fe-8a7b-c36e4c6e767f req-cf898ad5-54bc-4623-9f63-45e5e8ba3c2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.043382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-adf68cc6-e6f4-46fe-8a7b-c36e4c6e767f req-cf898ad5-54bc-4623-9f63-45e5e8ba3c2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.058415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:32.061341 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-adf68cc6-e6f4-46fe-8a7b-c36e4c6e767f req-cf898ad5-54bc-4623-9f63-45e5e8ba3c2c service nova] Creating event network-vif-deleted:7a7aa40d-5907-4124-aa6e-a884c1782062 for instance 69067704-b794-4585-abc1-8b3b9e27c01c on n-h2-848886-16 Jul 26 05:08:32.066236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-adf68cc6-e6f4-46fe-8a7b-c36e4c6e767f req-cf898ad5-54bc-4623-9f63-45e5e8ba3c2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041504 Jul 26 05:08:32.066839 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3306/6671] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:32.087895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:32.097141 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-168784de-6d36-4740-a6e2-490a67fd9273 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1680 microversion: 2.1 time: 0.206612 Jul 26 05:08:32.098024 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3366/6672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:32.450519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:32.452293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] [instance: 69067704-b794-4585-abc1-8b3b9e27c01c] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:32.465629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.466214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.467214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.469414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.502327 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] HTTP exception thrown: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Request method failure captured: Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c HTTP/1.1 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33XRvfEnii5y15QNoNoTCIj-LlsokzsjpTkF0rsnf1UA1tDrwpcRdr2vzcB_uOBbtmuiyu4NvKZcuXTMcZ5DWsYER3PeKDpBIwanH7b2fXBTVlZLKHcq4tmLhGFgVFkN0BMs709R7G7TaLtsscT9OfZksi-RoFy-_2zt1GZmba_gZrY Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1818cf6e80d45ccbaf74b58d34cbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e1818cf6e80d45ccbaf74b58d34cbc92 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestNetworkBasicOps-2017698235 Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: cf3e349129904b78b0b8f34724d8baee Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestNetworkBasicOps-2017698235-project Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '69067704-b794-4585-abc1-8b3b9e27c01c'} Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:08:32.505590 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Returning 404 to user: Instance 69067704-b794-4585-abc1-8b3b9e27c01c could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-781d428f-e557-4c5e-9006-e78ac982472e tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c" status: 404 len: 111 microversion: 2.1 time: 0.077599 Jul 26 05:08:32.509948 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3307/6673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:32 2022] GET /compute/v2.1/servers/69067704-b794-4585-abc1-8b3b9e27c01c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:08:32.654264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0a6cecdf-b654-4255-ba69-2646301bc59e req-e744bc7e-bca3-4928-b156-d78309478e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "name": "network-vif-plugged", "status": "completed", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:32.664792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0a6cecdf-b654-4255-ba69-2646301bc59e req-e744bc7e-bca3-4928-b156-d78309478e61 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.665466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0a6cecdf-b654-4255-ba69-2646301bc59e req-e744bc7e-bca3-4928-b156-d78309478e61 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.678720 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0a6cecdf-b654-4255-ba69-2646301bc59e req-e744bc7e-bca3-4928-b156-d78309478e61 service nova] Creating event network-vif-plugged:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:08:32.703044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0a6cecdf-b654-4255-ba69-2646301bc59e req-e744bc7e-bca3-4928-b156-d78309478e61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270163 Jul 26 05:08:32.705442 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3367/6674] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:32.718424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-27715791-08e3-4cda-8e4e-66b3930aa69b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] Calling method '.version_select at 0x7f38b54a21f0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:32.766833 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-27715791-08e3-4cda-8e4e-66b3930aa69b tempest-TestNetworkBasicOps-2017698235 tempest-TestNetworkBasicOps-2017698235-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-94813309" status: 202 len: 0 microversion: 2.1 time: 0.052075 Jul 26 05:08:32.769863 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3308/6675] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-94813309 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:08:33.909735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-482243238", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:33.966869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:08:34.367482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:08:34.367920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:08:34.368406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:08:34.368827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:08:34.369253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:08:34.380056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.380522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.381332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.381779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.389174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=76 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:34.402736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Getting quotas for project b40609cf157b4d928fec94e517b9191a. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:08:34.408823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Getting quotas for user 7bafbfc61c624116957ad6df06bcc3ad and project b40609cf157b4d928fec94e517b9191a. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:08:34.422239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:08:34.424628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:08:34.470665 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f619e71-fb16-42da-8be8-b338d67804f6 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566203 Jul 26 05:08:34.471732 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3368/6676] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:08:34.486045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e2b12e5e-ec97-4d90-9c1a-1584fb9a6ded tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:34.488612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e2b12e5e-ec97-4d90-9c1a-1584fb9a6ded tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:34.623120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e2b12e5e-ec97-4d90-9c1a-1584fb9a6ded tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:34.631735 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e2b12e5e-ec97-4d90-9c1a-1584fb9a6ded tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1213 microversion: 2.1 time: 0.153291 Jul 26 05:08:34.633060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3309/6677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:34 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:35.655651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:35.656867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:35.675848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.683649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.684737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.686586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.908429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:35.923192 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7f3b599-be5c-4a7b-9516-e1a00baa43eb tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1265 microversion: 2.1 time: 0.270736 Jul 26 05:08:35.923831 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3369/6678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:35 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:36.945114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:36.945735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:36.961266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.961963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.962938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.963587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:37.094409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:37.108528 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a04aba7-bd9c-4dd9-a3ef-74a40af0b86a tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1271 microversion: 2.1 time: 0.167222 Jul 26 05:08:37.113913 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3310/6679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:36 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:38.129893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:38.131369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:38.139008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:38.139769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.140953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:38.141572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.523171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:38.532872 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad5857bc-7d88-4a7f-9f53-68c92b54e876 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.407231 Jul 26 05:08:38.533657 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3370/6680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:38 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:39.556919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:39.558301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:39.569418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.569896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.574383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.574864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.601269 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ccec92c6-5e35-45ff-96f1-fde69ca721f3 req-5a172ba6-6b27-4667-a4ff-7811cc78d91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0c0902-ec1f-4cfb-92c1-5475c5d421dc", "tag": "5335fe19-96f4-406b-90c4-2ac6ad47e575"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:39.614648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ccec92c6-5e35-45ff-96f1-fde69ca721f3 req-5a172ba6-6b27-4667-a4ff-7811cc78d91e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.615106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ccec92c6-5e35-45ff-96f1-fde69ca721f3 req-5a172ba6-6b27-4667-a4ff-7811cc78d91e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.631348 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ccec92c6-5e35-45ff-96f1-fde69ca721f3 req-5a172ba6-6b27-4667-a4ff-7811cc78d91e service nova] Creating event network-changed:5335fe19-96f4-406b-90c4-2ac6ad47e575 for instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc on n-h1-848886-16 Jul 26 05:08:39.637693 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ccec92c6-5e35-45ff-96f1-fde69ca721f3 req-5a172ba6-6b27-4667-a4ff-7811cc78d91e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392516 Jul 26 05:08:39.638358 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3311/6681] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:39.831276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:39.839598 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dcb5813d-1a29-4c1d-ad89-d908820418dd tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.286748 Jul 26 05:08:39.840186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3371/6682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:39 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:40.861106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:40.861812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:40.868676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.869208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:40.872259 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.872779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:41.023035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:41.031972 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81856aac-661d-4918-87da-ad78f91f912f tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.175915 Jul 26 05:08:41.032547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3312/6683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:40 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:42.054297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:42.055776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:42.066060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.067881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.068900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.070945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.216799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:42.224963 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-072da426-bc21-4dd1-9f06-4ef5fdb239a0 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.175855 Jul 26 05:08:42.225567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3372/6684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:42 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:43.247251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:43.247954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:43.251074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:43.256963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:43.257429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:43.258240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:43.258690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:43.394940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:43.403002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4096b200-631f-49b8-bf33-8592e698a1f4 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.160489 Jul 26 05:08:43.403766 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3313/6685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:43 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:44.425304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:44.426702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:44.429578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:44.430461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:44.431233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:44.436903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:44.437588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:44.438802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:44.439356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:44.478268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-3a11cdf1-2e33-4bcb-bee2-f178ec3b4e08 req-f6eaea3b-0ccd-4646-9abf-fe4875bd72ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c0902-ec1f-4cfb-92c1-5475c5d421dc", "name": "network-vif-plugged", "status": "completed", "tag": "5335fe19-96f4-406b-90c4-2ac6ad47e575"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:44.490417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3a11cdf1-2e33-4bcb-bee2-f178ec3b4e08 req-f6eaea3b-0ccd-4646-9abf-fe4875bd72ca service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:44.491071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-3a11cdf1-2e33-4bcb-bee2-f178ec3b4e08 req-f6eaea3b-0ccd-4646-9abf-fe4875bd72ca service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:44.503991 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-3a11cdf1-2e33-4bcb-bee2-f178ec3b4e08 req-f6eaea3b-0ccd-4646-9abf-fe4875bd72ca service nova] Creating event network-vif-plugged:5335fe19-96f4-406b-90c4-2ac6ad47e575 for instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc on n-h1-848886-16 Jul 26 05:08:44.509503 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-3a11cdf1-2e33-4bcb-bee2-f178ec3b4e08 req-f6eaea3b-0ccd-4646-9abf-fe4875bd72ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Jul 26 05:08:44.510737 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3314/6686] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:44.592895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:44.600999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6880aa42-d3d0-40a6-914e-15b55330322e tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.179869 Jul 26 05:08:44.602170 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3373/6687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:44 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:45.621373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:45.626635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:45.627371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:45.634345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:45.634798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:45.636240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:45.636688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:45.787348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:45.795995 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3e59118-2546-4d70-a767-c9205e671981 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1313 microversion: 2.1 time: 0.176350 Jul 26 05:08:45.796507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3315/6688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:45 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:46.816878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:46.817955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:46.825525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.825978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.826775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.827225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.957204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:46.965193 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-137942cc-a7aa-490f-884f-ec9aed04d498 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1463 microversion: 2.1 time: 0.152221 Jul 26 05:08:46.965762 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3374/6689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:46 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:46.986046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5dc26dc-ae64-4911-9181-11ae4bb2d418", "device": "/dev/sdb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:46.988586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:46.996303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.996769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.997546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.997994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:47.244562 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9481fd9-3cd6-4551-9286-46143995e122 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "POST /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262248 Jul 26 05:08:47.245868 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3316/6690] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:08:46 2022] POST /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:47.271625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:47.272434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:47.278991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:47.279474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:47.280272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:47.280751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:47.367827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lazy-loading 'services' on Instance uuid 8a7728e1-98d1-45f8-9078-5b653672671f {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:08:47.441266 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e03cb939-f2f9-4719-9597-59b0ea25e8e2 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f/os-volume_attachments/19f2d8b8-a4d8-4f8f-bdee-9c9e2630083c" status: 202 len: 0 microversion: 2.1 time: 0.173522 Jul 26 05:08:47.442004 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3375/6691] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:08:47 2022] DELETE /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f/os-volume_attachments/19f2d8b8-a4d8-4f8f-bdee-9c9e2630083c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:08:52.045263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:52.045854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:52.052503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:52.052966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:52.053742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:52.054211 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:52.081534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:08:52.158270 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba97830e-1a32-4487-ab2b-e08a178e9e07 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 204 len: 0 microversion: 2.1 time: 0.118532 Jul 26 05:08:52.159237 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3317/6692] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:08:52 2022] DELETE /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:08:52.171176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:52.171977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:52.178456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:52.178992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:52.179835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:52.180350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:52.319948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:52.328533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa4ad979-d82f-4acc-8de0-0d33e1b5dbd9 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1514 microversion: 2.1 time: 0.164757 Jul 26 05:08:52.329123 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3376/6693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:52 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:53.350821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:53.351436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:53.359388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:53.359851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:53.360647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:53.361091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:53.496765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:53.504772 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f9d2ede-095b-4ce2-bf05-35dc1e3d64b5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1514 microversion: 2.1 time: 0.158174 Jul 26 05:08:53.505354 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3318/6694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:53 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:54.392140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-5e9e3d4a-59e3-4cad-ba78-ccdda9549b37 req-5800cdfc-b1e0-4f43-941e-64737e783843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7728e1-98d1-45f8-9078-5b653672671f", "name": "network-vif-deleted", "tag": "98beb597-e4d2-41ea-a7ec-2a77dcabd0ca"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:54.406054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5e9e3d4a-59e3-4cad-ba78-ccdda9549b37 req-5800cdfc-b1e0-4f43-941e-64737e783843 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:54.406642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-5e9e3d4a-59e3-4cad-ba78-ccdda9549b37 req-5800cdfc-b1e0-4f43-941e-64737e783843 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:54.419144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-5e9e3d4a-59e3-4cad-ba78-ccdda9549b37 req-5800cdfc-b1e0-4f43-941e-64737e783843 service nova] Creating event network-vif-deleted:98beb597-e4d2-41ea-a7ec-2a77dcabd0ca for instance 8a7728e1-98d1-45f8-9078-5b653672671f on n-h2-848886-16 Jul 26 05:08:54.424092 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-5e9e3d4a-59e3-4cad-ba78-ccdda9549b37 req-5800cdfc-b1e0-4f43-941e-64737e783843 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035789 Jul 26 05:08:54.424759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3377/6695] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:54.526931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:54.527674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:54.534545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:54.535002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:54.535773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:54.536212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:54.568376 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:54.568747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:54.569194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lazy-loading 'fault' on Instance uuid 8a7728e1-98d1-45f8-9078-5b653672671f {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:08:54.612533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:54.620662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-005ad68b-dd11-4836-b2d7-eb9239d4c711 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 200 len: 1308 microversion: 2.1 time: 0.097918 Jul 26 05:08:54.622059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3319/6696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:54 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:55.644829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:55.645563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: 8a7728e1-98d1-45f8-9078-5b653672671f] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:55.651902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:55.653006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:55.653788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:55.654261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:55.670239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] HTTP exception thrown: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Request method failure captured: Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f HTTP/1.1 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33ZWvxvQCwufetRD8fSpep5tm-MCUGmejAZtF1pSZcfxL1FXZlpHx5HPSECBBk-bfEWnwm45EMU4U1RBOHweO4WshvKCd-pN11x69duE4xuiWtBaSRVSf-Qz--jdJSvR4pvW7KhS7ZnxXo0X9ilj2wa1Ut90YsKhSrRRNuv1xjIttk4 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: f181e6516af24e769896fef604db4502 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f181e6516af24e769896fef604db4502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f181e6516af24e769896fef604db4502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f181e6516af24e769896fef604db4502"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f181e6516af24e769896fef604db4502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: f181e6516af24e769896fef604db4502 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesSnapshotTestJSON-620099800-project Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 7536c5c978a449b3b96dabe20f1e3a8f Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesSnapshotTestJSON-620099800-project Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8a7728e1-98d1-45f8-9078-5b653672671f'} Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:08:55.671892 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Returning 404 to user: Instance 8a7728e1-98d1-45f8-9078-5b653672671f could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fbad150e-b90e-4d45-8323-42eed7d3848d tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f" status: 404 len: 111 microversion: 2.1 time: 0.033919 Jul 26 05:08:55.676484 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3378/6697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:55 2022] GET /compute/v2.1/servers/8a7728e1-98d1-45f8-9078-5b653672671f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:08:56.316218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:56.318574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:56.327606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:56.328064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:56.328843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:56.329283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:56.380727 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29b837e3-cac6-4e39-af63-d0a1957895b5 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action" status: 200 len: 24574 microversion: 2.1 time: 0.068198 Jul 26 05:08:56.388024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3320/6698] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:56 2022] POST /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:09:02.493092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-450983665", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "ed8090e9-8a68-45ae-a98d-b9ba9d7a5f59"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:02.549396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] validate_networks() for [('ed8090e9-8a68-45ae-a98d-b9ba9d7a5f59', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:09:03.055907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:09:03.056396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:09:03.056909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:09:03.057328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:09:03.057753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:09:03.067222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:03.067683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:03.068489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:03.068940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:03.086301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Getting quotas for project f181e6516af24e769896fef604db4502. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:09:03.092464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Getting quotas for user 7536c5c978a449b3b96dabe20f1e3a8f and project f181e6516af24e769896fef604db4502. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:09:03.104657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:09:03.107252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:09:03.151735 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ede8592e-0d52-4442-a700-6ff34eb7c5a0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662508 Jul 26 05:09:03.152714 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3379/6699] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:09:03.164618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4ec7b5c-ad04-4d31-ad24-d4b21608a9cd tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:03.165446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4ec7b5c-ad04-4d31-ad24-d4b21608a9cd tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:03.224218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4ec7b5c-ad04-4d31-ad24-d4b21608a9cd tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:03.234456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4ec7b5c-ad04-4d31-ad24-d4b21608a9cd tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1218 microversion: 2.1 time: 0.073994 Jul 26 05:09:03.235030 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3321/6700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:03 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:04.257275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:04.259796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:04.276714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:04.277223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:04.278471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:04.279211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:04.352313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:04.361149 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b024b2db-54ec-41c5-8883-71612082dca5 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1276 microversion: 2.1 time: 0.109355 Jul 26 05:09:04.361741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3380/6701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:04 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:05.382367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:05.382994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:05.390580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:05.391401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:05.392354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:05.392976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:05.424237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:05.620794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a4bc7e7d-3f20-49e4-a627-53c1d58f2c0c req-ef85c9f4-e17a-4b4d-a623-c912854348d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b", "tag": "b701f1c5-5657-48c2-9f83-2c9725d99cf3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:05.633707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a4bc7e7d-3f20-49e4-a627-53c1d58f2c0c req-ef85c9f4-e17a-4b4d-a623-c912854348d0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:05.634282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a4bc7e7d-3f20-49e4-a627-53c1d58f2c0c req-ef85c9f4-e17a-4b4d-a623-c912854348d0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:05.638644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:05.647397 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cd9da6e0-5998-4f7b-9879-c7eb1819c253 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.269271 Jul 26 05:09:05.648612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3322/6702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:05 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:05.656989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:05.659628 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a4bc7e7d-3f20-49e4-a627-53c1d58f2c0c req-ef85c9f4-e17a-4b4d-a623-c912854348d0 service nova] Creating event network-changed:b701f1c5-5657-48c2-9f83-2c9725d99cf3 for instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b on n-h2-848886-16 Jul 26 05:09:05.666420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a4bc7e7d-3f20-49e4-a627-53c1d58f2c0c req-ef85c9f4-e17a-4b4d-a623-c912854348d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051611 Jul 26 05:09:05.667333 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3381/6703] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:06.671353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:06.672106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:06.679472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:06.679930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:06.680715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:06.681157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:06.814455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:06.821941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb0a67f8-a9c0-48de-9b1a-bac6247bb96e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.155354 Jul 26 05:09:06.822536 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3323/6704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:06 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:07.844370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:07.845944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:07.853554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:07.854304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:07.855459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:07.856137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.019655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:08.028365 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ab6f1b4-6d5c-4e5d-b7f6-24497b1cbc96 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.187830 Jul 26 05:09:08.042105 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3382/6705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:07 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:08.265112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-40b62e33-30ca-4a4a-89bd-d5f74cd09455 req-53fe8cf2-2c4d-4260-973e-6bd3e7c8f99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:08.269136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:08.271098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:08.289277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.289791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.290561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.292399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-40b62e33-30ca-4a4a-89bd-d5f74cd09455 req-53fe8cf2-2c4d-4260-973e-6bd3e7c8f99f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.292837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-40b62e33-30ca-4a4a-89bd-d5f74cd09455 req-53fe8cf2-2c4d-4260-973e-6bd3e7c8f99f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.296421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.311717 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-40b62e33-30ca-4a4a-89bd-d5f74cd09455 req-53fe8cf2-2c4d-4260-973e-6bd3e7c8f99f service nova] Creating event network-changed:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:09:08.318930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-40b62e33-30ca-4a4a-89bd-d5f74cd09455 req-53fe8cf2-2c4d-4260-973e-6bd3e7c8f99f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058818 Jul 26 05:09:08.319973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3383/6706] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:08.339195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:09:08.531639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b601631c-1ef1-41bd-868f-88eeab5c3d6f tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 204 len: 0 microversion: 2.1 time: 0.270735 Jul 26 05:09:08.534018 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3324/6707] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:09:08 2022] DELETE /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:09:08.547426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:08.548142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:08.564692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.565466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.566582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.567188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.817888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:08.834095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a3895ff-829e-4660-8a11-dba9883102bf tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1686 microversion: 2.1 time: 0.292397 Jul 26 05:09:08.835798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3384/6708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:08 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1686 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:09:09.060028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:09.061399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:09.068050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.069756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:09.069756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.069954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:09.258302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:09.270442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f19d5be-8e43-4944-ab70-556f0890d2f0 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.220179 Jul 26 05:09:09.272279 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3325/6709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:09 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:09:09.858567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:09.859111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:09.866530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.867244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:09.868039 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.868700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:10.222603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:10.233991 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8721b295-f68a-4d7d-adf4-ae658f75ff4b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1686 microversion: 2.1 time: 0.380608 Jul 26 05:09:10.250585 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3385/6710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:09 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1686 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:10.301959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:10.303295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:10.317282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:10.318264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:10.319867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:10.321090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:10.507149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:10.515492 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0bd4f64b-a11b-4553-b396-ce617f858c1c tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.225376 Jul 26 05:09:10.516268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3326/6711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:10 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:10.969630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-836df8ad-5f9f-4b70-86de-3283acb9c0fa req-0c8bb833-7a5f-4448-9c0c-1c07bafba531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6e53cb-0b2a-4589-bd04-8b5adc0d9275", "name": "network-vif-deleted", "tag": "74c3abae-debe-4975-b63d-6dcc4cfecbc3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:10.980213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-836df8ad-5f9f-4b70-86de-3283acb9c0fa req-0c8bb833-7a5f-4448-9c0c-1c07bafba531 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:10.983069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-836df8ad-5f9f-4b70-86de-3283acb9c0fa req-0c8bb833-7a5f-4448-9c0c-1c07bafba531 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:10.999095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-836df8ad-5f9f-4b70-86de-3283acb9c0fa req-0c8bb833-7a5f-4448-9c0c-1c07bafba531 service nova] Creating event network-vif-deleted:74c3abae-debe-4975-b63d-6dcc4cfecbc3 for instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 on n-h1-848886-16 Jul 26 05:09:11.004650 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-836df8ad-5f9f-4b70-86de-3283acb9c0fa req-0c8bb833-7a5f-4448-9c0c-1c07bafba531 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039762 Jul 26 05:09:11.005774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3386/6712] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:11.256800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:11.257640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:11.277493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.278298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.279154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.279816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.340181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.342824 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.343642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lazy-loading 'fault' on Instance uuid 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:09:11.407672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3616211d754718b64b2d011a5342b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec8ccec3dbf4a6ea54631cff6d97c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:11.417068 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea9d2deb-97d2-4727-8661-1487446b1851 tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 200 len: 1356 microversion: 2.1 time: 0.164387 Jul 26 05:09:11.418956 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3327/6713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:11 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:11.464390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-515cf3c8-f766-485f-87d6-938d0543f1b8 req-792ebe56-ba77-4b86-acee-586b85399e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b", "name": "network-vif-plugged", "status": "completed", "tag": "b701f1c5-5657-48c2-9f83-2c9725d99cf3"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:11.513427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-515cf3c8-f766-485f-87d6-938d0543f1b8 req-792ebe56-ba77-4b86-acee-586b85399e47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.517035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-515cf3c8-f766-485f-87d6-938d0543f1b8 req-792ebe56-ba77-4b86-acee-586b85399e47 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.537255 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-515cf3c8-f766-485f-87d6-938d0543f1b8 req-792ebe56-ba77-4b86-acee-586b85399e47 service nova] Creating event network-vif-plugged:b701f1c5-5657-48c2-9f83-2c9725d99cf3 for instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b on n-h2-848886-16 Jul 26 05:09:11.540789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:11.541766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:11.543954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-515cf3c8-f766-485f-87d6-938d0543f1b8 req-792ebe56-ba77-4b86-acee-586b85399e47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085573 Jul 26 05:09:11.544892 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3387/6714] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:11.555082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.556252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.557538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.558276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.802631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:11.811638 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-71ef1780-cd1b-431e-81fe-dcac318c033e tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.277973 Jul 26 05:09:11.822704 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3328/6715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:11 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:09:12.442493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:12.443213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] [instance: 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:12.451200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.451668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:12.452509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.452966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:12.467481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] HTTP exception thrown: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Request method failure captured: Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 HTTP/1.1 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33RymeSjWnJQ555P7Axyt9qq2be7AliA7vnGSdm_9U1MboSxRCePG7Gjoub0klmO0Ye6K0eXxpbdagulI1QA0ws0aCcUZgieRg72PtIh5nD7YCStF6qHTSnJYJR9J5AgbMUIBpYAm_COhmZMERcqJ-gUpWSTKlsx64dn2fEEgjqKzpI Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec8ccec3dbf4a6ea54631cff6d97c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 8ec8ccec3dbf4a6ea54631cff6d97c4b Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-408594554 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: cc3616211d754718b64b2d011a5342b7 Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-408594554-project Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6a6e53cb-0b2a-4589-bd04-8b5adc0d9275'} Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:12.469162 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Returning 404 to user: Instance 6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7948f443-6321-4ea5-82c6-9550b7f5ae6b tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275" status: 404 len: 111 microversion: 2.1 time: 0.032529 Jul 26 05:09:12.474004 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3388/6716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:12 2022] GET /compute/v2.1/servers/6a6e53cb-0b2a-4589-bd04-8b5adc0d9275 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:09:12.834640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:12.835561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:12.843414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.843940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:12.844786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.846105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:13.006334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:13.020780 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-44020b61-d4cd-42b2-9b4f-09fa8a9f3f1a tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1318 microversion: 2.1 time: 0.190086 Jul 26 05:09:13.022554 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3329/6717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:12 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:14.047117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:14.049078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:14.055989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:14.057174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:14.060875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.063260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.064957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.065723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.287701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:14.324393 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fcb2a335-dfbe-4985-81f3-b6cdce243697 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1508 microversion: 2.1 time: 0.283089 Jul 26 05:09:14.340270 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3389/6718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:14 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:14.347115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff642f82-c73b-401d-8e8d-e06f0ed7d052", "device": "/dev/sdb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:14.349879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:14.352268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:14.354734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:14.363965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.364617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.365880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.366502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.765387 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f7ab685d-e391-4134-abe2-41eab42c70ed tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "POST /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423274 Jul 26 05:09:14.766853 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3330/6719] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:09:14 2022] POST /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:15.982434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c43c6bb1-b099-4ab8-bfb1-8edeb217f2db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] Calling method '.version_select at 0x7f38b4c00c10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:15.993854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:16.009383 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c43c6bb1-b099-4ab8-bfb1-8edeb217f2db tempest-TestNetworkAdvancedServerOps-408594554 tempest-TestNetworkAdvancedServerOps-408594554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1767981789" status: 202 len: 0 microversion: 2.1 time: 0.030776 Jul 26 05:09:16.016569 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3390/6720] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Jul 26 05:09:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1767981789 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:40.811963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:40.812652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:40.815632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:40.816401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:40.823528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:40.824666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:40.825465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:40.825920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:40.915571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lazy-loading 'services' on Instance uuid be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:09:40.989406 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7469a94b-5537-4feb-8d67-2f37612a28bb tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b/os-volume_attachments/ff642f82-c73b-401d-8e8d-e06f0ed7d052" status: 202 len: 0 microversion: 2.1 time: 0.182389 Jul 26 05:09:40.990391 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3331/6721] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:09:40 2022] DELETE /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b/os-volume_attachments/ff642f82-c73b-401d-8e8d-e06f0ed7d052 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:46.420623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=33 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:46.422472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:46.426388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:46.426902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:46.435761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.436233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.437013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.437465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.462686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:09:46.541478 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6bc6a890-3b7a-4354-ae1a-f6d3c6ebcb77 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 204 len: 0 microversion: 2.1 time: 0.120902 Jul 26 05:09:46.548433 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3391/6722] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:09:46 2022] DELETE /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:09:46.573482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:46.573956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:46.581629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.582099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.583029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.583486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.726398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:46.735082 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-857ce9f1-971b-4162-b788-08dc92b0f1e4 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1514 microversion: 2.1 time: 0.166499 Jul 26 05:09:46.735767 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3332/6723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:46 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:47.757365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:47.758205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:47.766355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:47.766820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:47.767605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:47.768052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:47.904262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:47.911951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1bf768f9-cbb5-4faf-87cb-eb28e8385903 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1514 microversion: 2.1 time: 0.159204 Jul 26 05:09:47.912548 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3392/6724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:47 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:48.884785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a37d4bf0-57da-4f40-9f78-392148c1543f req-934f8715-63e4-44fb-a0c3-182f43bb1ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b", "name": "network-vif-deleted", "tag": "b701f1c5-5657-48c2-9f83-2c9725d99cf3"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:48.898553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a37d4bf0-57da-4f40-9f78-392148c1543f req-934f8715-63e4-44fb-a0c3-182f43bb1ed0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:48.899014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a37d4bf0-57da-4f40-9f78-392148c1543f req-934f8715-63e4-44fb-a0c3-182f43bb1ed0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:48.913603 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a37d4bf0-57da-4f40-9f78-392148c1543f req-934f8715-63e4-44fb-a0c3-182f43bb1ed0 service nova] Creating event network-vif-deleted:b701f1c5-5657-48c2-9f83-2c9725d99cf3 for instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b on n-h2-848886-16 Jul 26 05:09:48.919427 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a37d4bf0-57da-4f40-9f78-392148c1543f req-934f8715-63e4-44fb-a0c3-182f43bb1ed0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039316 Jul 26 05:09:48.920347 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3333/6725] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:48.933651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:48.935182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:48.942494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:48.943201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:48.943998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:48.944671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:49.012926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536c5c978a449b3b96dabe20f1e3a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f181e6516af24e769896fef604db4502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:49.021870 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e88ed940-4104-4691-abd8-cb30606f12c7 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 200 len: 1303 microversion: 2.1 time: 0.092646 Jul 26 05:09:49.022553 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3393/6726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:48 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:50.045432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:50.046137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] [instance: be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:50.052936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.053685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.054489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.054932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.069477 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] HTTP exception thrown: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Request method failure captured: Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b HTTP/1.1 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33ZWvxvQCwufetRD8fSpep5tm-MCUGmejAZtF1pSZcfxL1FXZlpHx5HPSECBBk-bfEWnwm45EMU4U1RBOHweO4WshvKCd-pN11x69duE4xuiWtBaSRVSf-Qz--jdJSvR4pvW7KhS7ZnxXo0X9ilj2wa1Ut90YsKhSrRRNuv1xjIttk4 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: f181e6516af24e769896fef604db4502 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f181e6516af24e769896fef604db4502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f181e6516af24e769896fef604db4502"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f181e6516af24e769896fef604db4502"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f181e6516af24e769896fef604db4502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: f181e6516af24e769896fef604db4502 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-620099800 Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-VolumesSnapshotTestJSON-620099800-project Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 7536c5c978a449b3b96dabe20f1e3a8f Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-VolumesSnapshotTestJSON-620099800-project Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b'} Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:50.071161 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] Returning 404 to user: Instance be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6c0d4155-be23-4b5d-8897-8cb7fa02e698 tempest-VolumesSnapshotTestJSON-620099800 tempest-VolumesSnapshotTestJSON-620099800-project] 10.222.0.43 "GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b" status: 404 len: 111 microversion: 2.1 time: 0.033489 Jul 26 05:09:50.076827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3334/6727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:50 2022] GET /compute/v2.1/servers/be009ba9-7f7e-4311-9cfa-8d5e5e4a6d7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:02.044317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:02.044869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:02.047695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:02.048370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:02.054803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.055321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.056367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.056818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.140153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lazy-loading 'services' on Instance uuid 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:02.211608 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33a4dad4-7d26-435d-b6e5-bd1232ab4a70 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc/os-volume_attachments/f5dc26dc-ae64-4911-9181-11ae4bb2d418" status: 202 len: 0 microversion: 2.1 time: 0.171528 Jul 26 05:10:02.213241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3394/6728] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:10:02 2022] DELETE /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc/os-volume_attachments/f5dc26dc-ae64-4911-9181-11ae4bb2d418 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:07.628968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:07.629481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:07.639788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:07.640459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:07.643249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.643733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.644718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.645146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.677894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:10:07.774411 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-299e2a45-8a83-495b-95c5-1ba2d945586d tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 204 len: 0 microversion: 2.1 time: 0.149107 Jul 26 05:10:07.775256 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3335/6729] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:07 2022] DELETE /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:10:07.785475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:07.786224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:07.793012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.793484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.794304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.794760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.933885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:07.941664 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94871e86-b355-4119-ae31-f2921a761633 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1469 microversion: 2.1 time: 0.161855 Jul 26 05:10:07.942265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3395/6730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:07 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:08.963166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:08.964030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:08.971166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:08.971625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:08.972399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:08.972842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:09.115204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:09.123968 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9ae2b5d-1dfd-426e-b2f3-fba28a883507 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1469 microversion: 2.1 time: 0.165094 Jul 26 05:10:09.124630 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3336/6731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:08 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:09.712199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-593442fc-950a-4241-a91a-3ac9d9d256a3 req-39a5af27-a4ac-4f30-9fc0-73fad185608b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c0902-ec1f-4cfb-92c1-5475c5d421dc", "name": "network-vif-deleted", "tag": "5335fe19-96f4-406b-90c4-2ac6ad47e575"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:09.725049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-593442fc-950a-4241-a91a-3ac9d9d256a3 req-39a5af27-a4ac-4f30-9fc0-73fad185608b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:09.725677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-593442fc-950a-4241-a91a-3ac9d9d256a3 req-39a5af27-a4ac-4f30-9fc0-73fad185608b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:09.739301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-593442fc-950a-4241-a91a-3ac9d9d256a3 req-39a5af27-a4ac-4f30-9fc0-73fad185608b service nova] Creating event network-vif-deleted:5335fe19-96f4-406b-90c4-2ac6ad47e575 for instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc on n-h1-848886-16 Jul 26 05:10:09.745410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-593442fc-950a-4241-a91a-3ac9d9d256a3 req-39a5af27-a4ac-4f30-9fc0-73fad185608b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037268 Jul 26 05:10:09.746186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3396/6732] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:10.145085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:10.146091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:10.159189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:10.160163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:10.161095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:10.161643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:10.200122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:10.201005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:10.201716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lazy-loading 'fault' on Instance uuid 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:10.245272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bafbfc61c624116957ad6df06bcc3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40609cf157b4d928fec94e517b9191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:10.252875 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7968daf-73fa-4cf1-a16b-3ddd942405f9 tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 200 len: 1303 microversion: 2.1 time: 0.111584 Jul 26 05:10:10.253548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3337/6733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:10 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:11.276669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:11.277407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] [instance: 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:11.283859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:11.284324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:11.285107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:11.285561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:11.299467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] HTTP exception thrown: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Request method failure captured: Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc HTTP/1.1 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33bQP1xG6iU0Tndc5_UIdHk9qJ5lM360RsYj_KOTYaCuRtWb33as61YalYAM6rb2_ADoyl7y0SelrNTwLf-7FhVYjK0FyeQb3p5evJYShEdDrmJMbfKoCAyJxbZcxMARYKkBPxBm1w8978apCPTuU8aazUHbnwN4Vq6eZWCbr_KBgPs Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: b40609cf157b4d928fec94e517b9191a Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-VolumesBackupsTest-1214586825 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b40609cf157b4d928fec94e517b9191a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40609cf157b4d928fec94e517b9191a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b40609cf157b4d928fec94e517b9191a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b40609cf157b4d928fec94e517b9191a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-VolumesBackupsTest-1214586825 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: b40609cf157b4d928fec94e517b9191a Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-VolumesBackupsTest-1214586825 Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-VolumesBackupsTest-1214586825-project Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 7bafbfc61c624116957ad6df06bcc3ad Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-VolumesBackupsTest-1214586825-project Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7c0c0902-ec1f-4cfb-92c1-5475c5d421dc'} Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:11.301107 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] Returning 404 to user: Instance 7c0c0902-ec1f-4cfb-92c1-5475c5d421dc could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c82b0569-59d4-4f04-b4f3-4d9cdc63445c tempest-VolumesBackupsTest-1214586825 tempest-VolumesBackupsTest-1214586825-project] 10.222.0.43 "GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc" status: 404 len: 111 microversion: 2.1 time: 0.031715 Jul 26 05:10:11.306275 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3397/6734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:11 2022] GET /compute/v2.1/servers/7c0c0902-ec1f-4cfb-92c1-5475c5d421dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:13.123755 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:11:13.124460 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:11:14.086235 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:11:14.086786 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:11:22.965597 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:11:22.966259 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:13:15.446257 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:13:15.446858 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:13:17.574578 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:13:17.575138 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:14:33.054165 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:33.054845 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:14:33.133629 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:33.133858 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:14:34.094542 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:34.095017 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:14:42.973854 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:42.974543 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:14:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:16:02.505844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f76f6e99-8a7f-41d0-94a2-c3196aacb729 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Action: 'create', calling method: .version_select at 0x7f38b4f5fa60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1077257366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC/VNXVIW2YWYdgDx11knP6Znt7UFhde8XMIrywFusVuMSu9frzqDOMmuSNpa2q+StzxW2dOeKPadRh2qyw0JmFMffYNqZP2Czw1IByHvSVvtsSQYm6GUI68EegOaCh8g=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:02.512631 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:16:02.513741 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:16:02.514479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:02.515135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:02.529364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f76f6e99-8a7f-41d0-94a2-c3196aacb729 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Getting quotas for project e1c520d4d54746718e6f7aa144a3b2a6. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:16:02.534588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-f76f6e99-8a7f-41d0-94a2-c3196aacb729 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Getting quotas for user edc118b54e44405c89c27833cb6ce8ec and project e1c520d4d54746718e6f7aa144a3b2a6. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:16:02.562800 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f76f6e99-8a7f-41d0-94a2-c3196aacb729 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061341 Jul 26 05:16:02.563396 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3338/6735] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:16:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:16:03.549912 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:16:03.550939 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:16:03.551476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:03.552223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:03.557905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-681907538", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6ce41079-e261-4f94-b68d-5e32d961ade3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1077257366", "security_groups": [{"name": "tempest-secgroup-smoke-1575962192"}], "networks": [{"uuid": "59ec1f74-6f77-49eb-aa32-fa7f4dd649c3"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:03.856625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] validate_networks() for [('59ec1f74-6f77-49eb-aa32-fa7f4dd649c3', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:16:04.560619 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55238. Jul 26 05:16:04.561417 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55236. Jul 26 05:16:04.689149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:16:04.689587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:16:04.690128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:16:04.690571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:16:04.690994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:16:04.700424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:04.700878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:04.701678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:04.703000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:04.721262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Getting quotas for project e1c520d4d54746718e6f7aa144a3b2a6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:16:04.726678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Getting quotas for user edc118b54e44405c89c27833cb6ce8ec and project e1c520d4d54746718e6f7aa144a3b2a6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:16:04.786137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:16:04.788479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ce41079-e261-4f94-b68d-5e32d961ade3',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:16:04.917005 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f664dcd0-131b-4e21-827d-c56bb9cd26b4 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.369001 Jul 26 05:16:04.917643 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3398/6736] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:16:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:16:04.930628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e0a8ec7-e4c1-44a6-8046-e93037b7169e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:04.931250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e0a8ec7-e4c1-44a6-8046-e93037b7169e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:04.944090 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55248. Jul 26 05:16:04.945883 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55250. Jul 26 05:16:05.058887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e0a8ec7-e4c1-44a6-8046-e93037b7169e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:05.066751 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e0a8ec7-e4c1-44a6-8046-e93037b7169e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1098 microversion: 2.1 time: 0.141620 Jul 26 05:16:05.067324 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3339/6737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:04 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1098 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:06.088128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:06.089348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:06.097706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:06.098195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:06.099298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:06.099764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:06.215397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:06.225234 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78a32865-81f7-4c43-a316-48d521454165 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1214 microversion: 2.1 time: 0.141118 Jul 26 05:16:06.225810 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3399/6738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:06 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:07.257974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:07.258694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:07.269166 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:07.270123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:07.273027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:07.273687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:07.448092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:07.456438 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c08399d-0866-4382-b47e-305d1f8fcaa0 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1282 microversion: 2.1 time: 0.213008 Jul 26 05:16:07.457030 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3340/6739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:07 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:07.609866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2089f054-d7e7-4580-b3f3-4274bea30801 req-b7a5f44b-940d-4161-9f52-67a115f26b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:07.621511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2089f054-d7e7-4580-b3f3-4274bea30801 req-b7a5f44b-940d-4161-9f52-67a115f26b00 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:07.621979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2089f054-d7e7-4580-b3f3-4274bea30801 req-b7a5f44b-940d-4161-9f52-67a115f26b00 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:07.635957 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2089f054-d7e7-4580-b3f3-4274bea30801 req-b7a5f44b-940d-4161-9f52-67a115f26b00 service nova] Creating event network-changed:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:07.642880 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2089f054-d7e7-4580-b3f3-4274bea30801 req-b7a5f44b-940d-4161-9f52-67a115f26b00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158730 Jul 26 05:16:07.643800 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3400/6740] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:16:08.477473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:08.478410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:08.486050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:08.486539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:08.487336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:08.487965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:08.624396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:08.632338 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e990df1a-5939-43d3-b61f-ec6a5c406cad tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1282 microversion: 2.1 time: 0.158914 Jul 26 05:16:08.632911 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3341/6741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:08 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:09.655141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:09.656287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:09.662759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:09.663228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:09.664015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:09.664475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:09.800954 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:09.808984 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e79439b2-e2a4-48c1-be42-e47d0aff5860 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1282 microversion: 2.1 time: 0.159116 Jul 26 05:16:09.809881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3401/6742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:09 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:10.829643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:10.830295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:10.837294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:10.837758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:10.838571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:10.839020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:10.988686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:10.997227 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-32c75aae-f323-4c0b-a9dd-0cfe16a4303d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1282 microversion: 2.1 time: 0.172099 Jul 26 05:16:10.997842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3342/6743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:10 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:12.020100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:12.020662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:12.027568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:12.028033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:12.028815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:12.029267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:12.163741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:12.172284 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22f3f946-5d0f-4a18-b807-682ebf2f1d6e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.156928 Jul 26 05:16:12.173064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3402/6744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:12 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:13.192292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:13.192935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:13.200032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:13.200475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:13.201228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:13.201663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:13.338132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:13.345942 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f636423-2ffc-4d4a-bdc7-cb6b57010a74 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.157560 Jul 26 05:16:13.346542 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3343/6745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:13 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:16:14.366836 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:14.367465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:14.375174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:14.375953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:14.376875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:14.377326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:14.522310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:14.530738 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d5bbfe1-3245-46da-8ea6-54b2719b070b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.167753 Jul 26 05:16:14.531355 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3403/6746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:14 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:15.553680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:15.554326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:15.557051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:15.563386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:15.563842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:15.564612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:15.565052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:15.701848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:15.709993 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-11083774-2721-4b72-860c-7c0d6e30cafe tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.160272 Jul 26 05:16:15.710598 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3344/6747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:15 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:16.730401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:16.731035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:16.733044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:16.733892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:16.742378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:16.742846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:16.743639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:16.744092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:16.879273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:16.886767 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8601cdba-acef-4bed-974f-c66dc6e78353 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.160361 Jul 26 05:16:16.887331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3404/6748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:16 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:17.907933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:17.908482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:17.915557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:17.916011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:17.916778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:17.917244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:18.051818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:18.059473 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-58dfd701-6f34-4d3a-97b7-918ac80e357d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.156256 Jul 26 05:16:18.060049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3345/6749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:17 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:19.081337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:19.082009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:19.088979 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:19.089444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:19.090246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:19.090703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:19.227570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:19.235560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af2dc1c3-9f0e-4288-8f94-99772ee0527d tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.158458 Jul 26 05:16:19.236140 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3405/6750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:19 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:20.256888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:20.257507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:20.264454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:20.264910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:20.265726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:20.266791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:20.407063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:20.417021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-28a9447e-2397-4b1f-84b1-1481df96e45f tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.164120 Jul 26 05:16:20.417829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3346/6751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:20 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:21.438510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:21.439143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:21.446091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:21.446588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:21.447374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:21.447841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:21.578666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:21.586445 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b04f3e3-31dd-4d79-8aa2-4f9c5a081eee tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.152408 Jul 26 05:16:21.587022 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3406/6752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:21 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:16:22.606569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:22.607217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:22.614635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:22.614945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "name": "network-vif-plugged", "status": "completed", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:22.615408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:22.615947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:22.616402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:22.624634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:22.625091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:22.636960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] Creating event network-vif-plugged:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:22.640339 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] [7537cf1f-55c0-4120-aaff-17b74cd44af9] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:16:22.749151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:22.757756 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b16cfd2b-de37-4fcc-a020-ebec4a99c610 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.154959 Jul 26 05:16:22.758379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3407/6753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:22 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:23.648371 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] [7537cf1f-55c0-4120-aaff-17b74cd44af9] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 55316. Jul 26 05:16:23.651882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9588e2ca-4ce5-4f53-833b-83dd48e26ca1 req-781589bc-87df-49a8-aa49-e510ac56ee91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.128278 Jul 26 05:16:23.652507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3347/6754] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:16:23.778797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:23.779421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:23.787432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:23.787908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:23.788697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:23.789153 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:23.923193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:23.931165 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c731b1cb-410c-40b9-9617-9cb7a46b9cb3 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1270 microversion: 2.1 time: 0.156225 Jul 26 05:16:23.931809 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3408/6755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:23 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:24.953643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:24.955479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:24.962391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:24.962849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:24.963619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:24.964061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:25.104489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:25.112663 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2933e1e7-5f7e-4dfd-9313-79a99d4a292b tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1458 microversion: 2.1 time: 0.164170 Jul 26 05:16:25.113247 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3348/6756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:24 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:25.133297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:25.133951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:25.146789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:25.147538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:25.148349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:25.148818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:25.283989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:25.291642 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dda836c3-228d-4949-8414-c556ee99d3aa tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1458 microversion: 2.1 time: 0.162156 Jul 26 05:16:25.292218 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3409/6757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:25 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:16:26.926720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0e73a653-38c8-43b0-827c-a491004b9114 req-e33f6daf-e540-4778-a126-626a73e9fdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:26.940519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0e73a653-38c8-43b0-827c-a491004b9114 req-e33f6daf-e540-4778-a126-626a73e9fdc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:26.940975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0e73a653-38c8-43b0-827c-a491004b9114 req-e33f6daf-e540-4778-a126-626a73e9fdc8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:26.953194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0e73a653-38c8-43b0-827c-a491004b9114 req-e33f6daf-e540-4778-a126-626a73e9fdc8 service nova] Creating event network-changed:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:26.959045 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0e73a653-38c8-43b0-827c-a491004b9114 req-e33f6daf-e540-4778-a126-626a73e9fdc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036624 Jul 26 05:16:26.959666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3349/6758] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:16:28.012859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-dcce097b-af44-4ae0-846b-b8db727b593e req-197f4aa6-7738-43a6-8ccb-d01b9f45d09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:28.023903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dcce097b-af44-4ae0-846b-b8db727b593e req-197f4aa6-7738-43a6-8ccb-d01b9f45d09f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:28.024400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dcce097b-af44-4ae0-846b-b8db727b593e req-197f4aa6-7738-43a6-8ccb-d01b9f45d09f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:28.037322 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-dcce097b-af44-4ae0-846b-b8db727b593e req-197f4aa6-7738-43a6-8ccb-d01b9f45d09f service nova] Creating event network-changed:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:28.042640 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-dcce097b-af44-4ae0-846b-b8db727b593e req-197f4aa6-7738-43a6-8ccb-d01b9f45d09f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117389 Jul 26 05:16:28.043506 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3410/6759] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:16:30.059244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ade680c1-3f3c-4dc6-ae41-4113092752b3 req-1263e9de-c33f-4bd4-9900-65953805fc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:30.069528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ade680c1-3f3c-4dc6-ae41-4113092752b3 req-1263e9de-c33f-4bd4-9900-65953805fc50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:30.069974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ade680c1-3f3c-4dc6-ae41-4113092752b3 req-1263e9de-c33f-4bd4-9900-65953805fc50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:30.080896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ade680c1-3f3c-4dc6-ae41-4113092752b3 req-1263e9de-c33f-4bd4-9900-65953805fc50 service nova] Creating event network-changed:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:30.085861 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ade680c1-3f3c-4dc6-ae41-4113092752b3 req-1263e9de-c33f-4bd4-9900-65953805fc50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Jul 26 05:16:30.086548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3350/6760] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:16:59.314475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:59.315029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:59.315406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=66 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:59.315518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=54 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:16:59.319671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a9e4811d-2e02-41b7-baf9-cfae419924b1 req-6943cdc2-8d1e-4fa5-8345-1399833dac1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:16:59.319997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:59.320653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:59.330024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:59.330527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:59.331293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:59.331514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9e4811d-2e02-41b7-baf9-cfae419924b1 req-6943cdc2-8d1e-4fa5-8345-1399833dac1b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:59.331754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:59.331968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a9e4811d-2e02-41b7-baf9-cfae419924b1 req-6943cdc2-8d1e-4fa5-8345-1399833dac1b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:59.345443 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a9e4811d-2e02-41b7-baf9-cfae419924b1 req-6943cdc2-8d1e-4fa5-8345-1399833dac1b service nova] Creating event network-changed:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:16:59.350697 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a9e4811d-2e02-41b7-baf9-cfae419924b1 req-6943cdc2-8d1e-4fa5-8345-1399833dac1b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037815 Jul 26 05:16:59.351682 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3351/6761] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:16:59.366117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:16:59.459518 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-11786def-1bd6-460c-ae12-8c89528a3347 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 204 len: 0 microversion: 2.1 time: 0.147556 Jul 26 05:16:59.460263 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3411/6762] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:16:59 2022] DELETE /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:16:59.477549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:16:59.478734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:16:59.487146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:59.487839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:59.488665 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:16:59.489272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:16:59.639392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:16:59.647303 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-20c12ce6-386d-4a87-882c-29aeae996ad2 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1582 microversion: 2.1 time: 0.175869 Jul 26 05:16:59.653330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3352/6763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:16:59 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1582 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:00.671198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:00.671991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:00.679279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:00.679752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:00.680579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:00.681037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:00.907331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:00.915017 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ae183d1-63de-4868-aaf0-41ab02f4cd32 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1582 microversion: 2.1 time: 0.248819 Jul 26 05:17:00.915592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3412/6764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:00 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1582 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:01.496853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ae5f22d1-00da-4acf-be49-fabdc8fb030d req-7d4b45da-7418-4e61-93c1-7dd27c350c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d222144-d125-49a7-bb37-6dbfcc3204ad", "name": "network-vif-deleted", "tag": "3a848cde-7c70-4779-800e-a582f27d36a9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:01.508893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ae5f22d1-00da-4acf-be49-fabdc8fb030d req-7d4b45da-7418-4e61-93c1-7dd27c350c13 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:01.509412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ae5f22d1-00da-4acf-be49-fabdc8fb030d req-7d4b45da-7418-4e61-93c1-7dd27c350c13 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:01.521963 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ae5f22d1-00da-4acf-be49-fabdc8fb030d req-7d4b45da-7418-4e61-93c1-7dd27c350c13 service nova] Creating event network-vif-deleted:3a848cde-7c70-4779-800e-a582f27d36a9 for instance 8d222144-d125-49a7-bb37-6dbfcc3204ad on n-h1-848886-16 Jul 26 05:17:01.527558 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ae5f22d1-00da-4acf-be49-fabdc8fb030d req-7d4b45da-7418-4e61-93c1-7dd27c350c13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Jul 26 05:17:01.528305 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3353/6765] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:01.937037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:01.937670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:01.944751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:01.945223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:01.946046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:01.946537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:02.010490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:02.019446 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e506b65f-ad2d-4078-ae05-9275ebbc70bc tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1229 microversion: 2.1 time: 0.086539 Jul 26 05:17:02.019973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3413/6766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:01 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:03.042978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:03.043883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:03.051368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:03.051830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:03.052627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:03.053075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:03.124961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:03.133461 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60f15ea3-3c61-42c1-a2d4-14b21f6ac43e tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1229 microversion: 2.1 time: 0.096040 Jul 26 05:17:03.134059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3354/6767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:03 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:04.156807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:04.157577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:04.164677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:04.165062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:04.165851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:04.166332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:04.232407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:04.240079 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1589a008-dc8c-414d-8f2a-e337f42c11c9 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1229 microversion: 2.1 time: 0.088166 Jul 26 05:17:04.240889 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3414/6768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:04 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:05.264357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:05.265554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:05.278123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:05.278971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:05.280191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:05.280919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:05.360975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc118b54e44405c89c27833cb6ce8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c520d4d54746718e6f7aa144a3b2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:05.369623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9eb3c8f9-39fe-43b5-8d0a-3ab036266cae tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 200 len: 1229 microversion: 2.1 time: 0.111912 Jul 26 05:17:05.370243 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3355/6769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:05 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:17:06.392492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:06.393139 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] [instance: 8d222144-d125-49a7-bb37-6dbfcc3204ad] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:06.399367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:06.399827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:06.400596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:06.401046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:06.414335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] HTTP exception thrown: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Request method failure captured: Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad HTTP/1.1 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33gfeLBWG4K1QXJMLjuo8_m-E9ZFRR2RLwLz-aKtZz2sXuGwmxVWfDFG9ce56WwV5UQMsyI1XSF6eRFo25I_W3xdpl7hCUaLpKC10kiEkp_3XWBIKBWBrecsPn1TFloDifLcVUIAtwC90hjmaLCtm8uo-mqPgD2N_V596hZhFVr9HY4 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e1c520d4d54746718e6f7aa144a3b2a6 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestVolumeBackupRestore-560564432 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1c520d4d54746718e6f7aa144a3b2a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1c520d4d54746718e6f7aa144a3b2a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1c520d4d54746718e6f7aa144a3b2a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1c520d4d54746718e6f7aa144a3b2a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestVolumeBackupRestore-560564432 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e1c520d4d54746718e6f7aa144a3b2a6 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestVolumeBackupRestore-560564432 Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestVolumeBackupRestore-560564432-project Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: edc118b54e44405c89c27833cb6ce8ec Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestVolumeBackupRestore-560564432-project Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '8d222144-d125-49a7-bb37-6dbfcc3204ad'} Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:06.415981 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Returning 404 to user: Instance 8d222144-d125-49a7-bb37-6dbfcc3204ad could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5394fdf5-7885-4555-8154-2342b32bb888 tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad" status: 404 len: 111 microversion: 2.1 time: 0.029074 Jul 26 05:17:06.422298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3415/6770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:06 2022] GET /compute/v2.1/servers/8d222144-d125-49a7-bb37-6dbfcc3204ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:17:06.584281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29fff2d0-232e-44a4-a1f5-525b9e30bfca tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] Calling method '.version_select at 0x7f38b47aab80>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:06.608017 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29fff2d0-232e-44a4-a1f5-525b9e30bfca tempest-TestVolumeBackupRestore-560564432 tempest-TestVolumeBackupRestore-560564432-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1077257366" status: 202 len: 0 microversion: 2.1 time: 0.027543 Jul 26 05:17:06.608658 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3356/6771] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Jul 26 05:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1077257366 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:17:29.607639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:29.609017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:29.732097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-552425548", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:29.788576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] validate_networks() for None {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:17:29.981698 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:17:29.982456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:17:29.982982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:17:29.983413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:17:29.983846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:17:29.993021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:29.993491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:29.994359 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:29.994822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:30.012246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Getting quotas for project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:17:30.018205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Getting quotas for user eee4ca8aa9334c19bbaa7b8053edf6e4 and project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:17:30.030595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:17:30.032843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:17:30.075550 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d4d1941-7d43-4f6a-9de2-6fb427ce8000 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474259 Jul 26 05:17:30.076784 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3416/6772] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:17:30.089039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b05c620-bdcf-4f54-a691-daa72fdda682 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:30.089661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b05c620-bdcf-4f54-a691-daa72fdda682 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:30.093712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=22 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:30.094405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:30.151832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b05c620-bdcf-4f54-a691-daa72fdda682 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:30.158521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b05c620-bdcf-4f54-a691-daa72fdda682 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1221 microversion: 2.1 time: 0.073339 Jul 26 05:17:30.159104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3357/6773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:30 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:31.180663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:31.181438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:31.188768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:31.189255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:31.190077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:31.190539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:31.278451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:31.287837 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a11a64f2-1016-4eb0-b3f1-dc7eff135f49 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1281 microversion: 2.1 time: 0.112248 Jul 26 05:17:31.288699 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3417/6774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:31 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:32.309507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:32.311058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:32.318142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:32.318612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:32.319399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:32.320109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:32.477398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:32.490601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f1d7bc85-81f7-4e45-b9d4-a3cc2a868f2b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.184389 Jul 26 05:17:32.490983 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3358/6775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:32 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:32.977058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-900aea6f-2afb-4493-8cc6-f4dea88b46c9 req-f24fdff7-ba9c-4846-90b4-e4819d0302f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ad7489-27d9-4405-b46f-c7a42d1b3696", "tag": "8bc4cb5c-c564-4fdc-829a-f41163ac645e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:33.001049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-900aea6f-2afb-4493-8cc6-f4dea88b46c9 req-f24fdff7-ba9c-4846-90b4-e4819d0302f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:33.001526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-900aea6f-2afb-4493-8cc6-f4dea88b46c9 req-f24fdff7-ba9c-4846-90b4-e4819d0302f1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:33.018985 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-900aea6f-2afb-4493-8cc6-f4dea88b46c9 req-f24fdff7-ba9c-4846-90b4-e4819d0302f1 service nova] Creating event network-changed:8bc4cb5c-c564-4fdc-829a-f41163ac645e for instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 on n-h1-848886-16 Jul 26 05:17:33.024331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-900aea6f-2afb-4493-8cc6-f4dea88b46c9 req-f24fdff7-ba9c-4846-90b4-e4819d0302f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051168 Jul 26 05:17:33.025504 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3418/6776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:33.522930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:33.523544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:33.530548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:33.531001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:33.531791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:33.532260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:33.665377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:33.672936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d2ab817-54d4-4797-82a0-62aad679128b tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.153939 Jul 26 05:17:33.673505 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3359/6777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:33 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:34.694884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:34.695771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:34.702659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:34.703129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:34.703914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:34.704377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:34.839171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:34.847332 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-614b055a-fdc7-44a8-81d2-b4cb47af64bb tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.157995 Jul 26 05:17:34.848530 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3419/6778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:34 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:35.869304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:35.869917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:35.877003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:35.877453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:35.878236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:35.878675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:36.010829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:36.018360 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79fb1ce7-913d-49be-b9f4-321f3c530a09 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.152866 Jul 26 05:17:36.018876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3360/6779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:35 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:37.039869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:37.040428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:37.047714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:37.048185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:37.048962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:37.049419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:37.179850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:37.187721 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-66a4946c-dcee-422f-8c53-1a3cf56690d8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.151868 Jul 26 05:17:37.188288 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3420/6780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:37 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:38.208468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:38.209094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:38.215982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:38.216434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:38.217846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:38.218316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:38.348718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:38.356220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1e7d32c-08a6-4f28-8f28-b4d0614a8f36 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.151691 Jul 26 05:17:38.356796 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3361/6781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:38 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:38.645183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-dbb35e4b-23a7-46da-924e-01fca83457c1 req-639a98b9-f4ec-4e17-b7d6-79a7db4c67cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad7489-27d9-4405-b46f-c7a42d1b3696", "name": "network-vif-plugged", "status": "completed", "tag": "8bc4cb5c-c564-4fdc-829a-f41163ac645e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:38.656729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dbb35e4b-23a7-46da-924e-01fca83457c1 req-639a98b9-f4ec-4e17-b7d6-79a7db4c67cb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:38.657198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dbb35e4b-23a7-46da-924e-01fca83457c1 req-639a98b9-f4ec-4e17-b7d6-79a7db4c67cb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:38.668614 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-dbb35e4b-23a7-46da-924e-01fca83457c1 req-639a98b9-f4ec-4e17-b7d6-79a7db4c67cb service nova] Creating event network-vif-plugged:8bc4cb5c-c564-4fdc-829a-f41163ac645e for instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 on n-h1-848886-16 Jul 26 05:17:38.674107 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-dbb35e4b-23a7-46da-924e-01fca83457c1 req-639a98b9-f4ec-4e17-b7d6-79a7db4c67cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Jul 26 05:17:38.674741 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3421/6782] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:39.378015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:39.378620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:39.385751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:39.386231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:39.387006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:39.387453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:39.520501 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:39.528063 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a6fbd3c-3ad2-474f-b416-093db6125bdc tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1321 microversion: 2.1 time: 0.154763 Jul 26 05:17:39.528638 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3362/6783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:39 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:40.546901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:40.547695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:40.552227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:40.552935 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:40.560222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:40.561215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:40.562052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:40.562596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:40.699035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:40.707285 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-11d930da-c3c3-4fc8-bbaa-08aa8e6af6a8 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1470 microversion: 2.1 time: 0.162346 Jul 26 05:17:40.707863 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3422/6784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:40 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:40.730091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:40.793185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16932690-6cc7-488a-8418-0632cd0d1179 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '.version_select at 0x7f38b509f040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:40.860332 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16932690-6cc7-488a-8418-0632cd0d1179 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/83dd4e46add14c29a7d9e9466c0556d5" status: 200 len: 371 microversion: 2.1 time: 0.134740 Jul 26 05:17:40.860903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3363/6785] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 05:17:40 2022] GET /compute/v2.1/os-quota-sets/83dd4e46add14c29a7d9e9466c0556d5 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:40.872221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-10b7f363-fc8d-4a63-804f-c8039ded3dfe tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2030458005", "id": 1516190302, "os-flavor-access:is_public": "True"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:40.875326 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:17:40.875326 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 05:17:40.891465 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-10b7f363-fc8d-4a63-804f-c8039ded3dfe tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022891 Jul 26 05:17:40.892115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3423/6786] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:17:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:40.903980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1516190302"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:40.907046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:40.913310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:40.913775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:40.914584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:40.915033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.103224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8baad3e41d7948889d02b8244562f7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dd4e46add14c29a7d9e9466c0556d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:41.110140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2030458005 {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:17:41.116955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.117409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.118263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.118707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.139952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Getting quotas for project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:17:41.145027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Getting quotas for user eee4ca8aa9334c19bbaa7b8053edf6e4 and project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:17:41.157789 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.compute.api [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] ram quota exceeded for 83dd4e46add14c29a7d9e9466c0556d5, tried to resize instance. Jul 26 05:17:41.158363 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Request method failure captured: Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action HTTP/1.1 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 39 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33jpOQKpgbcI9iSgQXjh-t9IpFxN7ZZXQGvWYzlpdQJ8vcUla0OvsKaTgADhGLavff2OZBLy3QyIqpt4NnpecFezW_7SmnjHK2Bj8M2fIS9rER10WkbwBIALOVY8lbFQ7d7PHIvnyuOE62P5SIkn9yzOIcnZnUoXE37YLcxmb1_bqgw Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 83dd4e46add14c29a7d9e9466c0556d5 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader,admin Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader,admin Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 83dd4e46add14c29a7d9e9466c0556d5 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminNegativeTestJSON-28646731-project-admin Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 8baad3e41d7948889d02b8244562f7c8 Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28646731-project-admin Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: {"resize": {"flavorRef": "1516190302"}} Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '01ad7489-27d9-4405-b46f-c7a42d1b3696', 'body': {'resize': {'flavorRef': '1516190302'}}} Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.160508 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa682011-daa8-4083-8b81-9034a45fb261 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action" status: 403 len: 118 microversion: 2.1 time: 0.261944 Jul 26 05:17:41.169308 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3364/6787] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:17:40 2022] POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:17:41.173712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b02df5c5-a132-40d9-9e72-554c11daa959 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.173712 n-d-848886-16 devstack@n-api.service[119488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:17:41.173712 n-d-848886-16 devstack@n-api.service[119488]: warnings.warn(msg) Jul 26 05:17:41.187878 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b02df5c5-a132-40d9-9e72-554c11daa959 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1516190302" status: 202 len: 0 microversion: 2.1 time: 0.020709 Jul 26 05:17:41.188474 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3424/6788] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 05:17:41 2022] DELETE /compute/v2.1/flavors/1516190302 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:17:41.196325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5bd925ec-13df-4e93-adec-2544aac173e2 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.217052 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5bd925ec-13df-4e93-adec-2544aac173e2 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024234 Jul 26 05:17:41.217802 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3365/6789] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 05:17:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:41.237622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2852a39-e2ba-461b-8e75-a8ad6df589cd tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '.version_select at 0x7f38babf3f70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.307039 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2852a39-e2ba-461b-8e75-a8ad6df589cd tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/83dd4e46add14c29a7d9e9466c0556d5" status: 200 len: 371 microversion: 2.1 time: 0.073096 Jul 26 05:17:41.307623 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3425/6790] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Jul 26 05:17:41 2022] GET /compute/v2.1/os-quota-sets/83dd4e46add14c29a7d9e9466c0556d5 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:41.318998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eee7d8dd-64f6-4231-b758-072244776012 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2093251006", "id": 1933372572, "os-flavor-access:is_public": "True"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:41.322055 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:17:41.322055 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 05:17:41.337174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eee7d8dd-64f6-4231-b758-072244776012 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021959 Jul 26 05:17:41.337747 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3366/6791] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:17:41 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:41.349799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1933372572"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:41.352270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:41.359354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.359827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.360622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.361080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.449773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8baad3e41d7948889d02b8244562f7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dd4e46add14c29a7d9e9466c0556d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:41.457229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2093251006 {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:17:41.464629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.465097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.465927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.466409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.490184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Getting quotas for project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:17:41.495677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Getting quotas for user eee4ca8aa9334c19bbaa7b8053edf6e4 and project 790986ed94fb48a8802fbc7f8057c4b5. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:17:41.508926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] cores quota exceeded for 83dd4e46add14c29a7d9e9466c0556d5, tried to resize instance. Jul 26 05:17:41.509399 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Request method failure captured: Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action HTTP/1.1 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 39 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33jpOQKpgbcI9iSgQXjh-t9IpFxN7ZZXQGvWYzlpdQJ8vcUla0OvsKaTgADhGLavff2OZBLy3QyIqpt4NnpecFezW_7SmnjHK2Bj8M2fIS9rER10WkbwBIALOVY8lbFQ7d7PHIvnyuOE62P5SIkn9yzOIcnZnUoXE37YLcxmb1_bqgw Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 83dd4e46add14c29a7d9e9466c0556d5 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader,admin Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader,admin Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83dd4e46add14c29a7d9e9466c0556d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 83dd4e46add14c29a7d9e9466c0556d5 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-28646731 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersAdminNegativeTestJSON-28646731-project-admin Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 8baad3e41d7948889d02b8244562f7c8 Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-28646731-project-admin Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: {"resize": {"flavorRef": "1933372572"}} Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '01ad7489-27d9-4405-b46f-c7a42d1b3696', 'body': {'resize': {'flavorRef': '1933372572'}}} Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.511873 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c6dc6d4-afab-44da-8906-c3663b9f8f6f tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action" status: 403 len: 113 microversion: 2.1 time: 0.167529 Jul 26 05:17:41.517214 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3426/6792] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:17:41 2022] POST /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:17:41.522133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-864e95e0-8a71-4e55-bf2d-de1528c81197 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.522926 n-d-848886-16 devstack@n-api.service[119487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 05:17:41.522926 n-d-848886-16 devstack@n-api.service[119487]: warnings.warn(msg) Jul 26 05:17:41.541609 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-864e95e0-8a71-4e55-bf2d-de1528c81197 tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1933372572" status: 202 len: 0 microversion: 2.1 time: 0.023132 Jul 26 05:17:41.542243 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3367/6793] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Jul 26 05:17:41 2022] DELETE /compute/v2.1/flavors/1933372572 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:17:41.551733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6f48ed24-7254-4a50-8584-8fb06ce9200a tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.573299 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6f48ed24-7254-4a50-8584-8fb06ce9200a tempest-ServersAdminNegativeTestJSON-28646731 tempest-ServersAdminNegativeTestJSON-28646731-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025260 Jul 26 05:17:41.573890 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3427/6794] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Jul 26 05:17:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:41.594428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.594935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:41.601155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.601616 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.602421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.602871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.628219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:17:41.702576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d86c070-08c4-4221-82d1-0f863ea69251 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 204 len: 0 microversion: 2.1 time: 0.111664 Jul 26 05:17:41.703234 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3368/6795] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:17:41 2022] DELETE /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:17:41.711562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:41.712210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:41.719122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.719584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.720357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:41.720809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:41.849913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:41.857675 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4ecb5c0-4cb0-455a-8ed5-59cbded103be tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1476 microversion: 2.1 time: 0.149945 Jul 26 05:17:41.858291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3428/6796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:41 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1476 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:42.879579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:42.880209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:42.887471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:42.887934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:42.888707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:42.889284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:43.023888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee4ca8aa9334c19bbaa7b8053edf6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790986ed94fb48a8802fbc7f8057c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:43.032161 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6b6b23f-f915-43ee-ba9e-ab629b0cb97e tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 200 len: 1476 microversion: 2.1 time: 0.157041 Jul 26 05:17:43.032741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3369/6797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:42 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:43.593008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4c22daaf-c673-4d80-8356-04616cc8b139 req-36f6cb73-2ca7-4a0e-bd94-4bfbe8ef7d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad7489-27d9-4405-b46f-c7a42d1b3696", "name": "network-vif-deleted", "tag": "8bc4cb5c-c564-4fdc-829a-f41163ac645e"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:43.619794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4c22daaf-c673-4d80-8356-04616cc8b139 req-36f6cb73-2ca7-4a0e-bd94-4bfbe8ef7d81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:43.620269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4c22daaf-c673-4d80-8356-04616cc8b139 req-36f6cb73-2ca7-4a0e-bd94-4bfbe8ef7d81 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:43.634018 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4c22daaf-c673-4d80-8356-04616cc8b139 req-36f6cb73-2ca7-4a0e-bd94-4bfbe8ef7d81 service nova] Creating event network-vif-deleted:8bc4cb5c-c564-4fdc-829a-f41163ac645e for instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 on n-h1-848886-16 Jul 26 05:17:43.639768 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4c22daaf-c673-4d80-8356-04616cc8b139 req-36f6cb73-2ca7-4a0e-bd94-4bfbe8ef7d81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050919 Jul 26 05:17:43.643542 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3429/6798] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:44.053793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:44.054515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] [instance: 01ad7489-27d9-4405-b46f-c7a42d1b3696] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:44.063009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:44.063468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:44.064245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:44.064689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:44.079010 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] HTTP exception thrown: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Request method failure captured: Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 HTTP/1.1 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33jo1oKSQASAxXVbIVOzB-EYoEkSX2Y45_DgXOOuSmPmGiNCn2CNXx4wDgXYI480eqXTTQjKW79Pre9txprTqUjMCdbE0fQtd-nsah55SoBc8wqV4oSjTxWJpu_2iZ1sN8dAjpRp4IJHZPdXVhtddka-JZGcvx9nbZS949itGyMbkiA Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 790986ed94fb48a8802fbc7f8057c4b5 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-550861508 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/790986ed94fb48a8802fbc7f8057c4b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/790986ed94fb48a8802fbc7f8057c4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/790986ed94fb48a8802fbc7f8057c4b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_790986ed94fb48a8802fbc7f8057c4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-550861508 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 790986ed94fb48a8802fbc7f8057c4b5 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-550861508 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersAdminNegativeTestJSON-550861508-project Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: eee4ca8aa9334c19bbaa7b8053edf6e4 Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-550861508-project Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '01ad7489-27d9-4405-b46f-c7a42d1b3696'} Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:17:44.080675 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] Returning 404 to user: Instance 01ad7489-27d9-4405-b46f-c7a42d1b3696 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-038feff6-029c-4aa2-9320-5cde390d9398 tempest-ServersAdminNegativeTestJSON-550861508 tempest-ServersAdminNegativeTestJSON-550861508-project] 10.222.0.43 "GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696" status: 404 len: 111 microversion: 2.1 time: 0.033064 Jul 26 05:17:44.086374 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3370/6799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:44 2022] GET /compute/v2.1/servers/01ad7489-27d9-4405-b46f-c7a42d1b3696 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:17:50.361952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-421041403", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "3f6216ff-9122-4aff-a061-a19e64584a15"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:50.416930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] validate_networks() for [('3f6216ff-9122-4aff-a061-a19e64584a15', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:17:50.813991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:17:50.814454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:17:50.814949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:17:50.815378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:17:50.815839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:17:50.824972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:50.825441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:50.826290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:50.826754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:50.844999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Getting quotas for project d1a9fc92480b4c44802918c933c58fa2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:17:50.851896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Getting quotas for user aa1e9155222b44fc991a1e0953207411 and project d1a9fc92480b4c44802918c933c58fa2. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:17:50.869480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:17:50.872341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:17:50.920456 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab660b99-eab8-4a2a-92bf-71aaaa4e4bbb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690384 Jul 26 05:17:50.922191 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3430/6800] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:17:50.935018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4b2bfb27-b762-4df4-800a-3bdd4b947345 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:50.935633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b2bfb27-b762-4df4-800a-3bdd4b947345 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:50.941297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:51.014789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4b2bfb27-b762-4df4-800a-3bdd4b947345 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:51.023659 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4b2bfb27-b762-4df4-800a-3bdd4b947345 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1214 microversion: 2.1 time: 0.094386 Jul 26 05:17:51.024796 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3371/6801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:50 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:52.045483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:52.047077 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:52.060097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:52.060840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:52.062319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:52.063081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:52.143155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:52.151956 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-89154d91-5262-4e29-9449-7683b9447323 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1272 microversion: 2.1 time: 0.110659 Jul 26 05:17:52.153718 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3431/6802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:52 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:53.063808 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:17:53.064388 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:17:53.170820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:17:53.177452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:53.178744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:53.186474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:53.187679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:53.188479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:53.188926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:53.366492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:53.375815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68252147-6b91-4a09-a0ed-5e1ad053f456 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.206195 Jul 26 05:17:53.377025 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3372/6803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:53 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:53.507101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-96b58793-bf12-4dda-bc2d-ff98ffb5a1e1 req-4d46f321-0ccf-4bc5-9ae5-e8925a1c125c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8432d45-a951-4297-9d12-0ff437fb2de9", "tag": "201911c8-579e-4415-8e6d-582a96cc8995"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:53.540053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96b58793-bf12-4dda-bc2d-ff98ffb5a1e1 req-4d46f321-0ccf-4bc5-9ae5-e8925a1c125c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:53.540831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96b58793-bf12-4dda-bc2d-ff98ffb5a1e1 req-4d46f321-0ccf-4bc5-9ae5-e8925a1c125c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:53.560576 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-96b58793-bf12-4dda-bc2d-ff98ffb5a1e1 req-4d46f321-0ccf-4bc5-9ae5-e8925a1c125c service nova] Creating event network-changed:201911c8-579e-4415-8e6d-582a96cc8995 for instance b8432d45-a951-4297-9d12-0ff437fb2de9 on n-h1-848886-16 Jul 26 05:17:53.566822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-96b58793-bf12-4dda-bc2d-ff98ffb5a1e1 req-4d46f321-0ccf-4bc5-9ae5-e8925a1c125c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063530 Jul 26 05:17:53.568181 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3432/6804] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:17:54.104079 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:17:54.104261 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:17:54.396184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:54.396813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:54.403776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:54.404231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:54.404996 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:54.405688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:54.543434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:54.551707 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-227a6368-1ac0-41af-b7f4-9ed6ba9a4eb4 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.159541 Jul 26 05:17:54.552284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3373/6805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:54 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:55.574357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:55.575074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:55.582136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:55.582634 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:55.583423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:55.583885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:55.712823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:55.721224 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-780c87c9-c185-4efd-8c3a-29cdcbe3b55b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.151998 Jul 26 05:17:55.722041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3433/6806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:55 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:56.743073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:56.743878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:56.751267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:56.751727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:56.752505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:56.752959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:56.890975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:56.898524 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f57546d7-bdb0-4d46-92e4-6e9bfe32a598 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.159456 Jul 26 05:17:56.899093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3374/6807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:56 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:57.919957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:57.920579 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:57.928014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:57.928508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:57.929277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:57.929724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:58.061412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:58.068981 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9592a18e-c80e-4294-9084-e2f50f7cddcb tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.152941 Jul 26 05:17:58.069557 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3434/6808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:57 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:17:58.746332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0dc37102-868c-4b6f-86d0-7473924ac283 req-d9e86dce-6fe8-47c0-98c9-bfafa23759fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8432d45-a951-4297-9d12-0ff437fb2de9", "name": "network-vif-plugged", "status": "completed", "tag": "201911c8-579e-4415-8e6d-582a96cc8995"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:17:58.756853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0dc37102-868c-4b6f-86d0-7473924ac283 req-d9e86dce-6fe8-47c0-98c9-bfafa23759fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:58.757780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0dc37102-868c-4b6f-86d0-7473924ac283 req-d9e86dce-6fe8-47c0-98c9-bfafa23759fc service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:58.770445 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0dc37102-868c-4b6f-86d0-7473924ac283 req-d9e86dce-6fe8-47c0-98c9-bfafa23759fc service nova] Creating event network-vif-plugged:201911c8-579e-4415-8e6d-582a96cc8995 for instance b8432d45-a951-4297-9d12-0ff437fb2de9 on n-h1-848886-16 Jul 26 05:17:58.775644 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0dc37102-868c-4b6f-86d0-7473924ac283 req-d9e86dce-6fe8-47c0-98c9-bfafa23759fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Jul 26 05:17:58.776320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3375/6809] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:17:59.090004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:17:59.090691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:17:59.098605 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:59.099071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:59.099846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:17:59.100299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:17:59.232649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:17:59.240947 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9fe7bc9-2f6e-4470-99ff-1be3acae43ce tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1314 microversion: 2.1 time: 0.154824 Jul 26 05:17:59.241528 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3435/6810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:17:59 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:00.262659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:00.263301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:00.265784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:00.271370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.271854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.272625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.273076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.277790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:00.414051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:00.422165 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1d10284b-9724-48c6-8f70-402eb67ed8f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1501 microversion: 2.1 time: 0.164546 Jul 26 05:18:00.422745 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3376/6811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:00 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:00.443081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:00.445377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:00.448182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:00.454445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.454906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.455676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.456122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.459312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=80 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:00.486318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:00.491944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:18:00.498018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:18:00.498472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:18:00.498951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:18:00.499430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:18:00.499854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:18:00.563434 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2821423a-8302-4468-b2f9-d7790a450c1f tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "POST /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9/action" status: 202 len: 0 microversion: 2.1 time: 0.124095 Jul 26 05:18:00.563982 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3436/6812] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:18:00 2022] POST /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:18:00.572206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:00.572755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:00.579035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.579422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.580205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:00.580656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:00.716202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:00.723992 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-365c7c10-3b9a-444c-808e-2018bccaafcf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1510 microversion: 2.1 time: 0.155705 Jul 26 05:18:00.724623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3377/6813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:00 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:01.741679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:01.742501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:01.747745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:01.748365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:01.755794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:01.756325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:01.757101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:01.757550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:01.889315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:01.897127 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-adfbc180-8ab0-4b5a-97b4-71037191e9a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1510 microversion: 2.1 time: 0.156168 Jul 26 05:18:01.897699 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3437/6814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:01 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:02.917977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:02.918619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:02.920511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:02.927380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:02.927833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:02.928596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:02.929042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:03.066687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:03.074303 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7fb1365-0c1e-42b3-9a1f-9412e26a1c52 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.160516 Jul 26 05:18:03.074876 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3378/6815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:02 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:04.094669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:04.095296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:04.102176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:04.102637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:04.103409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:04.103871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:04.233661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:04.241724 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-197ce34c-0227-4e8a-a8bf-24aabc162d59 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.151170 Jul 26 05:18:04.242312 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3438/6816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:04 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:05.263745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:05.264346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:05.271782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:05.272231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:05.272992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:05.273430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:05.403584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:05.411585 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bdd102da-b031-4f14-ac3c-813f7a963f1b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.152041 Jul 26 05:18:05.412158 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3379/6817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:05 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:06.432625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:06.433274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:06.440081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:06.440538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:06.441324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:06.441757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:06.575623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:06.583811 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27a29029-7d57-4412-84f1-0bc598313806 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.155351 Jul 26 05:18:06.584384 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3439/6818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:06 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:07.604977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:07.605595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:07.613139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:07.613598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:07.614400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:07.614850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:07.747131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:07.755043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9c8fe58-a56f-42cb-bbda-f7d51ebc2d0c tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.154063 Jul 26 05:18:07.755627 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3380/6819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:07 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:08.776853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:08.777479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:08.785357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:08.785829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:08.786639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:08.787094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:08.918828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:08.927411 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2046fe71-3328-4aca-a6d8-1bfd5a957c12 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.154381 Jul 26 05:18:08.927987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3440/6820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:08 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:09.948664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:09.949313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:09.956314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:09.956773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:09.957541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:09.957985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:10.093126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:10.100893 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77044818-9e4f-4e7a-abfc-3ce5cd29b735 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156316 Jul 26 05:18:10.101460 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3381/6821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:09 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:11.122908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:11.123650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:11.131802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:11.132272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:11.133069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:11.133529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:11.269190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:11.276796 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e727ee2-bfba-4563-b0d4-c0523eeaad7d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.157794 Jul 26 05:18:11.277362 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3441/6822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:11 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:12.297291 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:12.297955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:12.304999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:12.305444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:12.306223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:12.306663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:12.436765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:12.444882 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7070eb37-77f2-45fc-89c3-d076b78e98e6 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.151493 Jul 26 05:18:12.445455 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3382/6823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:12 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:13.465929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:13.466573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:13.473835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:13.474334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:13.475113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:13.475568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:13.606224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:13.614539 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1a5fe4c3-0830-4bc2-b74b-8f29dbc84424 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.152415 Jul 26 05:18:13.615481 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3442/6824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:13 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:14.636847 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:14.637469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:14.645282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:14.645742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:14.646537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:14.646988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:14.783851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:14.791974 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-946dbb6e-927f-4d03-af98-0a845d513dbf tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.159176 Jul 26 05:18:14.792547 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3383/6825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:14 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:15.812894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:15.813521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:15.821103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:15.821568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:15.822381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:15.822840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:15.958230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:15.965861 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-84a40dfe-1f93-4945-bf97-d97799edbca3 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156872 Jul 26 05:18:15.966469 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3443/6826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:15 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:16.987404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:16.989013 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:16.996137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:16.996591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:16.997358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:16.997794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:17.132328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:17.140389 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8e786a0-5465-4d21-a15c-3d06aaef9987 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156828 Jul 26 05:18:17.140977 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3384/6827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:16 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:18.162370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:18.163014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:18.170406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:18.170878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:18.171685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:18.172156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:18.306449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:18.313874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f8313b5-7240-45f2-a85b-cf32f18ee522 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.155541 Jul 26 05:18:18.314466 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3444/6828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:18 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:19.336386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:19.336998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:19.344048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:19.344510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:19.345288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:19.345733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:19.480527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:19.488739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-239c57e6-6ef4-4625-8a2b-23f1afc439cc tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156610 Jul 26 05:18:19.489482 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3385/6829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:19 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:20.509952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:20.510617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:20.517702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:20.518176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:20.518995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:20.519661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:20.648667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:20.656610 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6cb4ac96-d93e-4e31-811c-419376418263 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.150464 Jul 26 05:18:20.657202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3445/6830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:20 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:21.678512 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:21.679145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:21.685986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:21.686473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:21.687235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:21.687696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:21.821061 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:21.828632 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d54bee16-2f0a-429d-8406-b57a21fe4f57 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.154783 Jul 26 05:18:21.829210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3386/6831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:21 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:22.850976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:22.851575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:22.858589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:22.859063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:22.859847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:22.860306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:22.994602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:23.002056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f5e5310-b35d-4034-aa6b-e3683156d0a1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.155726 Jul 26 05:18:23.002650 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3446/6832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:22 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:24.024189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:24.024803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:24.031760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:24.032214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:24.032980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:24.033429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:24.167853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:24.175484 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d36a2beb-a23d-4d8d-9172-034640dc2717 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.155202 Jul 26 05:18:24.176061 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3387/6833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:24 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:25.196496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:25.197103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:25.204122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:25.204582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:25.205348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:25.205796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:25.336475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:25.344000 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-775665d9-6d45-4346-824d-2a02667da3ba tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.151406 Jul 26 05:18:25.344638 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3447/6834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:25 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:26.365415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:26.366064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:26.373373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:26.373781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:26.374588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:26.375037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:26.509366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:26.517139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d45529fd-859d-4a7b-be4b-c2dbe07a3c27 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156168 Jul 26 05:18:26.517715 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3388/6835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:26 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:27.537903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:27.538559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:27.545582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:27.546046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:27.546854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:27.547308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:27.682821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:27.690395 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-658f7329-13c3-4905-9f41-0c6bb8dd074b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156390 Jul 26 05:18:27.690964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3448/6836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:27 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:28.712248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:28.712865 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:28.719925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:28.720383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:28.721154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:28.721600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:28.856331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:28.864419 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc234587-0d55-48e8-9828-1cd81ccfcc95 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1515 microversion: 2.1 time: 0.156056 Jul 26 05:18:28.865015 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3389/6837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:28 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:29.885337 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:29.885906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:29.893078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:29.893543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:29.894354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:29.895073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:29.995429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8432d45-a951-4297-9d12-0ff437fb2de9", "name": "network-vif-unplugged", "status": "completed", "tag": "201911c8-579e-4415-8e6d-582a96cc8995"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:30.008140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:30.008897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:30.022444 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] Creating event network-vif-unplugged:201911c8-579e-4415-8e6d-582a96cc8995 for instance b8432d45-a951-4297-9d12-0ff437fb2de9 on n-h2-848886-16 Jul 26 05:18:30.030558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] Instance b8432d45-a951-4297-9d12-0ff437fb2de9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:18:30.038561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:30.044541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-00c010e3-b7a4-4f85-bac0-069976274f47 req-181fae27-c7fa-4855-95c8-b5660da191d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052942 Jul 26 05:18:30.046561 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3390/6838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:18:30.052649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e3cd7bc-bb30-4ac6-a4d0-83081c4805a9 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1514 microversion: 2.1 time: 0.170109 Jul 26 05:18:30.053265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3449/6839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:29 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:31.077077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:31.077696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:31.079674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=30 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:31.085727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:31.086214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:31.087005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:31.087455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:31.091842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=88 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:31.221774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:31.230236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-439c452e-1382-4e6e-9fc7-6b3ef0c1c45d tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1512 microversion: 2.1 time: 0.158748 Jul 26 05:18:31.230817 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3391/6840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:31 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:32.063831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8432d45-a951-4297-9d12-0ff437fb2de9", "tag": "201911c8-579e-4415-8e6d-582a96cc8995"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:32.070210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:32.076088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:32.076540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:32.080144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:32.088933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] Creating event network-changed:201911c8-579e-4415-8e6d-582a96cc8995 for instance b8432d45-a951-4297-9d12-0ff437fb2de9 on n-h2-848886-16 Jul 26 05:18:32.094863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] Instance b8432d45-a951-4297-9d12-0ff437fb2de9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:18:32.105825 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ef82de54-3c69-4cd7-8d30-c4186216fd6c req-b2175fdc-c70e-40b0-8309-4b33a3442bef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045936 Jul 26 05:18:32.106470 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3450/6841] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:18:32.252771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:32.253393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:32.260340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:32.260786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:32.261587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:32.262056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:32.406544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:32.414768 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d3a0e8f7-b262-48ac-aee4-190dc493e1f1 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1512 microversion: 2.1 time: 0.165975 Jul 26 05:18:32.415363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3392/6842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:32 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:33.437604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:33.438336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:33.445536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:33.445999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:33.446799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:33.447250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:33.585757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:33.593570 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-27d42e64-16d1-4174-a1ec-81c25d1e7952 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1512 microversion: 2.1 time: 0.160970 Jul 26 05:18:33.594310 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3451/6843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:33 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:34.615618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:34.616224 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:34.623159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:34.623612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:34.624373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:34.624816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:34.756687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:34.764401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14c4ef66-0f53-4b41-bcf9-c85c8952a475 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1509 microversion: 2.1 time: 0.152700 Jul 26 05:18:34.765240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3393/6844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:34 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:34.784997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:34.785814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:34.792188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:34.792660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:34.793443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:34.793896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:34.820485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:18:34.869604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.compute.api [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Found an unconfirmed migration during delete, id: 16, status: finished Jul 26 05:18:36.233360 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e6296e94-9014-4b6e-92b8-fd00f58f8160 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 204 len: 0 microversion: 2.1 time: 1.451986 Jul 26 05:18:36.234120 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3452/6845] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:18:34 2022] DELETE /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:18:36.242568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:36.243191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:36.249730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:36.250225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:36.251010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:36.251463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:36.390257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:36.397774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffdf4aa2-085a-49b7-852d-5d0507d01e80 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1501 microversion: 2.1 time: 0.159334 Jul 26 05:18:36.398364 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3394/6846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:36 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:37.420350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:37.421098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:37.428017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:37.428489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:37.429267 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:37.429727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:37.562694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa1e9155222b44fc991a1e0953207411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9fc92480b4c44802918c933c58fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:37.570202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af542235-6406-4afa-a386-b0cb305b9513 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 200 len: 1501 microversion: 2.1 time: 0.154138 Jul 26 05:18:37.570774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3453/6847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:37 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:38.109457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-61f906f9-4305-4119-a0ee-9e6434b076ca req-101b23c8-53c6-4c9b-b8c3-64c228b1c029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8432d45-a951-4297-9d12-0ff437fb2de9", "name": "network-vif-deleted", "tag": "201911c8-579e-4415-8e6d-582a96cc8995"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:38.120825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61f906f9-4305-4119-a0ee-9e6434b076ca req-101b23c8-53c6-4c9b-b8c3-64c228b1c029 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.121276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-61f906f9-4305-4119-a0ee-9e6434b076ca req-101b23c8-53c6-4c9b-b8c3-64c228b1c029 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.133353 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-61f906f9-4305-4119-a0ee-9e6434b076ca req-101b23c8-53c6-4c9b-b8c3-64c228b1c029 service nova] Creating event network-vif-deleted:201911c8-579e-4415-8e6d-582a96cc8995 for instance b8432d45-a951-4297-9d12-0ff437fb2de9 on n-h2-848886-16 Jul 26 05:18:38.138481 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-61f906f9-4305-4119-a0ee-9e6434b076ca req-101b23c8-53c6-4c9b-b8c3-64c228b1c029 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Jul 26 05:18:38.139100 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3395/6848] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:18:38.591503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:38.592121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:38.599786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.600246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.601023 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.601486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.616198 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] HTTP exception thrown: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Request method failure captured: Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 HTTP/1.1 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33j-l4cWrwjP5SeSmf3POPoNGV4Fr22pQ6V4QMN_BCfOXFLytpRqg3MZc-o1QcI7q3mb8CgzlgN9DHc-Y4pRwlGTiuk2ZLFgIoF3YcnlCDl9CcxUolRlOAOxnVTPXE4hsLJNL2nrqqZQBw5y2eSIpA6LUYac_gyL0OVsYuGJ3lW_YLU Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: aa1e9155222b44fc991a1e0953207411 Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b8432d45-a951-4297-9d12-0ff437fb2de9'} Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.617832 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Returning 404 to user: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71216178-c352-4729-9783-88d8098a3d0b tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 404 len: 111 microversion: 2.1 time: 0.031674 Jul 26 05:18:38.621202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3454/6849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:38 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:18:38.635386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:38.635964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:38.642595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.643045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.643800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.644234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.657401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] HTTP exception thrown: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Request method failure captured: Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 HTTP/1.1 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33j-l4cWrwjP5SeSmf3POPoNGV4Fr22pQ6V4QMN_BCfOXFLytpRqg3MZc-o1QcI7q3mb8CgzlgN9DHc-Y4pRwlGTiuk2ZLFgIoF3YcnlCDl9CcxUolRlOAOxnVTPXE4hsLJNL2nrqqZQBw5y2eSIpA6LUYac_gyL0OVsYuGJ3lW_YLU Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: aa1e9155222b44fc991a1e0953207411 Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'b8432d45-a951-4297-9d12-0ff437fb2de9'} Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:18:38.659082 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Returning 404 to user: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6419b94e-0cd8-4ced-b744-aae2c2b38ba5 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 404 len: 111 microversion: 2.1 time: 0.029584 Jul 26 05:18:38.662804 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3396/6850] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:18:38 2022] DELETE /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:18:38.669656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:38.670314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] [instance: b8432d45-a951-4297-9d12-0ff437fb2de9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:38.677255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.677507 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.678304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:38.678755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:38.694745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] HTTP exception thrown: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Request method failure captured: Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 HTTP/1.1 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33j-l4cWrwjP5SeSmf3POPoNGV4Fr22pQ6V4QMN_BCfOXFLytpRqg3MZc-o1QcI7q3mb8CgzlgN9DHc-Y4pRwlGTiuk2ZLFgIoF3YcnlCDl9CcxUolRlOAOxnVTPXE4hsLJNL2nrqqZQBw5y2eSIpA6LUYac_gyL0OVsYuGJ3lW_YLU Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1a9fc92480b4c44802918c933c58fa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: d1a9fc92480b4c44802918c933c58fa2 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1124051912 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: aa1e9155222b44fc991a1e0953207411 Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-DeleteServersTestJSON-1124051912-project Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'b8432d45-a951-4297-9d12-0ff437fb2de9'} Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:18:38.696254 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] Returning 404 to user: Instance b8432d45-a951-4297-9d12-0ff437fb2de9 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-766fbe5a-5882-4632-94a0-7a6d0894e813 tempest-DeleteServersTestJSON-1124051912 tempest-DeleteServersTestJSON-1124051912-project] 10.222.0.43 "GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9" status: 404 len: 111 microversion: 2.1 time: 0.031815 Jul 26 05:18:38.703237 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3455/6851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:38 2022] GET /compute/v2.1/servers/b8432d45-a951-4297-9d12-0ff437fb2de9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:18:47.395627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-523705234", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "d4dc7d86-827c-493b-af40-ffdd048eb66e"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:47.452311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] validate_networks() for [('d4dc7d86-827c-493b-af40-ffdd048eb66e', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:18:47.847744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:18:47.848183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:18:47.849084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:18:47.849516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:18:47.849937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:18:47.858974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:47.859432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:47.860244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:47.861042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:47.878715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for project e61b1f85218045fe8e45634ba5234147. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:18:47.885305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for user 4d8a9846d3ac406694dc48e5a8d83671 and project e61b1f85218045fe8e45634ba5234147. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:18:47.899245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:18:47.901546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:18:47.947914 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-60c0e5c1-568b-4858-80ce-bafb70ca3189 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679536 Jul 26 05:18:47.948573 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3397/6852] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:18:47.960029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e210dcc-40ac-4ee8-bc65-ed154862791a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:47.960647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e210dcc-40ac-4ee8-bc65-ed154862791a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:48.016119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e210dcc-40ac-4ee8-bc65-ed154862791a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:48.023159 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e210dcc-40ac-4ee8-bc65-ed154862791a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1217 microversion: 2.1 time: 0.067701 Jul 26 05:18:48.023732 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3456/6853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:47 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:49.045041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:49.045664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:49.054294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:49.054758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:49.055540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:49.055991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:49.133441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:49.143041 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0cbe57f7-2b38-45cb-b185-f6d7c2fcbce5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1275 microversion: 2.1 time: 0.102578 Jul 26 05:18:49.151312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3398/6854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:49 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:50.165026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:50.165662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:50.168656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:50.177931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:50.178498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:50.179339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:50.179840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:50.400880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:50.409709 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12982634-e913-4e89-aec9-82d82fa460a1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.248783 Jul 26 05:18:50.410822 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3457/6855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:50 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:50.500239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-90797d3a-c2ff-4a80-bb24-862f7408eea5 req-53632945-54ea-4eb1-987c-03c87608b979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:50.523147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-90797d3a-c2ff-4a80-bb24-862f7408eea5 req-53632945-54ea-4eb1-987c-03c87608b979 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:50.523731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-90797d3a-c2ff-4a80-bb24-862f7408eea5 req-53632945-54ea-4eb1-987c-03c87608b979 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:50.555634 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-90797d3a-c2ff-4a80-bb24-862f7408eea5 req-53632945-54ea-4eb1-987c-03c87608b979 service nova] Creating event network-changed:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h1-848886-16 Jul 26 05:18:50.560978 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-90797d3a-c2ff-4a80-bb24-862f7408eea5 req-53632945-54ea-4eb1-987c-03c87608b979 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068694 Jul 26 05:18:50.562268 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3399/6856] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:18:51.431567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:51.432295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:51.439156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:51.439618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:51.440386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:51.440832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:51.568917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:51.576438 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6144e146-7831-4472-9c58-b9abce4bdd53 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.149013 Jul 26 05:18:51.577002 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3458/6857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:51 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:52.598310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:52.599052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:52.606452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:52.606905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:52.607670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:52.608108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:52.739198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:52.747755 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29815714-151e-41eb-8252-9ae678d8d6c4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.154631 Jul 26 05:18:52.748320 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3400/6858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:52 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:53.769294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:53.769925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:53.777523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:53.777990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:53.778810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:53.779261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:53.908315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:53.916305 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ea58df7c-f1cb-4230-8eb2-ad061c8d89fd tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.151252 Jul 26 05:18:53.916881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3459/6859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:53 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:54.937618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:54.938284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:54.945197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:54.945656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:54.946462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:54.946912 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:55.020203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b63099d9-ccb4-4576-a0fe-b79be8174fbf req-bf280e94-be0a-4187-9b69-2cd52bd46be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "name": "network-vif-plugged", "status": "completed", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:55.031891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b63099d9-ccb4-4576-a0fe-b79be8174fbf req-bf280e94-be0a-4187-9b69-2cd52bd46be5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:55.032285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b63099d9-ccb4-4576-a0fe-b79be8174fbf req-bf280e94-be0a-4187-9b69-2cd52bd46be5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:55.045508 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b63099d9-ccb4-4576-a0fe-b79be8174fbf req-bf280e94-be0a-4187-9b69-2cd52bd46be5 service nova] Creating event network-vif-plugged:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h1-848886-16 Jul 26 05:18:55.050872 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b63099d9-ccb4-4576-a0fe-b79be8174fbf req-bf280e94-be0a-4187-9b69-2cd52bd46be5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Jul 26 05:18:55.051767 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3460/6860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:18:55.093249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:55.103660 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-14dd663b-105c-4da3-b140-3d4d58c4bb2a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.169931 Jul 26 05:18:55.104434 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3401/6861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:54 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:56.126887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:56.127872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:56.138368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:56.138874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:56.139734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:56.140188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:56.275154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:56.282762 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18545336-63b2-47cf-9665-8a6c523a3cbf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1317 microversion: 2.1 time: 0.161595 Jul 26 05:18:56.283330 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3461/6862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:56 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:57.304129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:57.304745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:57.311696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.312146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.312905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.313340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.444428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:57.452080 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0be1a59d-2deb-4588-b6f0-699d9e5a2869 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1508 microversion: 2.1 time: 0.152022 Jul 26 05:18:57.452648 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3402/6863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:57 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:57.472712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:57.473370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:57.480413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.480887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.481671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.482127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.617475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:57.625474 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b872446d-ec0b-43fd-9b27-f6f7128a82da tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1508 microversion: 2.1 time: 0.156584 Jul 26 05:18:57.626041 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3462/6864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:57 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:57.646139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:57.649352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:57.655518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.655974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.656752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.657195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.719181 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34a288d3-786c-487b-9357-d09c9863f66a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "PUT /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1080 microversion: 2.1 time: 0.077225 Jul 26 05:18:57.719748 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3403/6865] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Jul 26 05:18:57 2022] PUT /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:57.738386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:57.739001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:57.746458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.746928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.747707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.748159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.884877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:57.892767 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be5d2154-e35d-4a1d-9610-3aa9827222b4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1506 microversion: 2.1 time: 0.158256 Jul 26 05:18:57.893332 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3463/6866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:57 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:57.912627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:57.913246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:57.915297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:57.915971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:57.922503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.922956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:57.923721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:57.924190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:58.061403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:58.070717 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8c3c48c-c822-4ebf-b71a-5bf5b9711d38 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1506 microversion: 2.1 time: 0.161866 Jul 26 05:18:58.071297 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3404/6867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:57 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:18:58.090688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:18:58.092953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:58.095042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:18:58.101119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:58.101590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:58.102400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:58.102857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:58.131062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:58.136880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:18:58.143390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:18:58.143831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:18:58.144326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:18:58.144756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:18:58.145184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:18:58.206170 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-49fa0e35-86e0-4ec7-be8e-2c88a5d517f6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491/action" status: 202 len: 0 microversion: 2.1 time: 0.119504 Jul 26 05:18:58.206817 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3464/6868] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:18:58 2022] POST /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:18:58.214974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:58.215678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:58.221783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:58.222299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:58.223089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:58.223509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:58.365906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:58.375011 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37af2b43-99dd-4e15-a30a-8588f96feeb3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1517 microversion: 2.1 time: 0.163893 Jul 26 05:18:58.375595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3405/6869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:58 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:18:59.397461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:18:59.398078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:18:59.404294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:59.404755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:59.405525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:18:59.405973 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:18:59.621939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:18:59.629547 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96d3cc52-2c78-474a-be15-769779a5e8ca tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1517 microversion: 2.1 time: 0.236932 Jul 26 05:18:59.630113 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3465/6870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:18:59 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:00.651105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:00.651715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:00.658651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:00.659097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:00.659855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:00.660296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:00.795144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:00.802734 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db47258f-954b-43c1-9f7f-24eaa67d777f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.155773 Jul 26 05:19:00.804016 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3406/6871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:00 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:01.825576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:01.826254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:01.833098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:01.833554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:01.834377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:01.834870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:01.964146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:01.971714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-83273489-20d8-4ff9-8831-6223bf5954e2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.150586 Jul 26 05:19:01.972288 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3466/6872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:01 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:02.993981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:02.994621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:02.997345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:03.003132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:03.003595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:03.004365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:03.004817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:03.010188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:03.145110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:03.153781 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ef9ab66-5362-42fe-a64c-91fd0045c668 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.164047 Jul 26 05:19:03.154388 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3407/6873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:02 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:04.175740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:04.176303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:04.179064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:04.184883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:04.185351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:04.186138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:04.186614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:04.320777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:04.328306 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62a1c665-dbdf-43df-a2c0-e36c7cfd4ec2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.156564 Jul 26 05:19:04.328879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3467/6874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:04 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:05.351984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:05.352598 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:05.358761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:05.359210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:05.359966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:05.360407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:05.491660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:05.499212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d01af629-688b-4be3-bd51-dfcf8900c9bc tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.151484 Jul 26 05:19:05.499775 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3408/6875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:05 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:06.521188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:06.521806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:06.528543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:06.529003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:06.529767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:06.530236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:06.661108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:06.669218 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-789653be-32e9-4452-94ce-489c8c345705 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.152349 Jul 26 05:19:06.669787 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3468/6876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:06 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:07.690484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:07.691099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:07.698832 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:07.699289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:07.700059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:07.700502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:07.837498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:07.845221 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6abfbd5d-48dc-47fc-ab0b-26e2710c48c1 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.158695 Jul 26 05:19:07.845793 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3409/6877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:07 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:08.866938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:08.867692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:08.874713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:08.875179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:08.875951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:08.876399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:09.035844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:09.044783 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d3664737-ded5-44d4-a2e2-091e6e10797b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.182340 Jul 26 05:19:09.045379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3469/6878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:08 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:10.065340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:10.065900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:10.074090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:10.074587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:10.075369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:10.075812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:10.206641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:10.214441 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-578117ba-bf5b-46ee-98d0-34ed1ad661b9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.153100 Jul 26 05:19:10.215027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3410/6879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:10 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:11.235424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:11.236046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:11.243674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:11.244132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:11.244891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:11.245334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:11.377418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:11.386311 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93360e6a-d198-4f4b-b9b4-99e96c75b6e4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.154547 Jul 26 05:19:11.386976 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3470/6880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:11 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:12.407761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:12.408396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:12.415513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:12.415964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:12.416722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:12.417159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:12.550378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:12.558048 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e23e954b-eec6-4fa1-86dd-54567dc1fb08 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.154158 Jul 26 05:19:12.558652 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3411/6881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:12 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:13.579370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:13.579992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:13.587687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:13.588154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:13.588925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:13.589374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:13.719797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:13.728330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b89d3fc-2afd-4cfc-8245-050acaca9d5e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.152862 Jul 26 05:19:13.728899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3471/6882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:13 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:14.749200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:14.749848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:14.756926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:14.757547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:14.758527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:14.758973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:14.891125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:14.899178 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e5b157a-f0be-438f-a8e5-082b0052ac99 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.153948 Jul 26 05:19:14.899753 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3412/6883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:14 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:15.919283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:15.919910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:15.926802 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:15.927271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:15.928046 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:15.928501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:16.062098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:16.065528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:16.070739 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1bf92e3b-74b4-48a2-aae0-6b3bef8f9b40 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.155236 Jul 26 05:19:16.071369 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3472/6884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:15 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:17.093685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:17.094350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:17.101395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:17.101858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:17.102735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:17.103234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:17.239540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:17.247907 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5099ded-8d11-4f12-b059-861e5184dfda tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.158178 Jul 26 05:19:17.248477 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3413/6885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:17 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:18.269288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:18.270028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:18.280180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:18.280648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:18.281450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:18.281904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:18.412386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:18.420572 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2997a8c-382c-486b-8012-cd614230d7b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.155492 Jul 26 05:19:18.421153 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3473/6886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:18 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:19.441531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:19.442168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:19.450167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:19.450631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:19.451405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:19.451854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:19.591124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:19.598716 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-92be3ad3-ec2c-4170-b74f-147bcf57ae34 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.161177 Jul 26 05:19:19.599304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3414/6887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:19 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:20.619417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:20.620037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:20.627024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:20.627484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:20.628247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:20.628690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:20.763285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:20.771234 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-544a3229-d0eb-4e88-b75d-587acf47dadb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.155668 Jul 26 05:19:20.771808 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3474/6888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:20 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:21.793178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:21.793803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:21.800869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:21.801325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:21.802121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:21.802590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:21.937839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:21.945453 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-87145f92-8fda-4a93-809a-f76ad6de2820 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.156588 Jul 26 05:19:21.946031 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3415/6889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:21 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:22.966689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:22.967355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:22.974190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:22.974655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:22.975424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:22.975872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:23.109831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:23.117302 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-21a3d768-c86d-46fc-9b66-6f4798aa043f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.154528 Jul 26 05:19:23.117874 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3475/6890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:22 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:24.138251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:24.138845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:24.146026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:24.146510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:24.147271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:24.147713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:24.283884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:24.293071 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-93f3c02c-ff7b-4b2a-8151-e78aea568721 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.158824 Jul 26 05:19:24.293646 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3416/6891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:24 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:25.314084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:25.314738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:25.321774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:25.322368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:25.323158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:25.323610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:25.452379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:25.459849 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7dcf7743-7e85-4a40-ac64-a28bdfcb7732 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.149753 Jul 26 05:19:25.460416 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3476/6892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:25 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:19:26.481759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:26.482412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:26.489363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:26.489819 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:26.490622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:26.491064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:26.623257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:26.630841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-349425ab-7700-4a0e-9c99-620e2a378bfe tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1522 microversion: 2.1 time: 0.153105 Jul 26 05:19:26.631414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3417/6893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:26 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:27.373869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "name": "network-vif-unplugged", "status": "completed", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:27.385660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:27.386108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:27.398282 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] Creating event network-vif-unplugged:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h2-848886-16 Jul 26 05:19:27.404225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] Instance 36ec3936-c2df-4831-aa74-4de9a8874491 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:19:27.416504 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-43b05d67-4b4c-4638-9852-1df0c2f62e27 req-4af28866-d650-4e8d-b27c-9c265272809e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045911 Jul 26 05:19:27.417127 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3477/6894] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:19:27.652759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:27.654192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:27.664085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:27.664797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:27.666733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:27.666937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:27.922649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:27.930349 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53e779ce-7c09-4f2d-915d-2491ca4c6b5d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1521 microversion: 2.1 time: 0.281862 Jul 26 05:19:27.931447 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3418/6895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:27 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:28.953450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:28.954235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:28.961351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:28.961812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:28.962695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:28.963225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:29.093449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:29.101186 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d158b97b-bbb3-44d1-9775-d0e612839900 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1519 microversion: 2.1 time: 0.151999 Jul 26 05:19:29.101752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3478/6896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:28 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:29.430994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:29.441183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:29.441627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:29.453723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] Creating event network-changed:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h2-848886-16 Jul 26 05:19:29.459047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] Instance 36ec3936-c2df-4831-aa74-4de9a8874491 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:19:29.470596 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cbe1734c-c2d9-408f-88d4-209293195867 req-51592112-cf4d-4c70-a3af-0d73b1131a4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Jul 26 05:19:29.471363 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3419/6897] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:19:30.123728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:30.124385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:30.131187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:30.131649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:30.132417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:30.132863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:30.339186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:30.346817 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d6a7a12-99ed-4947-afdb-63d428a38f17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1519 microversion: 2.1 time: 0.227220 Jul 26 05:19:30.347401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3479/6898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:30 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:31.371331 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:31.372080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:31.378572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.379059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.379843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.380285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.516719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:31.524731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7db49e3e-8fda-424f-a34d-84e0870c5532 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1516 microversion: 2.1 time: 0.159782 Jul 26 05:19:31.526176 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3420/6899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:31 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:31.545850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:31.546416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:31.553436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.553894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.554688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.555135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.611877 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c4ecd3a0-6fc0-4866-b80f-e1741cda15e0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491/action" status: 204 len: 0 microversion: 2.1 time: 0.069674 Jul 26 05:19:31.612505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3480/6900] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:19:31 2022] POST /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:19:31.621689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:31.622344 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:31.628404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.628864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.629640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:31.630093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:31.769975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:31.778946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89464585-8fcf-4cae-837e-f59ce03dd29f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1516 microversion: 2.1 time: 0.161965 Jul 26 05:19:31.779924 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3421/6901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:31 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:32.802209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:32.802916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:32.809307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:32.809701 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:32.810502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:32.810969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:32.950688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:32.961457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cbeb1b84-95f5-4885-b8f6-78b3fbe932e6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1516 microversion: 2.1 time: 0.164412 Jul 26 05:19:32.962036 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3481/6902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:32 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:33.983340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:33.983953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:33.988533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=30 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:33.995077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:33.995526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:33.996292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:33.996726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:34.000691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=88 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:34.126533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:34.134324 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4a1d106-857d-4b00-975e-f4efafb45851 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1508 microversion: 2.1 time: 0.154819 Jul 26 05:19:34.134956 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3422/6903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:33 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:34.154733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:34.155363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:34.162383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:34.162852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:34.163628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:34.164081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:34.296997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:34.304533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d87c15be-eb59-4499-961a-59e42c71fcac tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1508 microversion: 2.1 time: 0.153771 Jul 26 05:19:34.305109 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3482/6904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:34 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:34.328258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6114b79-b12c-42ca-87f1-d8610f235ae2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'create', calling method: .version_select at 0x7f38b5135af0>, body: {"keypair": {"name": "tempest-keypair-125005388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8Ddk3FCm9PB4Zy23OQByN1KGZoWb0PmkUD7RB3qB+HN+ftJtZ7b64jW5ojvbuZgEheEZg35DleiF4cC3lJkBaDi5V2Hj9nFvgvC+xuXcaC5gGr9vfA3xWSNO2LdnC7cQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:34.343422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d6114b79-b12c-42ca-87f1-d8610f235ae2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for project e61b1f85218045fe8e45634ba5234147. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:19:34.348462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-d6114b79-b12c-42ca-87f1-d8610f235ae2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for user 4d8a9846d3ac406694dc48e5a8d83671 and project e61b1f85218045fe8e45634ba5234147. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:19:34.372142 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6114b79-b12c-42ca-87f1-d8610f235ae2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047871 Jul 26 05:19:34.372732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3423/6905] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:19:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:19:34.558645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-888bb1da-4e9b-4e9b-a148-66796718564d req-bdcb2afc-8f4f-46c3-bc91-4c0901452bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "name": "network-vif-plugged", "status": "completed", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:34.563854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:34.569933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-888bb1da-4e9b-4e9b-a148-66796718564d req-bdcb2afc-8f4f-46c3-bc91-4c0901452bbf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:34.570908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-888bb1da-4e9b-4e9b-a148-66796718564d req-bdcb2afc-8f4f-46c3-bc91-4c0901452bbf service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:34.583021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-888bb1da-4e9b-4e9b-a148-66796718564d req-bdcb2afc-8f4f-46c3-bc91-4c0901452bbf service nova] Creating event network-vif-plugged:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h2-848886-16 Jul 26 05:19:34.589068 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-888bb1da-4e9b-4e9b-a148-66796718564d req-bdcb2afc-8f4f-46c3-bc91-4c0901452bbf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Jul 26 05:19:34.589960 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3483/6906] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:19:35.593537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:35.594203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:35.600907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:35.601359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:35.602117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:35.602579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:35.733549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:35.741278 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b80a416c-5a1f-46a9-9699-943a0489b40a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 200 len: 1508 microversion: 2.1 time: 0.153207 Jul 26 05:19:35.741850 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3424/6907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:35 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:35.763366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:35.763999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:35.770577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:35.771043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:35.771820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:35.772273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:35.797561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:19:35.871346 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be8e5d40-ba0e-4794-9d27-708dba83cd41 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 204 len: 0 microversion: 2.1 time: 0.113205 Jul 26 05:19:35.872064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3484/6908] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:19:35 2022] DELETE /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:19:35.927491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1130431230", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "d4dc7d86-827c-493b-af40-ffdd048eb66e"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:35.980442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] validate_networks() for [('d4dc7d86-827c-493b-af40-ffdd048eb66e', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:19:36.344635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:19:36.345066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:19:36.345547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:19:36.345968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:19:36.346425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:19:36.356472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:36.356921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:36.357715 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:36.358145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:36.375686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for project e61b1f85218045fe8e45634ba5234147. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:19:36.380906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Getting quotas for user 4d8a9846d3ac406694dc48e5a8d83671 and project e61b1f85218045fe8e45634ba5234147. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:19:36.393049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:19:36.395667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:19:36.439267 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2e81047e-7e70-4d2d-84a3-c7fe7c267c17 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516037 Jul 26 05:19:36.439923 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3425/6909] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:19:36.451570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfeb0c15-dd7e-42d2-8ec0-ba90130a346b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:36.452418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfeb0c15-dd7e-42d2-8ec0-ba90130a346b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:36.506256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfeb0c15-dd7e-42d2-8ec0-ba90130a346b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:36.513285 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfeb0c15-dd7e-42d2-8ec0-ba90130a346b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1218 microversion: 2.1 time: 0.066053 Jul 26 05:19:36.513856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3485/6910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:36 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:37.535619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:37.536988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:37.544607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:37.545144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:37.546045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:37.546551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:37.622075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:37.630225 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f74dcf8d-e67e-4673-a02a-433e8a4b50d3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1276 microversion: 2.1 time: 0.099401 Jul 26 05:19:37.631374 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3426/6911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:37 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:37.773837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-62635301-3b76-4306-be79-5afffeeb62cc req-100db5b6-183b-46ef-8c63-e7662e6d7570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ec3936-c2df-4831-aa74-4de9a8874491", "name": "network-vif-deleted", "tag": "9cfe5275-fd1f-4eca-bd72-af13c16ac00a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:37.786415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-62635301-3b76-4306-be79-5afffeeb62cc req-100db5b6-183b-46ef-8c63-e7662e6d7570 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:37.786875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-62635301-3b76-4306-be79-5afffeeb62cc req-100db5b6-183b-46ef-8c63-e7662e6d7570 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:37.798757 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-62635301-3b76-4306-be79-5afffeeb62cc req-100db5b6-183b-46ef-8c63-e7662e6d7570 service nova] Creating event network-vif-deleted:9cfe5275-fd1f-4eca-bd72-af13c16ac00a for instance 36ec3936-c2df-4831-aa74-4de9a8874491 on n-h2-848886-16 Jul 26 05:19:37.803438 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-62635301-3b76-4306-be79-5afffeeb62cc req-100db5b6-183b-46ef-8c63-e7662e6d7570 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033524 Jul 26 05:19:37.804302 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3486/6912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:19:38.653069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:38.653679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:38.660614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:38.661064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:38.661828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:38.662293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:38.688372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-30313439-23c7-4c23-a7b5-449dddeaf518 req-10ee814f-682e-4408-858d-2f538e5b0ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:38.722514 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-30313439-23c7-4c23-a7b5-449dddeaf518 req-10ee814f-682e-4408-858d-2f538e5b0ffd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:38.729729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-30313439-23c7-4c23-a7b5-449dddeaf518 req-10ee814f-682e-4408-858d-2f538e5b0ffd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:38.747962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-30313439-23c7-4c23-a7b5-449dddeaf518 req-10ee814f-682e-4408-858d-2f538e5b0ffd service nova] Creating event network-changed:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h1-848886-16 Jul 26 05:19:38.753619 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-30313439-23c7-4c23-a7b5-449dddeaf518 req-10ee814f-682e-4408-858d-2f538e5b0ffd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072879 Jul 26 05:19:38.755210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3487/6913] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:19:38.834124 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:38.842551 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-87fe1655-5a50-460b-b26a-84ee68bf3b44 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1318 microversion: 2.1 time: 0.194145 Jul 26 05:19:38.843239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3427/6914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:38 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:39.866433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:39.867145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:39.873729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:39.874211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:39.874986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:39.875438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:40.087319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:40.095697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc52fac4-d580-41bb-b644-bb956dbe1053 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1318 microversion: 2.1 time: 0.234317 Jul 26 05:19:40.096278 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3488/6915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:39 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:41.116655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:41.117275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:41.124986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:41.125447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:41.126246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:41.126695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:41.274459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:41.282874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-36e48a74-3b56-4bef-8b07-3531f1b922b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1318 microversion: 2.1 time: 0.170146 Jul 26 05:19:41.283702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3428/6916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:41 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:19:42.304368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:42.304999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:42.313045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:42.313511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:42.314325 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:42.314777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:42.444216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:42.451966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7785f3ce-a9e3-418e-b46d-276c6d8a96c7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1318 microversion: 2.1 time: 0.151548 Jul 26 05:19:42.452521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3489/6917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:42 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:43.386762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9203329e-f335-41af-9962-3f01abaeac66 req-3e3c6bf8-143d-4754-a5a2-72fec919d806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "name": "network-vif-plugged", "status": "completed", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:43.400450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9203329e-f335-41af-9962-3f01abaeac66 req-3e3c6bf8-143d-4754-a5a2-72fec919d806 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:43.401050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9203329e-f335-41af-9962-3f01abaeac66 req-3e3c6bf8-143d-4754-a5a2-72fec919d806 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:43.413126 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9203329e-f335-41af-9962-3f01abaeac66 req-3e3c6bf8-143d-4754-a5a2-72fec919d806 service nova] Creating event network-vif-plugged:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h1-848886-16 Jul 26 05:19:43.420289 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9203329e-f335-41af-9962-3f01abaeac66 req-3e3c6bf8-143d-4754-a5a2-72fec919d806 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038325 Jul 26 05:19:43.421209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3429/6918] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:19:43.474078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:43.474808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:43.482711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:43.483172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:43.483953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:43.484397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:43.487245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:43.651052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:43.659178 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf7b6968-2332-4949-a7d5-39d297ada4d4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1318 microversion: 2.1 time: 0.189728 Jul 26 05:19:43.659763 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3490/6919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:43 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:44.680917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:44.681612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:44.689449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:44.689904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:44.690709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:44.691146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:44.823460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:44.832034 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cbc4d77-d0ea-4eb4-a3d2-52c118034038 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1508 microversion: 2.1 time: 0.155401 Jul 26 05:19:44.832622 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3430/6920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:44 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:44.852944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:44.853569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:44.861000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:44.861468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:44.862269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:44.862722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:44.991688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:44.999172 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-009cd47b-1f0c-464f-b943-adac371c348f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1508 microversion: 2.1 time: 0.150080 Jul 26 05:19:44.999743 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3491/6921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:44 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:45.018829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:19:45.021557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:45.028353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:45.028813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:45.029591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:45.030039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:45.103962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:45.110397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Old instance type m1.heat2, new instance type m1.heat {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:19:45.117110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:19:45.117532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:19:45.118005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:19:45.118447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:19:45.118856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:19:45.227001 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a43e1d4-52cf-497b-a26d-d4daf97db9a2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14/action" status: 202 len: 0 microversion: 2.1 time: 0.212017 Jul 26 05:19:45.227788 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3431/6922] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:19:45 2022] POST /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:19:45.236444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:45.237296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:45.243402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:45.243858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:45.244734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:45.245182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:45.416733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:45.425822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-81e65008-e46e-47a3-900f-508a4014118f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1515 microversion: 2.1 time: 0.193090 Jul 26 05:19:45.426509 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3492/6923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:45 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:19:46.445162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:46.446556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:46.451353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:46.452139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:46.460433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:46.460885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:46.461722 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:46.462231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:46.599973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:46.607749 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2b434762-84d2-428d-b439-db04cec9cf9b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1515 microversion: 2.1 time: 0.164282 Jul 26 05:19:46.608414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3432/6924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:46 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:47.629305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:47.629930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:47.632686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:19:47.639071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:47.639799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:47.640583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:47.641034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:47.772119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:47.780563 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-22173e8b-ef1c-4c19-a1d8-24d69081172d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.155158 Jul 26 05:19:47.781140 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3493/6925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:47 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:48.802002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:48.802761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:48.810244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:48.810698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:48.811458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:48.811897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:48.942639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:48.950115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ab26ddd-e911-4408-8d9e-7e5598018a95 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.152049 Jul 26 05:19:48.950703 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3433/6926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:48 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:49.971109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:49.971718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:49.978626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:49.979082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:49.979851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:49.980830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:50.112588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:50.120146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87413d3c-4a16-4d3f-a31d-040ad40179b0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.152964 Jul 26 05:19:50.120708 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3494/6927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:49 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:51.141142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:51.141754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:51.148987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:51.149435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:51.150210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:51.150651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:51.285323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:51.293273 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f160098f-0b86-4496-948b-3ef4cc04f1a5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.155586 Jul 26 05:19:51.293550 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3434/6928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:51 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:52.314767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:52.315401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:52.322633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:52.323104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:52.323891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:52.324554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:52.455232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:52.462779 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-33a6701b-bc1d-4de4-ba77-78ee1944b1af tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.151865 Jul 26 05:19:52.463355 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3495/6929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:52 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:53.484617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:53.485194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:53.492517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:53.492977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:53.493739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:53.494214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:53.627809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:53.635845 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f57d456-ba16-4cf1-9601-5c75bd96c0a3 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.155579 Jul 26 05:19:53.636434 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3435/6930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:53 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:54.656933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:54.657546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:54.664450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:54.664927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:54.665673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:54.666118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:54.802513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:54.811060 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-668eb156-d370-4842-ad23-25a11e2fd3b2 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.157966 Jul 26 05:19:54.811635 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3496/6931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:54 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:55.831342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:55.831957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:55.839024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:55.839489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:55.840554 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:55.841043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:55.981412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:55.989312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-094913ab-2ee6-4551-a403-d07ee23bd68c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.161898 Jul 26 05:19:55.989882 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3436/6932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:55 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:19:57.011055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:57.011697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:57.019268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:57.019740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:57.020519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:57.021250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:57.152161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:57.160013 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bfe27c6a-5000-462c-acbb-9420080fc9d0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.152810 Jul 26 05:19:57.160613 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3497/6933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:57 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:58.181081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:58.181700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:58.188789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:58.189245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:58.190007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:58.190492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:58.330182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:58.337791 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97f72e9f-9556-4e34-96dd-42e63b8f5dab tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.160610 Jul 26 05:19:58.338414 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3437/6934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:58 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:19:59.360473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:19:59.361087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:19:59.368155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:59.368617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:59.369393 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:19:59.369840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:19:59.499437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:19:59.507349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52dce79b-249c-4b62-8967-029396484bb9 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.151459 Jul 26 05:19:59.507929 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3498/6935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:19:59 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:00.529690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:00.530334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:00.537276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:00.537738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:00.538536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:00.538981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:00.668866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:00.676447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b97661a5-88e3-44f1-a05e-4e33605f790a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.150777 Jul 26 05:20:00.677023 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3438/6936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:00 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:01.696825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:01.697450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:01.705095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:01.705553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:01.706347 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:01.706794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:01.843717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:01.851794 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e6bb6a2b-27d8-46ae-852c-39057e0108f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.159095 Jul 26 05:20:01.852401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3499/6937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:01 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:02.874669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:02.875289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:02.882356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:02.882755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:02.883525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:02.883967 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:03.016478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:03.018735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:03.025970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-197c476e-f8e0-4738-ab8a-1473fe48816a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.155910 Jul 26 05:20:03.026573 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3439/6938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:02 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:04.047333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:04.047871 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:04.054902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:04.055365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:04.056182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:04.056872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:04.191576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:04.199109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-62a953e2-7a48-413d-9b18-89574a7a3db5 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.156340 Jul 26 05:20:04.199687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3500/6939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:04 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:05.220731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:05.221349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:05.223584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:05.229940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:05.230426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:05.231927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:05.232375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:05.362425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:05.370397 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38104db8-4005-4e46-8516-0f50493d0326 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.153852 Jul 26 05:20:05.370975 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3440/6940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:05 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:06.392257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:06.392908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:06.394992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:06.400529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:06.400996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:06.401778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:06.402259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:06.534370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:06.542135 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e5ec4005-f6c4-483e-b97c-ddc8cf05de4a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.153863 Jul 26 05:20:06.542759 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3501/6941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:06 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:07.563239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:07.563835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:07.570763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:07.571212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:07.571968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:07.572405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:07.699146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:07.707197 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e050c02a-225f-48dc-842c-02767986c60e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.148556 Jul 26 05:20:07.707769 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3441/6942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:07 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:08.728268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:08.728889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:08.736201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:08.736712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:08.737493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:08.737939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:08.872586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:08.880641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-adca5b2c-4403-4066-a0d2-794f14a8934c tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.156268 Jul 26 05:20:08.881217 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3502/6943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:08 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:09.901905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:09.902566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:09.910091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:09.910564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:09.911321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:09.911757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:10.043663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:10.051756 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-efe77a86-d421-454c-a62c-d27fe73c3c31 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.153679 Jul 26 05:20:10.052339 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3442/6944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:09 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:11.072796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:11.073583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:11.080816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:11.081278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:11.082055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:11.082533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:11.210517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:11.218744 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1eee8f53-a353-4efd-8ea3-bb4cbbe71d67 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.150021 Jul 26 05:20:11.219315 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3503/6945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:11 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:12.240129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:12.240784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:12.247810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:12.248275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:12.249659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:12.250216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:12.381496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:12.389126 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-103e7a74-0cea-4fa6-8957-adff7980f5f4 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.152906 Jul 26 05:20:12.389741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3443/6946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:12 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:13.410312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:13.410851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:13.417619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:13.418078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:13.418877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:13.419332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:13.551117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:13.553377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=88 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:13.560160 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-71a681cc-27cc-47f5-ae8f-6f9aac91a1e7 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1520 microversion: 2.1 time: 0.153868 Jul 26 05:20:13.560748 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3504/6947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:13 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:14.581068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:14.581736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:14.588922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:14.589350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:14.590108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:14.590566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:14.791327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "name": "network-vif-unplugged", "status": "completed", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:14.796550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:14.803490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:14.803947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:14.805214 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-29f5bb22-1de2-46b5-8669-7b3cad13bf4b tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1519 microversion: 2.1 time: 0.228183 Jul 26 05:20:14.806004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3444/6948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:14 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:14.817498 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] Creating event network-vif-unplugged:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h2-848886-16 Jul 26 05:20:14.822988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:20:14.833805 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a5906e73-7714-44fd-bc21-b609b59f4c45 req-7a69e5a6-8365-4603-8b76-7f1cab0c2a9a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046070 Jul 26 05:20:14.834754 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3505/6949] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:20:15.827866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:15.828485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:15.835506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:15.835963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:15.836732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:15.837178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:15.973517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:15.981083 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-26ecd809-8959-4a3e-8076-50170df35916 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1517 microversion: 2.1 time: 0.157724 Jul 26 05:20:15.981651 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3445/6950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:15 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:16.854658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:16.864950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:16.865412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:16.878760 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] Creating event network-changed:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h2-848886-16 Jul 26 05:20:16.884065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:20:16.895088 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-bd0dabd5-2260-4c9d-b68a-3132b571e5a2 req-971d4dac-ea13-41a1-8a98-c99c25e3d47b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045294 Jul 26 05:20:16.895625 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3506/6951] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:17.003836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:17.004498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:17.011489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:17.011942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:17.012736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:17.013176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:17.151584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:17.160217 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-35e0e038-7482-4884-b609-cb04ad2c2bdf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1517 microversion: 2.1 time: 0.161016 Jul 26 05:20:17.161008 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3446/6952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:16 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:18.182119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:18.182847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:18.190118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:18.190608 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:18.191395 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:18.191842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:18.335308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:18.344366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-09f361c1-25ba-4b70-b401-3bb3b50afdeb tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1517 microversion: 2.1 time: 0.165689 Jul 26 05:20:18.352368 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3507/6953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:18 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:19.366659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:19.367272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:19.374226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.374739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.376038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.376488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.514678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:19.523202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dd459402-9be2-4491-91b9-ed7c7aa42fd0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1514 microversion: 2.1 time: 0.160492 Jul 26 05:20:19.523776 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3447/6954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:19 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:19.543664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:19.544216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:19.551308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.551778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.552552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.553004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.610591 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bef36404-54cb-40f0-b57d-f6e87ede5f4d tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "POST /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14/action" status: 204 len: 0 microversion: 2.1 time: 0.070600 Jul 26 05:20:19.611241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3508/6955] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:20:19 2022] POST /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:20:19.619327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:19.619882 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:19.627163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.627624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.628396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:19.628841 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:19.766356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:19.774586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43361184-7de0-4332-9990-cf2e38007649 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1514 microversion: 2.1 time: 0.159103 Jul 26 05:20:19.775169 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3448/6956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:19 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:20.799020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:20.799769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:20.806072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:20.806581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:20.807369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:20.807828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:20.947482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:20.955289 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5a5c0e23-bd5e-41f2-9f8f-07c0ebb00032 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1514 microversion: 2.1 time: 0.161988 Jul 26 05:20:20.955887 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3509/6957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:20 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:21.976933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:21.977542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:21.984945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:21.985393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:21.986171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:21.986637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.119404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:22.127076 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5752d4e-0a61-4ddc-af74-613264b6b89a tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1506 microversion: 2.1 time: 0.154041 Jul 26 05:20:22.127654 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3449/6958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:21 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:22.148138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:22.148761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:22.155673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.157186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.157983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.158471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.290663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:22.298467 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0da3bb4-f738-461a-9423-e262e274cfb8 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1506 microversion: 2.1 time: 0.154329 Jul 26 05:20:22.299071 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3510/6959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:22 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:22.319084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:22.319709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:22.325790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.326263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.327018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.327450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.463414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:22.471161 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b41a890c-3a98-4733-b0fc-3a27811a0a97 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1506 microversion: 2.1 time: 0.156239 Jul 26 05:20:22.471732 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3450/6960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:22 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:22.490893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:22.491398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:22.497349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.497807 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.498616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.499049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.524749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:20:22.596422 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2ccb54d9-111e-4200-b6f6-60ec310dc661 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 204 len: 0 microversion: 2.1 time: 0.108947 Jul 26 05:20:22.597340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3511/6961] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:20:22 2022] DELETE /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:20:22.613817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:22.614348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:22.620348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.620794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.621546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.621983 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.649141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:20:22.695346 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.compute.api [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Instance is already in deleting state, ignoring this request Jul 26 05:20:22.696188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f68836f-e627-4eca-82cd-b1e279e52e4f tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 204 len: 0 microversion: 2.1 time: 0.086268 Jul 26 05:20:22.696752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3451/6962] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:20:22 2022] DELETE /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:20:22.705970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:22.706718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:22.712907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.713371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.714170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.714630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.799040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ce7a59cd-4d36-4eee-9907-966c0703dcc8 req-abed42c0-b524-445c-87d0-b6dad1c6766e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "name": "network-vif-plugged", "status": "completed", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:22.809436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ce7a59cd-4d36-4eee-9907-966c0703dcc8 req-abed42c0-b524-445c-87d0-b6dad1c6766e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:22.809947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ce7a59cd-4d36-4eee-9907-966c0703dcc8 req-abed42c0-b524-445c-87d0-b6dad1c6766e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:22.822852 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ce7a59cd-4d36-4eee-9907-966c0703dcc8 req-abed42c0-b524-445c-87d0-b6dad1c6766e service nova] Creating event network-vif-plugged:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h2-848886-16 Jul 26 05:20:22.828071 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ce7a59cd-4d36-4eee-9907-966c0703dcc8 req-abed42c0-b524-445c-87d0-b6dad1c6766e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034148 Jul 26 05:20:22.829277 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3452/6963] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:20:22.852147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:22.860714 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fa78b30-1cc0-4c70-919a-d4c8a8feb0b6 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1512 microversion: 2.1 time: 0.159590 Jul 26 05:20:22.861352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3512/6964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:22 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:20:23.883443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:23.884154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:23.891169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:23.891633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:23.892399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:23.892844 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:24.068632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8a9846d3ac406694dc48e5a8d83671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b1f85218045fe8e45634ba5234147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:24.077436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aab30b8d-8262-4016-a7b1-18bdcf4bd04e tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 200 len: 1512 microversion: 2.1 time: 0.199159 Jul 26 05:20:24.091288 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3453/6965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:23 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:24.473253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ba896871-02d0-4a29-8c8f-0a37ae4a96de req-c18d2c2c-bddc-4c6a-bc61-953b23f25a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14", "name": "network-vif-deleted", "tag": "51e05feb-b618-4b68-9ed3-8ddc9f153890"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:24.487455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ba896871-02d0-4a29-8c8f-0a37ae4a96de req-c18d2c2c-bddc-4c6a-bc61-953b23f25a95 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:24.488233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ba896871-02d0-4a29-8c8f-0a37ae4a96de req-c18d2c2c-bddc-4c6a-bc61-953b23f25a95 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:24.503823 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ba896871-02d0-4a29-8c8f-0a37ae4a96de req-c18d2c2c-bddc-4c6a-bc61-953b23f25a95 service nova] Creating event network-vif-deleted:51e05feb-b618-4b68-9ed3-8ddc9f153890 for instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 on n-h2-848886-16 Jul 26 05:20:24.510359 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ba896871-02d0-4a29-8c8f-0a37ae4a96de req-c18d2c2c-bddc-4c6a-bc61-953b23f25a95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042130 Jul 26 05:20:24.511298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3513/6966] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:25.099148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:25.099760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:25.106684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.107141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.107907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.108346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.122254 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] HTTP exception thrown: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Request method failure captured: Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 HTTP/1.1 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33k3KxtCREVUIGLXISZ9ipWZSBlcTbgDEnb-LQWLk7XEXbJ9aZKmZAM7chOq9ydB8LWJStf0ORMjJ5yzh0-3B4CBbikc_Jujj6RC7kyrUCiy1-JvGR-V43uN6jJ1exVPbJfpornRzz4UUPBPkqllwynj2sJ1ZzcKxulhRrCxDdGtcjA Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e61b1f85218045fe8e45634ba5234147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4d8a9846d3ac406694dc48e5a8d83671 Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14'} Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.123873 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Returning 404 to user: Instance dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea0ff20e-a7f1-4dff-b899-2f55288c49c0 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14" status: 404 len: 111 microversion: 2.1 time: 0.030175 Jul 26 05:20:25.129034 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3454/6967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:25 2022] GET /compute/v2.1/servers/dd2bb8d8-a0fc-40c3-a6c9-7708b001ec14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:20:25.134893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6522a9cc-fc73-4f6d-8d31-949b3ba0a112 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '.version_select at 0x7f38b4352700>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:25.158071 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6522a9cc-fc73-4f6d-8d31-949b3ba0a112 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-125005388" status: 202 len: 0 microversion: 2.1 time: 0.027231 Jul 26 05:20:25.158679 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3514/6968] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Jul 26 05:20:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-125005388 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:20:25.782768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:25.783266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:25.789292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.789743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.790523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.790955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.808890 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] HTTP exception thrown: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Request method failure captured: Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 HTTP/1.1 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33k3KxtCREVUIGLXISZ9ipWZSBlcTbgDEnb-LQWLk7XEXbJ9aZKmZAM7chOq9ydB8LWJStf0ORMjJ5yzh0-3B4CBbikc_Jujj6RC7kyrUCiy1-JvGR-V43uN6jJ1exVPbJfpornRzz4UUPBPkqllwynj2sJ1ZzcKxulhRrCxDdGtcjA Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e61b1f85218045fe8e45634ba5234147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 4d8a9846d3ac406694dc48e5a8d83671 Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '36ec3936-c2df-4831-aa74-4de9a8874491'} Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:20:25.810457 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Returning 404 to user: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f936bf75-14d8-4f47-9e21-3fe6e8fd12bf tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 404 len: 111 microversion: 2.1 time: 0.033071 Jul 26 05:20:25.815733 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3455/6969] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:20:25 2022] DELETE /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:20:25.821911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:25.822685 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] [instance: 36ec3936-c2df-4831-aa74-4de9a8874491] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:25.829547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.830013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.830824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:25.831281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:25.844291 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] HTTP exception thrown: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Request method failure captured: Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 HTTP/1.1 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33k3KxtCREVUIGLXISZ9ipWZSBlcTbgDEnb-LQWLk7XEXbJ9aZKmZAM7chOq9ydB8LWJStf0ORMjJ5yzh0-3B4CBbikc_Jujj6RC7kyrUCiy1-JvGR-V43uN6jJ1exVPbJfpornRzz4UUPBPkqllwynj2sJ1ZzcKxulhRrCxDdGtcjA Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e61b1f85218045fe8e45634ba5234147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e61b1f85218045fe8e45634ba5234147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: e61b1f85218045fe8e45634ba5234147 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960422304 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 4d8a9846d3ac406694dc48e5a8d83671 Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerDiskConfigTestJSON-960422304-project Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '36ec3936-c2df-4831-aa74-4de9a8874491'} Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:20:25.845974 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] Returning 404 to user: Instance 36ec3936-c2df-4831-aa74-4de9a8874491 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0873cc3-b572-4990-b530-8f401de68160 tempest-ServerDiskConfigTestJSON-960422304 tempest-ServerDiskConfigTestJSON-960422304-project] 10.222.0.43 "GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491" status: 404 len: 111 microversion: 2.1 time: 0.030318 Jul 26 05:20:25.850098 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3515/6970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:25 2022] GET /compute/v2.1/servers/36ec3936-c2df-4831-aa74-4de9a8874491 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:20:34.233436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72437292-bf5a-4bac-b802-721fd8665397 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: .version_select at 0x7f38b5da9670>, body: {"keypair": {"name": "tempest-keypair-1600227385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ8WwRYiZCLOGd/7GZ9iOiS/LOQXpiH12ouar3md3n5f+wB4O2ge37dkCAwxR6ML9k3pDhtN/Mizn3yRMetswSMx5zhHR34j45wKwnhpVFTNIEVOtWwiKaBF0lkpAXsHQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:34.249762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-72437292-bf5a-4bac-b802-721fd8665397 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:20:34.255725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-72437292-bf5a-4bac-b802-721fd8665397 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:20:34.283001 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72437292-bf5a-4bac-b802-721fd8665397 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173949 Jul 26 05:20:34.283610 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3456/6971] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:20:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:35.928967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1263441258", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53908455-43d8-485c-ab83-26df7a521003"}], "security_groups": [{"name": "tempest-securitygroup--2104219552"}], "key_name": "tempest-keypair-1600227385", "user_data": "}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:35.939886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:35.940755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:36.052315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] validate_networks() for [('53908455-43d8-485c-ab83-26df7a521003', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:20:36.470901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:20:36.471556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:20:36.472044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:20:36.472463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:20:36.472893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:20:36.482766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:36.483247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:36.484044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:36.485053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:36.502488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:20:36.508143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:20:36.520082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:20:36.522385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:20:36.569854 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fbe04dca-45fa-4424-9131-e1b50706e0e0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.646277 Jul 26 05:20:36.576148 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3516/6972] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:20:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:20:36.583048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b651c7af-5c82-4e42-9529-4455746148ff tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:36.583670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b651c7af-5c82-4e42-9529-4455746148ff tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:36.585895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:36.587994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:36.654022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b651c7af-5c82-4e42-9529-4455746148ff tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:36.661841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b651c7af-5c82-4e42-9529-4455746148ff tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1239 microversion: 2.1 time: 0.084013 Jul 26 05:20:36.676807 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3457/6973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:36 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:37.684474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:37.686943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:37.700338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:37.700820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:37.701615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:37.702306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:37.777509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:37.786196 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-526c603e-8d28-4d42-a538-091ebcd60a39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1309 microversion: 2.1 time: 0.106729 Jul 26 05:20:37.786774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3517/6974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:37 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:38.807402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:38.808111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:38.818755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:38.819311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:38.820320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:38.821111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:38.988048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:38.996367 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-116c9106-64e8-4e0a-bcfe-88a8cd6c860a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.192942 Jul 26 05:20:38.997036 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3458/6975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:38 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:39.053253 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-26f3ac36-f5cf-48e7-a01e-9993dda2ca35 req-d698a483-371a-42ec-8f84-25038638ae31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:39.064908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-26f3ac36-f5cf-48e7-a01e-9993dda2ca35 req-d698a483-371a-42ec-8f84-25038638ae31 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:39.065643 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-26f3ac36-f5cf-48e7-a01e-9993dda2ca35 req-d698a483-371a-42ec-8f84-25038638ae31 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:39.077890 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-26f3ac36-f5cf-48e7-a01e-9993dda2ca35 req-d698a483-371a-42ec-8f84-25038638ae31 service nova] Creating event network-changed:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h1-848886-16 Jul 26 05:20:39.084254 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-26f3ac36-f5cf-48e7-a01e-9993dda2ca35 req-d698a483-371a-42ec-8f84-25038638ae31 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Jul 26 05:20:39.085121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3518/6976] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:40.016927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:40.017482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:40.024730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:40.025182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:40.025935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:40.026402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:40.158515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:40.165923 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-83970180-41cd-4c52-bffb-047e72b2685b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.153060 Jul 26 05:20:40.166524 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3459/6977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:40 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:41.188976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:41.189675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:41.195943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:41.196405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:41.197173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:41.197622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:41.331132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:41.338730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b0f0e6d0-efd6-458a-9092-13000df1937d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.155524 Jul 26 05:20:41.339298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3519/6978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:41 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:42.359725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:42.361107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:42.368116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:42.368610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:42.369380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:42.369828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:42.499091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:42.507404 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22334b8c-0877-42b5-85a3-29cddb54c585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.151716 Jul 26 05:20:42.507988 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3460/6979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:42 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:43.528734 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:43.529386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:43.537517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:43.537991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:43.538820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:43.539274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:43.662409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cfb4a5f2-f5cb-4b4a-b08f-06d7c7156d66 req-d83c8c53-c964-4ca2-9370-daa68ef1a560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "name": "network-vif-plugged", "status": "completed", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:43.677771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:43.677975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cfb4a5f2-f5cb-4b4a-b08f-06d7c7156d66 req-d83c8c53-c964-4ca2-9370-daa68ef1a560 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:43.678340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cfb4a5f2-f5cb-4b4a-b08f-06d7c7156d66 req-d83c8c53-c964-4ca2-9370-daa68ef1a560 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:43.685131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-25966b92-6231-4fea-8d6c-60b09b8eed70 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.160389 Jul 26 05:20:43.685926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3520/6980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:43 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:43.692806 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cfb4a5f2-f5cb-4b4a-b08f-06d7c7156d66 req-d83c8c53-c964-4ca2-9370-daa68ef1a560 service nova] Creating event network-vif-plugged:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h1-848886-16 Jul 26 05:20:43.699176 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cfb4a5f2-f5cb-4b4a-b08f-06d7c7156d66 req-d83c8c53-c964-4ca2-9370-daa68ef1a560 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040277 Jul 26 05:20:43.700283 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3461/6981] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:44.709001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:44.709624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:44.716559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:44.717026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:44.717801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:44.718354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:44.850283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:44.861096 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c26afd26-efdf-4c9e-8076-14d47b047d3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1365 microversion: 2.1 time: 0.156888 Jul 26 05:20:44.861933 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3521/6982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:44 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:45.881518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:45.882239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:45.890025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:45.890504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:45.891277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:45.892323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:46.027917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:20:46.036681 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0aab0194-e121-407a-8d7f-ba70f01d4cca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1551 microversion: 2.1 time: 0.159471 Jul 26 05:20:46.037253 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3462/6983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:20:45 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:20:46.057929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:20:46.058460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:20:46.066052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:46.066585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:46.067386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:46.067833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:46.144315 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-94d0b2be-091f-4b80-9706-3afb48e79c2e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090244 Jul 26 05:20:46.144935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3522/6984] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:20:46 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:20:47.396592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-01ab5f9c-b146-4c0b-9c61-c9b6fc76a378 req-7250cd4d-8650-4b33-8abd-2fc161160e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:20:47.401702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:20:47.409612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-01ab5f9c-b146-4c0b-9c61-c9b6fc76a378 req-7250cd4d-8650-4b33-8abd-2fc161160e8c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:20:47.410059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-01ab5f9c-b146-4c0b-9c61-c9b6fc76a378 req-7250cd4d-8650-4b33-8abd-2fc161160e8c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:20:47.421160 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-01ab5f9c-b146-4c0b-9c61-c9b6fc76a378 req-7250cd4d-8650-4b33-8abd-2fc161160e8c service nova] Creating event network-changed:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h1-848886-16 Jul 26 05:20:47.426897 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-01ab5f9c-b146-4c0b-9c61-c9b6fc76a378 req-7250cd4d-8650-4b33-8abd-2fc161160e8c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035107 Jul 26 05:20:47.427510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3463/6985] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:21:17.052554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.053901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.055596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.056262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.060442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:17.061068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:17.070717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.071185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.071972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.072424 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.268445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:17.276940 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17039a26-1c52-4855-8a6f-882429ad2ccc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.225248 Jul 26 05:21:17.277521 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3523/6986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:17 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:17.295594 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=15 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.296448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=28 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:17.300998 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:17.301845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:17.309200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.309655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.310444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.310880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.506299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:17.514463 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ddefc19-fc70-4bba-9871-e9d92a536677 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.220746 Jul 26 05:21:17.515356 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3464/6987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:17 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:17.535821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:17.536464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:17.542804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.543260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.544045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.544603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.675920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:17.683657 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-265be541-e066-4cc9-8f09-ff5d33508e7f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.151962 Jul 26 05:21:17.684229 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3524/6988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:17 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:17.703826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:17.706268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:17.712745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.713348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.714147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.714603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.748936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:17.755270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Old instance type m1.heat2, new instance type m1.heat {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:21:17.765438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:21:17.765856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:21:17.766353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:21:17.766767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:21:17.767174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:21:17.832898 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de2a7b19-58f1-45d4-a864-89f195165000 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/action" status: 202 len: 0 microversion: 2.1 time: 0.132936 Jul 26 05:21:17.836443 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3465/6989] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:21:17 2022] POST /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:21:17.841809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:17.842396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:17.849692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.850262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:17.851618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:17.851618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:18.021024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:18.032131 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d68669d-8f7f-418d-bad2-1e6a71f581ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1679 microversion: 2.1 time: 0.193856 Jul 26 05:21:18.032712 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3525/6990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:17 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:21:19.055020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:19.055624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:19.061697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:19.062163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:19.062931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:19.063368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:19.200263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:19.208522 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-226a0736-a2ef-448f-8910-bbd7f35d5037 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1679 microversion: 2.1 time: 0.158916 Jul 26 05:21:19.209111 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3466/6991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:19 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:20.229609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:20.230260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:20.237135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:20.237603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:20.238652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:20.239114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:20.367280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:20.374871 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab11d445-e16e-4d29-9bf3-6785e779949d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.149168 Jul 26 05:21:20.375445 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3526/6992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:20 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:21.397327 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:21.398371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:21.405475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:21.406115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:21.406949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:21.407388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:21.536713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:21.544226 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1bbcb0db-b673-46cd-9bf8-f9274acc3bf0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.151332 Jul 26 05:21:21.544810 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3467/6993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:21 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:22.566233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:22.566858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:22.573659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:22.574121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:22.574927 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:22.575378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:22.712859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:22.720404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4f808a3b-acac-49e3-8dcc-55282ed7da3c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.158177 Jul 26 05:21:22.720973 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3527/6994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:22 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:23.741949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:23.742590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:23.749733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:23.750208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:23.750975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:23.751410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:23.886496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:23.894128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f5c89ed5-ecac-4655-b612-0d84f3cdf762 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.156175 Jul 26 05:21:23.895968 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3468/6995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:23 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:24.917102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:24.917799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:24.924785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:24.925198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:24.926091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:24.926561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:25.055281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:25.062654 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a42662c4-910b-4298-a3f7-96935208621b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.149439 Jul 26 05:21:25.063215 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3528/6996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:24 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:26.084610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:26.085139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:26.092209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:26.092659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:26.093409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:26.093840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:26.226768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:26.234452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bff7967d-1224-428d-a219-9765e19a7fb8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.153863 Jul 26 05:21:26.235024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3469/6997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:26 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:27.256611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:27.257256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:27.264304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:27.264763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:27.265533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:27.265981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:27.398133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:27.405928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e82e770-90b6-4c72-b5bc-097ca791506c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.153755 Jul 26 05:21:27.406532 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3529/6998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:27 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:28.427734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:28.428347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:28.435490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:28.435949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:28.436720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:28.437160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:28.568131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:28.575671 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8c844552-e7ed-424f-aa66-2dc7437fde6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.152407 Jul 26 05:21:28.576244 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3470/6999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:28 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:29.597451 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:29.598025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:29.605143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:29.605663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:29.606475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:29.606930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:29.739598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:29.748425 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c77e9d59-b088-49f2-b49e-3bb01f91a61f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.154912 Jul 26 05:21:29.749486 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3530/7000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:29 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:30.772032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:30.772649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:30.779839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:30.780292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:30.781059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:30.781498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:30.919352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:30.927122 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95866b4b-2bcd-46d8-b1ed-646d2860ae3e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1684 microversion: 2.1 time: 0.160162 Jul 26 05:21:30.927699 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3471/7001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:30 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:31.948786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:31.949441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:31.956668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:31.957335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:31.958116 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:31.958595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:32.096247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:32.104262 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75496244-da62-4551-bf96-640428152633 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1683 microversion: 2.1 time: 0.159379 Jul 26 05:21:32.104821 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3531/7002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:31 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:32.229964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "name": "network-vif-unplugged", "status": "completed", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:32.240079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:32.240532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:32.253175 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] Creating event network-vif-unplugged:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h2-848886-16 Jul 26 05:21:32.259079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] Instance bd8da855-2e06-453d-a855-abf13770b9bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:21:32.271835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c2d69e9e-9f3d-406b-9af0-2b2419c88e89 req-d675a6e5-cb34-4058-8808-4e4b377fb33b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113803 Jul 26 05:21:32.273127 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3472/7003] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:33.126962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:33.127499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:33.134697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:33.135161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:33.135947 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:33.136396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:33.272172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:33.280001 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ced3b22-b0b4-4062-8837-71345a37ebeb tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1683 microversion: 2.1 time: 0.157264 Jul 26 05:21:33.280566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3532/7004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:33 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:21:34.290954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:34.300530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:34.301905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:34.302370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:34.302546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:34.309293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:34.309759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:34.310555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:34.311003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:34.313738 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] Creating event network-changed:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h2-848886-16 Jul 26 05:21:34.319831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] Instance bd8da855-2e06-453d-a855-abf13770b9bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:21:34.330881 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-06b8c7d8-bc78-48e3-bb68-a36991e937a6 req-924275b0-aed1-4b76-ad89-95088a57ea62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045954 Jul 26 05:21:34.331741 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3473/7005] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:34.529644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:34.537888 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec0e1e6e-4ab0-414a-aabe-229bb478cbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1681 microversion: 2.1 time: 0.240344 Jul 26 05:21:34.538505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3533/7006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:34 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:21:35.560597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:35.561304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:35.567750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:35.568210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:35.568976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:35.569418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:35.732871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:35.742238 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7c011d62-0964-485b-ba41-58e9f46c0fa3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1681 microversion: 2.1 time: 0.186704 Jul 26 05:21:35.746350 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3474/7007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:35 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:36.763586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:36.764259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:36.771456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:36.771919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:36.772697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:36.773151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:36.904399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:36.912685 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad97f321-50a2-40de-b55e-73c31f121466 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1678 microversion: 2.1 time: 0.152998 Jul 26 05:21:36.913258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3534/7008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:36 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:36.933350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:36.933830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:36.940746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:36.941189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:36.942128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:36.942588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:36.999602 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d70d5780-771a-424c-bd2c-a645d7e0d767 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/action" status: 204 len: 0 microversion: 2.1 time: 0.070253 Jul 26 05:21:37.000240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3475/7009] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:21:36 2022] POST /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:21:37.009895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:37.010552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:37.016770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:37.017284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:37.018219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:37.018739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:37.237355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:37.245849 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f4b6b54b-708e-478a-a218-1bbb0999f149 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1678 microversion: 2.1 time: 0.239904 Jul 26 05:21:37.253221 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3535/7010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:37 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:38.270702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:38.271444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:38.277979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.278473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.279258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.279699 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.411339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:38.419088 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9814a3d8-8d15-4790-8fc4-11f1f206d2ca tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.153895 Jul 26 05:21:38.419657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3476/7011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:38 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:21:38.439663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:38.440287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:38.448221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.448688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.449469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.449923 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.585426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:38.592943 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-17b9d1ec-afc6-4973-a7cc-8eb0d897383a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.157150 Jul 26 05:21:38.593506 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3536/7012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:38 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:38.614786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:38.615433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:38.621896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.622409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.623183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.623628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.756352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:38.764012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2df40496-7f96-4ffd-b745-ccabea3c0e7e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1670 microversion: 2.1 time: 0.153995 Jul 26 05:21:38.764581 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3477/7013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:38 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:38.784550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:38.785577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:38.792001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.792463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.793233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.793681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.819259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:21:38.869196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:38.897072 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2b2d120f-a0b8-4ad3-bc9c-dd03a8a534e6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 204 len: 0 microversion: 2.1 time: 0.116176 Jul 26 05:21:38.897676 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3537/7014] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:21:38 2022] DELETE /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:21:38.906029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:38.906671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:38.914169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.914633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:38.915401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:38.915842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:39.045063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:39.047424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:39.055408 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e4736e33-0ef5-4428-a62e-3f8bcaf45dbf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1676 microversion: 2.1 time: 0.152961 Jul 26 05:21:39.055511 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3478/7015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:38 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:39.280288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3c8e61c3-4309-4848-8519-84c69d24e250 req-0f2217fe-579b-4813-9abf-413bbee052b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "name": "network-vif-plugged", "status": "completed", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:39.290035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3c8e61c3-4309-4848-8519-84c69d24e250 req-0f2217fe-579b-4813-9abf-413bbee052b1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:39.290532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3c8e61c3-4309-4848-8519-84c69d24e250 req-0f2217fe-579b-4813-9abf-413bbee052b1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:39.301682 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3c8e61c3-4309-4848-8519-84c69d24e250 req-0f2217fe-579b-4813-9abf-413bbee052b1 service nova] Creating event network-vif-plugged:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h2-848886-16 Jul 26 05:21:39.306495 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3c8e61c3-4309-4848-8519-84c69d24e250 req-0f2217fe-579b-4813-9abf-413bbee052b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102479 Jul 26 05:21:39.307085 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3538/7016] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:40.076078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:40.076612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:40.086266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:40.086728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:40.087502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:40.087945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:40.248571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:40.256834 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34423e83-090a-48ce-a47d-194fd5f54b39 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1676 microversion: 2.1 time: 0.185034 Jul 26 05:21:40.257423 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3479/7017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:40 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:41.125518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e8064f13-f374-4a27-933c-fc3260d53ea2 req-31a1720d-afe5-49ee-95db-38438656bf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8da855-2e06-453d-a855-abf13770b9bc", "name": "network-vif-deleted", "tag": "555feda2-ee37-4bd1-904a-ea501bfded2c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:41.136344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e8064f13-f374-4a27-933c-fc3260d53ea2 req-31a1720d-afe5-49ee-95db-38438656bf2b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:41.136810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e8064f13-f374-4a27-933c-fc3260d53ea2 req-31a1720d-afe5-49ee-95db-38438656bf2b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:41.149061 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e8064f13-f374-4a27-933c-fc3260d53ea2 req-31a1720d-afe5-49ee-95db-38438656bf2b service nova] Creating event network-vif-deleted:555feda2-ee37-4bd1-904a-ea501bfded2c for instance bd8da855-2e06-453d-a855-abf13770b9bc on n-h2-848886-16 Jul 26 05:21:41.154335 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e8064f13-f374-4a27-933c-fc3260d53ea2 req-31a1720d-afe5-49ee-95db-38438656bf2b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Jul 26 05:21:41.154977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3539/7018] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:41.279048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:41.279663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:41.287786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:41.288763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:41.289494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:41.290144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:41.323440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:41.323897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:41.324354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lazy-loading 'fault' on Instance uuid bd8da855-2e06-453d-a855-abf13770b9bc {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:21:41.375878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:41.383447 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-82625ebe-4eab-42ff-8d9e-54dd8904fe8c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 200 len: 1329 microversion: 2.1 time: 0.108683 Jul 26 05:21:41.384025 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3480/7019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:41 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:42.406993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:42.407639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:42.414894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:42.415352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:42.416146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:42.416591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:42.430223 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc HTTP/1.1 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'bd8da855-2e06-453d-a855-abf13770b9bc'} Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:21:42.431827 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9be2e761-7f3d-475b-a82b-d1e678f4fe83 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 404 len: 111 microversion: 2.1 time: 0.031722 Jul 26 05:21:42.435566 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3540/7020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:42 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:21:42.445893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:42.447270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:42.454176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:42.454652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:42.455428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:42.455874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:42.469190 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc HTTP/1.1 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bd8da855-2e06-453d-a855-abf13770b9bc'} Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:21:42.470851 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fa699cad-78e4-4abf-addd-52d97f2114e5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 404 len: 111 microversion: 2.1 time: 0.030499 Jul 26 05:21:42.474966 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3481/7021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:42 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:21:42.521570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-114396690", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "53908455-43d8-485c-ab83-26df7a521003"}], "security_groups": [{"name": "tempest-securitygroup--2104219552"}], "key_name": "tempest-keypair-1600227385", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:42.632690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] validate_networks() for [('53908455-43d8-485c-ab83-26df7a521003', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:21:43.047611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:21:43.048054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:21:43.048547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:21:43.048974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:21:43.049401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:21:43.058721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:43.059189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:43.060002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:43.060611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:43.080034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:21:43.087435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:21:43.101087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:21:43.103412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:21:43.149771 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ab29608b-5134-48ce-9b51-1d3004f81329 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632306 Jul 26 05:21:43.150460 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3541/7022] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:21:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:21:43.162869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d9822a0-2678-4df2-8b50-63ea0ddc9e77 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:43.163483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d9822a0-2678-4df2-8b50-63ea0ddc9e77 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:43.226675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d9822a0-2678-4df2-8b50-63ea0ddc9e77 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:43.233409 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d9822a0-2678-4df2-8b50-63ea0ddc9e77 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1238 microversion: 2.1 time: 0.075693 Jul 26 05:21:43.234211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3482/7023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:43 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:44.255618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:44.256245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:44.264313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:44.264782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:44.265566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:44.266021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:44.365439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:44.372926 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fc5b82c5-fa34-4995-9043-ef3cf33fecc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1296 microversion: 2.1 time: 0.121301 Jul 26 05:21:44.373687 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3542/7024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:44 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:45.394635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:45.395524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:45.404252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:45.405026 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:45.406012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:45.406697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:45.575332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:45.595788 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4ee7da3-259c-47ed-8b74-27649a449de7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1364 microversion: 2.1 time: 0.202090 Jul 26 05:21:45.596396 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3483/7025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:45 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:45.615995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b48f41b7-7256-4bde-96c3-212328d9d638 req-53fa3f59-6aa3-446d-b4c1-d0122aa779ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:45.625804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b48f41b7-7256-4bde-96c3-212328d9d638 req-53fa3f59-6aa3-446d-b4c1-d0122aa779ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:45.626319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b48f41b7-7256-4bde-96c3-212328d9d638 req-53fa3f59-6aa3-446d-b4c1-d0122aa779ea service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:45.638883 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b48f41b7-7256-4bde-96c3-212328d9d638 req-53fa3f59-6aa3-446d-b4c1-d0122aa779ea service nova] Creating event network-changed:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h1-848886-16 Jul 26 05:21:45.643918 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b48f41b7-7256-4bde-96c3-212328d9d638 req-53fa3f59-6aa3-446d-b4c1-d0122aa779ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145273 Jul 26 05:21:45.644975 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3543/7026] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:21:46.617872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:46.618504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:46.625393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:46.625842 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:46.626632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:46.627078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:46.768902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:46.777375 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-04ee5930-15c2-4976-8978-184207af37b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1364 microversion: 2.1 time: 0.163519 Jul 26 05:21:46.778230 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3484/7027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:46 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:47.801915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:47.802792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:47.804857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:47.810436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:47.810896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:47.811673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:47.812121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:47.950716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:47.959273 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41641e2f-4ace-49e4-bf35-2c686c6d4a9d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1364 microversion: 2.1 time: 0.163175 Jul 26 05:21:47.959867 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3544/7028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:47 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:48.980659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:48.981199 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:48.984008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=51 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:21:48.989768 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:48.990247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:48.991007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:48.991442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:49.123979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:49.132400 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6705c23-b31c-4042-b9ee-37763d419971 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1364 microversion: 2.1 time: 0.155720 Jul 26 05:21:49.132971 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3485/7029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:48 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:49.947731 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-100083d3-06a7-4aa4-ad28-f040ae073917 req-ad993f8e-0d10-4bda-b6a7-b2fc305f66f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "name": "network-vif-plugged", "status": "completed", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:49.959453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-100083d3-06a7-4aa4-ad28-f040ae073917 req-ad993f8e-0d10-4bda-b6a7-b2fc305f66f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:49.959905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-100083d3-06a7-4aa4-ad28-f040ae073917 req-ad993f8e-0d10-4bda-b6a7-b2fc305f66f6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:49.978464 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-100083d3-06a7-4aa4-ad28-f040ae073917 req-ad993f8e-0d10-4bda-b6a7-b2fc305f66f6 service nova] Creating event network-vif-plugged:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h1-848886-16 Jul 26 05:21:49.983455 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-100083d3-06a7-4aa4-ad28-f040ae073917 req-ad993f8e-0d10-4bda-b6a7-b2fc305f66f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039799 Jul 26 05:21:49.984146 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3545/7030] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:50.152785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:50.153691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:50.160923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:50.161620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:50.162438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:50.162886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:50.291541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:50.298990 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b36a32da-d93f-499c-892d-649c716f3a55 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1364 microversion: 2.1 time: 0.150066 Jul 26 05:21:50.299557 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3486/7031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:50 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:51.321406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:51.322120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:51.328415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:51.328886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:51.329669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:51.330131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:51.463512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:21:51.471095 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1844263e-53e8-4213-8070-112ff43d3250 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1551 microversion: 2.1 time: 0.155597 Jul 26 05:21:51.471666 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3546/7032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:21:51 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:21:51.491551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:21:51.492070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:21:51.498963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:51.499410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:51.500165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:51.500601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:51.580271 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1cb0cc3-6c02-47d3-b56b-7202286fddc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092637 Jul 26 05:21:51.580900 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3487/7033] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:21:51 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:21:52.855822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-39038b52-4d56-42c2-8c20-e96c44ec7f9d req-2d6f85b2-78f5-4533-af5b-41b394d50d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:21:52.868134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-39038b52-4d56-42c2-8c20-e96c44ec7f9d req-2d6f85b2-78f5-4533-af5b-41b394d50d7b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:21:52.868692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-39038b52-4d56-42c2-8c20-e96c44ec7f9d req-2d6f85b2-78f5-4533-af5b-41b394d50d7b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:21:52.881713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-39038b52-4d56-42c2-8c20-e96c44ec7f9d req-2d6f85b2-78f5-4533-af5b-41b394d50d7b service nova] Creating event network-changed:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h1-848886-16 Jul 26 05:21:52.887256 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-39038b52-4d56-42c2-8c20-e96c44ec7f9d req-2d6f85b2-78f5-4533-af5b-41b394d50d7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034798 Jul 26 05:21:52.887891 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3547/7034] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:22:25.895606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.897100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=5 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.897786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=45 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.902521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-79518c18-e879-4c75-809d-b5fc4c15ef6f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:25.910114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79518c18-e879-4c75-809d-b5fc4c15ef6f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:25.910583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-79518c18-e879-4c75-809d-b5fc4c15ef6f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:25.932800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-79518c18-e879-4c75-809d-b5fc4c15ef6f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Going to try to stop instance {{(pid=119487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 05:22:25.974382 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-79518c18-e879-4c75-809d-b5fc4c15ef6f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action" status: 202 len: 0 microversion: 2.1 time: 0.080077 Jul 26 05:22:25.974997 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3488/7035] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:22:25 2022] POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:22:25.980874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.981607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.983277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.983943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:25.988350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:25.989064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:25.997594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:25.998052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:25.998858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:25.999308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:26.133586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:26.141334 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5df4751-d6f2-4479-a6c9-c34203991fce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.161591 Jul 26 05:22:26.141913 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3548/7036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:25 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:27.166821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:27.167438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:27.173640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:27.174087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:27.174872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:27.175321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:27.306652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:27.314106 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2263dd31-b524-47d9-bfc6-a0865d2609b4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.153229 Jul 26 05:22:27.314696 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3489/7037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:27 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:28.336170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:28.336790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:28.343679 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:28.344143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:28.344915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:28.345368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:28.479791 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:28.487296 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5e157ff7-3257-4ccb-bd07-18211eae8926 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.155873 Jul 26 05:22:28.487865 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3549/7038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:28 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:29.509463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:29.510077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:29.516962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:29.517417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:29.518192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:29.518634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:29.651625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:29.659541 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-131d7ad8-3de9-4d6c-abd4-be44335b5e74 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.154623 Jul 26 05:22:29.660117 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3490/7039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:29 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:30.681296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:30.681914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:30.688815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:30.689272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:30.690041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:30.690508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:30.821832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:30.829543 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-08bb7a0b-1385-453d-89fb-acbd40854481 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.152786 Jul 26 05:22:30.830120 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3550/7040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:30 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:31.851282 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:31.851920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:31.858849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:31.859299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:31.860058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:31.860495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:31.998870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:32.007423 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4c3c857-f80a-4959-8918-a6f9d60cee87 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.160326 Jul 26 05:22:32.007998 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3491/7041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:31 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:33.028692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:33.029269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:33.036408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:33.037564 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:33.038501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:33.038964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:33.174560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:33.182568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8553399-f349-4737-acee-26624a12e04d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.157797 Jul 26 05:22:33.183144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3551/7042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:33 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:34.203423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:34.204067 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:34.211357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:34.211815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:34.212579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:34.213021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:34.345339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:34.353612 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de07552c-07c4-4b19-aa09-926a6473aa85 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.154086 Jul 26 05:22:34.354219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3492/7043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:34 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:35.375241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:35.375862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:35.382301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:35.382768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:35.383545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:35.384001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:35.517123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:35.525315 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b8ca9a22-2de0-49ff-acd5-a4d2be3a16cd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.154044 Jul 26 05:22:35.525891 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3552/7044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:35 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:36.546883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:36.547476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:36.555119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.555578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.556349 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.556793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.687217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:36.695586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-212f53dc-8b21-48d6-a769-fe213e8838a5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1657 microversion: 2.1 time: 0.152620 Jul 26 05:22:36.696167 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3493/7045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:36 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:36.715644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:36.717845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:36.724837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.725302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.726075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.726551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.755413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:36.762098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:22:36.768365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:22:36.768798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:22:36.769288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:22:36.769713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:22:36.770141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:22:36.832221 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88d5c258-36ac-4185-9fd7-09f14af78930 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action" status: 202 len: 0 microversion: 2.1 time: 0.120307 Jul 26 05:22:36.832745 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3553/7046] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:22:36 2022] POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:22:36.841905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:36.842543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:36.848632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.849080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.850295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:36.850744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:36.985624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:36.994108 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85b8ddcf-0085-4eb1-b655-61206eb77986 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.156236 Jul 26 05:22:36.994961 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3494/7047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:36 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:22:38.016673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:38.017300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:38.023946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:38.024417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:38.025203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:38.025660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:38.252851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:38.261276 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-96dd3075-0409-471e-9c4a-63783044e76e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1680 microversion: 2.1 time: 0.249395 Jul 26 05:22:38.261848 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3554/7048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:38 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:39.282592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:39.283202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:39.290424 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:39.290873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:39.291629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:39.292066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:39.426037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:39.433841 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-08d339e0-d11c-4297-a365-f106252e948d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1685 microversion: 2.1 time: 0.155418 Jul 26 05:22:39.434435 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3495/7049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:39 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:22:40.456158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:40.456780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:40.464149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:40.464618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:40.465397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:40.465845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:40.606863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:40.614513 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ea1ac39-40c8-4d60-8b2c-01ce907bb71b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1685 microversion: 2.1 time: 0.162221 Jul 26 05:22:40.615896 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3555/7050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:40 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:40.993890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "name": "network-vif-unplugged", "status": "completed", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:41.005266 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:41.006277 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:41.018290 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] Creating event network-vif-unplugged:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h2-848886-16 Jul 26 05:22:41.024891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] Instance d71fd563-19db-410c-9d1c-b202ae2efce8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:22:41.036076 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5031a3b1-5cf6-499f-80b7-6408555ffee6 req-940b9771-6e6c-4e6b-b45c-e6144b3cbd2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046017 Jul 26 05:22:41.036702 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3496/7051] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:22:41.636897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:41.637524 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:41.644458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:41.644934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:41.645721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:41.646351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:41.779145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:41.787852 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6c58af51-9d12-4c70-b7d1-a8b2159030d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1684 microversion: 2.1 time: 0.154301 Jul 26 05:22:41.788420 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3556/7052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:41 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:42.810767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:42.811465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:42.817738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:42.818332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:42.819111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:42.819551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:42.951467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:42.959739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7a5a0fc1-3fff-4002-8867-280df16f1669 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1682 microversion: 2.1 time: 0.153903 Jul 26 05:22:42.960312 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3497/7053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:42 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:43.051959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:43.063138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:43.063623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:43.075595 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] Creating event network-changed:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h2-848886-16 Jul 26 05:22:43.080804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] Instance d71fd563-19db-410c-9d1c-b202ae2efce8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:22:43.093031 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-93f75a20-c5da-4d6c-92fd-4526a144f7ab req-80b2e649-e219-4ab0-82cc-62349abe47b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044619 Jul 26 05:22:43.093627 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3557/7054] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:22:43.981296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:43.981936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:43.988889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:43.989342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:43.990139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:43.990605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:44.130537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:44.139265 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-760f429b-6c9c-42cf-a4e3-8cf6a581210d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1682 microversion: 2.1 time: 0.161895 Jul 26 05:22:44.139915 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3498/7055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:43 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:45.163025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:45.163812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:45.170090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.170581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.171351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.171799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.310673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:45.324126 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3abbf69b-1563-4e52-b266-63d2d2ece854 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1678 microversion: 2.1 time: 0.166883 Jul 26 05:22:45.324910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3558/7056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:45 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:45.344400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:45.344917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:45.352445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.352898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.353661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.354096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.412699 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2ebe85c-2fe6-4520-8ae2-420bf7a112d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action" status: 204 len: 0 microversion: 2.1 time: 0.071314 Jul 26 05:22:45.413531 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3499/7057] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:22:45 2022] POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:22:45.422371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:45.423201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:45.430902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.431693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.432854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:45.433455 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:45.653233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:45.661452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05588f0a-61c9-482f-a1e3-29a09e7f212f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1678 microversion: 2.1 time: 0.243568 Jul 26 05:22:45.662691 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3559/7058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:45 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:46.685813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:46.686542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:46.692813 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:46.693913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:46.695125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:46.695570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:46.837080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:46.844677 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-407b2b62-0aef-4599-8f4a-3182373b9bde tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1657 microversion: 2.1 time: 0.164172 Jul 26 05:22:46.845249 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3500/7059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:46 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1657 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:46.865659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:46.866459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:46.873768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:46.874270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:46.875053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:46.875509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:47.003912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:47.011457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-617e4add-b3fa-4c8c-beaf-aed3e05a8a56 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1657 microversion: 2.1 time: 0.150270 Jul 26 05:22:47.012024 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3560/7060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:46 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:47.032937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-135f4b29-4c36-416e-907b-629604e2a7ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:47.039724 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-135f4b29-4c36-416e-907b-629604e2a7ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:47.040172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-135f4b29-4c36-416e-907b-629604e2a7ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:47.062897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-135f4b29-4c36-416e-907b-629604e2a7ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Going to try to start instance {{(pid=119487) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 05:22:47.096777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:47.106141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-135f4b29-4c36-416e-907b-629604e2a7ac tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action" status: 202 len: 0 microversion: 2.1 time: 0.077262 Jul 26 05:22:47.106760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3501/7061] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:22:47 2022] POST /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:22:47.115945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:47.116565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:47.122672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:47.123131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:47.123918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:47.124401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:47.261834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:47.269324 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-18aa0fce-c02c-467d-a8a3-df88c4aaa090 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1666 microversion: 2.1 time: 0.157907 Jul 26 05:22:47.269888 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3561/7062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:47 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:22:47.500868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-ff70ab9a-6c0b-4b2c-8ea0-db26de0da6d7 req-608c83cc-0698-4f91-a437-a93438d65b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "name": "network-vif-plugged", "status": "completed", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:47.511843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff70ab9a-6c0b-4b2c-8ea0-db26de0da6d7 req-608c83cc-0698-4f91-a437-a93438d65b23 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:47.512510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-ff70ab9a-6c0b-4b2c-8ea0-db26de0da6d7 req-608c83cc-0698-4f91-a437-a93438d65b23 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:47.525026 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-ff70ab9a-6c0b-4b2c-8ea0-db26de0da6d7 req-608c83cc-0698-4f91-a437-a93438d65b23 service nova] Creating event network-vif-plugged:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h2-848886-16 Jul 26 05:22:47.530245 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-ff70ab9a-6c0b-4b2c-8ea0-db26de0da6d7 req-608c83cc-0698-4f91-a437-a93438d65b23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Jul 26 05:22:47.531314 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3502/7063] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:22:48.291977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:48.292603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:48.299746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.300211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.301008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.301447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.433946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:48.441584 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9565f7be-4bc4-4b18-b768-0722f2da8584 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1670 microversion: 2.1 time: 0.154117 Jul 26 05:22:48.442186 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3562/7064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:48 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:48.464697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:48.465298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:48.472142 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.472589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.473343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.473779 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.498781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:22:48.576204 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f136c70-491b-4a4c-b95e-800d6bc2921c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 204 len: 0 microversion: 2.1 time: 0.116770 Jul 26 05:22:48.576828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3503/7065] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:22:48 2022] DELETE /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:22:48.586022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:48.586690 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:48.592684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.593150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.593932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:48.594419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:48.612709 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:48.725799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:48.733405 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c99483b3-45b6-43c7-8fe2-b221f125320d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1676 microversion: 2.1 time: 0.152244 Jul 26 05:22:48.733984 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3563/7066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:48 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:49.756543 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:49.757240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:49.763942 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:49.764394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:49.765159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:49.765592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:49.895676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:49.903546 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7859c40-0e7c-4930-bbb2-e341aa2be9a6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1676 microversion: 2.1 time: 0.152463 Jul 26 05:22:49.904119 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3504/7067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:49 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:50.925215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:50.925779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:50.933030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:50.933496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:50.934308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:50.934763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:51.004026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:51.011845 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-85b9deeb-730e-4612-9aa5-ce7327fb4299 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 200 len: 1608 microversion: 2.1 time: 0.090652 Jul 26 05:22:51.012417 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3564/7068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:50 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:51.137262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-9e0c51e1-0244-4956-8da2-485dd961c32e req-3db4fe26-9902-4d06-b210-2748f4309562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71fd563-19db-410c-9d1c-b202ae2efce8", "name": "network-vif-deleted", "tag": "516407d1-67c2-4662-b225-7a6c2cd3629a"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:51.154671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9e0c51e1-0244-4956-8da2-485dd961c32e req-3db4fe26-9902-4d06-b210-2748f4309562 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:51.155392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-9e0c51e1-0244-4956-8da2-485dd961c32e req-3db4fe26-9902-4d06-b210-2748f4309562 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:51.167866 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-9e0c51e1-0244-4956-8da2-485dd961c32e req-3db4fe26-9902-4d06-b210-2748f4309562 service nova] Creating event network-vif-deleted:516407d1-67c2-4662-b225-7a6c2cd3629a for instance d71fd563-19db-410c-9d1c-b202ae2efce8 on n-h2-848886-16 Jul 26 05:22:51.173057 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-9e0c51e1-0244-4956-8da2-485dd961c32e req-3db4fe26-9902-4d06-b210-2748f4309562 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Jul 26 05:22:51.173785 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3505/7069] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:22:52.034725 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:52.035353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:52.042668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.043112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.043920 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.044389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.060833 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 HTTP/1.1 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd71fd563-19db-410c-9d1c-b202ae2efce8'} Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:22:52.062531 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c9a8b5c-ec0f-402c-8d14-fec2ff2f2940 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 404 len: 111 microversion: 2.1 time: 0.033624 Jul 26 05:22:52.067145 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3565/7070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:52 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:22:52.078860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:52.079569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:52.086948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.087539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.088288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.088746 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.103321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 HTTP/1.1 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd71fd563-19db-410c-9d1c-b202ae2efce8'} Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:22:52.104972 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0f30fbae-2729-46fb-a55d-b1ec6cb4c906 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 404 len: 111 microversion: 2.1 time: 0.032002 Jul 26 05:22:52.110941 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3506/7071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:52 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:22:52.161950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1590247093", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "53908455-43d8-485c-ab83-26df7a521003"}], "security_groups": [{"name": "tempest-securitygroup--2104219552"}], "key_name": "tempest-keypair-1600227385", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:52.267864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] validate_networks() for [('53908455-43d8-485c-ab83-26df7a521003', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:22:52.629680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:22:52.630266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:22:52.630760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:22:52.632245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:22:52.632689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:22:52.641561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.642019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.642868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:52.643317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:52.660693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:22:52.666408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:22:52.679537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:22:52.681837 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:22:52.727426 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c48fd857-0d9c-494a-be0d-cbb761f8d508 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.569549 Jul 26 05:22:52.728065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3566/7072] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:22:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:22:52.738807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d18b2b8d-3998-493a-90a8-7d6024cacd1c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:52.739412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d18b2b8d-3998-493a-90a8-7d6024cacd1c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:52.794380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d18b2b8d-3998-493a-90a8-7d6024cacd1c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:52.801838 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d18b2b8d-3998-493a-90a8-7d6024cacd1c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1239 microversion: 2.1 time: 0.066816 Jul 26 05:22:52.802418 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3507/7073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:52 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:53.074874 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:22:53.075571 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:22:53.824389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:53.825086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:53.832071 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:53.832543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:53.833326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:53.833783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:53.904250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:53.912037 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d923d34b-37b5-4d55-a6e0-9c27a1330acc tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1297 microversion: 2.1 time: 0.092432 Jul 26 05:22:53.913169 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3567/7074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:53 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:54.936732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:54.937346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:54.947087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:54.951398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:54.952255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:54.952709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:55.039421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6dae37de-b4ed-4182-a893-c940591b38bd req-9966fced-f9d8-46bd-8164-dbfdc109df04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:22:55.053847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6dae37de-b4ed-4182-a893-c940591b38bd req-9966fced-f9d8-46bd-8164-dbfdc109df04 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:55.054302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6dae37de-b4ed-4182-a893-c940591b38bd req-9966fced-f9d8-46bd-8164-dbfdc109df04 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:55.086966 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6dae37de-b4ed-4182-a893-c940591b38bd req-9966fced-f9d8-46bd-8164-dbfdc109df04 service nova] Creating event network-changed:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:22:55.094078 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6dae37de-b4ed-4182-a893-c940591b38bd req-9966fced-f9d8-46bd-8164-dbfdc109df04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058529 Jul 26 05:22:55.095451 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3568/7075] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:22:55.114607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:55.123301 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e15b6b3-3436-4262-954c-0a6395e18b27 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.191386 Jul 26 05:22:55.124155 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3508/7076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:54 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:56.148249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:56.148967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:56.151018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:56.156803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:56.157275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:56.158067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:56.158552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:56.298637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:56.306277 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bb470349-4418-40a2-918e-6a1e4439d8d2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.163753 Jul 26 05:22:56.306841 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3569/7077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:56 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:57.327782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:57.328390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:57.331343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:22:57.337520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:57.337974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:57.338764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:57.339207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:57.469886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:57.478283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cddb91a0-1585-4bf6-a7cb-0a7e1b52f665 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.154405 Jul 26 05:22:57.478852 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3509/7078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:57 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:58.499783 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:58.500473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:58.507988 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:58.508448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:58.509221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:58.509667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:58.640286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:58.648193 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9ead6122-5e65-4c37-ab53-40aa85139008 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.152352 Jul 26 05:22:58.648761 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3570/7079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:58 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:22:59.670011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:22:59.670645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:22:59.677650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:59.678107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:59.678906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:22:59.679341 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:22:59.816112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:22:59.824037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd58b26f-c08e-44f3-98ee-53ee1ffaaa21 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.157935 Jul 26 05:22:59.824606 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3510/7080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:22:59 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:00.282569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-993ab1ab-3cc4-469d-9efc-c21d17312c81 req-da4653ab-da95-4352-94d2-e06323a6d04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-plugged", "status": "completed", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:23:00.293912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-993ab1ab-3cc4-469d-9efc-c21d17312c81 req-da4653ab-da95-4352-94d2-e06323a6d04e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:00.294474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-993ab1ab-3cc4-469d-9efc-c21d17312c81 req-da4653ab-da95-4352-94d2-e06323a6d04e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:00.307047 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-993ab1ab-3cc4-469d-9efc-c21d17312c81 req-da4653ab-da95-4352-94d2-e06323a6d04e service nova] Creating event network-vif-plugged:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:23:00.312177 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-993ab1ab-3cc4-469d-9efc-c21d17312c81 req-da4653ab-da95-4352-94d2-e06323a6d04e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033601 Jul 26 05:23:00.312806 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3571/7081] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:23:00.845611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:00.846253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:00.854356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:00.854839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:00.855602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:00.856045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:00.985293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:00.993525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-34f61125-5b8d-48de-8e45-9b9362de3a1e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1365 microversion: 2.1 time: 0.151812 Jul 26 05:23:00.994096 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3511/7082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:00 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:02.014242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:02.014898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:02.022319 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:02.022780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:02.023939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:02.024420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:02.158364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:02.166494 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ace8822-af95-4761-ae55-32de486cb404 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1551 microversion: 2.1 time: 0.156600 Jul 26 05:23:02.167063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3572/7083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:02 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:02.188321 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:02.188825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:02.195901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:02.196862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:02.197638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:02.198086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:02.275589 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eaf22d0d-475e-423f-9336-8c90dd2a4ee0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092141 Jul 26 05:23:02.276186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3512/7084] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:23:02 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:23:02.988472 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:23:02.988664 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:23:03.234063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-cf3ac3b2-59f7-4159-829d-9d2fb0017d52 req-765b01ef-032d-44ff-ba0b-8d39c8ad0fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:23:03.239022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:03.239863 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:03.250812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-cf3ac3b2-59f7-4159-829d-9d2fb0017d52 req-765b01ef-032d-44ff-ba0b-8d39c8ad0fa1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:03.251326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-cf3ac3b2-59f7-4159-829d-9d2fb0017d52 req-765b01ef-032d-44ff-ba0b-8d39c8ad0fa1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:03.263696 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-cf3ac3b2-59f7-4159-829d-9d2fb0017d52 req-765b01ef-032d-44ff-ba0b-8d39c8ad0fa1 service nova] Creating event network-changed:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:23:03.268587 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-cf3ac3b2-59f7-4159-829d-9d2fb0017d52 req-765b01ef-032d-44ff-ba0b-8d39c8ad0fa1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038162 Jul 26 05:23:03.269321 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3573/7085] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:23:36.347384 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:36.349263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=7 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:36.349901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=54,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:36.353845 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:23:36.356706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:36.365085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:36.365548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:36.366353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:36.366798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:36.398800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:36.405151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Old instance type m1.heat2, new instance type m1.heat {{(pid=119487) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:23:36.411745 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:23:36.412164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:23:36.412628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:23:36.413027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:23:36.413430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:23:36.475491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e99ab2c8-a4bf-4904-8b07-1d5d0f4f8b01 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/action" status: 202 len: 0 microversion: 2.1 time: 0.128562 Jul 26 05:23:36.476420 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3513/7086] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:23:36 2022] POST /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:23:36.482782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=9 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:36.484187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=42 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:23:36.489015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:36.489827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:36.497818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:36.498403 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:36.499261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:36.499897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:36.666136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:36.674454 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2027824d-be3c-466a-8a67-fcff28e2d615 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1679 microversion: 2.1 time: 0.193738 Jul 26 05:23:36.675035 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3574/7087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:36 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:37.695644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:37.696254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:37.703997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:37.704451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:37.705215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:37.705657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:37.846095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:37.853753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3abff332-17ed-4303-a373-e27f2146550f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1679 microversion: 2.1 time: 0.162000 Jul 26 05:23:37.854558 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3514/7088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:37 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:38.875980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:38.876594 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:38.883487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:38.883949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:38.884723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:38.885171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:39.014365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:39.021747 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2e87b591-eff8-406f-b5e8-d01f6e5804d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.150190 Jul 26 05:23:39.022333 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3575/7089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:38 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:40.043473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:40.044139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:40.051120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:40.051580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:40.052381 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:40.052831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:40.185661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:40.193241 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-206b5f1a-f16f-4c68-9f80-6191447f1868 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.153763 Jul 26 05:23:40.193808 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3515/7090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:40 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:41.216193 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:41.217044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:41.223921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:41.224383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:41.225149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:41.225599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:41.360400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:41.367879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-373dcf38-8a07-494e-b415-3ed61f4d3f7b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.156098 Jul 26 05:23:41.368436 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3576/7091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:41 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:42.388886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:42.389488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:42.396345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:42.396798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:42.397553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:42.397985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:42.527694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:42.535973 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-02ca3266-3651-4c4a-918b-850b704ea2be tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.150920 Jul 26 05:23:42.536513 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3516/7092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:42 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:43.557742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:43.558404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:43.566105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:43.566599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:43.567377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:43.567834 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:43.699925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:43.707590 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5a42d44-f0b9-40fb-944f-598c77db60ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.153786 Jul 26 05:23:43.708162 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3577/7093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:43 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:44.728658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:44.729281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:44.736697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:44.737153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:44.737924 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:44.738383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:44.869862 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:44.878025 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c6580094-ea4b-417f-a1ae-af1b4cf325fe tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.153267 Jul 26 05:23:44.878605 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3517/7094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:44 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:45.899789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:45.900410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:45.908051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:45.908774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:45.909549 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:45.910030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:46.048592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:46.056031 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-500697bf-df84-4cf1-bafa-a3c4da4c000b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.160132 Jul 26 05:23:46.056590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3578/7095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:45 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:47.078335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:47.078944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:47.085929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:47.086418 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:47.087175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:47.087612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:47.222576 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:47.230012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f187387-ae5f-4ed0-b323-6924ac009238 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.156361 Jul 26 05:23:47.230595 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3518/7096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:47 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:48.251228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:48.251991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:48.259069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:48.259534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:48.260314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:48.260762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:48.396348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:48.404523 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d680d7d-543e-4263-a2d9-706ef5529c68 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.156817 Jul 26 05:23:48.405116 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3579/7097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:48 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:49.424937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:49.425548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:49.432406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:49.432855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:49.433611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:49.434045 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:49.568350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:49.575821 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33bab1b7-005f-4c32-b01e-81ba3d7cb9f2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.154695 Jul 26 05:23:49.576452 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3519/7098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:49 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:50.597839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:50.598525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:50.605487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:50.605956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:50.606758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:50.607219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:50.742400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:50.750014 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b195023-e9f1-4ab2-a7da-7f16b4d4b1d5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.156433 Jul 26 05:23:50.750612 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3580/7099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:50 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:51.771348 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:51.771956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:51.778801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:51.779247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:51.780756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:51.781210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:51.914754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:51.922640 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8dd6a5f5-07e7-4e8b-b991-ae9fab4380f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.155192 Jul 26 05:23:51.923211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3520/7100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:51 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:52.943499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:52.944148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:52.951125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:52.952225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:52.953109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:52.953563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:53.093275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:53.100828 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ddd4ac0d-6142-4a12-932c-40f97c6cee75 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.161271 Jul 26 05:23:53.101394 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3581/7101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:52 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:54.122143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:54.122732 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:54.130416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:54.130874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:54.131646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:54.132091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:54.261974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:54.270010 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e39f14e-e108-4835-b718-10e819c35c3f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1684 microversion: 2.1 time: 0.151869 Jul 26 05:23:54.270604 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3521/7102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:54 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:55.291691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:55.292334 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:55.300596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:55.301070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:55.301868 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:55.302355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:55.444478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:55.452804 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a93e51b0-ee2b-4c71-a22c-56e26db6bb31 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1683 microversion: 2.1 time: 0.164973 Jul 26 05:23:55.453539 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3582/7103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:55 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:23:55.772054 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-unplugged", "status": "completed", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:23:55.783350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:55.784109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:55.795958 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] Creating event network-vif-unplugged:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h2-848886-16 Jul 26 05:23:55.801442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:23:55.812547 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c0106458-c4a9-4d01-a027-842774932ba4 req-bdb7b909-942f-4b01-946f-e24aea50d3c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044110 Jul 26 05:23:55.813148 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3522/7104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:23:56.474533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:56.475100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:56.482210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:56.482711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:56.483673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:56.484130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:56.616951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:56.625660 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-917a2a12-1444-4698-894f-2f892d321d14 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1683 microversion: 2.1 time: 0.155126 Jul 26 05:23:56.626269 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3583/7105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:56 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:57.648461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:57.649150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:57.656096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:57.656541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:57.657292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:57.657727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:57.789538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:57.797731 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3c28207-847a-47d6-9675-59ef7aa2accd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1681 microversion: 2.1 time: 0.154482 Jul 26 05:23:57.798351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3523/7106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:57 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:57.828598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:23:57.838798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:57.839252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:57.851337 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] Creating event network-changed:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h2-848886-16 Jul 26 05:23:57.856558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:23:57.867931 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-15562ea8-0d20-4d9f-b36b-2560d30c65e8 req-17f4c70f-bbbe-41c3-986c-e8d36faec5ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043503 Jul 26 05:23:57.868596 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3584/7107] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:23:58.819323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:58.819934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:23:58.827315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:58.827871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:58.828624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:23:58.829057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:23:58.962267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:23:58.970533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c563e05-e540-4143-97e3-e068a93a5c8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1681 microversion: 2.1 time: 0.154991 Jul 26 05:23:58.971104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3524/7108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:58 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:23:59.994409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:23:59.995262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:00.001669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.002127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.002919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.003367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.137877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:00.146454 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef2239bb-8c10-4432-97ae-b084ca3e6280 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1678 microversion: 2.1 time: 0.157220 Jul 26 05:24:00.147030 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3585/7109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:23:59 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:00.167542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:00.168203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:00.176023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.176429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.177207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.177651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.220335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.220786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.221587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.222033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.243003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:24:00.248330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:24:00.330961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:00.355300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0c8f9fb4-40fb-49e4-9061-a643a993fb7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/action" status: 202 len: 0 microversion: 2.1 time: 0.191677 Jul 26 05:24:00.355930 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3525/7110] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:24:00 2022] POST /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:24:00.364717 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:00.365333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:00.371387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.371853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.372649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:00.373094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:00.514190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:00.521897 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ec0947a-1e01-444f-9104-be2ec482ded5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1677 microversion: 2.1 time: 0.161172 Jul 26 05:24:00.522608 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3586/7111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:00 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:01.546363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:01.547083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:01.553355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:01.553825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:01.554640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:01.555072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:01.685435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:01.694131 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f20e340-ddcb-44d6-abc0-2bd4df320ae6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1677 microversion: 2.1 time: 0.153643 Jul 26 05:24:01.694743 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3526/7112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:01 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:01.995252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-plugged", "status": "completed", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:02.006346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:02.006804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:02.019137 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] Creating event network-vif-plugged:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h2-848886-16 Jul 26 05:24:02.024822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:24:02.037528 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7980868c-eba8-42cc-91cf-3e11a583e2b2 req-27b879d7-fd9d-4f79-bd16-20f5206c5604 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045950 Jul 26 05:24:02.038253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3587/7113] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:24:02.715469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:02.716095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:02.724028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:02.724483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:02.725251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:02.725694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:02.871575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:02.879818 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e5bad1a1-9492-44d9-a6e2-99f0b2950cc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1677 microversion: 2.1 time: 0.168206 Jul 26 05:24:02.880394 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3527/7114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:02 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:03.492686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-unplugged", "status": "completed", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:03.503704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:03.504163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:03.516740 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] Creating event network-vif-unplugged:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:24:03.522166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:24:03.535239 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-35343a5a-38e5-4d16-a5e4-3e3e88a907cd req-35334226-12b8-439e-870f-18552dfb5700 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046594 Jul 26 05:24:03.535874 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3588/7115] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:03.901301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:03.901927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:03.915265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:03.915723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:03.916773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:03.916948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:04.062307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:04.070416 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-abb8d187-1482-475d-8932-b775659ce828 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1677 microversion: 2.1 time: 0.173134 Jul 26 05:24:04.071308 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3528/7116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:03 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:05.094603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:05.095322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:05.101906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:05.102412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:05.103188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:05.103640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:05.234088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:05.241525 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12ef4351-ff68-4805-83bd-0fbdd3035cf2 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1677 microversion: 2.1 time: 0.152403 Jul 26 05:24:05.242087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3589/7117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:05 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:05.550600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:05.560195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:05.560638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:05.572620 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] Creating event network-changed:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:24:05.578028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:24:05.588538 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7edad6f8-b8cd-48fc-b6c0-25b2b0d8cb05 req-9f3bc71b-c81d-47f2-8caa-26493549045f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041636 Jul 26 05:24:05.589113 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3529/7118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:06.262710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:06.263399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:06.271142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.271613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.272408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.272860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.413619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:06.422493 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e775025-d062-4a3c-861a-20b0f8ae3e71 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1670 microversion: 2.1 time: 0.163698 Jul 26 05:24:06.423070 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3590/7119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:06 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:06.445297 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:06.446021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:06.448030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:06.454062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.454728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.455508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.455949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.593867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:06.601645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cdee493a-59f1-4d91-80fe-4a764a5cb441 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1670 microversion: 2.1 time: 0.162060 Jul 26 05:24:06.614216 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3530/7120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:06 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:06.623633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:06.624242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:06.626353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=35 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:06.631816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.632279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.633062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.633506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.638799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:06.767789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:06.775271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fa897f75-9e3e-45bd-b6fa-5d941d1f329d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1670 microversion: 2.1 time: 0.155825 Jul 26 05:24:06.776152 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3591/7121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:06 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:06.797458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:06.797886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:06.803920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.804375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.805134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.805572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.834071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:24:06.909012 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e1023d2c-bf10-4ae1-8028-e7053684f593 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 204 len: 0 microversion: 2.1 time: 0.116214 Jul 26 05:24:06.910106 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3531/7122] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:24:06 2022] DELETE /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:24:06.919543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:06.920695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:06.927188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.927654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:06.928429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:06.928989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:07.057180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:07.065232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dabfd5c6-8f75-4be6-8a7b-f1d7bde7fb81 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1676 microversion: 2.1 time: 0.150773 Jul 26 05:24:07.065797 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3592/7123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:06 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:08.087284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:08.087898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:08.095431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:08.095886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:08.096653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:08.097094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:08.227324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:08.235739 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da9002bc-6699-4b22-8b1c-bb270bbe745f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1676 microversion: 2.1 time: 0.152783 Jul 26 05:24:08.236319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3532/7124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:08 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:08.683699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-46b048fd-e300-4aa1-9c68-898b571c7a5a req-665817a7-c377-4c1b-bcad-b0c5990d4edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-plugged", "status": "completed", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:08.696548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-46b048fd-e300-4aa1-9c68-898b571c7a5a req-665817a7-c377-4c1b-bcad-b0c5990d4edb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:08.697199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-46b048fd-e300-4aa1-9c68-898b571c7a5a req-665817a7-c377-4c1b-bcad-b0c5990d4edb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:08.712441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-46b048fd-e300-4aa1-9c68-898b571c7a5a req-665817a7-c377-4c1b-bcad-b0c5990d4edb service nova] Creating event network-vif-plugged:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:24:08.720049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-46b048fd-e300-4aa1-9c68-898b571c7a5a req-665817a7-c377-4c1b-bcad-b0c5990d4edb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039951 Jul 26 05:24:08.720292 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3593/7125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:09.256786 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:09.258024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:09.265742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:09.266443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:09.267372 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:09.267857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:09.332342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:09.339830 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b8ef9a62-1029-499d-b475-f1a585632ea7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 200 len: 1608 microversion: 2.1 time: 0.086847 Jul 26 05:24:09.340407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3533/7126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:09 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 1608 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:24:09.410959 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-4ac74f52-94a3-439e-9804-9095622ac406 req-910aa081-615b-47c5-a6dc-a92503222f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12a365-f9c2-4eec-a183-42dae4db9920", "name": "network-vif-deleted", "tag": "74ad5d54-2ce1-4f3b-812d-72d71e6737b8"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:09.424475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4ac74f52-94a3-439e-9804-9095622ac406 req-910aa081-615b-47c5-a6dc-a92503222f1b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:09.424984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-4ac74f52-94a3-439e-9804-9095622ac406 req-910aa081-615b-47c5-a6dc-a92503222f1b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:09.438596 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-4ac74f52-94a3-439e-9804-9095622ac406 req-910aa081-615b-47c5-a6dc-a92503222f1b service nova] Creating event network-vif-deleted:74ad5d54-2ce1-4f3b-812d-72d71e6737b8 for instance 9f12a365-f9c2-4eec-a183-42dae4db9920 on n-h1-848886-16 Jul 26 05:24:09.444491 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-4ac74f52-94a3-439e-9804-9095622ac406 req-910aa081-615b-47c5-a6dc-a92503222f1b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Jul 26 05:24:09.446281 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3594/7127] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:10.361648 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:10.362202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:10.364226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:10.370837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:10.371300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:10.372077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:10.372519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:10.386537 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 HTTP/1.1 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '9f12a365-f9c2-4eec-a183-42dae4db9920'} Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:24:10.388192 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-016d449a-78ad-477d-8564-8ba3cfd1edc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 404 len: 111 microversion: 2.1 time: 0.032836 Jul 26 05:24:10.392016 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3534/7128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:10 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:24:10.405313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:10.406029 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:10.413627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:10.414096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:10.414908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:10.415371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:10.429297 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 HTTP/1.1 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '9f12a365-f9c2-4eec-a183-42dae4db9920'} Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:24:10.430971 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68885c7b-69f2-4dc1-9afd-482541c47156 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 404 len: 111 microversion: 2.1 time: 0.031861 Jul 26 05:24:10.435174 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3595/7129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:10 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:24:10.576210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-395946964", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "53908455-43d8-485c-ab83-26df7a521003"}], "security_groups": [{"name": "tempest-securitygroup--2104219552"}], "key_name": "tempest-keypair-1600227385", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:10.761434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] validate_networks() for [('53908455-43d8-485c-ab83-26df7a521003', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:24:11.183430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:24:11.183856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:24:11.184332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:24:11.184777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:24:11.185188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:24:11.195121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:11.195571 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:11.196366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:11.196812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:11.214470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:24:11.220750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:24:11.234048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:24:11.236322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:24:11.281188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c9401430-7170-40d7-8962-31e4f6deb652 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708807 Jul 26 05:24:11.282040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3535/7130] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:24:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 05:24:11.293101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b294367b-45df-4671-9fb0-52a380269cc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:11.293716 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b294367b-45df-4671-9fb0-52a380269cc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:11.389883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b294367b-45df-4671-9fb0-52a380269cc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:11.396655 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b294367b-45df-4671-9fb0-52a380269cc6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1238 microversion: 2.1 time: 0.107374 Jul 26 05:24:11.397219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3596/7131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:11 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:12.419059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:12.419669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:12.426704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:12.427154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:12.427925 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:12.428361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:12.615125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:12.622835 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ed6bc29-cacf-4eac-aa35-90f84100505f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1296 microversion: 2.1 time: 0.208562 Jul 26 05:24:12.623957 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3536/7132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:12 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1296 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:13.589086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9b2e188f-a9d9-43d2-9326-0f0420a1f801 req-37205fa5-159e-44f6-acd9-28277624fed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:13.619546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9b2e188f-a9d9-43d2-9326-0f0420a1f801 req-37205fa5-159e-44f6-acd9-28277624fed0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:13.619948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9b2e188f-a9d9-43d2-9326-0f0420a1f801 req-37205fa5-159e-44f6-acd9-28277624fed0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:13.632066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9b2e188f-a9d9-43d2-9326-0f0420a1f801 req-37205fa5-159e-44f6-acd9-28277624fed0 service nova] Creating event network-changed:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:24:13.637333 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9b2e188f-a9d9-43d2-9326-0f0420a1f801 req-37205fa5-159e-44f6-acd9-28277624fed0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053025 Jul 26 05:24:13.639495 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3597/7133] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:13.647095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:13.647871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:13.657219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:13.657899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:13.658974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:13.659761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:13.896438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:13.903937 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-da9f0046-fa60-4c95-8a4f-674473d1fe7d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.262174 Jul 26 05:24:13.904502 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3537/7134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:13 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:24:14.926776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:14.927483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:14.933718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:14.934209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:14.934986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:14.935439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:15.148976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:15.157084 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a9191b54-bc92-4ce0-9b15-4f66ca2485a3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.235421 Jul 26 05:24:15.157646 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3598/7135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:14 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:16.183030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:16.183644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:16.191150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:16.191605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:16.192382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:16.192825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:16.411875 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:16.419308 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9e20f7f-b0e6-4c8d-845c-41d2b1126231 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.244722 Jul 26 05:24:16.419894 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3538/7136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:16 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:17.440442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:17.441095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:17.448068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:17.448527 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:17.449294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:17.449741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:17.589441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:17.598179 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73494658-5a3d-40bd-bca3-edee6a0890d1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.161520 Jul 26 05:24:17.598769 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3599/7137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:17 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:18.619770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:18.620308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:18.627539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:18.627990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:18.628744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:18.629179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:18.758913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:18.766600 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c43080b0-5fae-4a5e-88d7-dfd8ef1901b0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.150724 Jul 26 05:24:18.767178 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3539/7138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:18 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:19.788503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:19.789125 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:19.797167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:19.797653 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:19.798460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:19.798911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:19.934098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:19.942115 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ac10859-340a-45fd-abd7-1fbbf0c77959 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.157766 Jul 26 05:24:19.942701 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3600/7139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:19 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:19.957990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-89da4959-d4fd-4a44-a6b9-540c4f609c94 req-ef32e859-8695-4033-8909-7e9650eee61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-plugged", "status": "completed", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:19.969651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-89da4959-d4fd-4a44-a6b9-540c4f609c94 req-ef32e859-8695-4033-8909-7e9650eee61c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:19.970100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-89da4959-d4fd-4a44-a6b9-540c4f609c94 req-ef32e859-8695-4033-8909-7e9650eee61c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:19.981126 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-89da4959-d4fd-4a44-a6b9-540c4f609c94 req-ef32e859-8695-4033-8909-7e9650eee61c service nova] Creating event network-vif-plugged:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:24:19.986529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-89da4959-d4fd-4a44-a6b9-540c4f609c94 req-ef32e859-8695-4033-8909-7e9650eee61c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032098 Jul 26 05:24:19.987134 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3540/7140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:20.964656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:20.965238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:20.972475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:20.972943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:20.973726 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:20.974205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:21.106132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:21.114139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fb4a1450-1a9d-424d-9dc9-d2002baf4f8b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1364 microversion: 2.1 time: 0.153502 Jul 26 05:24:21.114727 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3601/7141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:20 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:22.133796 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:22.134590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:22.138973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:22.139703 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:22.146893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:22.147345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:22.148107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:22.148548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:22.276965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:24:22.285394 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7292d7e-aba2-42ff-bac1-5f498e5fc87b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1551 microversion: 2.1 time: 0.153091 Jul 26 05:24:22.285959 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3541/7142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:24:22 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:24:22.306423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:24:22.306941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:24:22.308902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:24:22.315037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:22.315496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:22.316261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:22.316711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:22.396510 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b196755c-da61-4ef2-a17d-f0787c9630f9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093902 Jul 26 05:24:22.397115 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3602/7143] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:24:22 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:24:23.349553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1ddc0def-ea7a-4762-81ee-2f8fbcf7a31a req-1a11055e-abc8-4c5f-8c70-fd316527c406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:24:23.360630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ddc0def-ea7a-4762-81ee-2f8fbcf7a31a req-1a11055e-abc8-4c5f-8c70-fd316527c406 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:24:23.361070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ddc0def-ea7a-4762-81ee-2f8fbcf7a31a req-1a11055e-abc8-4c5f-8c70-fd316527c406 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:24:23.373115 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1ddc0def-ea7a-4762-81ee-2f8fbcf7a31a req-1a11055e-abc8-4c5f-8c70-fd316527c406 service nova] Creating event network-changed:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:24:23.379681 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1ddc0def-ea7a-4762-81ee-2f8fbcf7a31a req-1a11055e-abc8-4c5f-8c70-fd316527c406 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Jul 26 05:24:23.380838 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3542/7144] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:25:36.856096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=25 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:36.856914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=47 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:36.861622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:36.862274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:36.871831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:36.872286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:36.873032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:36.873486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:37.005758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:37.013301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-311008d4-02c1-4412-a464-609da24ac711 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1670 microversion: 2.1 time: 0.159721 Jul 26 05:25:37.013859 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3603/7145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:36 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:37.033188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:37.033938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:37.039339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a64a4f6-33f2-4423-acc0-7fedf0db74fe"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:25:37.041840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:37.050866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:37.051322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:37.052094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:37.052541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:37.287944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9fd7ab8-cbb9-4936-b40f-1ff8b9e23259 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257337 Jul 26 05:25:37.288555 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3543/7146] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:25:37 2022] POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:25:49.036442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:25:49.038922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:49.041660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:49.042375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:49.051353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:49.051812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:49.052591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:49.053037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:49.350682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:49.356736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:25:49.363972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:25:49.364392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:25:49.364873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:25:49.365289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:25:49.365706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:25:49.426929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1377d45-8d20-49d2-b1f8-aa65b34adaa6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.394653 Jul 26 05:25:49.427525 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3604/7147] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:25:49 2022] POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:25:49.436139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:49.436837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:49.440535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:49.441386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:25:49.450717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:49.451264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:49.452215 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:49.452661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:49.598913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:49.607636 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85c14a54-4c6f-4bf5-b6b2-7933bfb744a7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1725 microversion: 2.1 time: 0.175694 Jul 26 05:25:49.608204 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3544/7148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:49 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:50.630226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:50.630851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:50.638651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:50.639114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:50.639892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:50.640343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:50.768781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:50.776840 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5610c115-cb0c-4437-b500-3a85be24ceaf tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1725 microversion: 2.1 time: 0.150923 Jul 26 05:25:50.777386 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3605/7149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:50 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:51.799453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:51.800069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:51.807039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:51.807525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:51.808286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:51.808727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:51.939741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:51.947808 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-733b7d27-24f4-4d9b-9d94-13465243d127 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1725 microversion: 2.1 time: 0.152650 Jul 26 05:25:51.948392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3545/7150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:51 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:52.970283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:52.970909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:52.977995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:52.978488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:52.979266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:52.979710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:53.113255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:53.121517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f9e5ffd-6ade-49e8-b869-842950dc7609 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1725 microversion: 2.1 time: 0.155105 Jul 26 05:25:53.122083 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3606/7151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:52 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:54.142794 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:54.143532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:54.150729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:54.151184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:54.151986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:54.152458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:54.281583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:54.290179 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df736bcf-6722-484c-b7fa-3c0ed34de0a4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.151313 Jul 26 05:25:54.290752 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3546/7152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:54 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:55.312840 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:55.313467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:55.320826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:55.321292 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:55.322064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:55.322538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:55.455269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:55.464015 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d116d95-a4f0-450b-a3d9-c9f55cf836bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.155077 Jul 26 05:25:55.464573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3607/7153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:55 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:56.484839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:56.485448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:56.492309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:56.492755 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:56.493511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:56.493947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:56.628365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:56.636578 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b05bb8f-a76e-4a69-81af-bc8f48c3b0d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.155618 Jul 26 05:25:56.637144 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3547/7154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:56 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:57.657825 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:57.658491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:57.665831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:57.666344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:57.667128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:57.667583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:57.797980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:57.806838 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4c304093-dbc3-44c7-94ba-35cfaf5148a9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.152923 Jul 26 05:25:57.807439 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3608/7155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:57 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:58.828812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:58.829421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:25:58.837148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:58.837597 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:58.838392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:25:58.838835 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:25:58.969281 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:25:58.977428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf1b2169-ea2c-4792-a621-6a057f1a8b96 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.152532 Jul 26 05:25:58.977998 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3548/7156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:58 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:25:59.998182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:25:59.998853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:00.005829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:00.006329 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:00.007096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:00.007544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:00.147486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:00.155951 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e4d65539-215d-48c1-a994-db2fc8b5d753 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.161515 Jul 26 05:26:00.156917 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3609/7157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:25:59 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:01.178670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:01.179394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:01.186962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:01.187415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:01.188175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:01.188607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:01.326635 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:01.334783 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8a9ca1b5-d6cb-4dd2-a780-55bfcafbc055 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.160494 Jul 26 05:26:01.335351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3549/7158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:01 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:02.356753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:02.357416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:02.364509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:02.364978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:02.365765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:02.366273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:02.498115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:02.506740 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c0590d27-a972-488d-b7d3-180d6c6f7966 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.153964 Jul 26 05:26:02.507307 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3610/7159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:02 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:03.528479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:03.529078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:03.537002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:03.537463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:03.538524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:03.538971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:03.672816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:03.681436 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8ab3d63-b930-4141-9686-b95ac476fc89 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.156862 Jul 26 05:26:03.682003 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3550/7160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:03 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:04.703865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:04.704484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:04.711598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:04.712066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:04.712844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:04.713297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:04.852674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:04.860729 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ef30053-4631-4ec8-b986-7e33ea6efbc0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.160746 Jul 26 05:26:04.861291 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3611/7161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:04 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:05.882997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:05.883619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:05.890293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:05.890753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:05.891524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:05.891971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:06.028193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:06.036960 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ddff68bc-1336-495a-a103-6689d2c2d6da tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.158027 Jul 26 05:26:06.037534 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3551/7162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:05 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:07.058851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:07.059425 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:07.067104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:07.067565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:07.068338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:07.068787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:07.196945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:07.205032 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2416f2c-ac90-444f-bf15-0fa0ce05a61c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.150181 Jul 26 05:26:07.205590 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3612/7163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:07 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:08.226999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:08.227603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:08.234614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:08.235057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:08.235809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:08.236246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:08.366677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:08.374698 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-94056055-02b8-4c5b-bde2-aa072fb85996 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.151533 Jul 26 05:26:08.375260 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3552/7164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:08 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:09.395818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:09.396443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:09.403417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:09.403885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:09.404661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:09.405117 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:09.540558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:09.548573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9edbad7c-f0b4-42d6-b519-50db7d90e5db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.156828 Jul 26 05:26:09.549135 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3613/7165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:09 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:10.570639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:10.571249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:10.578280 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:10.578731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:10.579487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:10.579920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:10.709137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:10.717043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e6f7b6d5-9ddc-45c5-8405-edfff1439257 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.150371 Jul 26 05:26:10.717612 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3553/7166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:10 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:26:11.738739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:11.739361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:11.746431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:11.746890 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:11.747664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:11.748115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:11.882528 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:11.890751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d23bb5b8-c9e6-40e6-845e-f5438300c9ec tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.156689 Jul 26 05:26:11.891354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3614/7167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:11 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:12.912971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:12.913867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:12.920901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:12.921356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:12.922130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:12.922595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:13.058127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:13.066754 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c5d49a1d-e1b9-418d-9629-3c76c5c28706 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.158232 Jul 26 05:26:13.067318 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3554/7168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:12 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:13.083514 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:26:13.084043 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:26:14.088179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:14.088801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:14.095790 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:14.097036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:14.097830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:14.098306 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:14.233756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:14.242975 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7e5e9f10-6307-48cb-9c84-16f44b3a3bab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.158999 Jul 26 05:26:14.243573 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3615/7169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:14 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:26:15.264856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:15.265463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:15.272742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:15.273218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:15.274014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:15.274486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:15.404509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:15.413150 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-459c1818-680e-49af-8dbb-bd2c6a3456d6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.152158 Jul 26 05:26:15.413990 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3555/7170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:15 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:16.435559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:16.436225 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:16.446467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:16.446943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:16.447789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:16.448243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:16.588772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:16.597378 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5aaa1a98-23fe-4bf8-ac04-ddabc3f43895 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1730 microversion: 2.1 time: 0.165608 Jul 26 05:26:16.597949 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3616/7171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:16 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:17.618917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:17.619530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:17.626495 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:17.626955 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:17.628406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:17.628857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:17.781320 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:17.791843 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ae30952-ad82-4b34-8d01-7ed141ed4a15 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1729 microversion: 2.1 time: 0.176801 Jul 26 05:26:17.792973 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3556/7172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:17 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:18.213161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-unplugged", "status": "completed", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:18.227130 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:18.227596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:18.241873 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] Creating event network-vif-unplugged:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h1-848886-16 Jul 26 05:26:18.249078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:26:18.254758 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] [2d5a64c3-408d-4591-b8bb-70782d576a3e] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:26:18.815833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:18.816459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:18.823995 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:18.824528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:18.825490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:18.825863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:18.964776 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:18.974326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81a6be03-b5fe-437a-8ed3-0a18ec766585 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1729 microversion: 2.1 time: 0.162978 Jul 26 05:26:18.974916 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3557/7173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:18 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:26:19.261541 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] [2d5a64c3-408d-4591-b8bb-70782d576a3e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 57476. Jul 26 05:26:19.270477 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-32d0f599-6456-41c3-945a-d85f9e339bcf req-e2836018-75bf-4df9-af49-401378c40286 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.126913 Jul 26 05:26:19.271259 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3617/7174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:19.995621 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:19.996233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:19.998973 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=29 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:20.005231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:20.005684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:20.006476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:20.006917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:20.009735 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=85 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:20.148646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:20.156669 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c91962c9-cdce-4b5d-a86a-2ef367051315 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.164981 Jul 26 05:26:20.157235 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3558/7175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:19 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:21.181402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:21.182333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:21.184390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=33 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:21.191404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:21.191879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:21.192722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:21.193173 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:21.196168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:21.291478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:21.304285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:21.305051 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:21.320033 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] Creating event network-changed:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h1-848886-16 Jul 26 05:26:21.326799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:26:21.338866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:21.339512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-073de13a-4cb8-4050-a5a0-528cd5b76a05 req-ea700650-869e-4f2d-a298-b8b40a0a4c1c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051841 Jul 26 05:26:21.340438 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3559/7176] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:21.359217 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d631e2b-a1c1-4e77-b8cb-699c8afbf4ab tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.182721 Jul 26 05:26:21.359663 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3618/7177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:21 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:22.382043 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:22.382906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:22.390017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:22.390505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:22.391272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:22.391716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:22.525518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:22.533675 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-537cd360-0cb4-46dc-a00c-a0ceb22e627e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.156518 Jul 26 05:26:22.534266 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3560/7178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:22 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:22.997416 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:26:22.997644 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:26:23.555996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:23.556621 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:23.563951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:23.564422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:23.565821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:23.566307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:23.704475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:23.714292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87964a59-c1f2-44ad-a8a7-08765b2a7911 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.162147 Jul 26 05:26:23.715056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3619/7179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:23 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:24.736524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:24.737774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:24.744814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:24.745262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:24.746014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:24.746538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:24.883416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:24.891428 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-85f664ae-8722-41d2-b972-5aa9364a959c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.158795 Jul 26 05:26:24.891989 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3561/7180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:24 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:25.913484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:25.914368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:25.921210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:25.921671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:25.922472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:25.922925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:26.059166 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:26.067711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e331f67e-9253-4dd4-98a2-73c7a335146f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.158865 Jul 26 05:26:26.068279 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3620/7181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:25 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:27.088878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:27.089420 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:27.096403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:27.096861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:27.097615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:27.098048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:27.232480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:27.242037 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-41968b1e-b659-4105-927a-1b6e7a8e0b9f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.157048 Jul 26 05:26:27.242630 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3562/7182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:27 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:28.264262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:28.264883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:28.272965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:28.273426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:28.274224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:28.274674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:28.405708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:28.414366 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dc857fbc-f275-4e4b-8aa7-a07c9763f5c9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.153810 Jul 26 05:26:28.414932 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3621/7183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:28 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:29.436223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:29.436833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:29.443954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:29.444406 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:29.445167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:29.445608 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:29.579336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:29.588088 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d392569-71fd-48e6-a8b6-fc1a8df30a5f tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.155710 Jul 26 05:26:29.588650 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3563/7184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:29 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:30.609147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:30.609676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:30.616697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:30.617161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:30.617937 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:30.618431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:30.761155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:30.770470 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb918921-c091-468d-993e-da9331701d6c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1727 microversion: 2.1 time: 0.165268 Jul 26 05:26:30.771049 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3622/7185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:30 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:31.792438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:31.793088 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:31.800560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:31.801010 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:31.801790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:31.802264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:31.935905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:31.944008 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38c99855-c44c-41c7-9ed9-0394169493c1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1724 microversion: 2.1 time: 0.155724 Jul 26 05:26:31.944607 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3564/7186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:31 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:31.964463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:31.965004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:31.972600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:31.973059 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:31.973826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:31.974301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:32.011084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:32.011488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:32.012287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:32.012730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:32.035766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:26:32.041886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Getting quotas for user 3022c453f64a4b288d2fe7a5f1b702bd and project 5cfdbb14f0724f77ad081c0def18cfd6. Resources: {'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:26:32.146541 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-24108666-43ee-4b42-9370-e3c930d9be7a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.185684 Jul 26 05:26:32.147242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3623/7187] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:26:31 2022] POST /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:26:32.155294 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:32.155900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:32.162946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:32.163395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:32.164577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:32.165011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:32.297560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:32.306439 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1e8253de-feaf-4d4c-9a85-6101be64f3ee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.154974 Jul 26 05:26:32.307107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3565/7188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:32 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:33.310442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-plugged", "status": "completed", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:33.321939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:33.324864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:33.330023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:33.331442 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:33.338040 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] Creating event network-vif-plugged:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h1-848886-16 Jul 26 05:26:33.338583 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:33.339110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:33.339941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:33.340446 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:33.343500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:26:33.354227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-91ab3dc2-e9e8-4aef-abb9-9de49675d6f0 req-d4591987-fb85-4747-9bd4-70733d9e57f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096385 Jul 26 05:26:33.354833 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3624/7189] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:33.482771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:33.490839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-146a68da-0c4b-4443-b2fc-d112bf19b4d3 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.165613 Jul 26 05:26:33.491396 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3566/7190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:33 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:34.515002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:34.515820 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:34.522503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:34.522970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:34.523752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:34.524209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:34.661064 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:34.669546 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-169592de-5b42-4249-97a2-3fa77259c973 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.160367 Jul 26 05:26:34.670112 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3625/7191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:34 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:35.692397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:35.693009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:35.699821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:35.700283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:35.701056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:35.701500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:35.834314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:35.842368 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13b0c501-cf0a-4985-80e4-04ee54f6d0dd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.154325 Jul 26 05:26:35.842950 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3567/7192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:35 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:26:36.864300 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:36.865128 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:36.872195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:36.872658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:36.873437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:36.873883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:37.009835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:37.018031 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-314e12f7-ddd7-4b91-87a8-f9432ce4f8b6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.157717 Jul 26 05:26:37.018935 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3626/7193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:36 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:26:37.379330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-unplugged", "status": "completed", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:37.389329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:37.389792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:37.406339 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] Creating event network-vif-unplugged:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:26:37.413395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:26:37.425326 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bf814284-dc8c-48fe-b9aa-6df8b0776453 req-bb36b447-55a3-4654-98e8-1819be44e690 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107182 Jul 26 05:26:37.426042 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3568/7194] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:38.041445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:38.042073 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:38.049010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:38.049472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:38.050287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:38.051326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:38.184618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:38.193401 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-83faf9b4-ff7c-43ac-9ad8-04f25b5b19e1 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.155921 Jul 26 05:26:38.193975 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3627/7195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:38 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:39.216858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:39.217563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:39.225048 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:39.225507 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:39.226307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:39.226753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:39.368544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:39.376638 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22865202-3f03-4b7d-93a8-74136fdce3bd tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.164822 Jul 26 05:26:39.377206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3569/7196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:39 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:39.443934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:39.454343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:39.454800 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:39.466529 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] Creating event network-changed:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:26:39.471945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:26:39.483425 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-384b2204-85f3-4055-b334-848f87f464f7 req-72c26fd9-fb6f-4a6c-bb65-68b9559dd94e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Jul 26 05:26:39.484014 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3628/7197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:40.399530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:40.400147 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:40.407709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:40.408157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:40.408941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:40.409379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:40.548805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:40.558331 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d687911a-464b-41bb-ae9a-6f0bfd172cce tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.163595 Jul 26 05:26:40.559008 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3570/7198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:40 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:41.581244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:41.582072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:41.588667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:41.589135 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:41.589926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:41.590405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:41.730356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:41.739435 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3ef5229b-66f5-470a-97c7-9dab597f2d5c tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.163408 Jul 26 05:26:41.740033 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3629/7199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:41 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:42.763328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:42.763972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:42.771962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:42.772412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:42.773194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:42.773631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:42.912111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:42.920638 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-47f1918b-d115-452a-b784-aa7c6c25eb9a tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.162269 Jul 26 05:26:42.921206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3571/7200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:42 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:43.943216 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:43.943839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:43.945828 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:43.952992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:43.953452 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:43.954252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:43.954730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:44.085183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:44.093307 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0ded87e4-09db-40ba-8f2f-efac3b0ee31e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.154133 Jul 26 05:26:44.093870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3630/7201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:43 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:45.116024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:45.116617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:45.123496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:45.123956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:45.124729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:45.125171 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:45.257258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:45.265321 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a527a433-6e54-4d9d-8f6b-88cd83710fc4 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.153860 Jul 26 05:26:45.265891 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3572/7202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:45 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:46.287099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:46.287736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:46.295058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:46.295522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:46.296304 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:46.296759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:46.429658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:46.437745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-da2a0943-e54a-42cd-adb9-d2986d9637d7 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.154602 Jul 26 05:26:46.438355 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3631/7203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:46 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:47.460494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:47.461101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:47.468267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:47.468716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:47.469473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:47.469937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:47.601815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:47.610028 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3279692-866a-4b5d-b82f-fd68789a9505 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.153965 Jul 26 05:26:47.610665 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3573/7204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:47 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:48.632041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:48.632695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:48.639613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:48.640079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:48.640849 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:48.641301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:48.657387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:48.780249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:48.788805 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2d70ad37-2ee2-4612-bce2-71ed819180c6 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.161468 Jul 26 05:26:48.789634 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3632/7205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:48 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:49.810706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:49.811354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:49.818710 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:49.819168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:49.819931 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:49.820378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:49.954696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:49.963374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-40bd85d8-1e03-4ac2-b94a-7beffaed0cee tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.156669 Jul 26 05:26:49.963941 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3574/7206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:49 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:50.985759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:50.986416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:50.994028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:50.994530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:50.995309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:50.995760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:51.126797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:51.135875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-412adad5-f030-46a6-9262-e715b26273f8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1723 microversion: 2.1 time: 0.154276 Jul 26 05:26:51.136453 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3633/7207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:50 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:52.157498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:52.158114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:52.161197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=34 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:52.167423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.167873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.168642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.169084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.171828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:52.304601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:52.312536 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b496cbce-ad6e-4ad3-a9e8-c5631bf83473 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1716 microversion: 2.1 time: 0.159004 Jul 26 05:26:52.313108 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3575/7208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:52 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:52.334423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:52.335050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:52.337749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:26:52.342978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.343450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.344232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.344688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.477151 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:52.485480 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c84f9a27-4a5c-4125-877f-9a0bcb640d86 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1716 microversion: 2.1 time: 0.155741 Jul 26 05:26:52.486117 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3634/7209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:52 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:52.506921 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:52.507531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:52.513474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.513927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.514764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.515207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.646371 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:52.654348 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b517061c-efa3-441b-b302-e9a01d96b96b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1716 microversion: 2.1 time: 0.151911 Jul 26 05:26:52.654913 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3576/7210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:52 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:52.675320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:52.675852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:52.682017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.682521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.683312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.683770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.712997 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:26:52.794705 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-88e2f0a3-bd58-4cec-95cf-5db724a2f31d tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 204 len: 0 microversion: 2.1 time: 0.122909 Jul 26 05:26:52.795475 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3635/7211] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:26:52 2022] DELETE /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:26:52.804759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:52.805467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:52.811592 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.812149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.813005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:52.813628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:52.952414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:52.960834 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffe2377d-14cf-4212-a5bb-8ff87c6b70fa tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1722 microversion: 2.1 time: 0.160650 Jul 26 05:26:52.961412 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3577/7212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:52 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:53.983338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:53.984094 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:53.991182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:53.991636 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:53.992404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:53.992848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:54.125894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:54.134965 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cc5c80a3-4279-479d-b8b4-e05e60490ec5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1722 microversion: 2.1 time: 0.155908 Jul 26 05:26:54.135550 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3636/7213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:53 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:54.864103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f3e3ee54-dcce-4327-8884-6734ebce70c8 req-2207d007-df92-4265-8701-0348c5398b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-plugged", "status": "completed", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:54.875664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f3e3ee54-dcce-4327-8884-6734ebce70c8 req-2207d007-df92-4265-8701-0348c5398b3d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:54.876201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f3e3ee54-dcce-4327-8884-6734ebce70c8 req-2207d007-df92-4265-8701-0348c5398b3d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:54.889339 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f3e3ee54-dcce-4327-8884-6734ebce70c8 req-2207d007-df92-4265-8701-0348c5398b3d service nova] Creating event network-vif-plugged:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:26:54.895403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f3e3ee54-dcce-4327-8884-6734ebce70c8 req-2207d007-df92-4265-8701-0348c5398b3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Jul 26 05:26:54.896015 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3578/7214] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:55.157025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:55.157647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:55.169714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:55.170598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:55.171835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:55.172546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:55.249388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:55.258866 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f392df4-1018-4eae-bbc1-a630b9919e52 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1654 microversion: 2.1 time: 0.105695 Jul 26 05:26:55.259661 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3637/7215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:55 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1654 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:55.344225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-263d1f0e-9b72-4d10-ac74-e852d89b5a1b req-2b16ec67-d1f2-4343-82d3-8ec8ccba09ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3", "name": "network-vif-deleted", "tag": "99b7fc73-294d-40ee-8a36-dcd7f19b5ca1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:26:55.366256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-263d1f0e-9b72-4d10-ac74-e852d89b5a1b req-2b16ec67-d1f2-4343-82d3-8ec8ccba09ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:55.366646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-263d1f0e-9b72-4d10-ac74-e852d89b5a1b req-2b16ec67-d1f2-4343-82d3-8ec8ccba09ce service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:55.379489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-263d1f0e-9b72-4d10-ac74-e852d89b5a1b req-2b16ec67-d1f2-4343-82d3-8ec8ccba09ce service nova] Creating event network-vif-deleted:99b7fc73-294d-40ee-8a36-dcd7f19b5ca1 for instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 on n-h2-848886-16 Jul 26 05:26:55.384386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-263d1f0e-9b72-4d10-ac74-e852d89b5a1b req-2b16ec67-d1f2-4343-82d3-8ec8ccba09ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044512 Jul 26 05:26:55.385001 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3579/7216] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:26:56.281069 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:56.281692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:56.289995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:56.290830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:56.291632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:56.292091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:56.364552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:56.372928 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d0b8aada-a73a-413e-99b6-51a2c784b213 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1369 microversion: 2.1 time: 0.095887 Jul 26 05:26:56.373658 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3638/7217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:56 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:57.395580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:57.396172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:57.402493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:57.402948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:57.403714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:57.404154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:57.471082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:57.479910 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-76f0edb0-abff-4a54-bc34-5b2408020687 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1369 microversion: 2.1 time: 0.089520 Jul 26 05:26:57.480476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3580/7218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:57 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:58.501475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:58.502099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:58.510284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:58.510755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:58.511537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:58.511991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:58.577516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:58.586604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-736e413f-56ba-4e46-99a2-dfc9c05f6c17 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1369 microversion: 2.1 time: 0.088968 Jul 26 05:26:58.587203 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3639/7219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:58 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:26:59.607968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:26:59.608574 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:26:59.616314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:59.616762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:59.617513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:59.617947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:59.647874 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:26:59.648318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:26:59.648760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lazy-loading 'fault' on Instance uuid 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:26:59.689546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022c453f64a4b288d2fe7a5f1b702bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfdbb14f0724f77ad081c0def18cfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:26:59.697666 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7727d0b5-aef6-4252-b13b-720447e4b701 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 200 len: 1374 microversion: 2.1 time: 0.093700 Jul 26 05:26:59.698252 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3581/7220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:26:59 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 1374 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:00.719554 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:00.720157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:00.728272 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:00.728741 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:00.729522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:00.729974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:00.744786 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 HTTP/1.1 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3'} Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:00.746502 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f27845e6-b2a9-4541-b598-82bb0ef7209b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 404 len: 111 microversion: 2.1 time: 0.032346 Jul 26 05:27:00.750448 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3640/7221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:00 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:00.808232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:00.810394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:00.817809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:00.818295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:00.819117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:00.819552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:00.831914 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-volume_attachments HTTP/1.1 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3'} Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:00.833625 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-430b7019-b6d4-49a0-842e-4415a9c4b8ae tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030735 Jul 26 05:27:00.838097 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3582/7222] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:27:00 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.162560 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.163065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.170412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.170889 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.171674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.172143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.186566 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 HTTP/1.1 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3'} Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.188134 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5cfc7d48-02fe-4d42-92d0-a826781333a0 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 404 len: 111 microversion: 2.1 time: 0.031764 Jul 26 05:27:04.192241 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3641/7223] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:04 2022] DELETE /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.198443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.199084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.205975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.206459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.207220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.207666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.221186 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 HTTP/1.1 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3'} Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.222731 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-74ee8e10-2d76-44ae-9e32-71ae6b60b1d9 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3" status: 404 len: 111 microversion: 2.1 time: 0.030591 Jul 26 05:27:04.227564 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3583/7224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:04 2022] GET /compute/v2.1/servers/7b26c1b9-ca09-44c9-8a7d-ab0abc6a3ad3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.233680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.234219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.240601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.241070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.241873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.242389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.260920 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 HTTP/1.1 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '9f12a365-f9c2-4eec-a183-42dae4db9920'} Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.262556 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5ea102ca-af4a-47dd-bf75-0e1daaff71d8 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 404 len: 111 microversion: 2.1 time: 0.034427 Jul 26 05:27:04.266264 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3642/7225] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:04 2022] DELETE /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.272894 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.273510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: 9f12a365-f9c2-4eec-a183-42dae4db9920] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.279788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.280237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.281005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.281438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.296668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 HTTP/1.1 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '9f12a365-f9c2-4eec-a183-42dae4db9920'} Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.298226 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance 9f12a365-f9c2-4eec-a183-42dae4db9920 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2e09fd3-15ee-4399-b308-9ff74910615e tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920" status: 404 len: 111 microversion: 2.1 time: 0.030768 Jul 26 05:27:04.303555 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3584/7226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:04 2022] GET /compute/v2.1/servers/9f12a365-f9c2-4eec-a183-42dae4db9920 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.309394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.310002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.316487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.317577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.318671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.319204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.334656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 HTTP/1.1 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd71fd563-19db-410c-9d1c-b202ae2efce8'} Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.336348 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f25a9ecd-bf82-4561-9de6-f0a1654fb83b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 404 len: 111 microversion: 2.1 time: 0.032806 Jul 26 05:27:04.340271 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3643/7227] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:04 2022] DELETE /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.347762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.348991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: d71fd563-19db-410c-9d1c-b202ae2efce8] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.355194 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.355657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.356434 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.356881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.371112 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 HTTP/1.1 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd71fd563-19db-410c-9d1c-b202ae2efce8'} Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.372673 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance d71fd563-19db-410c-9d1c-b202ae2efce8 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3066b19c-d164-40a6-9ddd-71fb03bde1db tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8" status: 404 len: 111 microversion: 2.1 time: 0.030366 Jul 26 05:27:04.376515 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3585/7228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:04 2022] GET /compute/v2.1/servers/d71fd563-19db-410c-9d1c-b202ae2efce8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.382968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.383472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.389544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.390048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.390827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.391275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.405988 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc HTTP/1.1 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'bd8da855-2e06-453d-a855-abf13770b9bc'} Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.407599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-effe22a9-6f64-4240-ab80-6b06a2939de5 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jul 26 05:27:04.412660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3644/7229] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:04 2022] DELETE /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.418505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.419121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] [instance: bd8da855-2e06-453d-a855-abf13770b9bc] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:04.425187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.425654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.426504 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:04.427113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:04.442421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] HTTP exception thrown: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Request method failure captured: Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc HTTP/1.1 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33miMgMGcAurEfX8ITG8NlD2lGUQMKYzcFRbqDaAdQZrvK3N9wZpbQAkHP7umxXz-IfrSPa6j232zYHgxtaTLKFu3ks9Y2WotFGK3ImnTH8S1ifYJOE99V1_oAtb1ol1z81jFsECHzPe8GIkTbXrytTz9IjkLM2-u5UaicGFw5tyaJ8 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cfdbb14f0724f77ad081c0def18cfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 5cfdbb14f0724f77ad081c0def18cfd6 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1354912364 Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 3022c453f64a4b288d2fe7a5f1b702bd Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServerActionsTestJSON-1354912364-project Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'bd8da855-2e06-453d-a855-abf13770b9bc'} Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:04.443951 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Returning 404 to user: Instance bd8da855-2e06-453d-a855-abf13770b9bc could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1667b9ec-32a7-4539-9596-f25861c43e2b tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc" status: 404 len: 111 microversion: 2.1 time: 0.031078 Jul 26 05:27:04.448126 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3586/7230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:04 2022] GET /compute/v2.1/servers/bd8da855-2e06-453d-a855-abf13770b9bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:04.454176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c2dfb086-ba2f-4fd5-9978-9b9531d67289 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] Calling method '.version_select at 0x7f38b4c36ee0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:04.479454 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c2dfb086-ba2f-4fd5-9978-9b9531d67289 tempest-ServerActionsTestJSON-1354912364 tempest-ServerActionsTestJSON-1354912364-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600227385" status: 202 len: 0 microversion: 2.1 time: 0.029056 Jul 26 05:27:04.480096 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3645/7231] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 26 05:27:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600227385 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:27:14.175631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-56079713", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "1f7cd978-1e64-4e2f-be98-689916ca987c"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:14.235805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] validate_networks() for [('1f7cd978-1e64-4e2f-be98-689916ca987c', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:27:14.432837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=45 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:14.729005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:27:14.729438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:27:14.730036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:27:14.730473 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:27:14.733892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:27:14.746234 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:14.746695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:14.747496 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:14.747938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:14.771235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Getting quotas for project eb5cedc14908437e9a16dad3a7cbd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:27:14.777009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Getting quotas for user d62ec3bb95624ac2864c65f1b9271546 and project eb5cedc14908437e9a16dad3a7cbd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:27:14.790400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:27:14.792696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:27:14.839723 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b0f79a33-6c0b-4a42-9baf-3ed1f57794f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790963 Jul 26 05:27:14.840397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3587/7232] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:27:14.852457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04060190-8894-47b6-af2f-daee82bde3ad tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:14.853101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04060190-8894-47b6-af2f-daee82bde3ad tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:14.855648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:14.856317 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:14.946666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-04060190-8894-47b6-af2f-daee82bde3ad tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:14.959755 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04060190-8894-47b6-af2f-daee82bde3ad tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1215 microversion: 2.1 time: 0.111122 Jul 26 05:27:14.960288 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3646/7233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:14 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:15.983203 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:15.984664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:15.992468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:15.993223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:15.994275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:15.994945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:16.079421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:16.091300 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-73321f38-3bba-4c20-afcc-ae8c192f797b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1275 microversion: 2.1 time: 0.113457 Jul 26 05:27:16.106411 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3588/7234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:15 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:17.113134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:17.115154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:17.140683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:17.142593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:17.147813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:17.148563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:17.490680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:17.518331 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fd2078ef-9eba-4a5c-96e8-3bacd8e06bda tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1315 microversion: 2.1 time: 0.391151 Jul 26 05:27:17.518331 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3647/7235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:17 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:17.689110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-269b2aa0-3e62-4284-89e1-f777df6ff268 req-3e145af1-c17e-4c78-8fb3-c9dbccddde50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facca021-680b-4503-b007-41c211348bd6", "tag": "d75e936f-11b7-44d0-9b82-c7292c65d96d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:17.704060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-269b2aa0-3e62-4284-89e1-f777df6ff268 req-3e145af1-c17e-4c78-8fb3-c9dbccddde50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:17.704774 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-269b2aa0-3e62-4284-89e1-f777df6ff268 req-3e145af1-c17e-4c78-8fb3-c9dbccddde50 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:17.724646 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-269b2aa0-3e62-4284-89e1-f777df6ff268 req-3e145af1-c17e-4c78-8fb3-c9dbccddde50 service nova] Creating event network-changed:d75e936f-11b7-44d0-9b82-c7292c65d96d for instance facca021-680b-4503-b007-41c211348bd6 on n-h1-848886-16 Jul 26 05:27:17.731553 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-269b2aa0-3e62-4284-89e1-f777df6ff268 req-3e145af1-c17e-4c78-8fb3-c9dbccddde50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047831 Jul 26 05:27:17.736079 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3589/7236] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:27:18.527335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:18.527968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:18.534990 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:18.535460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:18.536789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:18.537246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:18.665869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:18.673349 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fe524fd1-7212-40c2-9ddc-84f6dca88bb2 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1315 microversion: 2.1 time: 0.149956 Jul 26 05:27:18.673928 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3648/7237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:18 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:19.694830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:19.695743 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:19.702050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:19.702540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:19.703313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:19.703762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:19.840577 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:19.848230 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4920de68-533d-4584-a322-70bb257a3c91 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1315 microversion: 2.1 time: 0.159020 Jul 26 05:27:19.848798 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3590/7238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:19 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:20.869447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:20.870107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:20.877006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:20.877474 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:20.878356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:20.878821 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:21.010842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:21.018664 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-49cf24ac-9fd9-4c47-8c18-ccb9fcb99a95 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1315 microversion: 2.1 time: 0.153353 Jul 26 05:27:21.019173 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3649/7239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:20 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:21.474898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-47ac56e8-facc-4eaa-ba7b-1b91812c9455 req-e18fab58-9a56-4590-bf50-0c0ab8120d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facca021-680b-4503-b007-41c211348bd6", "name": "network-vif-plugged", "status": "completed", "tag": "d75e936f-11b7-44d0-9b82-c7292c65d96d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:21.485350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47ac56e8-facc-4eaa-ba7b-1b91812c9455 req-e18fab58-9a56-4590-bf50-0c0ab8120d2b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:21.485830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47ac56e8-facc-4eaa-ba7b-1b91812c9455 req-e18fab58-9a56-4590-bf50-0c0ab8120d2b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:21.497246 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-47ac56e8-facc-4eaa-ba7b-1b91812c9455 req-e18fab58-9a56-4590-bf50-0c0ab8120d2b service nova] Creating event network-vif-plugged:d75e936f-11b7-44d0-9b82-c7292c65d96d for instance facca021-680b-4503-b007-41c211348bd6 on n-h1-848886-16 Jul 26 05:27:21.502188 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-47ac56e8-facc-4eaa-ba7b-1b91812c9455 req-e18fab58-9a56-4590-bf50-0c0ab8120d2b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Jul 26 05:27:21.502792 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3591/7240] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:27:22.040477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:22.041161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:22.048060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:22.048531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:22.049348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:22.049813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:22.180170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:22.187797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-57200137-6b00-4392-9ff7-0e6b0032a72d tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1315 microversion: 2.1 time: 0.152070 Jul 26 05:27:22.188308 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3650/7241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:22 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:23.209609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:23.210377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:23.212301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:23.217817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:23.218293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:23.219052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:23.219491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:23.361984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:23.370550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68a54bb6-73d3-4f69-ba6a-b402bb47936b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.166182 Jul 26 05:27:23.371115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3592/7242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:23 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:23.430079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-119556440", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "1f7cd978-1e64-4e2f-be98-689916ca987c"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:23.483521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] validate_networks() for [('1f7cd978-1e64-4e2f-be98-689916ca987c', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:27:23.927014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:27:23.927459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:27:23.927950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:27:23.928374 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:27:23.928803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:27:23.937770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:23.938265 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:23.939080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:23.939533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:23.956163 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Getting quotas for project eb5cedc14908437e9a16dad3a7cbd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:27:23.962176 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Getting quotas for user d62ec3bb95624ac2864c65f1b9271546 and project eb5cedc14908437e9a16dad3a7cbd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:27:23.975100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:27:23.977367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:27:24.021976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2f2a2d9-0a1e-4d6a-8504-3fa0df129b64 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595583 Jul 26 05:27:24.022818 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3651/7243] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:27:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:27:24.033711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1cff27af-8afb-4197-9caf-bf84cc0700f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:24.034363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1cff27af-8afb-4197-9caf-bf84cc0700f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:24.089966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1cff27af-8afb-4197-9caf-bf84cc0700f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:24.097261 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1cff27af-8afb-4197-9caf-bf84cc0700f5 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1216 microversion: 2.1 time: 0.067357 Jul 26 05:27:24.097834 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3593/7244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:24 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:25.118877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:25.119607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:25.129759 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:25.130258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:25.131996 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:25.132449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:25.195281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:25.203803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3bf085e5-228f-45ab-aba9-bfb1fcacdcdb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1274 microversion: 2.1 time: 0.089339 Jul 26 05:27:25.204543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3652/7245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:25 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:26.226106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:26.226919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:26.230024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:26.236900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:26.237390 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:26.238241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:26.238690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:26.341784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-96df1f6f-07c3-41ec-b92f-4cc530d50e06 req-fc85ee09-745e-4e07-8963-2fa1a4786e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9e2632-02c4-4af3-840f-1a288dfcbd30", "tag": "3d85c431-8aa8-479b-8fde-df79736e7625"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:26.357249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96df1f6f-07c3-41ec-b92f-4cc530d50e06 req-fc85ee09-745e-4e07-8963-2fa1a4786e44 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:26.357918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-96df1f6f-07c3-41ec-b92f-4cc530d50e06 req-fc85ee09-745e-4e07-8963-2fa1a4786e44 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:26.371375 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-96df1f6f-07c3-41ec-b92f-4cc530d50e06 req-fc85ee09-745e-4e07-8963-2fa1a4786e44 service nova] Creating event network-changed:3d85c431-8aa8-479b-8fde-df79736e7625 for instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 on n-h2-848886-16 Jul 26 05:27:26.377864 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-96df1f6f-07c3-41ec-b92f-4cc530d50e06 req-fc85ee09-745e-4e07-8963-2fa1a4786e44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041132 Jul 26 05:27:26.378473 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3653/7246] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:27:26.503679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:26.512462 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dde7289d-8d37-4893-bf82-4a1be83548eb tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.290923 Jul 26 05:27:26.513047 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3594/7247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:26 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:27.536127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:27.537423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:27.546823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:27.547295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:27.548095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:27.548530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:27.702561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:27.710522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-11f67a1b-6c3a-41a2-8406-4fde7d1f73e9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.179096 Jul 26 05:27:27.711108 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3654/7248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:27 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:28.731465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:28.732076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:28.739959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:28.740742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:28.741532 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:28.741978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:28.952593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:28.960670 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4fd48e20-5d03-48ad-91d1-405d68a4a9c4 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.233082 Jul 26 05:27:28.961261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3595/7249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:28 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:29.980903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:29.981529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:29.988466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:29.988938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:29.990299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:29.990869 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:30.121522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:30.129033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-12b9af70-42dc-4550-8137-cb944d4a7a5e tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.152066 Jul 26 05:27:30.129605 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3655/7250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:29 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:27:31.152187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:31.152799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:31.158754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:31.159202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:31.159959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:31.160395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:31.296858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:31.305061 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5d31c35d-0d36-46bd-b095-a242b786048a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.157874 Jul 26 05:27:31.305634 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3596/7251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:31 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:32.325603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:32.326204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:32.334829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:32.335299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:32.336085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:32.336542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:32.468055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:32.476391 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dfcb5743-21dc-41a9-b596-b622efe20a66 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.154858 Jul 26 05:27:32.476971 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3656/7252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:32 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:32.998301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4e77a53c-7bfe-484f-9e72-1c35edb2d54b req-3ecbb8e2-1e18-4173-9596-b1b494cc2e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9e2632-02c4-4af3-840f-1a288dfcbd30", "name": "network-vif-plugged", "status": "completed", "tag": "3d85c431-8aa8-479b-8fde-df79736e7625"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:33.009689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e77a53c-7bfe-484f-9e72-1c35edb2d54b req-3ecbb8e2-1e18-4173-9596-b1b494cc2e62 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:33.010137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4e77a53c-7bfe-484f-9e72-1c35edb2d54b req-3ecbb8e2-1e18-4173-9596-b1b494cc2e62 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:33.021297 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4e77a53c-7bfe-484f-9e72-1c35edb2d54b req-3ecbb8e2-1e18-4173-9596-b1b494cc2e62 service nova] Creating event network-vif-plugged:3d85c431-8aa8-479b-8fde-df79736e7625 for instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 on n-h2-848886-16 Jul 26 05:27:33.026043 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4e77a53c-7bfe-484f-9e72-1c35edb2d54b req-3ecbb8e2-1e18-4173-9596-b1b494cc2e62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Jul 26 05:27:33.026721 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3597/7253] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:27:33.497026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:33.497683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:33.504736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:33.505207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:33.506007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:33.506485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:33.639108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:33.645680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-86f9a8a2-30ae-4858-bfb6-fc0388cf535b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1316 microversion: 2.1 time: 0.152586 Jul 26 05:27:33.647045 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3657/7254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:33 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:34.666892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:34.671286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:34.671920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:34.678968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.679412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:34.680163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.680600 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:34.809160 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:34.816809 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d2e69969-7fd8-4ede-985e-49eba5960ee8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1504 microversion: 2.1 time: 0.151950 Jul 26 05:27:34.817375 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3598/7255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:34 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:34.837881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:34.838410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:34.840551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:34.841231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:34.846857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.847361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:34.848183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.848646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:34.873654 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:27:34.951647 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52493f7f-bd2a-480a-8f8d-f19c9d517a06 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 204 len: 0 microversion: 2.1 time: 0.118189 Jul 26 05:27:34.952239 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3658/7256] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:34 2022] DELETE /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:27:34.961049 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:34.961655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:34.967737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.968186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:34.968938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:34.969378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:35.104126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:35.112317 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5cf3cf26-d6fd-47ce-8b8a-8c187840883f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1510 microversion: 2.1 time: 0.155358 Jul 26 05:27:35.112875 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3599/7257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:34 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:36.134853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:36.135508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:36.142410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:36.142881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:36.143665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:36.144124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:36.277056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:36.284626 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2175361-6be8-42be-96c0-66b65b23660f tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 200 len: 1510 microversion: 2.1 time: 0.155004 Jul 26 05:27:36.285236 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3659/7258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:36 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:36.776472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b72a8e7f-1b7c-4906-9555-1d919fb593b3 req-b47383b2-aaa7-407c-9f91-6172371da66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9e2632-02c4-4af3-840f-1a288dfcbd30", "name": "network-vif-deleted", "tag": "3d85c431-8aa8-479b-8fde-df79736e7625"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:36.802893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b72a8e7f-1b7c-4906-9555-1d919fb593b3 req-b47383b2-aaa7-407c-9f91-6172371da66f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:36.803612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b72a8e7f-1b7c-4906-9555-1d919fb593b3 req-b47383b2-aaa7-407c-9f91-6172371da66f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:36.816110 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b72a8e7f-1b7c-4906-9555-1d919fb593b3 req-b47383b2-aaa7-407c-9f91-6172371da66f service nova] Creating event network-vif-deleted:3d85c431-8aa8-479b-8fde-df79736e7625 for instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 on n-h2-848886-16 Jul 26 05:27:36.822251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b72a8e7f-1b7c-4906-9555-1d919fb593b3 req-b47383b2-aaa7-407c-9f91-6172371da66f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049345 Jul 26 05:27:36.823504 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3600/7259] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:27:37.306633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:37.307261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.314318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.314787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.315603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.316055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.329954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 HTTP/1.1 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6f9e2632-02c4-4af3-840f-1a288dfcbd30'} Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.331647 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 404 to user: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b19f013-cfde-4b26-a398-1a55f824d6ce tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jul 26 05:27:37.336614 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3660/7260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:37 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:37.343556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:37.344249 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.352089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.352572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.353350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.353820 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.487209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:37.495506 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ae457c72-bea9-4a5d-95b4-3087ffc2b780 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.156166 Jul 26 05:27:37.496074 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3601/7261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:37 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:37.516101 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:37.518447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: cae2f4e4-273c-44a3-a159-8e66b43e4d8c] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.523902 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/cae2f4e4-273c-44a3-a159-8e66b43e4d8c/action HTTP/1.1 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 32 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: {"resize": {"flavorRef": "452"}} Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'cae2f4e4-273c-44a3-a159-8e66b43e4d8c', 'body': {'resize': {'flavorRef': '452'}}} Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:37.525473 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 404 to user: Instance cae2f4e4-273c-44a3-a159-8e66b43e4d8c could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1247a2a3-c5ad-4003-8cd1-ff385531703b tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "POST /compute/v2.1/servers/cae2f4e4-273c-44a3-a159-8e66b43e4d8c/action" status: 404 len: 111 microversion: 2.1 time: 0.014815 Jul 26 05:27:37.529909 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3661/7262] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:27:37 2022] POST /compute/v2.1/servers/cae2f4e4-273c-44a3-a159-8e66b43e4d8c/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:27:37.535056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:37.535669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.541793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.542274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.543036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.543482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.673866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:37.682258 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5c0323a-bce8-4270-b87e-70b3582b4195 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.150894 Jul 26 05:27:37.682828 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3602/7263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:37 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:27:37.703744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:37.704364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.711324 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.711782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.712551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.712994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.841477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:37.849579 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0fb4f6e8-399e-4919-9310-fcaa20dd6960 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.149207 Jul 26 05:27:37.850358 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3662/7264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:37 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:37.870305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "33498a87-d266-4454-880e-000010e22f51"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:37.872524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.879357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.879807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.880764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.881209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.908943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:37.914545 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: request: POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action HTTP/1.1 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 65 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: {"resize": {"flavorRef": "33498a87-d266-4454-880e-000010e22f51"}} Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: exception: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'facca021-680b-4503-b007-41c211348bd6', 'body': {'resize': {'flavorRef': '33498a87-d266-4454-880e-000010e22f51'}}} Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 05:27:37.916739 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 400 to user: Flavor 33498a87-d266-4454-880e-000010e22f51 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4a06e777-3c71-413a-83de-7fca3544b38c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action" status: 400 len: 107 microversion: 2.1 time: 0.051868 Jul 26 05:27:37.921133 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3603/7265] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:27:37 2022] POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:27:37.928490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:37.929079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:37.935170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.935642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:37.936420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:37.936880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.063540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:38.071713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0a85090-2c9f-440c-899e-0f2a78ea331a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.147751 Jul 26 05:27:38.072276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3663/7266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:37 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:38.093397 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.094012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.100157 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.100609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.101378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.101817 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.228977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:38.236511 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d5db7985-cd52-474b-bd99-4e8bd2f2ec70 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.147008 Jul 26 05:27:38.237089 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3604/7267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:38 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:38.257575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd09e8e-def3-4c6d-84ad-97a4ce478c47 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd09e8e-def3-4c6d-84ad-97a4ce478c47 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: request: POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action HTTP/1.1 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 29 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: {"resize": {"flavorRef": ""}} Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'facca021-680b-4503-b007-41c211348bd6', 'body': {'resize': {'flavorRef': ''}}} Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise error Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi '' Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.261221 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bdd09e8e-def3-4c6d-84ad-97a4ce478c47 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bdd09e8e-def3-4c6d-84ad-97a4ce478c47 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action" status: 400 len: 113 microversion: 2.1 time: 0.009753 Jul 26 05:27:38.265949 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3664/7268] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:27:38 2022] POST /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:27:38.270558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.271801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.277711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.278178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.278969 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.279410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.412675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:38.420558 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b1a9b740-799c-4afb-9bbc-dbf85b63f2d8 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1503 microversion: 2.1 time: 0.153702 Jul 26 05:27:38.421125 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3605/7269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:38 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:38.445847 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.446412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.453492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.453961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.454776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.455237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.468837 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 HTTP/1.1 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '6f9e2632-02c4-4af3-840f-1a288dfcbd30'} Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:38.470433 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 404 to user: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-016d35dd-eedb-476b-8371-f87152243a2c tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 404 len: 111 microversion: 2.1 time: 0.031494 Jul 26 05:27:38.475798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3665/7270] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:38 2022] DELETE /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:27:38.480923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.481541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: 6f9e2632-02c4-4af3-840f-1a288dfcbd30] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.487619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.488072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.488839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.489283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.503020 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 HTTP/1.1 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '6f9e2632-02c4-4af3-840f-1a288dfcbd30'} Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:38.504525 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 404 to user: Instance 6f9e2632-02c4-4af3-840f-1a288dfcbd30 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d506f8e-91c5-4dc6-8e6f-48f64d7b1edd tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30" status: 404 len: 111 microversion: 2.1 time: 0.029316 Jul 26 05:27:38.509639 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3606/7271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:38 2022] GET /compute/v2.1/servers/6f9e2632-02c4-4af3-840f-1a288dfcbd30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:27:38.514986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.515491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.522083 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.522517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.523280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.523723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.541827 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:27:38.550392 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:27:38.625475 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-04067638-0719-4b73-b059-3bae0b10dbee tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 204 len: 0 microversion: 2.1 time: 0.113909 Jul 26 05:27:38.629088 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3666/7272] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:27:38 2022] DELETE /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:27:38.635070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:38.635693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:38.641696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.642174 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.642965 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:38.643412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:38.774567 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:38.781989 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5d0cf4f-984c-44cc-86e5-8f6d6b08890a tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1509 microversion: 2.1 time: 0.151584 Jul 26 05:27:38.782585 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3607/7273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:38 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:27:39.805764 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:39.806442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:39.813340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:39.813811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:39.814628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:39.815085 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:39.952257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:39.960021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6239a9dd-964f-4412-a5ff-9894cba02fb9 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1509 microversion: 2.1 time: 0.160127 Jul 26 05:27:39.960587 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3667/7274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:39 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:40.869520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-bea2599d-24ca-416f-a0a4-e87c16e5e20b req-4b15d91e-b22d-4841-8adf-81383b1c9e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facca021-680b-4503-b007-41c211348bd6", "name": "network-vif-deleted", "tag": "d75e936f-11b7-44d0-9b82-c7292c65d96d"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:27:40.886753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bea2599d-24ca-416f-a0a4-e87c16e5e20b req-4b15d91e-b22d-4841-8adf-81383b1c9e2d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:40.887207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-bea2599d-24ca-416f-a0a4-e87c16e5e20b req-4b15d91e-b22d-4841-8adf-81383b1c9e2d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:40.902018 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-bea2599d-24ca-416f-a0a4-e87c16e5e20b req-4b15d91e-b22d-4841-8adf-81383b1c9e2d service nova] Creating event network-vif-deleted:d75e936f-11b7-44d0-9b82-c7292c65d96d for instance facca021-680b-4503-b007-41c211348bd6 on n-h1-848886-16 Jul 26 05:27:40.908262 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-bea2599d-24ca-416f-a0a4-e87c16e5e20b req-4b15d91e-b22d-4841-8adf-81383b1c9e2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043105 Jul 26 05:27:40.908871 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3608/7275] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:27:40.982261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:40.983808 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:40.991967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:40.992431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:40.993218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:40.993695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:41.062124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62ec3bb95624ac2864c65f1b9271546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cedc14908437e9a16dad3a7cbd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:27:41.070509 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b6452a1-85cc-4222-a34e-4d4de93a5e40 tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 200 len: 1300 microversion: 2.1 time: 0.092858 Jul 26 05:27:41.071007 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3668/7276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:40 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:27:42.091164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:27:42.091778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] [instance: facca021-680b-4503-b007-41c211348bd6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:27:42.098816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:42.099373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:42.100258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:27:42.100698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:27:42.116206 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] HTTP exception thrown: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Request method failure captured: Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 HTTP/1.1 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33sxpNQh8FoVc0_HQE1aLJSFXauZryxZyWxnXR8pRsFphArSxEzXULmXaRj3cxjCLI05PWxgy3fYL0vl0kksx3UihlrXn09fD3ahN95_LpTmTCL2ZuMKnU2Fq_r9T-T_uFX8jcQ3OM8pHghKZBJl0aXuvOa421kFN9CgkBozibIpz_Q Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb5cedc14908437e9a16dad3a7cbd6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: eb5cedc14908437e9a16dad3a7cbd6dd Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1356354647 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d62ec3bb95624ac2864c65f1b9271546 Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-ServersNegativeTestJSON-1356354647-project Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'facca021-680b-4503-b007-41c211348bd6'} Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:27:42.117806 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] Returning 404 to user: Instance facca021-680b-4503-b007-41c211348bd6 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d71ec16a-055d-46f5-b28c-0b8c5d7973dc tempest-ServersNegativeTestJSON-1356354647 tempest-ServersNegativeTestJSON-1356354647-project] 10.222.0.43 "GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6" status: 404 len: 111 microversion: 2.1 time: 0.032337 Jul 26 05:27:42.121605 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3609/7277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:27:42 2022] GET /compute/v2.1/servers/facca021-680b-4503-b007-41c211348bd6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:28:13.311355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:13.313839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:13.534228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0f2da073-534e-4950-8402-5814ae935661 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: .version_select at 0x7f38b42754c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1741019325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFuBPQHPBZcPqCcRB72dXIzDV3O4cuGt5tVxNx2DUpfAGSikgtYSLlqqzGOLnpslSnC2ZYqUKyTLZMKNdGfSjnWTLGLDwgzzGJes0R5U9j6D2zcehvQLNPf52JMxRw1pw=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:13.553222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f2da073-534e-4950-8402-5814ae935661 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:28:13.562626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0f2da073-534e-4950-8402-5814ae935661 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:28:13.597574 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0f2da073-534e-4950-8402-5814ae935661 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.291835 Jul 26 05:28:13.598211 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3669/7278] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:28:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:28:13.664216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1180532214", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1741019325", "networks": [{"uuid": "c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:13.681891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=39 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:13.683235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=98 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:13.735595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] validate_networks() for [('c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:28:14.132550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:28:14.132979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:28:14.133490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:28:14.133911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:28:14.134459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:28:14.143723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:14.144191 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:14.145101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:14.146497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:14.163336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:28:14.168858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:28:14.181019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:28:14.183264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:28:14.229601 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-05fc4463-2401-49d8-9348-e0e81e39eb1f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570112 Jul 26 05:28:14.230284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3610/7279] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:28:14.241167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5b70066d-ec60-4a3a-b8e3-81ef1022862a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:14.241804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5b70066d-ec60-4a3a-b8e3-81ef1022862a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:14.298199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5b70066d-ec60-4a3a-b8e3-81ef1022862a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:14.305189 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5b70066d-ec60-4a3a-b8e3-81ef1022862a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1263 microversion: 2.1 time: 0.068177 Jul 26 05:28:14.305967 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3670/7280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:14 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:28:15.325401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:15.326025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:15.336629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:15.337262 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:15.338093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:15.338615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:15.405550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:15.413854 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b28e06cd-226e-4d36-a9a4-d48d19edcb0f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1321 microversion: 2.1 time: 0.092763 Jul 26 05:28:15.414713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3611/7281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:15 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:16.436126 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:16.436787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:16.446671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:16.447331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:16.448438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:16.449086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:16.558204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-19db0321-97e5-4d7a-92cf-183ff836a182 req-c1a96823-05da-43a3-9b56-2a953b13f4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15a0f85-bf85-48e0-b92f-c98f575d51bd", "tag": "bca2775d-79a3-40d5-bd0e-2a4993492743"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:16.574952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-19db0321-97e5-4d7a-92cf-183ff836a182 req-c1a96823-05da-43a3-9b56-2a953b13f4e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:16.575959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-19db0321-97e5-4d7a-92cf-183ff836a182 req-c1a96823-05da-43a3-9b56-2a953b13f4e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:16.601794 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-19db0321-97e5-4d7a-92cf-183ff836a182 req-c1a96823-05da-43a3-9b56-2a953b13f4e8 service nova] Creating event network-changed:bca2775d-79a3-40d5-bd0e-2a4993492743 for instance d15a0f85-bf85-48e0-b92f-c98f575d51bd on n-h1-848886-16 Jul 26 05:28:16.610824 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-19db0321-97e5-4d7a-92cf-183ff836a182 req-c1a96823-05da-43a3-9b56-2a953b13f4e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056199 Jul 26 05:28:16.612001 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3612/7282] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:16.870471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:16.887860 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cab8b688-0c9f-4390-8ea8-f60a6c78a2a0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.456527 Jul 26 05:28:16.890581 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3671/7283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:16 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:17.914063 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:17.915094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:17.921716 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:17.922301 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:17.923152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:17.923923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:18.067534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:18.077874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6c1b7dc6-69fc-467d-a14a-7eeba394ba4d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.169817 Jul 26 05:28:18.078475 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3613/7284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:17 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:19.099357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:19.100003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:19.106924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:19.107383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:19.108157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:19.108607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:19.237563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:19.245509 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8afadb2d-00f4-4ee7-aaeb-f7bd361738fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.150030 Jul 26 05:28:19.246082 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3672/7285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:19 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:20.266484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:20.267097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:20.274806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:20.275271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:20.276018 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:20.276455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:20.409275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:20.418249 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ecd36c2-6230-43e2-9cae-fdb6dda565e8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.155730 Jul 26 05:28:20.418823 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3614/7286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:20 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:21.440031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:21.440657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:21.447632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:21.448093 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:21.448860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:21.449313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:21.578682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:21.587129 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73f67032-1a90-4e9c-a940-fe2f7adf06e6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.151043 Jul 26 05:28:21.588021 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3673/7287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:21 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:21.727317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-0231472c-fb86-44f4-93aa-c8819f4a7f90 req-61b16847-fc3e-4977-9922-5f6a8799fb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15a0f85-bf85-48e0-b92f-c98f575d51bd", "name": "network-vif-plugged", "status": "completed", "tag": "bca2775d-79a3-40d5-bd0e-2a4993492743"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:21.739643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0231472c-fb86-44f4-93aa-c8819f4a7f90 req-61b16847-fc3e-4977-9922-5f6a8799fb89 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:21.740132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-0231472c-fb86-44f4-93aa-c8819f4a7f90 req-61b16847-fc3e-4977-9922-5f6a8799fb89 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:21.751932 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-0231472c-fb86-44f4-93aa-c8819f4a7f90 req-61b16847-fc3e-4977-9922-5f6a8799fb89 service nova] Creating event network-vif-plugged:bca2775d-79a3-40d5-bd0e-2a4993492743 for instance d15a0f85-bf85-48e0-b92f-c98f575d51bd on n-h1-848886-16 Jul 26 05:28:21.761425 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-0231472c-fb86-44f4-93aa-c8819f4a7f90 req-61b16847-fc3e-4977-9922-5f6a8799fb89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Jul 26 05:28:21.762841 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3615/7288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:28:22.607332 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:22.607911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:22.615635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:22.616103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:22.616906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:22.617365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:22.747851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:22.755814 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f819af51-c83f-4103-902f-f389e8208d47 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1363 microversion: 2.1 time: 0.152519 Jul 26 05:28:22.756379 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3674/7289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:22 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:23.778254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:23.778881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:23.785144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:23.785599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:23.787221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:23.787666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:23.918492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:23.925955 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cd326758-e4d3-4661-86c4-f2ff70369577 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1554 microversion: 2.1 time: 0.153002 Jul 26 05:28:23.927093 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3616/7290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:23 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:23.947694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:23.948313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:23.955648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:23.956115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:23.956896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:23.957346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:24.094844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:24.102364 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b7c2fdcf-a34e-49bc-aa2d-44cd7b4ea851 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1554 microversion: 2.1 time: 0.158612 Jul 26 05:28:24.102934 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3675/7291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:23 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:25.710683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dff32f9-afba-456a-b245-162137afedcc"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:25.713028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:25.715068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:25.715868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:25.722685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:25.723145 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:25.724516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:25.724956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:25.960403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-68b5c2fb-82be-468c-8a47-b9a41dceeb8d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253992 Jul 26 05:28:25.961060 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3617/7292] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:28:25 2022] POST /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:36.668270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:36.668765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:36.670647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:36.671510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:36.672330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=30 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:36.678898 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:36.679362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:36.680138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:36.680592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:36.761011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'services' on Instance uuid d15a0f85-bf85-48e0-b92f-c98f575d51bd {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:28:36.832388 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3729736a-6a24-4c03-8e4d-b1bd8fc839fd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments/5dff32f9-afba-456a-b245-162137afedcc" status: 202 len: 0 microversion: 2.1 time: 0.168302 Jul 26 05:28:36.832991 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3676/7293] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:28:36 2022] DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments/5dff32f9-afba-456a-b245-162137afedcc => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:28:36.842057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:36.844538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:36.847197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:36.847979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:28:36.854178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:36.854749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:36.855531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:36.855966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:36.889548 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-295e1dab-3bc7-4926-9dca-f807809a4cac tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051780 Jul 26 05:28:36.890107 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3618/7294] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:36 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:28:37.903162 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:37.905567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:37.912765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:37.913240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:37.914026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:37.914509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:37.945202 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f714e340-d609-49de-8867-d697fdb38dcc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047265 Jul 26 05:28:37.945776 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3677/7295] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:37 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:38.957042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:38.960017 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:38.967197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:38.967646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:38.968403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:38.968838 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:38.999031 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-231007df-8b71-40e8-a3ff-1afb0b67192f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Jul 26 05:28:38.999591 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3619/7296] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:38 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:40.011489 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:40.013851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:40.021355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:40.021811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:40.022616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:40.023062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:40.052384 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-77f0ca20-9d54-4e8d-9e02-19ee28dbcb7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Jul 26 05:28:40.052939 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3678/7297] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:40 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:41.064839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:41.067462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:41.074440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:41.074889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:41.075649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:41.076109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:41.105817 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0dc4452a-37e6-4c0b-9f47-7fd51cdc024d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Jul 26 05:28:41.106405 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3620/7298] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:41 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:42.118519 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:42.120630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:42.127494 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:42.127960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:42.128736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:42.129212 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:42.158287 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e4aa7b8-20e2-4041-9057-bb43ac863360 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044011 Jul 26 05:28:42.158838 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3679/7299] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:28:42 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:28:42.170116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:42.170629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:42.177633 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:42.178085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:42.178871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:42.179311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:42.253579 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd is not attached to volume 5dff32f9-afba-456a-b245-162137afedcc Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments/5dff32f9-afba-456a-b245-162137afedcc HTTP/1.1 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd is not attached to volume 5dff32f9-afba-456a-b245-162137afedcc Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': 'd15a0f85-bf85-48e0-b92f-c98f575d51bd', 'id': '5dff32f9-afba-456a-b245-162137afedcc'} Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5dff32f9-afba-456a-b245-162137afedcc. Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd is not attached to volume 5dff32f9-afba-456a-b245-162137afedcc Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:28:42.270534 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd is not attached to volume 5dff32f9-afba-456a-b245-162137afedcc Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd is not attached to volume 5dff32f9-afba-456a-b245-162137afedcc {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f24a7bcd-f6af-487f-b028-87c1efdad63a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments/5dff32f9-afba-456a-b245-162137afedcc" status: 404 len: 154 microversion: 2.1 time: 0.106080 Jul 26 05:28:42.275328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3621/7300] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:28:42 2022] DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd/os-volume_attachments/5dff32f9-afba-456a-b245-162137afedcc => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:28:45.617865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:45.618484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:45.626034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:45.626915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:45.627785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:45.628309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:45.656026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:28:45.745803 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-849a88cf-66eb-4dc9-9d28-80120394fd7a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 204 len: 0 microversion: 2.1 time: 0.131702 Jul 26 05:28:45.746455 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3680/7301] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:28:45 2022] DELETE /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:28:45.755953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:45.756843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:45.764401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:45.764855 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:45.765632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:45.766074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:45.900682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:45.908355 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cd58eb17-a536-4a0b-8f1a-5e2c0e93d54e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1560 microversion: 2.1 time: 0.157387 Jul 26 05:28:45.909006 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3622/7302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:45 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:46.931026 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:46.931740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:46.938819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:46.939290 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:46.940078 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:46.940539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:47.070641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:47.078206 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4889be3b-e70b-44ab-9bd3-ba03a26ec283 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1560 microversion: 2.1 time: 0.152071 Jul 26 05:28:47.078782 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3681/7303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:46 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:47.809511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-47452090-e5e5-4219-a054-7066f20a643d req-ad275eb3-6241-4492-9421-e1620de711e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15a0f85-bf85-48e0-b92f-c98f575d51bd", "name": "network-vif-deleted", "tag": "bca2775d-79a3-40d5-bd0e-2a4993492743"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:47.821046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47452090-e5e5-4219-a054-7066f20a643d req-ad275eb3-6241-4492-9421-e1620de711e3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:47.821487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-47452090-e5e5-4219-a054-7066f20a643d req-ad275eb3-6241-4492-9421-e1620de711e3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:47.834686 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-47452090-e5e5-4219-a054-7066f20a643d req-ad275eb3-6241-4492-9421-e1620de711e3 service nova] Creating event network-vif-deleted:bca2775d-79a3-40d5-bd0e-2a4993492743 for instance d15a0f85-bf85-48e0-b92f-c98f575d51bd on n-h1-848886-16 Jul 26 05:28:47.840247 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-47452090-e5e5-4219-a054-7066f20a643d req-ad275eb3-6241-4492-9421-e1620de711e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Jul 26 05:28:47.841352 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3623/7304] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:48.100844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:48.101390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:48.108287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:48.108757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:48.109536 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:48.109991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:48.141968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:48.142467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:48.142936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'fault' on Instance uuid d15a0f85-bf85-48e0-b92f-c98f575d51bd {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:28:48.190677 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:48.199155 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c796991-099a-48fa-974a-2b4b14acd479 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 200 len: 1353 microversion: 2.1 time: 0.103209 Jul 26 05:28:48.199974 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3682/7305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:48 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:49.223309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:49.224036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: d15a0f85-bf85-48e0-b92f-c98f575d51bd] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:49.230461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:49.230916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:49.231691 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:49.232134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:49.246525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd HTTP/1.1 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd15a0f85-bf85-48e0-b92f-c98f575d51bd'} Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:28:49.248176 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance d15a0f85-bf85-48e0-b92f-c98f575d51bd could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4ff94cb2-c860-46d0-a695-f1ab7f6f931a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd" status: 404 len: 111 microversion: 2.1 time: 0.031946 Jul 26 05:28:49.253084 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3624/7306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:49 2022] GET /compute/v2.1/servers/d15a0f85-bf85-48e0-b92f-c98f575d51bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:28:49.259187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-139ac997-0cfe-4429-af7d-a1898f57feff tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '.version_select at 0x7f38b45c0f70>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:49.279621 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-139ac997-0cfe-4429-af7d-a1898f57feff tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1741019325" status: 202 len: 0 microversion: 2.1 time: 0.024249 Jul 26 05:28:49.280181 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3683/7307] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Jul 26 05:28:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1741019325 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:28:49.297904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7e659e56-e9e4-48ac-8692-f16c536223e9 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: .version_select at 0x7f38b471e670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1725884731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM1+nnxYz+PFYllZiTPeo82AbyojUDESfopiNbWbtrA2ke8YFoyVUh2Yv3mFQuGwAqtzQTGmG4CvMiNaC9NoKslxHNvAXMrCEbT0uUP6FP4FXSJEXlNKjMB3NpdeyCdWQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:49.313028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7e659e56-e9e4-48ac-8692-f16c536223e9 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:28:49.321807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7e659e56-e9e4-48ac-8692-f16c536223e9 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:28:49.348817 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7e659e56-e9e4-48ac-8692-f16c536223e9 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054732 Jul 26 05:28:49.349425 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3625/7308] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:28:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:28:49.399466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-800990736", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1725884731", "networks": [{"uuid": "c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:49.452813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] validate_networks() for [('c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:28:49.829183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:28:49.829809 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:28:49.830326 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:28:49.830750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:28:49.831172 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:28:49.840505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:49.840972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:49.841814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:49.842318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:49.859511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:28:49.865473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:28:49.877949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:28:49.880371 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:28:49.926903 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-99c873eb-85b5-4ef7-b0cd-9c7ccb98cfec tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531015 Jul 26 05:28:49.927568 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3684/7309] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:28:49.938202 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-67e0b0aa-9ddf-485b-afdc-3c7c56b521fb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:49.938848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-67e0b0aa-9ddf-485b-afdc-3c7c56b521fb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:49.996826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-67e0b0aa-9ddf-485b-afdc-3c7c56b521fb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:50.003542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-67e0b0aa-9ddf-485b-afdc-3c7c56b521fb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1262 microversion: 2.1 time: 0.069331 Jul 26 05:28:50.004439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3626/7310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:49 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:51.026179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:51.026722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:51.032900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:51.033360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:51.034203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:51.034873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:51.099631 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:51.107473 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d8767a3-eccb-41f2-a2cf-e7431d3d251d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1332 microversion: 2.1 time: 0.086252 Jul 26 05:28:51.108062 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3685/7311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:51 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:52.128948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:52.130920 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:52.138247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:52.138712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:52.139490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:52.140143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:52.338470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:52.346500 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10969441-2c16-401e-83a8-72719db90771 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.221401 Jul 26 05:28:52.347065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3627/7312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:52 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:52.372538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-c6af4f86-c248-4b7c-9a14-47f4f594c49d req-d0371aa0-44be-4c24-b6fa-fc4d8ed8707f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e621f469-e90a-40a3-aa2f-90e0155ba117", "tag": "f65ed5ad-42a7-4f42-b655-c9b02278f8b9"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:52.384241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c6af4f86-c248-4b7c-9a14-47f4f594c49d req-d0371aa0-44be-4c24-b6fa-fc4d8ed8707f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:52.384715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-c6af4f86-c248-4b7c-9a14-47f4f594c49d req-d0371aa0-44be-4c24-b6fa-fc4d8ed8707f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:52.411175 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-c6af4f86-c248-4b7c-9a14-47f4f594c49d req-d0371aa0-44be-4c24-b6fa-fc4d8ed8707f service nova] Creating event network-changed:f65ed5ad-42a7-4f42-b655-c9b02278f8b9 for instance e621f469-e90a-40a3-aa2f-90e0155ba117 on n-h2-848886-16 Jul 26 05:28:52.416420 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-c6af4f86-c248-4b7c-9a14-47f4f594c49d req-d0371aa0-44be-4c24-b6fa-fc4d8ed8707f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048055 Jul 26 05:28:52.417352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3686/7313] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:53.367993 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:53.368670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:53.375436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:53.375886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:53.376638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:53.377128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:53.507289 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:53.514722 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81e8d028-a415-4cff-ad2c-ff3cc09fcb53 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.150923 Jul 26 05:28:53.515284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3628/7314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:53 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:54.537185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:54.537888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:54.544538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:54.545005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:54.545784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:54.546268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:54.680647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:54.688271 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-addef852-9423-4c19-b34e-0146972c65e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.156257 Jul 26 05:28:54.688842 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3687/7315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:54 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:55.709090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:55.709638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:55.716701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:55.717161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:55.717935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:55.718407 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:55.858481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:55.866081 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a79aef93-1e04-4ab3-b1b6-2451baedff8e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.161086 Jul 26 05:28:55.866667 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3629/7316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:55 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:56.887826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:56.888459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:56.896250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:56.897063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:56.897862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:56.898356 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:57.030079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:57.038203 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6afbe9a6-de96-41b9-bde5-00ef70b0706a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.155450 Jul 26 05:28:57.038785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3688/7317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:56 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:57.359335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-8b723fcb-ee65-409e-8a9c-34789f1cd5da req-0dc74830-3516-4785-9b10-cb838e8db092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e621f469-e90a-40a3-aa2f-90e0155ba117", "name": "network-vif-plugged", "status": "completed", "tag": "f65ed5ad-42a7-4f42-b655-c9b02278f8b9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:28:57.371413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8b723fcb-ee65-409e-8a9c-34789f1cd5da req-0dc74830-3516-4785-9b10-cb838e8db092 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:57.371413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-8b723fcb-ee65-409e-8a9c-34789f1cd5da req-0dc74830-3516-4785-9b10-cb838e8db092 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:57.383435 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-8b723fcb-ee65-409e-8a9c-34789f1cd5da req-0dc74830-3516-4785-9b10-cb838e8db092 service nova] Creating event network-vif-plugged:f65ed5ad-42a7-4f42-b655-c9b02278f8b9 for instance e621f469-e90a-40a3-aa2f-90e0155ba117 on n-h2-848886-16 Jul 26 05:28:57.388394 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-8b723fcb-ee65-409e-8a9c-34789f1cd5da req-0dc74830-3516-4785-9b10-cb838e8db092 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Jul 26 05:28:57.388989 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3630/7318] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:28:58.059134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:58.059667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:58.066620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:58.067092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:58.068456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:58.069011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:58.199544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:58.206983 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5586da01-49d6-462d-9e7e-c7d5f60bb1c2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1362 microversion: 2.1 time: 0.151865 Jul 26 05:28:58.207555 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3689/7319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:58 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:59.230558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:59.231252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:59.237514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:59.237963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:59.238754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:59.239712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:59.374132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:59.382974 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d28fa57a-32fd-4aa4-a517-ff318faa20dd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1553 microversion: 2.1 time: 0.157592 Jul 26 05:28:59.383546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3631/7320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:59 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:28:59.404115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:28:59.404746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:28:59.411703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:59.412178 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:59.412970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:28:59.413428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:28:59.546872 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:28:59.555085 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2fbeabac-d8f0-4b48-b149-4bd60303b0cd tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1553 microversion: 2.1 time: 0.154842 Jul 26 05:28:59.555647 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3690/7321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:28:59 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:01.054601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dde65b8-0799-472e-bc15-1776155875cb"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:01.056944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:01.059007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:01.065238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:01.065695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:01.066490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:01.066934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:01.303529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-260aa762-07b1-4b30-993f-5e210ec352f4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253278 Jul 26 05:29:01.304156 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3632/7322] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:29:01 2022] POST /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:11.997297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:11.997819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:11.999967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.000862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.001521 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.002187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.009916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:12.010420 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:12.011209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:12.011662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:12.096109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'services' on Instance uuid e621f469-e90a-40a3-aa2f-90e0155ba117 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:29:12.166278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-13f8c820-50d4-4925-b02a-7870bc30b514 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments/4dde65b8-0799-472e-bc15-1776155875cb" status: 202 len: 0 microversion: 2.1 time: 0.172873 Jul 26 05:29:12.166870 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3691/7323] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:29:11 2022] DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments/4dde65b8-0799-472e-bc15-1776155875cb => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:29:12.173516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.174380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:12.178711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:12.181060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:12.191591 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:12.192073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:12.193811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:12.194290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:12.225905 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9774d6d7-2a81-438b-b402-3f6e679dba06 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054277 Jul 26 05:29:12.226507 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3633/7324] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:12 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:13.240389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:13.242957 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:13.249410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:13.249944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:13.250826 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:13.251340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:13.281603 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-36184f64-5591-4f9a-a7e9-22bd5324efa0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046987 Jul 26 05:29:13.282419 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3692/7325] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:13 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:14.293858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:14.296070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:14.305537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:14.305985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:14.306780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:14.307247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:14.338487 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf50537a-7ac1-4524-a60e-61c3e18d7bdc tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Jul 26 05:29:14.339265 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3634/7326] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:14 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:15.351388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:15.353603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:15.360561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:15.361022 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:15.361794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:15.362266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:15.391713 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d2d96775-7807-4f2b-9c86-663743fb069f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Jul 26 05:29:15.392264 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3693/7327] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:15 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:16.404417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:16.406678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:16.414509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:16.414960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:16.415761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:16.416197 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:16.447047 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c7b4633c-f517-4f3c-9c06-0977c6cd594a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Jul 26 05:29:16.447614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3635/7328] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:16 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:17.459468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:17.461640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:17.468555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:17.469015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:17.469782 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:17.470254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:17.505193 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-113d40f8-9ea1-454b-9600-fe056a878e99 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049644 Jul 26 05:29:17.505785 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3694/7329] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:17 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:29:17.516620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:17.517196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:17.526178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:17.526638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:17.527417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:17.527888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:17.659873 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 is not attached to volume 4dde65b8-0799-472e-bc15-1776155875cb Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments/4dde65b8-0799-472e-bc15-1776155875cb HTTP/1.1 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 is not attached to volume 4dde65b8-0799-472e-bc15-1776155875cb Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': 'e621f469-e90a-40a3-aa2f-90e0155ba117', 'id': '4dde65b8-0799-472e-bc15-1776155875cb'} Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4dde65b8-0799-472e-bc15-1776155875cb. Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 is not attached to volume 4dde65b8-0799-472e-bc15-1776155875cb Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:17.662089 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 is not attached to volume 4dde65b8-0799-472e-bc15-1776155875cb Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 is not attached to volume 4dde65b8-0799-472e-bc15-1776155875cb {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1baaa01e-dd3e-4922-86df-dc1c46a2efed tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments/4dde65b8-0799-472e-bc15-1776155875cb" status: 404 len: 154 microversion: 2.1 time: 0.151156 Jul 26 05:29:17.666004 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3636/7330] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:29:17 2022] DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117/os-volume_attachments/4dde65b8-0799-472e-bc15-1776155875cb => generated 154 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:29:21.004784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:21.005280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:21.012623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:21.013011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:21.013806 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:21.014286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:21.042131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:29:21.124010 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5f28cd7e-48b5-4cf9-a81b-91ed3fc05bf2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 204 len: 0 microversion: 2.1 time: 0.122811 Jul 26 05:29:21.128298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3695/7331] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:29:20 2022] DELETE /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:29:21.134012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:21.134652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:21.142422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:21.142997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:21.143958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:21.144401 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:21.276588 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:21.284320 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f87cb98-521b-44a8-80de-f3da545d94c8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1559 microversion: 2.1 time: 0.154567 Jul 26 05:29:21.284964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3637/7332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:21 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:22.307191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:22.307901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:22.314974 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:22.315439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:22.316223 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:22.316676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:22.546124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:22.553872 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-75428b8c-86e4-4b3d-a68b-75a32353ff20 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1559 microversion: 2.1 time: 0.250969 Jul 26 05:29:22.554478 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3696/7333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:22 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:23.344334 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-60fbbfdd-5cab-49d0-9dc6-a60fe8cd55e2 req-af056da3-edab-48db-ab4f-be9f7eba171b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e621f469-e90a-40a3-aa2f-90e0155ba117", "name": "network-vif-deleted", "tag": "f65ed5ad-42a7-4f42-b655-c9b02278f8b9"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:23.363244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-60fbbfdd-5cab-49d0-9dc6-a60fe8cd55e2 req-af056da3-edab-48db-ab4f-be9f7eba171b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:23.364035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-60fbbfdd-5cab-49d0-9dc6-a60fe8cd55e2 req-af056da3-edab-48db-ab4f-be9f7eba171b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:23.382675 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-60fbbfdd-5cab-49d0-9dc6-a60fe8cd55e2 req-af056da3-edab-48db-ab4f-be9f7eba171b service nova] Creating event network-vif-deleted:f65ed5ad-42a7-4f42-b655-c9b02278f8b9 for instance e621f469-e90a-40a3-aa2f-90e0155ba117 on n-h2-848886-16 Jul 26 05:29:23.387823 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-60fbbfdd-5cab-49d0-9dc6-a60fe8cd55e2 req-af056da3-edab-48db-ab4f-be9f7eba171b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047169 Jul 26 05:29:23.388457 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3638/7334] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:23.575600 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:23.576157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:23.583056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:23.583704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:23.584480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:23.584931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:23.615694 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:23.616171 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:23.616606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'fault' on Instance uuid e621f469-e90a-40a3-aa2f-90e0155ba117 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:29:23.660874 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:23.669557 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f79790f7-8853-4e79-9219-130be01f008d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 200 len: 1352 microversion: 2.1 time: 0.097834 Jul 26 05:29:23.670376 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3697/7335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:23 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:24.694034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:24.694763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: e621f469-e90a-40a3-aa2f-90e0155ba117] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:24.701053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:24.701508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:24.702304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:24.702749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:24.716576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 HTTP/1.1 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'e621f469-e90a-40a3-aa2f-90e0155ba117'} Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:24.718190 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance e621f469-e90a-40a3-aa2f-90e0155ba117 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee95c435-a3f2-44fb-a39f-c465b5845469 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117" status: 404 len: 111 microversion: 2.1 time: 0.031263 Jul 26 05:29:24.722895 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3639/7336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:24 2022] GET /compute/v2.1/servers/e621f469-e90a-40a3-aa2f-90e0155ba117 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:29:24.728736 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-15977ef1-7e3b-4c6f-8499-25f370e1e5be tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '.version_select at 0x7f38b42aa550>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:24.751489 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-15977ef1-7e3b-4c6f-8499-25f370e1e5be tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1725884731" status: 202 len: 0 microversion: 2.1 time: 0.026521 Jul 26 05:29:24.752064 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3698/7337] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Jul 26 05:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1725884731 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:29:24.769465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-811f88ec-72d4-40b4-950a-4b4fbefaa51b tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: .version_select at 0x7f38b471e550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-183905953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0kOFbu04ZT6GI8tHHDtghsl55FWQ514BxQlMKeYGNWiE1S/sRG0GugToDV7LB93QhCQX/pttD9iK8zcu3PmLpjg5euY+IXOLnT/+kbJQQVuRq96xGB02hSnGcZt7kMfQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:24.785619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-811f88ec-72d4-40b4-950a-4b4fbefaa51b tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:29:24.794410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-811f88ec-72d4-40b4-950a-4b4fbefaa51b tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:29:24.817892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-811f88ec-72d4-40b4-950a-4b4fbefaa51b tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051805 Jul 26 05:29:24.818535 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3640/7338] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:29:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:29:24.867899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-131831998", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-183905953", "networks": [{"uuid": "c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:24.921951 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] validate_networks() for [('c620a5ec-fef3-4860-bf1a-9a5e7cd3d1db', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:29:25.289251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:29:25.289672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:29:25.290177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:29:25.290635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:29:25.291060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:29:25.300208 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:25.300667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:25.302003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:25.302563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:25.319539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:29:25.324703 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Getting quotas for user d2a6d485d3734a0fa93f43ec252f3079 and project 67397a61800b49d5a237979dcbf38033. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:29:25.337689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:29:25.340058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:29:25.387213 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b24adb79-8f1d-4de3-bba7-ef315f5d499a tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523435 Jul 26 05:29:25.387868 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3699/7339] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:29:25.398535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2654a5ae-e535-4b2d-b43f-26984819cdc4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:25.399272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2654a5ae-e535-4b2d-b43f-26984819cdc4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:25.456114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2654a5ae-e535-4b2d-b43f-26984819cdc4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:25.463114 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2654a5ae-e535-4b2d-b43f-26984819cdc4 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1261 microversion: 2.1 time: 0.068524 Jul 26 05:29:25.463692 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3641/7340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:25 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:26.485198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:26.485830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:26.492971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:26.493446 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:26.494263 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:26.494730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:26.569382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:26.576960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e3f53630-6838-4647-990b-3dba6f7995a2 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1319 microversion: 2.1 time: 0.096661 Jul 26 05:29:26.577543 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3700/7341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:26 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:27.598503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:27.599490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:27.606448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:27.606903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:27.607674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:27.608116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:27.744342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:27.752358 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1a828b40-c137-41af-8cfe-fdec181ed6e5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1361 microversion: 2.1 time: 0.157665 Jul 26 05:29:27.767448 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3642/7342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:27 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:27.970025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ed7361f7-1987-4ae4-b2c7-066afe85ef5b req-e71aa63c-adc5-449c-b9dc-b80dc4b1beeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7", "tag": "56386664-1753-44e2-aa6b-9dc1cd927e9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:27.987013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ed7361f7-1987-4ae4-b2c7-066afe85ef5b req-e71aa63c-adc5-449c-b9dc-b80dc4b1beeb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:27.987478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ed7361f7-1987-4ae4-b2c7-066afe85ef5b req-e71aa63c-adc5-449c-b9dc-b80dc4b1beeb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:28.007330 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ed7361f7-1987-4ae4-b2c7-066afe85ef5b req-e71aa63c-adc5-449c-b9dc-b80dc4b1beeb service nova] Creating event network-changed:56386664-1753-44e2-aa6b-9dc1cd927e9a for instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 on n-h1-848886-16 Jul 26 05:29:28.012842 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ed7361f7-1987-4ae4-b2c7-066afe85ef5b req-e71aa63c-adc5-449c-b9dc-b80dc4b1beeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047446 Jul 26 05:29:28.013465 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3701/7343] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:28.775165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:28.775788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:28.782863 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:28.783314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:28.784076 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:28.784515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:28.919106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:28.927178 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5760abd9-75f6-4f51-a45d-89e8990c7fdf tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1361 microversion: 2.1 time: 0.155331 Jul 26 05:29:28.927760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3643/7344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:28 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:29.952978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:29.954587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:29.962744 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:29.963206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:29.963994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:29.964445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:30.109063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:30.117383 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6a33c853-e305-430c-9929-4edc783ecfd6 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1361 microversion: 2.1 time: 0.172899 Jul 26 05:29:30.118419 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3702/7345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:29 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:31.139694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:31.140227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:31.148039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:31.148488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:31.149242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:31.149685 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:31.280783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:31.289002 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-97ea7693-f5a8-46b1-af4e-9c4156802906 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1361 microversion: 2.1 time: 0.153225 Jul 26 05:29:31.289565 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3644/7346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:31 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:32.216771 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-547bcf59-30ae-45dc-9b32-36bcbcf8f269 req-199b81ee-7980-4a11-9a75-0ba2fe063071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7", "name": "network-vif-plugged", "status": "completed", "tag": "56386664-1753-44e2-aa6b-9dc1cd927e9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:32.227949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-547bcf59-30ae-45dc-9b32-36bcbcf8f269 req-199b81ee-7980-4a11-9a75-0ba2fe063071 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:32.228426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-547bcf59-30ae-45dc-9b32-36bcbcf8f269 req-199b81ee-7980-4a11-9a75-0ba2fe063071 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:32.240028 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-547bcf59-30ae-45dc-9b32-36bcbcf8f269 req-199b81ee-7980-4a11-9a75-0ba2fe063071 service nova] Creating event network-vif-plugged:56386664-1753-44e2-aa6b-9dc1cd927e9a for instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 on n-h1-848886-16 Jul 26 05:29:32.244908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-547bcf59-30ae-45dc-9b32-36bcbcf8f269 req-199b81ee-7980-4a11-9a75-0ba2fe063071 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Jul 26 05:29:32.245693 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3703/7347] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:29:32.309152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:32.309870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:32.318284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:32.318738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:32.319534 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:32.319960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:32.454033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:32.462236 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4c00cba0-6c97-4c8b-8e96-f6584fa16c00 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1361 microversion: 2.1 time: 0.157215 Jul 26 05:29:32.462810 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3645/7348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:32 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:33.483669 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:33.484373 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:33.491194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:33.491661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:33.492433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:33.492881 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:33.623513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:33.631534 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bc7fc39a-64cd-4ea0-a2e6-8b7e21593575 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1552 microversion: 2.1 time: 0.152520 Jul 26 05:29:33.632100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3704/7349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:33 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:33.651958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:33.652553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:33.659548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:33.660001 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:33.660762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:33.662239 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:33.799040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:33.807980 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-835adec8-a88a-43ff-8e5b-e691cf40f4b1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1552 microversion: 2.1 time: 0.159764 Jul 26 05:29:33.808587 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3646/7350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:33 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:29:35.290002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4826620a-f86c-4ce4-8635-d2d9e6555a63"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:35.292383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:35.299008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:35.299466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:35.300233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:35.300680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:35.316041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:35.330867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:35.535247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-58a5cfc2-fba0-4e47-98cc-5c80728e8ec8 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "POST /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250136 Jul 26 05:29:35.535867 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3705/7351] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:29:35 2022] POST /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:46.223542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:46.224019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:46.226363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:46.227178 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:46.227821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=64 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:46.233994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:46.234462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:46.235221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:46.235662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:46.315362 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'services' on Instance uuid ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:29:46.388398 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c4712c5-76f4-4837-ad7e-3c18521eada5 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments/4826620a-f86c-4ce4-8635-d2d9e6555a63" status: 202 len: 0 microversion: 2.1 time: 0.168483 Jul 26 05:29:46.389065 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3647/7352] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:29:46 2022] DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments/4826620a-f86c-4ce4-8635-d2d9e6555a63 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:29:46.400538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:46.402955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:46.406375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:46.407772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:29:46.416430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:46.416899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:46.417958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:46.418443 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:46.452933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d7110499-b27e-4cca-8182-fa5195ab790d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059180 Jul 26 05:29:46.453503 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3706/7353] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:46 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:47.467629 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:47.470083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:47.478916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:47.479398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:47.480169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:47.480601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:47.510578 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d5e0b54-a623-4e0d-94a6-2af7586fa13e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048208 Jul 26 05:29:47.511138 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3648/7354] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:47 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:48.523312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:48.525492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:48.532436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:48.532902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:48.533684 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:48.534136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:48.564627 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-be522ebe-4588-41c1-bb6b-2dab8ab5d860 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Jul 26 05:29:48.565197 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3707/7355] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:48 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:49.577092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:49.579236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:49.586229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:49.586681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:49.587438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:49.587871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:49.617930 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5a37a3ce-b22e-4b8d-bbb6-532424f0500f tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Jul 26 05:29:49.618506 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3649/7356] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:49 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:50.629956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:50.632907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:50.640532 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:50.641003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:50.641796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:50.642277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:50.675680 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c8bb3c17-672f-4a4d-ad18-984652d9c542 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049650 Jul 26 05:29:50.676255 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3708/7357] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:50 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:51.687737 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:51.689895 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:51.697268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:51.697720 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:51.698526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:51.698963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:51.727957 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac102056-5083-4ffc-8e98-75e5fb8686b0 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044169 Jul 26 05:29:51.728516 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3650/7358] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:29:51 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:29:51.739104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:51.739603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:51.747305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:51.747774 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:51.748550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:51.749004 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:51.825914 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 is not attached to volume 4826620a-f86c-4ce4-8635-d2d9e6555a63 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments/4826620a-f86c-4ce4-8635-d2d9e6555a63 HTTP/1.1 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 is not attached to volume 4826620a-f86c-4ce4-8635-d2d9e6555a63 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': 'ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7', 'id': '4826620a-f86c-4ce4-8635-d2d9e6555a63'} Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4826620a-f86c-4ce4-8635-d2d9e6555a63. Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 is not attached to volume 4826620a-f86c-4ce4-8635-d2d9e6555a63 Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:51.827888 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 is not attached to volume 4826620a-f86c-4ce4-8635-d2d9e6555a63 Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 is not attached to volume 4826620a-f86c-4ce4-8635-d2d9e6555a63 {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b72e23c6-0a99-4015-913e-03943996e909 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments/4826620a-f86c-4ce4-8635-d2d9e6555a63" status: 404 len: 154 microversion: 2.1 time: 0.094300 Jul 26 05:29:51.832437 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3709/7359] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:29:51 2022] DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7/os-volume_attachments/4826620a-f86c-4ce4-8635-d2d9e6555a63 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:29:55.168207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:55.168744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:55.175615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:55.176072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:55.176839 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:55.177293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:55.210638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:29:55.289862 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d0876a7-7b9a-4e97-bef6-2aef0031411d tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 204 len: 0 microversion: 2.1 time: 0.125301 Jul 26 05:29:55.290476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3651/7360] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:29:55 2022] DELETE /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:29:55.299234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:55.299971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:55.307596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:55.308144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:55.309001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:55.309463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:55.447340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:55.455301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c1deff4a-8348-437a-92c8-6909be0bb5e1 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1558 microversion: 2.1 time: 0.160106 Jul 26 05:29:55.455876 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3710/7361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:55 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:56.478116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:56.478859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:56.486527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:56.486985 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:56.487767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:56.488204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:56.619144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:56.626746 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-57350093-88a3-4411-880b-491a38e62b1e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1558 microversion: 2.1 time: 0.153224 Jul 26 05:29:56.627314 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3652/7362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:56 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:57.301772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2ce63a59-e94d-4195-9a52-9f47d6667958 req-5fb1d4a3-988b-4936-b939-7e5fe975262d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7", "name": "network-vif-deleted", "tag": "56386664-1753-44e2-aa6b-9dc1cd927e9a"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:29:57.315180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2ce63a59-e94d-4195-9a52-9f47d6667958 req-5fb1d4a3-988b-4936-b939-7e5fe975262d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:57.315929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2ce63a59-e94d-4195-9a52-9f47d6667958 req-5fb1d4a3-988b-4936-b939-7e5fe975262d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:57.330030 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2ce63a59-e94d-4195-9a52-9f47d6667958 req-5fb1d4a3-988b-4936-b939-7e5fe975262d service nova] Creating event network-vif-deleted:56386664-1753-44e2-aa6b-9dc1cd927e9a for instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 on n-h1-848886-16 Jul 26 05:29:57.337139 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2ce63a59-e94d-4195-9a52-9f47d6667958 req-5fb1d4a3-988b-4936-b939-7e5fe975262d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038953 Jul 26 05:29:57.338346 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3711/7363] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:29:57.648509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:57.649268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:57.656290 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:57.656738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:57.657531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:57.657934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:57.951184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:57.951628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:57.952070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lazy-loading 'fault' on Instance uuid ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:29:57.996603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a6d485d3734a0fa93f43ec252f3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67397a61800b49d5a237979dcbf38033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:29:58.003494 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-737d1ab8-c49f-4357-a3b5-3b12ab43793e tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 200 len: 1351 microversion: 2.1 time: 0.359373 Jul 26 05:29:58.004056 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3653/7364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:57 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:29:59.026102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:59.026775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] [instance: ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:29:59.033884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:59.034406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:59.035188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:29:59.035644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:29:59.050050 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] HTTP exception thrown: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Request method failure captured: Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 HTTP/1.1 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33tn312pT5-TZ_w0ycSS9edwHJ_G-q50xn9nmxXjMsgZ2pfnGrc1sbtHD5mQiah0oFMHfYAT4thB07C8vsywJ8-aCddhMilHTj-O3eBfQWFPFaOQrmXD95BHzqT9vorg6sYcQbxOBLLO-vaGxKrJLsO-bgZ9vif5Lhs9ksZos5Dncao Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67397a61800b49d5a237979dcbf38033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67397a61800b49d5a237979dcbf38033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67397a61800b49d5a237979dcbf38033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 67397a61800b49d5a237979dcbf38033 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-455769109 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: d2a6d485d3734a0fa93f43ec252f3079 Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestEncryptedCinderVolumes-455769109-project Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7'} Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:29:59.051779 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Returning 404 to user: Instance ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d6f76fc-6d42-4c25-92ce-f326d48d1ffb tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7" status: 404 len: 111 microversion: 2.1 time: 0.031987 Jul 26 05:29:59.056599 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3712/7365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:29:59 2022] GET /compute/v2.1/servers/ecb4bb0a-d4ce-4015-9eb3-c4b354bd19a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:29:59.062165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4982f3f9-7a73-4b05-b6ff-26ffd9761728 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] Calling method '.version_select at 0x7f38b4674040>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:29:59.082194 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4982f3f9-7a73-4b05-b6ff-26ffd9761728 tempest-TestEncryptedCinderVolumes-455769109 tempest-TestEncryptedCinderVolumes-455769109-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-183905953" status: 202 len: 0 microversion: 2.1 time: 0.023892 Jul 26 05:29:59.082749 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3654/7366] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Jul 26 05:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-183905953 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:30:26.209602 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-52dfaecd-510d-495c-80c8-a0b768d5adad tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: .version_select at 0x7f38b428f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2090417377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiEFN3zqiuIq1wAjms/UqxpcGJBckUXA+Vk2+sH15wR/JKvRNUhR3J5D11ltLPpLDtKaH5Eu7+NpNGEskGIleoVvB5QGoC2/muNEqheSWgkOjJ9DnGt23DgMs46w7/Njg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:30:26.215584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=14 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:26.216258 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=34 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:26.228553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-52dfaecd-510d-495c-80c8-a0b768d5adad tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:30:26.234735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-52dfaecd-510d-495c-80c8-a0b768d5adad tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for user 2442ad89944949299d0da2f943d0f3c5 and project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:30:26.258127 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-52dfaecd-510d-495c-80c8-a0b768d5adad tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052748 Jul 26 05:30:26.258742 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3713/7367] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:30:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:30:26.308302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:26.309115 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:26.313490 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-381979110", "imageRef": "172f768f-556c-4449-82a3-efd8a09028e0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2090417377", "networks": [{"uuid": "9f9579f3-9f1b-4704-af8a-07633ff032c8"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:30:26.367753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] validate_networks() for [('9f9579f3-9f1b-4704-af8a-07633ff032c8', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:30:26.753128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:30:26.753562 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:30:26.754046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:30:26.754509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:30:26.754928 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:30:26.764151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:26.764615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:26.765457 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:26.765901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:26.783676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:30:26.789148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for user 2442ad89944949299d0da2f943d0f3c5 and project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:30:26.801714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:30:26.804127 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='172f768f-556c-4449-82a3-efd8a09028e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:30:26.847998 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aa4acae8-489c-4c17-a2be-06c55376d173 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542080 Jul 26 05:30:26.848641 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3655/7368] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:30:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:30:26.859441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-de9ba55a-29ae-40be-a114-9a85f840d76e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:26.860080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-de9ba55a-29ae-40be-a114-9a85f840d76e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:26.920893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-de9ba55a-29ae-40be-a114-9a85f840d76e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:26.927917 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-de9ba55a-29ae-40be-a114-9a85f840d76e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1258 microversion: 2.1 time: 0.072409 Jul 26 05:30:26.928562 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3714/7369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:26 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:27.950324 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:27.950956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:27.957909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:27.958412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:27.959185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:27.960851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:28.038675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:28.050925 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a6651930-abf3-43d1-8533-0848df6f2aff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1316 microversion: 2.1 time: 0.105744 Jul 26 05:30:28.064419 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3656/7370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:27 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:29.073495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:29.074122 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:29.082119 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:29.083043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:29.083992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:29.085470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:29.227561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:29.236190 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad830ee3-e92c-4d55-8e35-5c484baf3b88 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.167289 Jul 26 05:30:29.236799 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3715/7371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:29 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:30.258426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:30.260011 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:30.267235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:30.267701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:30.268491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:30.268938 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:30.422756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:30.431724 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9fdcc9c-177c-4609-9f7d-81aa60c7d0a7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.177705 Jul 26 05:30:30.432513 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3657/7372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:30 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:31.452953 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:31.454239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:31.465087 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:31.465991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:31.466991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:31.467601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:31.631103 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:31.639552 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fa78cf5-c805-45b4-bf0a-4e9c13dc83de tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.190471 Jul 26 05:30:31.640298 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3716/7373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:31 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:32.661984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:32.664730 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:32.673872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:32.675251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:32.676275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:32.677149 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:32.831109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:32.839679 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eace133a-5140-4770-9a20-b7368942a163 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.182566 Jul 26 05:30:32.840513 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3658/7374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:32 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:33.861010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:33.862745 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:33.870189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:33.870993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:33.871870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:33.872561 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:34.016535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:34.025150 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-751f270f-f450-46bc-8fe9-86f7636b2525 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.168075 Jul 26 05:30:34.025926 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3717/7375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:33 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:35.047535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:35.049175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:35.056767 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:35.057601 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:35.058452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:35.058947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:35.201564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:35.209627 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5de467bf-a02c-4ae4-bd25-e07af3872391 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.166409 Jul 26 05:30:35.210546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3659/7376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:35 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:36.230018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:36.230727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:36.237154 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:36.237623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:36.238441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:36.238902 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:36.367673 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:36.375426 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7ac9e3b0-1e0d-478a-bb4b-c4a3d21ef0da tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.149990 Jul 26 05:30:36.375993 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3718/7377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:36 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:37.397020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:37.397727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:37.400450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:37.401133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:37.406871 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:37.407325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:37.408092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:37.408530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:37.543781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:37.551311 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a09e538e-ad4a-421f-bde5-752d901c34ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.158305 Jul 26 05:30:37.551871 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3660/7378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:37 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:38.573323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:38.573976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:38.575896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:30:38.582652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:38.583127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:38.583912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:38.584422 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:38.717844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:38.725474 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-411f63d5-1e7e-4be1-848e-a0298d487283 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.156706 Jul 26 05:30:38.726032 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3719/7379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:38 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:39.746831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:39.747443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:39.754596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:39.755060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:39.755901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:39.756414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:39.968128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:39.976418 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc06943c-bc65-4237-8e7f-9ce79faee82f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.233453 Jul 26 05:30:39.977012 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3661/7380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:39 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:40.305924 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ca53b4e5-6220-4f49-95bf-56578975c7ca req-ed7ba832-d738-4e3f-8441-4ae84d29b99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:30:40.317666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca53b4e5-6220-4f49-95bf-56578975c7ca req-ed7ba832-d738-4e3f-8441-4ae84d29b99a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:40.321285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca53b4e5-6220-4f49-95bf-56578975c7ca req-ed7ba832-d738-4e3f-8441-4ae84d29b99a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:40.339938 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ca53b4e5-6220-4f49-95bf-56578975c7ca req-ed7ba832-d738-4e3f-8441-4ae84d29b99a service nova] Creating event network-changed:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:30:40.345538 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ca53b4e5-6220-4f49-95bf-56578975c7ca req-ed7ba832-d738-4e3f-8441-4ae84d29b99a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044704 Jul 26 05:30:40.356893 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3720/7381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:30:40.997655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:40.998228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:41.005172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:41.005622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:41.007195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:41.007641 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:41.137886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:41.145377 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c62e620-5d12-4d9a-bcb6-99a39b03bd96 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.151689 Jul 26 05:30:41.145929 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3662/7382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:40 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:42.167533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:42.168238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:42.174785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:42.175247 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:42.176019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:42.176468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:42.307773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:42.315247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6f9251b1-7830-4519-9497-f8f35515d68a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.153004 Jul 26 05:30:42.315816 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3721/7383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:42 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:43.337552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:43.338073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:43.345038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:43.345502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:43.346313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:43.346765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:43.480300 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:43.487904 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75bcc183-9bac-49e3-a7fd-8d1d148669ac tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.155455 Jul 26 05:30:43.488474 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3663/7384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:43 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:44.509076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:44.509628 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:44.516760 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:44.517222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:44.517998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:44.518491 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:44.648338 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:44.655887 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fdb71521-b068-4912-9faa-7aedb0152cbd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.151272 Jul 26 05:30:44.656464 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3722/7385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:44 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:45.677488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:45.678136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:45.685561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:45.686044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:45.686823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:45.687268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:45.824184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:45.831797 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9c46a7d-48f9-4565-b89f-29cbae29a96e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.158279 Jul 26 05:30:45.832366 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3664/7386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:45 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:45.896333 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-b1fb0c20-4c59-4278-b66f-d6a7efef7f78 req-47795c72-3ed2-4682-a019-db61ddfbc48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "name": "network-vif-plugged", "status": "completed", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:30:45.907811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b1fb0c20-4c59-4278-b66f-d6a7efef7f78 req-47795c72-3ed2-4682-a019-db61ddfbc48b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:45.908277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-b1fb0c20-4c59-4278-b66f-d6a7efef7f78 req-47795c72-3ed2-4682-a019-db61ddfbc48b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:45.920447 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-b1fb0c20-4c59-4278-b66f-d6a7efef7f78 req-47795c72-3ed2-4682-a019-db61ddfbc48b service nova] Creating event network-vif-plugged:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:30:45.925435 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-b1fb0c20-4c59-4278-b66f-d6a7efef7f78 req-47795c72-3ed2-4682-a019-db61ddfbc48b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Jul 26 05:30:45.926038 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3723/7387] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:30:46.853423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:46.854029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:46.860905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:46.861356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:46.862119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:46.862581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:46.994123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:47.001683 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-72110042-975e-408a-9f8a-056fabd562e3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1358 microversion: 2.1 time: 0.152771 Jul 26 05:30:47.002273 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3665/7388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:46 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:48.024236 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:48.024861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:48.031137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.031595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.032369 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.032818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.174259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:48.181868 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-03840b31-bf2c-4350-ac24-5b5199d62ec1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1549 microversion: 2.1 time: 0.162986 Jul 26 05:30:48.182497 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3724/7389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:48 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:48.202468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:48.203117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:48.210182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.211370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.212139 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.212581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.347090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:48.355260 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-89876731-9b48-4a21-bf5a-c3dcfa151ec9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1549 microversion: 2.1 time: 0.156753 Jul 26 05:30:48.355864 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3666/7390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:48 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:48.374683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:48.379184 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:48.379962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Searching by: {'deleted': False, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 05:30:48.385312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.385770 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.386604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.387050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.411257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 05:30:48.438929 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6be06f92-f95f-4159-9b50-aea843731fe2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068000 Jul 26 05:30:48.439514 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3725/7391] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 05:30:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:30:48.450902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:30:48.451528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:48.457760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.458332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.459111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:48.459560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:48.590492 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:30:48.598059 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9701fc6c-c7e8-4151-a60b-37f7c674292d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1549 microversion: 2.1 time: 0.151289 Jul 26 05:30:48.598663 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3667/7392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:30:48 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:30:50.131886 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adc1133c-c014-4d74-aefc-1d2555e40158"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:30:50.134365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:30:50.141214 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:50.141680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:50.142472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:30:50.142916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:30:50.379293 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5531cde4-5170-4dce-ac2f-6c8d67e3f39e tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251273 Jul 26 05:30:50.379940 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3726/7393] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:30:50 2022] POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:31:03.403611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:31:03.404229 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:31:03.407107 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:31:03.407916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=74 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:31:03.415207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:03.415686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:03.416510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:03.416952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:03.546510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:31:03.554813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b615e92c-f09c-49d9-a14f-b28db00aeb16 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1595 microversion: 2.1 time: 0.154929 Jul 26 05:31:03.556220 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3668/7394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:31:03 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:31:05.261663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:31:05.262815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:31:05.263202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:31:05.268048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-97c33a3d-050b-4bcb-96ec-cbe33bcdaf08 req-eae6eb33-198a-47e2-96e2-fb4330553739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:31:05.281467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-97c33a3d-050b-4bcb-96ec-cbe33bcdaf08 req-eae6eb33-198a-47e2-96e2-fb4330553739 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:05.281943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-97c33a3d-050b-4bcb-96ec-cbe33bcdaf08 req-eae6eb33-198a-47e2-96e2-fb4330553739 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:05.295789 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-97c33a3d-050b-4bcb-96ec-cbe33bcdaf08 req-eae6eb33-198a-47e2-96e2-fb4330553739 service nova] Creating event network-changed:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:31:05.301724 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-97c33a3d-050b-4bcb-96ec-cbe33bcdaf08 req-eae6eb33-198a-47e2-96e2-fb4330553739 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041114 Jul 26 05:31:05.302364 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3727/7395] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:31:06.551509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1105356109"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:31:06.552050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:31:06.559356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:06.559811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:06.560570 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:06.561008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:06.692956 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Adding security group fa901aeb-7d3a-4ec8-8b7d-402fa823a019 to port 3e8e4226-b60a-41be-a0a0-7c91222a0403 Jul 26 05:31:07.047508 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e0cd1a2d-b26d-4398-b884-9f86dc5fb44d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action" status: 202 len: 0 microversion: 2.1 time: 0.499836 Jul 26 05:31:07.048159 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3669/7396] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:31:06 2022] POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:31:07.060005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:31:07.060733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:31:07.067963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:07.068438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:07.069358 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:07.070033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:07.241540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:31:07.251305 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a65e7d1-4c53-495b-abe0-170a54f2e41b tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1761 microversion: 2.1 time: 0.198588 Jul 26 05:31:07.251989 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3728/7397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:31:07 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1761 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:31:07.316686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-339f7b76-8688-46d9-be76-84261da3ea63 req-24f1f9af-8718-431c-9a90-82ebd79a9942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:31:07.326947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-339f7b76-8688-46d9-be76-84261da3ea63 req-24f1f9af-8718-431c-9a90-82ebd79a9942 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:31:07.327393 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-339f7b76-8688-46d9-be76-84261da3ea63 req-24f1f9af-8718-431c-9a90-82ebd79a9942 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:31:07.339550 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-339f7b76-8688-46d9-be76-84261da3ea63 req-24f1f9af-8718-431c-9a90-82ebd79a9942 service nova] Creating event network-changed:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:31:07.345139 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-339f7b76-8688-46d9-be76-84261da3ea63 req-24f1f9af-8718-431c-9a90-82ebd79a9942 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Jul 26 05:31:07.346059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3670/7398] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:32:54.126100 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:32:54.126887 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:33:03.010949 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:33:03.011566 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:33:19.314904 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:33:19.315834 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:33:19.316328 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:33:19.317107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:33:19.321470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:33:19.323729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:33:19.330574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:19.331050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:19.331830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:19.332285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:19.407481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad8db916-b5ce-4276-80ff-ca45e1561cbe tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action" status: 202 len: 0 microversion: 2.1 time: 0.094487 Jul 26 05:33:19.408641 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3729/7399] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:33:19 2022] POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:33:19.415334 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:33:19.416141 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:33:19.416708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:33:19.417848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:33:19.422467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:33:19.423163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:33:19.431764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:19.432219 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:19.433003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:19.433431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:19.673549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:33:19.681803 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a16cc5fa-778e-4221-9456-7b0215c8b95f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1763 microversion: 2.1 time: 0.268849 Jul 26 05:33:19.682406 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3671/7400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:33:19 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1763 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:33:20.703904 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:33:20.704622 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:33:20.715613 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:20.716107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:20.716895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:33:20.717353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:33:20.721489 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 58960. Jul 26 05:33:20.722229 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 58962. Jul 26 05:33:20.865678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:33:20.874407 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c7920844-ef1b-4c5d-ae5c-39de0286a364 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1761 microversion: 2.1 time: 0.174749 Jul 26 05:33:20.874975 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3730/7401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:33:20 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1761 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:34:33.159321 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:34:33.159917 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:35:04.751196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:04.751981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:04.757235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1105356109"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:04.757770 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:04.770233 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59000. Jul 26 05:35:04.772024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:04.772475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:04.773242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:04.773677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:04.780078 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 58998. Jul 26 05:35:05.150886 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Removing security group fa901aeb-7d3a-4ec8-8b7d-402fa823a019 from port 3e8e4226-b60a-41be-a0a0-7c91222a0403 Jul 26 05:35:05.758491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-393796bf-4239-4a2c-a990-fbeff5e9b5ee tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action" status: 202 len: 0 microversion: 2.1 time: 1.009015 Jul 26 05:35:05.761657 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3672/7402] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:35:04 2022] POST /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:35:05.772713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:05.773878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:05.953372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-18ac9769-2b70-4f39-8dbd-feea1d2b0575 req-e6ee8c32-9eea-4578-91d3-f9d2dfdf5361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:05.965156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-18ac9769-2b70-4f39-8dbd-feea1d2b0575 req-e6ee8c32-9eea-4578-91d3-f9d2dfdf5361 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:05.965625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-18ac9769-2b70-4f39-8dbd-feea1d2b0575 req-e6ee8c32-9eea-4578-91d3-f9d2dfdf5361 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:05.986111 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-18ac9769-2b70-4f39-8dbd-feea1d2b0575 req-e6ee8c32-9eea-4578-91d3-f9d2dfdf5361 service nova] Creating event network-changed:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:35:05.992113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-18ac9769-2b70-4f39-8dbd-feea1d2b0575 req-e6ee8c32-9eea-4578-91d3-f9d2dfdf5361 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225215 Jul 26 05:35:05.993015 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3731/7403] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:07.329645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:07.330244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:07.336707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:07.337168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:07.339032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:07.339487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:07.428602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lazy-loading 'services' on Instance uuid 78ee69e0-6ee7-4105-becc-04e9c00310fb {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:35:07.511885 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2779ff99-e1b0-4c98-9423-2379571d82a6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments/adc1133c-c014-4d74-aefc-1d2555e40158" status: 202 len: 0 microversion: 2.1 time: 0.186578 Jul 26 05:35:07.514327 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3673/7404] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:35:07 2022] DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments/adc1133c-c014-4d74-aefc-1d2555e40158 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:35:07.522655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:07.526462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:07.534693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:07.535596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:07.537316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:07.537884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:07.578716 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-afd99fe9-09fa-49a1-a25b-c98c436334cd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061489 Jul 26 05:35:07.579559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3732/7405] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:07 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:08.008475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-cb9bf68e-c0ad-4f5d-a337-a31949f5ec3a req-b1634cff-aa7c-4519-8bf5-7959cca03309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:08.018930 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cb9bf68e-c0ad-4f5d-a337-a31949f5ec3a req-b1634cff-aa7c-4519-8bf5-7959cca03309 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:08.019382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-cb9bf68e-c0ad-4f5d-a337-a31949f5ec3a req-b1634cff-aa7c-4519-8bf5-7959cca03309 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:08.033191 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-cb9bf68e-c0ad-4f5d-a337-a31949f5ec3a req-b1634cff-aa7c-4519-8bf5-7959cca03309 service nova] Creating event network-changed:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:35:08.038577 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-cb9bf68e-c0ad-4f5d-a337-a31949f5ec3a req-b1634cff-aa7c-4519-8bf5-7959cca03309 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Jul 26 05:35:08.039180 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3674/7406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:08.591738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:08.594045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:08.600994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:08.601456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:08.602259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:08.602761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:08.631982 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efad65a7-0fb8-4b4d-a155-a68311d6dbb3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Jul 26 05:35:08.632537 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3733/7407] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:08 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:09.646675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:09.648978 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:09.656599 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:09.657052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:09.657840 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:09.658322 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:09.690829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1757f074-9e95-466e-b33b-25b1074da610 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049429 Jul 26 05:35:09.691636 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3675/7408] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:09 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:10.705185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:10.707557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:10.716844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:10.717318 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:10.718147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:10.718623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:10.751886 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-721ffa00-d605-429d-a4ed-0cde1b9de2f8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051877 Jul 26 05:35:10.752370 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3734/7409] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:10 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:11.765491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:11.767753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:11.776165 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:11.776752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:11.777540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:11.778022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:11.808540 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13f42407-557c-4333-9514-bf502fccb5ec tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Jul 26 05:35:11.809104 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3676/7410] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:11 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:35:12.820833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:12.823345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:12.830313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:12.830780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:12.831563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:12.832018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:12.861721 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dababa9b-b78b-469e-8755-8ff75141f123 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044843 Jul 26 05:35:12.862295 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3735/7411] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:35:12 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:35:12.873267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:12.873823 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:12.880771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:12.881222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:12.881981 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:12.882453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:12.958121 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] HTTP exception thrown: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb is not attached to volume adc1133c-c014-4d74-aefc-1d2555e40158 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Request method failure captured: Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: request: DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments/adc1133c-c014-4d74-aefc-1d2555e40158 HTTP/1.1 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33vjBjPgwSUKT2zqCeAy1_-XW_hrAj-j0xswmJmAcAVe5wNvYbXSjX7ne1BatPp8cTCERsce080JkXd5IxaonNu4M_g80z-scP1ajYG64h9KNvmwpovKIThFF4TdrXUTtZ24S5P3lenbIqttuwwbPy6E99DYY8f4zf82KHYRR02fgOo Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2442ad89944949299d0da2f943d0f3c5 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb is not attached to volume adc1133c-c014-4d74-aefc-1d2555e40158 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'server_id': '78ee69e0-6ee7-4105-becc-04e9c00310fb', 'id': 'adc1133c-c014-4d74-aefc-1d2555e40158'} Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id adc1133c-c014-4d74-aefc-1d2555e40158. Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb is not attached to volume adc1133c-c014-4d74-aefc-1d2555e40158 Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:35:12.959757 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb is not attached to volume adc1133c-c014-4d74-aefc-1d2555e40158 Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Returning 404 to user: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb is not attached to volume adc1133c-c014-4d74-aefc-1d2555e40158 {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e8f0013d-79e4-4459-aeab-387d65197254 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments/adc1133c-c014-4d74-aefc-1d2555e40158" status: 404 len: 154 microversion: 2.1 time: 0.092569 Jul 26 05:35:12.965386 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3677/7412] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:35:12 2022] DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb/os-volume_attachments/adc1133c-c014-4d74-aefc-1d2555e40158 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:35:16.209496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:16.210008 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:16.217601 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:16.218070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:16.218901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:16.219355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:16.248314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:35:16.333490 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0c560ec2-aee2-492a-8dba-c9825c152cf6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 204 len: 0 microversion: 2.1 time: 0.127517 Jul 26 05:35:16.334431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3736/7413] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:35:16 2022] DELETE /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:35:16.346940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:16.347568 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:16.357036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:16.357503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:16.358314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:16.358769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:16.497329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:16.505085 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1880bac3-c29d-4cf0-aaa0-580e29e1a50c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1555 microversion: 2.1 time: 0.166303 Jul 26 05:35:16.505661 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3678/7414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:16 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:17.574772 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:17.575486 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:17.582721 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:17.583180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:17.583964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:17.584412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:17.772222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:17.780275 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5954ea72-8de8-4f19-a586-998dfe460708 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1555 microversion: 2.1 time: 0.258873 Jul 26 05:35:17.781009 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3737/7415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:17 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:18.708128 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-20f4b1e1-c160-4119-b98b-b96bab714dcf req-0ec50d79-c848-4a89-875b-4a229442dcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ee69e0-6ee7-4105-becc-04e9c00310fb", "name": "network-vif-deleted", "tag": "3e8e4226-b60a-41be-a0a0-7c91222a0403"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:18.721221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-20f4b1e1-c160-4119-b98b-b96bab714dcf req-0ec50d79-c848-4a89-875b-4a229442dcb9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:18.721896 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-20f4b1e1-c160-4119-b98b-b96bab714dcf req-0ec50d79-c848-4a89-875b-4a229442dcb9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:18.736131 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-20f4b1e1-c160-4119-b98b-b96bab714dcf req-0ec50d79-c848-4a89-875b-4a229442dcb9 service nova] Creating event network-vif-deleted:3e8e4226-b60a-41be-a0a0-7c91222a0403 for instance 78ee69e0-6ee7-4105-becc-04e9c00310fb on n-h2-848886-16 Jul 26 05:35:18.742163 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-20f4b1e1-c160-4119-b98b-b96bab714dcf req-0ec50d79-c848-4a89-875b-4a229442dcb9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037509 Jul 26 05:35:18.742780 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3679/7416] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:18.802076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:18.802720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:18.810589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:18.811057 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:18.811838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:18.812287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:18.845456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:18.845915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:18.846401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lazy-loading 'fault' on Instance uuid 78ee69e0-6ee7-4105-becc-04e9c00310fb {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:35:18.887914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:18.895583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5d1e8538-5cad-48c3-97a6-6ea35982b85f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 200 len: 1348 microversion: 2.1 time: 0.097613 Jul 26 05:35:18.896144 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3738/7417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:18 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:19.918044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:19.918687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 78ee69e0-6ee7-4105-becc-04e9c00310fb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:19.926019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:19.926500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:19.927268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:19.927708 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:19.941714 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] HTTP exception thrown: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Request method failure captured: Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb HTTP/1.1 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33vjBjPgwSUKT2zqCeAy1_-XW_hrAj-j0xswmJmAcAVe5wNvYbXSjX7ne1BatPp8cTCERsce080JkXd5IxaonNu4M_g80z-scP1ajYG64h9KNvmwpovKIThFF4TdrXUTtZ24S5P3lenbIqttuwwbPy6E99DYY8f4zf82KHYRR02fgOo Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 2442ad89944949299d0da2f943d0f3c5 Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '78ee69e0-6ee7-4105-becc-04e9c00310fb'} Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:35:19.943350 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Returning 404 to user: Instance 78ee69e0-6ee7-4105-becc-04e9c00310fb could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4d787f6e-1068-4166-93de-dd8bc6d32e98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb" status: 404 len: 111 microversion: 2.1 time: 0.031703 Jul 26 05:35:19.948548 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3680/7418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:19 2022] GET /compute/v2.1/servers/78ee69e0-6ee7-4105-becc-04e9c00310fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:35:19.954357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1532ae31-73c9-45b3-89ff-43f8db4e5285 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '.version_select at 0x7f38b45d35e0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:19.958983 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1532ae31-73c9-45b3-89ff-43f8db4e5285 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [9cddab06-3356-469c-8a5c-5a060558a200] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:35:20.966712 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [None req-1532ae31-73c9-45b3-89ff-43f8db4e5285 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [9cddab06-3356-469c-8a5c-5a060558a200] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59078. Jul 26 05:35:20.987415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1532ae31-73c9-45b3-89ff-43f8db4e5285 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2090417377" status: 202 len: 0 microversion: 2.1 time: 1.036803 Jul 26 05:35:20.988101 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3739/7419] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 05:35:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2090417377 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:35:29.854448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b16040b9-a728-4780-9f72-bc13e1c04c72 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: .version_select at 0x7f38b4921dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1392340329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhgTQOmYpAIpVgeJtbAh2CIrjKNYv9wcrhE697wpW4TdzoOlqplylLRaVKDeou5dMaQL6Wl/kR9CqzJKcLWwiKl7FfiTY8mlBEaqlLVnmstm0rGcfxKwYbz/Wrk9gvAmw=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:29.871994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b16040b9-a728-4780-9f72-bc13e1c04c72 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:35:29.877074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-b16040b9-a728-4780-9f72-bc13e1c04c72 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for user 2442ad89944949299d0da2f943d0f3c5 and project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:35:29.903903 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b16040b9-a728-4780-9f72-bc13e1c04c72 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053447 Jul 26 05:35:29.904501 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3681/7420] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:35:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:29.952676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:29.957104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1843480321", "imageRef": "87622859-67af-4e1f-8fad-0acbf93d2f34", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1392340329", "networks": [{"uuid": "9f9579f3-9f1b-4704-af8a-07633ff032c8"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:30.010542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] validate_networks() for [('9f9579f3-9f1b-4704-af8a-07633ff032c8', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:35:30.446248 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:35:30.447211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:35:30.447814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:35:30.448242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:35:30.448695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:35:30.457713 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:30.458206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:30.459030 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:30.459488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:30.477650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:35:30.483145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Getting quotas for user 2442ad89944949299d0da2f943d0f3c5 and project 64ccee6b6aea4a1a95b68981e7d3be73. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:35:30.495510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:35:30.497693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87622859-67af-4e1f-8fad-0acbf93d2f34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:35:30.547739 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1f8ab40e-c534-41e4-af9a-2aa0f0f161f5 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596802 Jul 26 05:35:30.548389 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3740/7421] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:35:30.556270 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:30.560421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fd15af55-7dbe-4080-bdc8-6c041c83b2e4 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:30.561069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fd15af55-7dbe-4080-bdc8-6c041c83b2e4 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:30.619795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fd15af55-7dbe-4080-bdc8-6c041c83b2e4 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:30.626583 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fd15af55-7dbe-4080-bdc8-6c041c83b2e4 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1259 microversion: 2.1 time: 0.071315 Jul 26 05:35:30.627408 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3682/7422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:30 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:31.648705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:31.650109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:31.656784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:31.657242 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:31.658021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:31.658511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:31.737435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:31.746175 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-051d2d1e-f275-477e-850c-9bcc85217a98 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1317 microversion: 2.1 time: 0.102142 Jul 26 05:35:31.746774 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3741/7423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:31 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:32.767738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:32.768444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:32.777027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:32.777482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:32.778310 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:32.778764 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:32.923244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:32.931189 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ad51aaed-6d7d-4c6d-98db-944325cf4fe8 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.167298 Jul 26 05:35:32.931871 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3683/7424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:32 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:33.951945 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:33.954273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:33.960848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:33.961430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:33.962912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:33.963447 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:34.117496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:34.125397 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f5f2b282-9447-4aa6-9ff8-2b1e371e575a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.177452 Jul 26 05:35:34.126320 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3742/7425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:33 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:35.149758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:35.150637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:35.152937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:35.158971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:35.159528 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:35.160396 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:35.160939 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:35.316235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:35.327092 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5c746cec-0e3b-47ae-812d-197134055c9c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.182394 Jul 26 05:35:35.327947 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3684/7426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:35 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:36.348541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:36.349933 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:36.353384 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:36.359308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:36.359582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:36.360418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:36.360876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:36.511870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:36.519764 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4a9f5c48-0a7e-4136-8163-b6e6fc789197 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.175092 Jul 26 05:35:36.520370 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3743/7427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:36 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:37.540233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:37.541016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:37.548540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:37.548984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:37.550020 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:37.550488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:37.689756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:37.698542 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-aea31a93-5658-4e53-afaa-568774427d74 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.162364 Jul 26 05:35:37.699373 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3685/7428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:37 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:38.720787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:38.721571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:38.731387 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:38.731925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:38.732743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:38.733199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:38.894950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:38.903023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29e00140-ccba-4d0e-bc35-7f8325efda32 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.187511 Jul 26 05:35:38.903588 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3744/7429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:38 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:39.924919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:39.925561 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:39.933412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:39.933864 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:39.934653 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:39.935094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:40.066368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:40.074793 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf64adf9-fabe-457d-9b06-ab817655459d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.153872 Jul 26 05:35:40.075380 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3686/7430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:39 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:40.468484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:40.481477 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7a9ed4b6-f5d4-460f-a0bc-4fdd16cf92c4 req-f7240194-d7ea-4123-904c-97ee0b588622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:40.490981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:40.495363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7a9ed4b6-f5d4-460f-a0bc-4fdd16cf92c4 req-f7240194-d7ea-4123-904c-97ee0b588622 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:40.495838 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7a9ed4b6-f5d4-460f-a0bc-4fdd16cf92c4 req-f7240194-d7ea-4123-904c-97ee0b588622 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:40.509049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7a9ed4b6-f5d4-460f-a0bc-4fdd16cf92c4 req-f7240194-d7ea-4123-904c-97ee0b588622 service nova] Creating event network-changed:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:35:40.514599 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7a9ed4b6-f5d4-460f-a0bc-4fdd16cf92c4 req-f7240194-d7ea-4123-904c-97ee0b588622 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108990 Jul 26 05:35:40.515822 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3745/7431] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:41.097130 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:41.097752 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:41.099672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:41.106829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:41.107293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:41.108068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:41.108518 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:41.242440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:41.250094 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1c4522a6-f3ee-4cc4-a60d-a6167f581b3c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.156851 Jul 26 05:35:41.250706 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3687/7432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:41 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:42.272279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:42.272994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:42.280034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:42.280513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:42.281330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:42.282299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:42.417075 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:42.424749 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7a5acf0e-2eae-4ad3-8a14-a3c6f6435ed2 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.157664 Jul 26 05:35:42.425313 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3746/7433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:42 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:43.446521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:43.447335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:43.454403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:43.454859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:43.455632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:43.456078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:43.583952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:43.592051 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0d62ee89-8e7d-4389-8b99-9f25f6a424e6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.150154 Jul 26 05:35:43.592616 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3688/7434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:43 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:35:44.063199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e7f733fa-8b21-4ace-ae41-f66501e95f1b req-86453e89-3792-4605-a3b5-2f31ce5a769a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "name": "network-vif-plugged", "status": "completed", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:44.074571 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e7f733fa-8b21-4ace-ae41-f66501e95f1b req-86453e89-3792-4605-a3b5-2f31ce5a769a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:44.075124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e7f733fa-8b21-4ace-ae41-f66501e95f1b req-86453e89-3792-4605-a3b5-2f31ce5a769a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:44.088247 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e7f733fa-8b21-4ace-ae41-f66501e95f1b req-86453e89-3792-4605-a3b5-2f31ce5a769a service nova] Creating event network-vif-plugged:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:35:44.094451 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e7f733fa-8b21-4ace-ae41-f66501e95f1b req-86453e89-3792-4605-a3b5-2f31ce5a769a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095582 Jul 26 05:35:44.095437 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3747/7435] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:44.613036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:44.613636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:44.621544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:44.622002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:44.622810 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:44.623260 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:44.760546 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:44.768442 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-834406bc-2738-4446-89db-3e5c6b3a0521 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1359 microversion: 2.1 time: 0.159375 Jul 26 05:35:44.769023 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3689/7436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:44 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:45.789730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:45.790466 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:45.798640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:45.799107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:45.799917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:45.800375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:45.936146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:45.943853 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cdcc7ba0-2904-4054-9781-ea71f0dffbb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1550 microversion: 2.1 time: 0.158452 Jul 26 05:35:45.944431 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3748/7437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:45 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:45.964228 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:45.964850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:45.971860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:45.972337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:45.973093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:45.973540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:46.109964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:46.117694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-45ca75b6-ac5f-42ee-a0ce-708ee906df08 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1550 microversion: 2.1 time: 0.157777 Jul 26 05:35:46.118304 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3690/7438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:45 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:46.137788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:46.142459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:46.143240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Searching by: {'deleted': False, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73'} {{(pid=119488) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 05:35:46.148645 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:46.149142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:46.149936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:46.150410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:46.174663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.multi_cell_list [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 05:35:46.204785 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20adb039-9176-4b9f-9404-771d017eb5f1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070822 Jul 26 05:35:46.205296 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3749/7439] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Jul 26 05:35:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:46.216466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:46.217078 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:46.223144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:46.223593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:46.224345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:46.224781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:46.352478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:46.359990 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bb060852-a1fe-4e0c-a3c4-61d88fc2fac6 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1550 microversion: 2.1 time: 0.147407 Jul 26 05:35:46.360559 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3691/7440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:46 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:35:47.867335 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25f7242f-4d86-4989-9ed0-6429d189e8be"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:35:47.870349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:47.877276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:47.877757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:47.878584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:47.879042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:48.116539 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-270f2f4a-4cd7-453c-9d94-fa581c5ec7ca tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252938 Jul 26 05:35:48.117352 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3750/7441] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Jul 26 05:35:47 2022] POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:35:58.874725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:35:58.875346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:35:58.878326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=15 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:58.878988 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=54 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:35:58.885525 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:58.885987 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:58.886789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:35:58.887232 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:35:59.021087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:35:59.029272 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9ea1396e-a4b3-4e1c-af6b-0b723d3a29e7 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1596 microversion: 2.1 time: 0.158457 Jul 26 05:35:59.029844 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3692/7442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:35:58 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:00.972550 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6857fb58-a706-4009-8b5e-5623a15c3590 req-c509eafc-6630-423d-8a54-e3b5644a4388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:36:00.978722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:00.979566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=15 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:00.980054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:00.986610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6857fb58-a706-4009-8b5e-5623a15c3590 req-c509eafc-6630-423d-8a54-e3b5644a4388 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:00.987098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6857fb58-a706-4009-8b5e-5623a15c3590 req-c509eafc-6630-423d-8a54-e3b5644a4388 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:01.000943 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6857fb58-a706-4009-8b5e-5623a15c3590 req-c509eafc-6630-423d-8a54-e3b5644a4388 service nova] Creating event network-changed:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:36:01.006041 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6857fb58-a706-4009-8b5e-5623a15c3590 req-c509eafc-6630-423d-8a54-e3b5644a4388 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Jul 26 05:36:01.006674 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3751/7443] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:36:02.097545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1253044681"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:36:02.098094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:02.105718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:02.106190 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:02.106961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:02.107529 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:02.251356 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.network.security_group_api [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Adding security group e4a186b2-b97f-486e-acdf-0c6a6b9f4009 to port ef167dab-177f-4216-b4f1-063f5d5a94de Jul 26 05:36:02.605039 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1ee8b7ef-52be-41b6-beec-1ffde0f7593f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action" status: 202 len: 0 microversion: 2.1 time: 0.511337 Jul 26 05:36:02.606194 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3693/7444] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:36:02 2022] POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:36:02.615817 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:02.616794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:02.625710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:02.626912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:02.628206 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:02.628853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:02.803179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:02.816066 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3049a029-0f89-4520-a2b9-e29e22477b1d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1762 microversion: 2.1 time: 0.205451 Jul 26 05:36:02.816732 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3752/7445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:02 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1762 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:03.020553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-24ec903c-f73e-4d0f-8e8c-a7af7d9960d1 req-79a3dbc6-5e10-4b66-9370-cf5f60331942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:36:03.030671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-24ec903c-f73e-4d0f-8e8c-a7af7d9960d1 req-79a3dbc6-5e10-4b66-9370-cf5f60331942 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:03.031123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-24ec903c-f73e-4d0f-8e8c-a7af7d9960d1 req-79a3dbc6-5e10-4b66-9370-cf5f60331942 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:03.042591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-24ec903c-f73e-4d0f-8e8c-a7af7d9960d1 req-79a3dbc6-5e10-4b66-9370-cf5f60331942 service nova] Creating event network-changed:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:36:03.048840 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-24ec903c-f73e-4d0f-8e8c-a7af7d9960d1 req-79a3dbc6-5e10-4b66-9370-cf5f60331942 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031870 Jul 26 05:36:03.049562 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3694/7446] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:36:14.135500 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:36:14.136264 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:36:18.470114 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:36:18.472484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:18.475496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:18.476170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:18.483311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:18.483775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:18.484556 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:18.485006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:18.557231 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b2cf3410-02a8-453a-88d7-c47013aa953c tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action" status: 202 len: 0 microversion: 2.1 time: 0.090878 Jul 26 05:36:18.557915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3753/7447] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:36:18 2022] POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:36:18.564477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:18.565709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:36:18.570296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:18.571218 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:18.580493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:18.580950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:18.581717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:18.582195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:18.736721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:18.745021 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6316d2bc-ef85-4af4-bd4e-d9d04d30fd51 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1754 microversion: 2.1 time: 0.182736 Jul 26 05:36:18.745604 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3695/7448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:18 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:19.769377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:19.770086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:19.776941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:19.777404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:19.778215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:19.778664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:19.926182 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:19.935081 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-afade996-ab28-4c6d-bd95-52696f2ab9bc tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.170827 Jul 26 05:36:19.935650 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3754/7449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:19 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:20.956680 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:20.957298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:20.964834 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:20.965286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:20.966053 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:20.966521 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:21.108642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:21.116753 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f02c150-e3ba-47a5-b1d1-4b7f0fb9048f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.164045 Jul 26 05:36:21.117319 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3696/7450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:20 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:22.138557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:22.139089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:22.145386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:22.145857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:22.146674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:22.147132 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:22.297565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:22.305651 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c653f337-fafe-4419-92fc-a74680657527 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.171471 Jul 26 05:36:22.306242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3755/7451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:22 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:23.327205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:23.327815 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:23.334700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:23.335152 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:23.335917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:23.336361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:23.486553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:23.496265 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7f966554-bb25-49d6-a337-5201cedcac47 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.173366 Jul 26 05:36:23.496829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3697/7452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:23 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:24.517660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:24.518310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:24.525147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:24.525615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:24.527243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:24.527704 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:24.684111 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:24.692240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cb7fb5a3-d5b9-4e73-a872-28c947b8be8d tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.178517 Jul 26 05:36:24.692964 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3756/7453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:24 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:25.714913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:25.715535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:25.722432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:25.722888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:25.723655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:25.724097 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:25.873238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:25.881414 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5e8ad41e-ff09-43f4-b70e-7141ffe62c40 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.170897 Jul 26 05:36:25.881993 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3698/7454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:25 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:26.902982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:26.903610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:26.910566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:26.911033 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:26.911810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:26.912269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:27.054490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:27.062725 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-436fdbbb-2239-4031-aeac-9f57dd8eeed1 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.164140 Jul 26 05:36:27.063297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3757/7455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:26 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:28.084244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:28.084780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:28.092374 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:28.092829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:28.093584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:28.094023 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:28.244070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:28.252728 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-19233d90-7198-4e33-9fa5-f8cd63aa7271 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.172521 Jul 26 05:36:28.253294 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3699/7456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:28 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:29.273089 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:29.273720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:29.281543 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:29.282011 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:29.282819 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:29.283273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:29.429352 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:29.438535 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7cded8d1-53a7-4d08-abad-16967212b979 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1759 microversion: 2.1 time: 0.169384 Jul 26 05:36:29.439100 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3758/7457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:29 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:36:30.459868 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:36:30.460517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:36:30.467686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:30.468141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:30.468914 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:36:30.469361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:36:30.612111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:36:30.620283 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ef4202fc-2040-4d59-a0df-34483246590a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1762 microversion: 2.1 time: 0.164422 Jul 26 05:36:30.620852 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3700/7458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:36:30 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1762 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:02.942978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1253044681"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:02.943555 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:02.946845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:02.947501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:02.951853 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:02.952316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:02.953096 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:02.953553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:03.080327 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.network.security_group_api [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Removing security group e4a186b2-b97f-486e-acdf-0c6a6b9f4009 from port ef167dab-177f-4216-b4f1-063f5d5a94de Jul 26 05:37:03.399742 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9e4aec5f-2723-4ced-b236-108035c404bd tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action" status: 202 len: 0 microversion: 2.1 time: 0.460885 Jul 26 05:37:03.401049 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3759/7459] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:37:02 2022] POST /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:37:03.407285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-c9a3f720-170d-4093-bd96-5bda47b16dff req-7980acd0-0437-45c1-a475-6455acfd4274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:03.412425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=12 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:03.413092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=36 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:03.429531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c9a3f720-170d-4093-bd96-5bda47b16dff req-7980acd0-0437-45c1-a475-6455acfd4274 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:03.430105 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-c9a3f720-170d-4093-bd96-5bda47b16dff req-7980acd0-0437-45c1-a475-6455acfd4274 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:03.444491 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-c9a3f720-170d-4093-bd96-5bda47b16dff req-7980acd0-0437-45c1-a475-6455acfd4274 service nova] Creating event network-changed:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:37:03.453291 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-c9a3f720-170d-4093-bd96-5bda47b16dff req-7980acd0-0437-45c1-a475-6455acfd4274 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050197 Jul 26 05:37:03.454115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3701/7460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:37:04.777504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:04.778018 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:04.784124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:04.784595 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:04.785379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:04.785835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:04.872134 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lazy-loading 'services' on Instance uuid 31190382-53cd-41f2-8815-ea14e1ab5f28 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:37:04.945620 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-45179e05-a2f9-4070-82ce-ac91af1253ff tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments/25f7242f-4d86-4989-9ed0-6429d189e8be" status: 202 len: 0 microversion: 2.1 time: 0.173171 Jul 26 05:37:04.946247 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3760/7461] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:37:04 2022] DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments/25f7242f-4d86-4989-9ed0-6429d189e8be => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:37:04.957494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:04.959829 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:04.966391 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:04.966851 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:04.967740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:04.968185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:05.000456 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15e47a77-489c-4d93-b1b2-3c8bff3e9f6f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049416 Jul 26 05:37:05.001059 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3702/7462] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:04 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:05.470558 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-29ee906a-45f6-452c-86ff-8044015063fa req-58b8ea8e-d55c-41a0-af18-71849fa7773b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:05.481702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29ee906a-45f6-452c-86ff-8044015063fa req-58b8ea8e-d55c-41a0-af18-71849fa7773b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:05.482315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-29ee906a-45f6-452c-86ff-8044015063fa req-58b8ea8e-d55c-41a0-af18-71849fa7773b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:05.495232 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-29ee906a-45f6-452c-86ff-8044015063fa req-58b8ea8e-d55c-41a0-af18-71849fa7773b service nova] Creating event network-changed:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:37:05.501123 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-29ee906a-45f6-452c-86ff-8044015063fa req-58b8ea8e-d55c-41a0-af18-71849fa7773b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034775 Jul 26 05:37:05.501897 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3761/7463] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:06.013609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:06.016113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:06.023502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:06.023958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:06.024734 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:06.025212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:06.057052 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2c41e891-1780-4ec6-bf61-de38b27e7868 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048016 Jul 26 05:37:06.058603 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3703/7464] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:06 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:07.072312 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:07.074640 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:07.081016 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:07.081473 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:07.082278 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:07.082728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:07.114406 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c9a70032-e2ec-47e1-9f65-b09885c33b69 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Jul 26 05:37:07.114970 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3762/7465] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:07 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:08.127100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:08.129241 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:08.136910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:08.137441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:08.138354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:08.138872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:08.176058 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9de933f7-2b0a-4ccf-9bba-11a7edebe421 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053087 Jul 26 05:37:08.177026 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3704/7466] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:08 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:09.188591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:09.190900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:09.199142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:09.199606 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:09.200398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:09.200859 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:09.230933 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-889146ac-66f9-4ae9-81e1-3c820c97811a tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Jul 26 05:37:09.231495 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3763/7467] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:09 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:10.243246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:10.246335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:10.253283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:10.253739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:10.254531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:10.254968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:10.283592 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fb8dd215-672a-4b97-9be3-8ee2fb0bcbd3 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044256 Jul 26 05:37:10.284142 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3705/7468] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Jul 26 05:37:10 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:37:10.295722 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:10.296270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:10.303183 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:10.303655 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:10.304437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:10.304896 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:10.380622 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] HTTP exception thrown: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 is not attached to volume 25f7242f-4d86-4989-9ed0-6429d189e8be Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Request method failure captured: Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: request: DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments/25f7242f-4d86-4989-9ed0-6429d189e8be HTTP/1.1 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33vjBjPgwSUKT2zqCeAy1_-XW_hrAj-j0xswmJmAcAVe5wNvYbXSjX7ne1BatPp8cTCERsce080JkXd5IxaonNu4M_g80z-scP1ajYG64h9KNvmwpovKIThFF4TdrXUTtZ24S5P3lenbIqttuwwbPy6E99DYY8f4zf82KHYRR02fgOo Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2442ad89944949299d0da2f943d0f3c5 Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 is not attached to volume 25f7242f-4d86-4989-9ed0-6429d189e8be Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'server_id': '31190382-53cd-41f2-8815-ea14e1ab5f28', 'id': '25f7242f-4d86-4989-9ed0-6429d189e8be'} Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 25f7242f-4d86-4989-9ed0-6429d189e8be. Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 is not attached to volume 25f7242f-4d86-4989-9ed0-6429d189e8be Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:37:10.382296 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 is not attached to volume 25f7242f-4d86-4989-9ed0-6429d189e8be Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Returning 404 to user: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 is not attached to volume 25f7242f-4d86-4989-9ed0-6429d189e8be {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-29168d04-7590-4167-aa43-ca2cc8cd9fb9 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments/25f7242f-4d86-4989-9ed0-6429d189e8be" status: 404 len: 154 microversion: 2.1 time: 0.093325 Jul 26 05:37:10.387413 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3764/7469] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Jul 26 05:37:10 2022] DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28/os-volume_attachments/25f7242f-4d86-4989-9ed0-6429d189e8be => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:37:13.633777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:13.634244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:13.642547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:13.643047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:13.643941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:13.644560 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:13.671125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:37:13.757062 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53a57613-7d1b-42dd-82da-1ba7083aca62 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 204 len: 0 microversion: 2.1 time: 0.126756 Jul 26 05:37:13.757830 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3706/7470] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:37:13 2022] DELETE /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:37:13.767670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:13.768385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:13.776002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:13.776720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:13.777523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:13.777981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:13.913217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:13.921341 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0bec5045-a7c5-4b64-93f5-bb838ffedc86 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1556 microversion: 2.1 time: 0.158854 Jul 26 05:37:13.921904 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3765/7471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:13 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:37:14.942916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:14.943609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:14.951316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:14.951771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:14.952524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:14.952957 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:15.084395 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:15.092598 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-710f5393-7946-4901-be15-3ed9b3270f80 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1556 microversion: 2.1 time: 0.154076 Jul 26 05:37:15.093172 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3707/7472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:14 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:15.852955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-787bd84c-cfdf-4f66-acbd-19b7c9e22240 req-fe600e15-5e24-4c03-8d35-c573857cc7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31190382-53cd-41f2-8815-ea14e1ab5f28", "name": "network-vif-deleted", "tag": "ef167dab-177f-4216-b4f1-063f5d5a94de"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:15.864903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-787bd84c-cfdf-4f66-acbd-19b7c9e22240 req-fe600e15-5e24-4c03-8d35-c573857cc7ef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:15.865360 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-787bd84c-cfdf-4f66-acbd-19b7c9e22240 req-fe600e15-5e24-4c03-8d35-c573857cc7ef service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:15.878038 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-787bd84c-cfdf-4f66-acbd-19b7c9e22240 req-fe600e15-5e24-4c03-8d35-c573857cc7ef service nova] Creating event network-vif-deleted:ef167dab-177f-4216-b4f1-063f5d5a94de for instance 31190382-53cd-41f2-8815-ea14e1ab5f28 on n-h1-848886-16 Jul 26 05:37:15.883022 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-787bd84c-cfdf-4f66-acbd-19b7c9e22240 req-fe600e15-5e24-4c03-8d35-c573857cc7ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Jul 26 05:37:15.883618 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3766/7473] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:16.113235 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:16.113999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:16.121363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:16.121827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:16.122642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:16.123086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:16.158382 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:16.158917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:16.159295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lazy-loading 'fault' on Instance uuid 31190382-53cd-41f2-8815-ea14e1ab5f28 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:37:16.204771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2442ad89944949299d0da2f943d0f3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ccee6b6aea4a1a95b68981e7d3be73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:16.215711 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-999c8f44-0509-471e-b9a7-a945c46f0bba tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 200 len: 1349 microversion: 2.1 time: 0.105495 Jul 26 05:37:16.216728 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3708/7474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:16 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:17.238480 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:17.239148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] [instance: 31190382-53cd-41f2-8815-ea14e1ab5f28] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:17.245976 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:17.246459 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:17.247235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:17.247689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:17.262531 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] HTTP exception thrown: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Request method failure captured: Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 HTTP/1.1 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi33vjBjPgwSUKT2zqCeAy1_-XW_hrAj-j0xswmJmAcAVe5wNvYbXSjX7ne1BatPp8cTCERsce080JkXd5IxaonNu4M_g80z-scP1ajYG64h9KNvmwpovKIThFF4TdrXUTtZ24S5P3lenbIqttuwwbPy6E99DYY8f4zf82KHYRR02fgOo Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_64ccee6b6aea4a1a95b68981e7d3be73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 64ccee6b6aea4a1a95b68981e7d3be73 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1666825967 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 2442ad89944949299d0da2f943d0f3c5 Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestMinimumBasicScenario-1666825967-project Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '31190382-53cd-41f2-8815-ea14e1ab5f28'} Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:37:17.264213 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Returning 404 to user: Instance 31190382-53cd-41f2-8815-ea14e1ab5f28 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-531474d5-c4f3-4190-97cd-d4512ede368f tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28" status: 404 len: 111 microversion: 2.1 time: 0.032474 Jul 26 05:37:17.268658 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3767/7475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:17 2022] GET /compute/v2.1/servers/31190382-53cd-41f2-8815-ea14e1ab5f28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:37:17.274853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b2a1eee0-90d7-4d94-8634-b39d1820f866 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] Calling method '.version_select at 0x7f38b498e8b0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:17.295448 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b2a1eee0-90d7-4d94-8634-b39d1820f866 tempest-TestMinimumBasicScenario-1666825967 tempest-TestMinimumBasicScenario-1666825967-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1392340329" status: 202 len: 0 microversion: 2.1 time: 0.024322 Jul 26 05:37:17.296209 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3709/7476] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Jul 26 05:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1392340329 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:37:26.707861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d9b8c55e-45cf-4ef5-8d47-410c86da0aba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: .version_select at 0x7f38bac5daf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-673310072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALHsRTCjCw+OltBjoOeuoT8KknWBqSc2FIalVpAro3fCI64IubCq59hVUtDkQXm5+xgm3/aslCeTtrySaPrP6Uq9WrSWvdfrJpFZh5iT/VT8sXvRlC2PkRnuohGzczQgA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:26.723985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d9b8c55e-45cf-4ef5-8d47-410c86da0aba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:37:26.730234 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-d9b8c55e-45cf-4ef5-8d47-410c86da0aba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:37:26.755788 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d9b8c55e-45cf-4ef5-8d47-410c86da0aba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.231700 Jul 26 05:37:26.756396 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3768/7477] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:37:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:32.630047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:32.630910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:32.637793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1276057707", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "0dbb6ba8-3e16-45ee-8d69-65c64a983dfd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-673310072", "security_groups": [{"name": "tempest-secgroup-smoke-1119709536"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:32.766753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] validate_networks() for [('0dbb6ba8-3e16-45ee-8d69-65c64a983dfd', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:37:33.262514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:37:33.262946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:37:33.263751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:37:33.264164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:37:33.264738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:37:33.274656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:33.275452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:33.276469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:33.277186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:33.307790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:37:33.313193 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:37:33.325884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:37:33.328185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:37:33.384202 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7cd8c4c4-025e-4c07-a55a-c0043c4b068a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.755867 Jul 26 05:37:33.385974 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3710/7478] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:37:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:37:33.393903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:33.399880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6129bbe5-2256-4683-a661-17bf5ebd0234 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:33.400765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6129bbe5-2256-4683-a661-17bf5ebd0234 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:33.423546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:33.492123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6129bbe5-2256-4683-a661-17bf5ebd0234 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:33.500522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6129bbe5-2256-4683-a661-17bf5ebd0234 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1266 microversion: 2.1 time: 0.107934 Jul 26 05:37:33.501340 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3769/7479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:33 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:34.521542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:34.522793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:34.531284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:34.532002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:34.532782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:34.533225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:34.675005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:34.687330 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8514c68-c831-4a82-897a-11ec718ad8ea tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1318 microversion: 2.1 time: 0.169581 Jul 26 05:37:34.688315 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3711/7480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:34 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:37:35.711339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:35.711962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:35.720756 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:35.721226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:35.722013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:35.723158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:35.874575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:35.882363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee14d820-4a51-4c93-a25d-8d115169bb92 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.174751 Jul 26 05:37:35.882948 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3770/7481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:35 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:37:36.199252 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-36354b0d-f7c8-48a8-8eac-c814814b1982 req-4867eb71-e16b-4cc9-9a37-f28a9318a905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c6f865-0e77-42c9-9b70-a6ce6150a0a6", "tag": "fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:36.215778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36354b0d-f7c8-48a8-8eac-c814814b1982 req-4867eb71-e16b-4cc9-9a37-f28a9318a905 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:36.216502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-36354b0d-f7c8-48a8-8eac-c814814b1982 req-4867eb71-e16b-4cc9-9a37-f28a9318a905 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:36.228880 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-36354b0d-f7c8-48a8-8eac-c814814b1982 req-4867eb71-e16b-4cc9-9a37-f28a9318a905 service nova] Creating event network-changed:fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609 for instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 on n-h2-848886-16 Jul 26 05:37:36.234847 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-36354b0d-f7c8-48a8-8eac-c814814b1982 req-4867eb71-e16b-4cc9-9a37-f28a9318a905 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039447 Jul 26 05:37:36.235505 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3712/7482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:36.903460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:36.904079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:36.911412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:36.911879 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:36.912650 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:36.913098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:37.053164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:37.061487 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4fdd2aaa-f9e6-4145-a2ee-a42432a71ed9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.162003 Jul 26 05:37:37.062082 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3771/7483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:36 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:38.083609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:38.084223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:38.091050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:38.091502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:38.092268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:38.092704 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:38.229982 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:38.237816 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63ba6fe4-e8d2-4e72-bee3-a6cce3e9284b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.159455 Jul 26 05:37:38.238431 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3713/7484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:38 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:39.258478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:39.259095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:39.266727 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:39.267198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:39.267968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:39.268419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:39.402097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:39.409663 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a0042988-a1fe-4ff8-8225-7cd854938c3f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.155133 Jul 26 05:37:39.410265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3772/7485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:39 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:40.430892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:40.431806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:40.438966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:40.439426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:40.440192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:40.440650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:40.575634 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:40.583239 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2108c2b-2c18-4ec8-8727-c49a99883c29 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.156260 Jul 26 05:37:40.583808 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3714/7486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:40 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:41.604091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:41.604723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:41.611450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:41.611913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:41.612687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:41.613140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:41.750724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:41.758264 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6e468a3b-73f8-4eaa-a283-6d19e16af802 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.158811 Jul 26 05:37:41.759131 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3773/7487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:41 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:42.228694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-adcb35e9-f11a-483d-b26f-03e653f943c1 req-90a81c91-1b47-4243-85db-7ae41840cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c6f865-0e77-42c9-9b70-a6ce6150a0a6", "name": "network-vif-plugged", "status": "completed", "tag": "fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:42.241066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-adcb35e9-f11a-483d-b26f-03e653f943c1 req-90a81c91-1b47-4243-85db-7ae41840cb4a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:42.241511 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-adcb35e9-f11a-483d-b26f-03e653f943c1 req-90a81c91-1b47-4243-85db-7ae41840cb4a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:42.253662 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-adcb35e9-f11a-483d-b26f-03e653f943c1 req-90a81c91-1b47-4243-85db-7ae41840cb4a service nova] Creating event network-vif-plugged:fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609 for instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 on n-h2-848886-16 Jul 26 05:37:42.258971 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-adcb35e9-f11a-483d-b26f-03e653f943c1 req-90a81c91-1b47-4243-85db-7ae41840cb4a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034636 Jul 26 05:37:42.259822 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3715/7488] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:37:42.780323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:42.780941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:42.787918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:42.788364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:42.789136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:42.789586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:42.922504 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:42.930044 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ef14af17-97ef-43e0-8ded-af32cea8fc27 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1392 microversion: 2.1 time: 0.153639 Jul 26 05:37:42.930651 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3774/7489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:42 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:43.952945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:43.953646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:43.956438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:43.957106 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:43.964398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:43.964798 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:43.965582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:43.966031 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:44.103268 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:44.110811 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16782b30-a729-41e9-83c6-d21cb6c1afae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1564 microversion: 2.1 time: 0.162175 Jul 26 05:37:44.111378 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3716/7490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:43 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:44.131079 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:44.131699 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:44.133574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:37:44.140275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:44.140742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:44.141522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:44.141977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:44.278281 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:44.285953 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4b39749a-26e1-4b3c-b7e2-92050f2e3563 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1564 microversion: 2.1 time: 0.158748 Jul 26 05:37:44.286547 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3775/7491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:44 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:37:45.885025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:37:45.885677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:37:45.887279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-0fce539b-6d05-4b26-ae36-94c470393df6 req-f677c16b-336e-4046-b020-a37ece9f9cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c6f865-0e77-42c9-9b70-a6ce6150a0a6", "tag": "fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:37:45.893168 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:45.893632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:45.894765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:45.895293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:45.898331 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0fce539b-6d05-4b26-ae36-94c470393df6 req-f677c16b-336e-4046-b020-a37ece9f9cb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:37:45.898795 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-0fce539b-6d05-4b26-ae36-94c470393df6 req-f677c16b-336e-4046-b020-a37ece9f9cb4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:37:45.911800 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-0fce539b-6d05-4b26-ae36-94c470393df6 req-f677c16b-336e-4046-b020-a37ece9f9cb4 service nova] Creating event network-changed:fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609 for instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 on n-h2-848886-16 Jul 26 05:37:45.918345 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-0fce539b-6d05-4b26-ae36-94c470393df6 req-f677c16b-336e-4046-b020-a37ece9f9cb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Jul 26 05:37:45.919847 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3776/7492] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:37:46.479802 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:37:46.487637 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f84ce905-2527-492b-a26e-119b6e180f85 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1564 microversion: 2.1 time: 0.607088 Jul 26 05:37:46.488673 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3717/7493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:37:45 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1564 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:37:53.168362 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:37:53.168884 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:38:19.790431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:19.794464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:19.796844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=17 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:19.797506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=38 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:19.804068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:19.804529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:19.805309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:19.805758 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:19.856615 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05566789-d7f4-480d-9db6-07b99ba1a713 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action" status: 200 len: 24573 microversion: 2.1 time: 0.070978 Jul 26 05:38:19.857188 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3777/7494] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:38:19 2022] POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:38:50.261513 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:50.262411 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=36 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:50.266497 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:50.267081 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:50.274296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:50.274754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:50.275541 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:50.276135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:50.351714 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-564eea06-b26b-4fbe-87b9-ee7f71834922 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action" status: 202 len: 0 microversion: 2.1 time: 0.091842 Jul 26 05:38:50.352368 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3718/7495] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:38:50 2022] POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:38:50.361423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:50.362262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:50.364894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:50.365575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=4 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:38:50.372706 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:50.373181 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:50.373984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:50.374467 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:50.519021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:50.527032 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8958a0c6-a8d8-41cb-a4e6-8da34d95f4db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1687 microversion: 2.1 time: 0.169997 Jul 26 05:38:50.527592 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3778/7496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:50 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:51.551133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:51.551836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:51.559323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:51.559782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:51.560551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:51.560994 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:51.695298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:51.704174 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a4eeaea5-f431-4b9f-a4db-f46dbc5a296c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1667 microversion: 2.1 time: 0.158377 Jul 26 05:38:51.704749 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3719/7497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:51 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:52.800936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:52.803196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:52.810914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.811375 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:52.812161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.812620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:52.864266 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4e68b500-694b-4d6f-8a26-77dfcc607035 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action" status: 200 len: 32649 microversion: 2.1 time: 0.067147 Jul 26 05:38:52.864939 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3779/7498] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:38:52 2022] POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action => generated 32649 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:38:52.877323 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:52.877859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:52.885725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.886242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:52.887007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.887443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:52.952058 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a28fde85-294a-482f-bebf-966028701709 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action" status: 202 len: 0 microversion: 2.1 time: 0.078546 Jul 26 05:38:52.952734 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3720/7499] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:38:52 2022] POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:38:52.961589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:52.962341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:52.969850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.970511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:52.971275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:52.971739 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:53.110141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:53.118065 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3388b7d1-0547-41de-be00-bbf473af405c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1674 microversion: 2.1 time: 0.160756 Jul 26 05:38:53.118666 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3780/7500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:52 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:54.142256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:54.142878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:54.149182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:54.149637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:54.151007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:54.151480 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:54.290688 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:54.298770 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7de8d1ee-9cfc-460b-9832-dc7731de6cff tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1682 microversion: 2.1 time: 0.161742 Jul 26 05:38:54.299346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3721/7501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:54 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:54.393641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:54.395812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:54.403894 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:54.404353 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:54.405124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:54.405576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:54.453652 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-166d4dc3-cc1c-4a04-8ea1-b568e5c6d971 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action" status: 200 len: 36853 microversion: 2.1 time: 0.063831 Jul 26 05:38:54.454325 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3781/7502] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:38:54 2022] POST /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6/action => generated 36853 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:38:55.472151 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:55.472678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:55.475983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-8c2fd776-db67-4aa6-96b0-aeaa8d9a9639 req-12196159-9401-4608-be14-f6ad34737a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c6f865-0e77-42c9-9b70-a6ce6150a0a6", "tag": "fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:55.482133 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:55.482627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:55.483421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:55.484123 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:55.488740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8c2fd776-db67-4aa6-96b0-aeaa8d9a9639 req-12196159-9401-4608-be14-f6ad34737a73 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:55.489339 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-8c2fd776-db67-4aa6-96b0-aeaa8d9a9639 req-12196159-9401-4608-be14-f6ad34737a73 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:55.502180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-8c2fd776-db67-4aa6-96b0-aeaa8d9a9639 req-12196159-9401-4608-be14-f6ad34737a73 service nova] Creating event network-changed:fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609 for instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 on n-h2-848886-16 Jul 26 05:38:55.507316 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-8c2fd776-db67-4aa6-96b0-aeaa8d9a9639 req-12196159-9401-4608-be14-f6ad34737a73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036104 Jul 26 05:38:55.508026 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3782/7503] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:38:55.513129 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:38:55.608574 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2f07c13f-b516-4200-9d69-03c279de7b4a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 204 len: 0 microversion: 2.1 time: 0.139544 Jul 26 05:38:55.609241 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3722/7504] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:38:55 2022] DELETE /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:38:55.618674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:55.619985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:55.627194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:55.627665 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:55.628460 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:55.628915 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:55.773074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:55.781439 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-df5ab357-d929-49e3-8f6c-9eac34470086 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1688 microversion: 2.1 time: 0.166932 Jul 26 05:38:55.782019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3783/7505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:55 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:56.804237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:56.804947 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:56.812727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:56.813182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:56.813953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:56.814433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:57.038226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:57.046774 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8218c80f-bbf1-4241-a45a-b25bb2b97d0d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1688 microversion: 2.1 time: 0.246835 Jul 26 05:38:57.047351 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3723/7506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:56 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:57.968714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e784bd97-f80c-487f-93ba-29f3e45dd553 req-8c4b8bda-68af-4008-bea3-ae7ce8b3c3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c6f865-0e77-42c9-9b70-a6ce6150a0a6", "name": "network-vif-deleted", "tag": "fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:38:57.980799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e784bd97-f80c-487f-93ba-29f3e45dd553 req-8c4b8bda-68af-4008-bea3-ae7ce8b3c3c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:57.981400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e784bd97-f80c-487f-93ba-29f3e45dd553 req-8c4b8bda-68af-4008-bea3-ae7ce8b3c3c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:57.992329 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e784bd97-f80c-487f-93ba-29f3e45dd553 req-8c4b8bda-68af-4008-bea3-ae7ce8b3c3c9 service nova] Creating event network-vif-deleted:fd2fbfc2-7eb4-4510-a618-7b0ac8d4d609 for instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 on n-h2-848886-16 Jul 26 05:38:57.997461 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e784bd97-f80c-487f-93ba-29f3e45dd553 req-8c4b8bda-68af-4008-bea3-ae7ce8b3c3c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Jul 26 05:38:57.998065 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3784/7507] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:38:58.069069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:58.069677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:58.077015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:58.077483 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:58.078303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:58.078934 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:58.115055 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:58.115515 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:58.115972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lazy-loading 'fault' on Instance uuid 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:38:58.157368 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:38:58.165533 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f8de4552-7c84-4f5c-8a50-5cba2a1b0a4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 200 len: 1356 microversion: 2.1 time: 0.100524 Jul 26 05:38:58.166701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3724/7508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:58 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:38:59.189161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:38:59.189876 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 72c6f865-0e77-42c9-9b70-a6ce6150a0a6] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:38:59.196250 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:59.196714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:59.198005 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:38:59.198493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:38:59.211784 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] HTTP exception thrown: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Request method failure captured: Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 HTTP/1.1 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi332VtQZD93xWXH5yDHXwv_vgiFQ4cRLJIEdusKojpZxInc4RJ3vhF4NMqYabg5ys2Flme4_Pg_irpL1X6P1YVuD4d9xhdfZQNVIXRxtH1WhmvRHLtvycCadNVW0wB4-RNVwIS8thDgc0Vo-sJZ3eJYfXAh1y6CGv49fkHeMM_2i_FrE Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 39704e668d824d4abc2363a4357d76cb Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '72c6f865-0e77-42c9-9b70-a6ce6150a0a6'} Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:38:59.214048 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Returning 404 to user: Instance 72c6f865-0e77-42c9-9b70-a6ce6150a0a6 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f227e819-2d55-4797-9a05-19dead86372b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6" status: 404 len: 111 microversion: 2.1 time: 0.031450 Jul 26 05:38:59.218697 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3785/7509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:38:59 2022] GET /compute/v2.1/servers/72c6f865-0e77-42c9-9b70-a6ce6150a0a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:39:02.569472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bd4f17a7-71e3-4136-af08-c09e52a8001e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '.version_select at 0x7f38b529ef70>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:02.593521 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bd4f17a7-71e3-4136-af08-c09e52a8001e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-673310072" status: 202 len: 0 microversion: 2.1 time: 0.027860 Jul 26 05:39:02.594366 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3725/7510] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 05:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-673310072 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:39:02.621897 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f6530a0d-4525-41a6-b902-4297d47d2bc4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: .version_select at 0x7f38b5a5a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-265778661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyiSWsatHUmJMd8KSl5T1Q8kwMJ3T3SI83+r+ZZnX5cbatlwxRZKZQlupKb90ColtPpwAKew656xSXg40moDOQIF0emWb/4o0J8vV4rQX0UyMM3DJMkX9KpI+j9hfOWaA=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:02.642689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6530a0d-4525-41a6-b902-4297d47d2bc4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:39:02.647810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-f6530a0d-4525-41a6-b902-4297d47d2bc4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:39:02.673251 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f6530a0d-4525-41a6-b902-4297d47d2bc4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056277 Jul 26 05:39:02.673864 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3786/7511] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:39:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:39:08.143508 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-780129679", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "084c5506-ed83-42fa-ba25-3b8711d6a29e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-265778661", "security_groups": [{"name": "tempest-secgroup-smoke-1440569268"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:08.165586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:08.267941 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] validate_networks() for [('084c5506-ed83-42fa-ba25-3b8711d6a29e', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:39:08.728948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:39:08.729469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:39:08.730057 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:39:08.731062 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:39:08.732104 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:39:08.747657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:08.748392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:08.749519 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:08.750220 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:08.771116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:39:08.777818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:39:08.793563 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:39:08.796556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:39:08.850434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ba897f39-eaff-40b3-b3ac-ce08107c6c42 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711158 Jul 26 05:39:08.858186 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3726/7512] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:39:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:39:08.865112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f94001f2-9980-4b52-be13-c32e9b00e0f1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:08.865750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f94001f2-9980-4b52-be13-c32e9b00e0f1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:08.936964 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f94001f2-9980-4b52-be13-c32e9b00e0f1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:08.946496 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f94001f2-9980-4b52-be13-c32e9b00e0f1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1265 microversion: 2.1 time: 0.086743 Jul 26 05:39:08.948729 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3787/7513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:08 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:09.975531 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:09.976159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:09.990144 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:09.990899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:09.992079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:09.992900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:10.120265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:10.133645 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-041ddcdc-7c48-480c-85d8-ed349dbc06e5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1335 microversion: 2.1 time: 0.168398 Jul 26 05:39:10.154994 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3727/7514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:09 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1335 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:11.158775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:11.159547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:11.162113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:11.172518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:11.173003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:11.173962 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:11.174429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:11.423632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:11.443448 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-14a59ab0-0cf6-43d6-b617-e2812a1f3ad2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.288523 Jul 26 05:39:11.444764 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3788/7515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:11 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:39:11.690094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-84c0b0ab-dff4-4632-ae8b-d2988ddc0cd7 req-1c297481-5b7e-4f2b-adc8-57a133fd1bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d090d2fa-0eeb-4395-981c-5bc4a216f049", "tag": "dafa5513-96af-486d-9539-5ca8a14cd83c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:11.716098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-84c0b0ab-dff4-4632-ae8b-d2988ddc0cd7 req-1c297481-5b7e-4f2b-adc8-57a133fd1bc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:11.720079 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-84c0b0ab-dff4-4632-ae8b-d2988ddc0cd7 req-1c297481-5b7e-4f2b-adc8-57a133fd1bc6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:11.735469 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-84c0b0ab-dff4-4632-ae8b-d2988ddc0cd7 req-1c297481-5b7e-4f2b-adc8-57a133fd1bc6 service nova] Creating event network-changed:dafa5513-96af-486d-9539-5ca8a14cd83c for instance d090d2fa-0eeb-4395-981c-5bc4a216f049 on n-h1-848886-16 Jul 26 05:39:11.748680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-84c0b0ab-dff4-4632-ae8b-d2988ddc0cd7 req-1c297481-5b7e-4f2b-adc8-57a133fd1bc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064654 Jul 26 05:39:11.749317 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3728/7516] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:39:12.465051 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:12.465682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:12.472702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:12.473179 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:12.473971 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:12.474461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:12.607226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:12.614693 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0fd1efca-571e-4369-ae8e-4e0318dbdfae tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.154287 Jul 26 05:39:12.615265 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3789/7517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:12 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:13.636926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:13.637538 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:13.645044 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:13.645498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:13.646286 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:13.646725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:13.790041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:13.798899 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3f12bb84-cbeb-497e-a89d-7f8765a0c4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.167307 Jul 26 05:39:13.799476 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3729/7518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:13 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:14.819966 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:14.820689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:14.828907 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:14.829552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:14.830529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:14.831000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:14.967918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:14.975578 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73f9f70f-baab-47bc-b193-4caa8b1ebe45 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.159580 Jul 26 05:39:14.976143 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3790/7519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:14 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:15.997358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:15.997992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:16.004890 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:16.005342 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:16.006110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:16.006580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:16.141793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:16.149752 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8282d477-9e9f-4153-8056-ad2f6fea35db tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.156934 Jul 26 05:39:16.150350 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3730/7520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:15 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:16.802544 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-288a4191-5d65-4f61-b0e1-57f6311c8312 req-fab8db58-e875-4090-8539-ff914f36a179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d090d2fa-0eeb-4395-981c-5bc4a216f049", "name": "network-vif-plugged", "status": "completed", "tag": "dafa5513-96af-486d-9539-5ca8a14cd83c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:16.814321 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-288a4191-5d65-4f61-b0e1-57f6311c8312 req-fab8db58-e875-4090-8539-ff914f36a179 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:16.814780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-288a4191-5d65-4f61-b0e1-57f6311c8312 req-fab8db58-e875-4090-8539-ff914f36a179 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:16.827096 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-288a4191-5d65-4f61-b0e1-57f6311c8312 req-fab8db58-e875-4090-8539-ff914f36a179 service nova] Creating event network-vif-plugged:dafa5513-96af-486d-9539-5ca8a14cd83c for instance d090d2fa-0eeb-4395-981c-5bc4a216f049 on n-h1-848886-16 Jul 26 05:39:16.832033 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-288a4191-5d65-4f61-b0e1-57f6311c8312 req-fab8db58-e875-4090-8539-ff914f36a179 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Jul 26 05:39:16.832635 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3791/7521] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:39:17.171962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:17.172620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:17.180148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:17.180603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:17.182453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:17.182904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:17.322200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:17.329763 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-96c333ef-ac65-4981-9a61-82a5fdf119c8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1391 microversion: 2.1 time: 0.162234 Jul 26 05:39:17.330364 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3731/7522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:17 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:18.352624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:18.353429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:18.360450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:18.360912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:18.361686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:18.362136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:18.494963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:18.502624 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ad88e170-4f4a-4aa0-a433-8f1613895b4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1564 microversion: 2.1 time: 0.155087 Jul 26 05:39:18.503208 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3792/7523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:18 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:18.523433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:18.524052 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:18.531609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:18.532072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:18.532849 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:18.533299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:18.667375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:18.675312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-941f8d43-2e7e-4577-a320-7fad2c79bd79 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1564 microversion: 2.1 time: 0.155751 Jul 26 05:39:18.675901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3732/7524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:18 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:20.629038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:20.629710 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:20.635293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-929d1ede-38ac-46bb-bad2-543dec9ad5ec req-02a291cc-943d-4076-b215-2b7032fcdb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d090d2fa-0eeb-4395-981c-5bc4a216f049", "tag": "dafa5513-96af-486d-9539-5ca8a14cd83c"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:20.640268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:20.644596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:20.647086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:20.647853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:20.654725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:20.662741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-929d1ede-38ac-46bb-bad2-543dec9ad5ec req-02a291cc-943d-4076-b215-2b7032fcdb5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:20.663161 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:20.663311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-929d1ede-38ac-46bb-bad2-543dec9ad5ec req-02a291cc-943d-4076-b215-2b7032fcdb5e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:20.663632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:20.664437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:20.665587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:20.685499 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-929d1ede-38ac-46bb-bad2-543dec9ad5ec req-02a291cc-943d-4076-b215-2b7032fcdb5e service nova] Creating event network-changed:dafa5513-96af-486d-9539-5ca8a14cd83c for instance d090d2fa-0eeb-4395-981c-5bc4a216f049 on n-h1-848886-16 Jul 26 05:39:20.691483 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-929d1ede-38ac-46bb-bad2-543dec9ad5ec req-02a291cc-943d-4076-b215-2b7032fcdb5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059994 Jul 26 05:39:20.692328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3733/7525] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:39:20.902598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:20.910896 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-16e2bc4d-a035-4e70-a4fb-c9bf861f3a43 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1564 microversion: 2.1 time: 0.285809 Jul 26 05:39:20.911698 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3793/7526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:20 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1564 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:44.157103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=36 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:44.161753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:44.164041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:44.173514 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:44.173966 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:44.174760 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:44.175208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:44.232240 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f9f2e9f5-7e21-44fa-b56c-aacc93286ba7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action" status: 200 len: 24563 microversion: 2.1 time: 0.076996 Jul 26 05:39:44.233094 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3734/7527] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:39:44 2022] POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action => generated 24563 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:39:50.620822 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:39:50.623074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:50.625952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:50.626644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:39:50.638000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:50.638500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:50.639303 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:50.639762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:50.718683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-531cfae7-01b9-441e-99ba-f170101322b1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action" status: 202 len: 0 microversion: 2.1 time: 0.101679 Jul 26 05:39:50.721789 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3794/7528] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:39:50 2022] POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:39:50.728706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:50.729681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:50.744453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:50.744883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:50.745905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:50.746389 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:50.890134 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:50.898488 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-31137836-55ec-4bf8-9a4a-4e675567d316 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1674 microversion: 2.1 time: 0.174696 Jul 26 05:39:50.899066 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3735/7529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:50 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:51.922311 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:51.923017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:51.929262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:51.929724 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:51.930523 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:51.931237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:52.062939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:52.070630 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-05435b6f-d7f8-42e9-98da-e8b2c32209ba tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.153799 Jul 26 05:39:52.071266 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3795/7530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:51 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:53.092753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:53.093271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:53.101154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:53.101606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:53.102404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:53.103367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:53.239056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:53.247307 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c50dd054-fe4d-4fb4-8e44-8b4634bbac26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.158564 Jul 26 05:39:53.247870 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3736/7531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:53 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:54.270461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:54.271091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:54.278301 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:54.278773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:54.279591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:54.280044 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:54.416647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:54.424470 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-78a05a1c-7f79-4aa3-858f-cb8bffaf6676 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.158008 Jul 26 05:39:54.425042 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3796/7532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:54 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:55.445363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:55.445970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:55.453586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:55.454036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:55.454825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:55.455265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:55.588444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:55.596027 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-95e3493e-f213-47e0-a06f-08a3e624bbb8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.154615 Jul 26 05:39:55.596596 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3737/7533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:55 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:56.616611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:56.617230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:56.625035 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:56.625495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:56.626289 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:56.626742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:56.759958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:56.767639 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7134e4e0-c513-4f88-b334-9c541c56f82c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.154894 Jul 26 05:39:56.768219 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3797/7534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:56 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:57.789367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:57.790066 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:57.797516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:57.797976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:57.798801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:57.799244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:57.937916 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:57.945509 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-46ce1074-1785-4b76-a5dd-c5da2c398596 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.160287 Jul 26 05:39:57.946861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3738/7535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:57 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:39:58.968237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:39:58.968860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:39:58.975813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:58.976282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:58.977062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:39:58.977985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:39:59.113512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:39:59.121711 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-606aaca7-bfcd-4d6f-bb08-4c322a8f5d00 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.157447 Jul 26 05:39:59.122300 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3798/7536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:39:58 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:00.142923 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:00.143477 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:00.151155 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:00.151609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:00.152364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:00.152806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:00.287775 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:00.296372 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4870f3a1-642b-4797-b205-789aefbf9fd8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.157489 Jul 26 05:40:00.296938 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3739/7537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:00 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:01.316866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:01.317498 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:01.325288 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:01.325763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:01.326589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:01.327053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:01.462168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:01.470241 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cf885b2c-efc6-4b83-9831-70167e00c700 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1679 microversion: 2.1 time: 0.157154 Jul 26 05:40:01.470776 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3799/7538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:01 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:02.492426 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:02.493022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:02.500500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:02.500952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:02.501712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:02.502169 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:02.634723 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:02.642306 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4eabcea-7510-4a48-9f5f-95ac4bdcd51f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1682 microversion: 2.1 time: 0.153850 Jul 26 05:40:02.642886 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3740/7539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:02 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:26.829113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:26.831330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:26.833797 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=12 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:26.834484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:26.841390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:26.841854 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:26.842656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:26.843109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:26.900125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f79be3f-7f58-458a-861f-4c092d505d88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action" status: 200 len: 69044 microversion: 2.1 time: 0.074172 Jul 26 05:40:26.900812 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3800/7540] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:40:26 2022] POST /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049/action => generated 69044 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:40:33.929408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:33.929918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:33.933464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=15 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:33.934337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=40 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:33.943231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:33.943681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:33.944468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:33.944922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:33.980015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:40:33.995493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-88280889-0e9a-4115-93b4-0d8afc207755 req-609a41a6-9bd2-48e0-b3ef-39040b458468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d090d2fa-0eeb-4395-981c-5bc4a216f049", "tag": "dafa5513-96af-486d-9539-5ca8a14cd83c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:34.007283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-88280889-0e9a-4115-93b4-0d8afc207755 req-609a41a6-9bd2-48e0-b3ef-39040b458468 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:34.007757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-88280889-0e9a-4115-93b4-0d8afc207755 req-609a41a6-9bd2-48e0-b3ef-39040b458468 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:34.019211 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-88280889-0e9a-4115-93b4-0d8afc207755 req-609a41a6-9bd2-48e0-b3ef-39040b458468 service nova] Creating event network-changed:dafa5513-96af-486d-9539-5ca8a14cd83c for instance d090d2fa-0eeb-4395-981c-5bc4a216f049 on n-h1-848886-16 Jul 26 05:40:34.025245 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-88280889-0e9a-4115-93b4-0d8afc207755 req-609a41a6-9bd2-48e0-b3ef-39040b458468 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097076 Jul 26 05:40:34.026210 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3801/7541] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:40:34.069434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5bff8cc1-7051-4cc1-b51d-5f53fbd622c1 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 204 len: 0 microversion: 2.1 time: 0.143892 Jul 26 05:40:34.074266 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3741/7542] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:40:33 2022] DELETE /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:40:34.080019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:34.080723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:34.088368 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:34.089138 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:34.090137 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:34.090805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:34.282546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:34.290830 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2a994c3e-55ff-4edc-a028-b75e84724d25 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1688 microversion: 2.1 time: 0.215215 Jul 26 05:40:34.291401 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3802/7543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:34 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:35.313336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:35.314132 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:35.320484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:35.321024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:35.322370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:35.322809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:35.510180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:35.517820 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ffb8c7bb-348c-47c1-969c-d632e8c93f6a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1688 microversion: 2.1 time: 0.208740 Jul 26 05:40:35.518417 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3742/7544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:35 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:36.169892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-82b0c823-822f-4c40-9697-a5f09a733bf3 req-c4893435-e97c-4f91-8f93-e2328951388b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d090d2fa-0eeb-4395-981c-5bc4a216f049", "name": "network-vif-deleted", "tag": "dafa5513-96af-486d-9539-5ca8a14cd83c"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:36.182729 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-82b0c823-822f-4c40-9697-a5f09a733bf3 req-c4893435-e97c-4f91-8f93-e2328951388b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:36.183188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-82b0c823-822f-4c40-9697-a5f09a733bf3 req-c4893435-e97c-4f91-8f93-e2328951388b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:36.195834 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-82b0c823-822f-4c40-9697-a5f09a733bf3 req-c4893435-e97c-4f91-8f93-e2328951388b service nova] Creating event network-vif-deleted:dafa5513-96af-486d-9539-5ca8a14cd83c for instance d090d2fa-0eeb-4395-981c-5bc4a216f049 on n-h1-848886-16 Jul 26 05:40:36.200795 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-82b0c823-822f-4c40-9697-a5f09a733bf3 req-c4893435-e97c-4f91-8f93-e2328951388b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034862 Jul 26 05:40:36.201570 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3803/7545] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:40:36.540233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:36.540856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:36.550180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:36.550782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:36.551579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:36.552022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:36.588276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:36.588900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:36.589464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lazy-loading 'fault' on Instance uuid d090d2fa-0eeb-4395-981c-5bc4a216f049 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:40:36.638877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:36.645874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-22d76064-5f0f-4392-a506-9286b798c347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 200 len: 1355 microversion: 2.1 time: 0.110655 Jul 26 05:40:36.646462 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3743/7546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:36 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:37.670546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:37.671185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: d090d2fa-0eeb-4395-981c-5bc4a216f049] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:37.677587 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:37.678055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:37.678864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:37.679322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:37.693117 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] HTTP exception thrown: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Request method failure captured: Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 HTTP/1.1 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi332VtQZD93xWXH5yDHXwv_vgiFQ4cRLJIEdusKojpZxInc4RJ3vhF4NMqYabg5ys2Flme4_Pg_irpL1X6P1YVuD4d9xhdfZQNVIXRxtH1WhmvRHLtvycCadNVW0wB4-RNVwIS8thDgc0Vo-sJZ3eJYfXAh1y6CGv49fkHeMM_2i_FrE Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 39704e668d824d4abc2363a4357d76cb Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': 'd090d2fa-0eeb-4395-981c-5bc4a216f049'} Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:40:37.694870 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Returning 404 to user: Instance d090d2fa-0eeb-4395-981c-5bc4a216f049 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8b8498ea-ca91-44d5-8591-67320c1680f2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049" status: 404 len: 111 microversion: 2.1 time: 0.032616 Jul 26 05:40:37.699457 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3804/7547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:37 2022] GET /compute/v2.1/servers/d090d2fa-0eeb-4395-981c-5bc4a216f049 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:40:40.797642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-33c7a64b-8be6-4428-946b-6e2e4b1039d8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '.version_select at 0x7f38b498eaf0>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:40.819113 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-33c7a64b-8be6-4428-946b-6e2e4b1039d8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-265778661" status: 202 len: 0 microversion: 2.1 time: 0.025955 Jul 26 05:40:40.819720 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3744/7548] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 05:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-265778661 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:40:40.847308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ec115113-e1dd-4e33-8de7-4146f1ffc2de tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: .version_select at 0x7f38b45195e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-479264071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVb0aP3yu6cByBPFAkno06MWD1UqV5Onw+9DFtoEdPyHrXteUxdRoPz7EQPP6m8AKPDMTDsqWaE72IJNAxCQAfhRdEazr+hf62yYFsNwez3r2qY3AMnYzPyDvvx7/6Ajg=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:40.864255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ec115113-e1dd-4e33-8de7-4146f1ffc2de tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:40:40.870066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-ec115113-e1dd-4e33-8de7-4146f1ffc2de tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:40:40.893453 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ec115113-e1dd-4e33-8de7-4146f1ffc2de tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049948 Jul 26 05:40:40.894011 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3805/7549] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:40:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:40:46.788087 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-28865801", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "b2afac2d-c892-41cd-918a-8fbd7eac81cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-479264071", "security_groups": [{"name": "tempest-secgroup-smoke-1102807503"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:46.806173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:46.925493 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] validate_networks() for [('b2afac2d-c892-41cd-918a-8fbd7eac81cf', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:40:47.348557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:40:47.348997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:40:47.349485 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:40:47.349901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:40:47.350481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:40:47.360068 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:47.360613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:47.361502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:47.362041 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:47.387867 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:40:47.398173 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:40:47.407373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:40:47.409727 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:40:47.457240 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63059d99-b55f-4fed-9b86-54c1195795a2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673726 Jul 26 05:40:47.457240 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3745/7550] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:40:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 05:40:47.468547 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1542301-6f99-4556-be2e-dc6f23dd9249 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:47.469169 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1542301-6f99-4556-be2e-dc6f23dd9249 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:47.539520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1542301-6f99-4556-be2e-dc6f23dd9249 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:47.547136 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1542301-6f99-4556-be2e-dc6f23dd9249 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1264 microversion: 2.1 time: 0.082506 Jul 26 05:40:47.547898 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3806/7551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:47 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1264 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:48.570246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:48.571662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:48.579378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:48.579886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:48.580677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:48.581118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:48.692858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:48.710970 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-53bdf998-7653-4960-b358-a155cd3ddbd9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1322 microversion: 2.1 time: 0.144656 Jul 26 05:40:48.712459 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3746/7552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:48 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:49.734196 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:49.739888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:49.741696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:49.761363 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:49.761867 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:49.762656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:49.763110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:49.946205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:49.955517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c08479dd-2efd-493d-9acd-fec2f01c4362 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.225227 Jul 26 05:40:49.968859 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3807/7553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:49 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:50.051451 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-66cfeffd-2e08-4b9d-bf8f-6ca14fd55f40 req-07837f76-2b3e-4cbc-863f-abcc946775e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:50.073742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-66cfeffd-2e08-4b9d-bf8f-6ca14fd55f40 req-07837f76-2b3e-4cbc-863f-abcc946775e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:50.074059 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-66cfeffd-2e08-4b9d-bf8f-6ca14fd55f40 req-07837f76-2b3e-4cbc-863f-abcc946775e8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:50.090759 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-66cfeffd-2e08-4b9d-bf8f-6ca14fd55f40 req-07837f76-2b3e-4cbc-863f-abcc946775e8 service nova] Creating event network-changed:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h2-848886-16 Jul 26 05:40:50.096344 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-66cfeffd-2e08-4b9d-bf8f-6ca14fd55f40 req-07837f76-2b3e-4cbc-863f-abcc946775e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052645 Jul 26 05:40:50.097115 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3747/7554] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:40:50.976940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:50.977598 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:50.984186 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:50.984647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:50.985416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:50.985860 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:51.119989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:51.127535 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af43e6a8-6b3c-432d-a995-4dcd39ad3baa tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.155021 Jul 26 05:40:51.128104 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3808/7555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:50 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:52.151040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:52.151674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:52.157986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:52.158469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:52.159237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:52.159683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:52.294214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:52.302000 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-143ff9a1-263f-4a78-8a2e-fa004d65c09d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.156870 Jul 26 05:40:52.302609 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3748/7556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:52 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:53.323625 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:53.324252 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:53.331205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:53.331676 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:53.332463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:53.332921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:53.473262 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:53.480808 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a8c19809-f47f-4d64-9c0a-5eb3d1ba719a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.161685 Jul 26 05:40:53.481389 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3809/7557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:53 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:54.501131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:54.501742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:54.509550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:54.509999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:54.510790 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:54.511231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:54.645904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:54.654489 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1dbe3e67-9f43-4f52-8bd5-b4c226a8a0fc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.157264 Jul 26 05:40:54.655068 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3749/7558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:54 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:55.675244 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:55.675900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:55.683732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:55.684205 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:55.685028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:55.685490 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:55.821259 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:55.828708 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1942ad55-3c51-4a6c-b6a5-777fed5d3347 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.157421 Jul 26 05:40:55.829276 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3810/7559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:55 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:56.848740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:56.849364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:56.857074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:56.857535 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:56.858352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:56.858809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:56.993265 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:57.000825 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ce63a913-b226-4c97-8aa3-a4de20d81b8f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.155992 Jul 26 05:40:57.001397 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3750/7560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:56 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:57.281293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-1f5efc0f-b558-4c64-a8a3-8b8035c3293d req-097bb992-92fc-4e2f-a055-25702f12c25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:40:57.287053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:57.295118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1f5efc0f-b558-4c64-a8a3-8b8035c3293d req-097bb992-92fc-4e2f-a055-25702f12c25f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:57.295575 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-1f5efc0f-b558-4c64-a8a3-8b8035c3293d req-097bb992-92fc-4e2f-a055-25702f12c25f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:57.307198 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-1f5efc0f-b558-4c64-a8a3-8b8035c3293d req-097bb992-92fc-4e2f-a055-25702f12c25f service nova] Creating event network-vif-plugged:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h2-848886-16 Jul 26 05:40:57.312378 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-1f5efc0f-b558-4c64-a8a3-8b8035c3293d req-097bb992-92fc-4e2f-a055-25702f12c25f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094299 Jul 26 05:40:57.312936 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3811/7561] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:40:58.022419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:58.023099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:58.025077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:58.025771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:58.032919 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:58.033375 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:58.034204 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:58.034647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:58.172933 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:58.181362 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d7d03663-cd88-4c80-86b3-adcb24b92902 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1390 microversion: 2.1 time: 0.162933 Jul 26 05:40:58.181929 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3751/7562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:58 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:59.199516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:40:59.204682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:59.205397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:59.212147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:59.212614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:59.213398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:59.213855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:59.350831 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:59.358605 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-90a8f1f7-a91a-4d1b-b5eb-0e7458c8bcc0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1561 microversion: 2.1 time: 0.160083 Jul 26 05:40:59.359179 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3812/7563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:59 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:40:59.379205 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:40:59.379866 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:40:59.387408 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:59.387856 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:59.388713 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:40:59.389154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:40:59.526857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:40:59.534576 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-35d60562-1c61-44ed-b927-5660036b5973 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1561 microversion: 2.1 time: 0.159277 Jul 26 05:40:59.535168 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3752/7564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:40:59 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:41:01.490642 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:41:01.491308 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:41:01.494657 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2ab15284-20ef-41e5-bd97-d0ce29d5dc66 req-2a7117a1-01eb-4a05-9d84-047b065783c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:41:01.505047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:41:01.505612 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2ab15284-20ef-41e5-bd97-d0ce29d5dc66 req-2a7117a1-01eb-4a05-9d84-047b065783c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:41:01.505787 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:41:01.506410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2ab15284-20ef-41e5-bd97-d0ce29d5dc66 req-2a7117a1-01eb-4a05-9d84-047b065783c9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:41:01.507080 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:41:01.508066 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:41:01.518690 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2ab15284-20ef-41e5-bd97-d0ce29d5dc66 req-2a7117a1-01eb-4a05-9d84-047b065783c9 service nova] Creating event network-changed:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h2-848886-16 Jul 26 05:41:01.526637 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2ab15284-20ef-41e5-bd97-d0ce29d5dc66 req-2a7117a1-01eb-4a05-9d84-047b065783c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036679 Jul 26 05:41:01.527631 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3753/7565] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:41:01.653013 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:41:01.664630 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f7b66076-c621-43e6-9606-83fb4817f368 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1561 microversion: 2.1 time: 0.177835 Jul 26 05:41:01.665211 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3813/7566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:41:01 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:41:13.177402 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:41:13.178220 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:41:34.948953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:41:34.949738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=42 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:41:34.954462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:41:34.956778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:41:34.965042 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:41:34.965505 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:41:34.966307 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:41:34.966758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:41:35.021492 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cefc5cd2-04b5-4f90-a1f0-ff7324a68728 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action" status: 200 len: 24561 microversion: 2.1 time: 0.074349 Jul 26 05:41:35.022330 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3754/7567] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:41:34 2022] POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action => generated 24561 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 05:42:05.423627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=5 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:05.424431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=38 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:05.428533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:05.431952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:05.438803 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:05.439268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:05.440053 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:05.440505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:05.524546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:05.531091 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=119488) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 05:42:05.537453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:42:05.537888 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:42:05.538432 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:42:05.538856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:42:05.539277 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:42:05.603170 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54838116-ed25-44f1-be68-e8506536185c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.181265 Jul 26 05:42:05.603879 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3814/7568] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:42:05 2022] POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:42:05.612295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:05.612989 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:05.615663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:05.617116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:05.623433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:05.623892 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:05.624673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:05.625110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:05.784954 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:05.793371 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ac725c88-a775-42b0-8322-b889f6d163f3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1688 microversion: 2.1 time: 0.185252 Jul 26 05:42:05.794521 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3755/7569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:05 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:06.820323 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:06.821049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:06.831887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:06.832348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:06.833157 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:06.833607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:06.969846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:06.978119 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-008978d7-bbdf-435f-87db-bb41f3fbcf2f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1688 microversion: 2.1 time: 0.165538 Jul 26 05:42:06.978726 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3815/7570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:06 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:07.999183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:07.999825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:08.008325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:08.008780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:08.009553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:08.010000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:08.144869 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:08.153156 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9263bad7-7ca2-46ca-9e26-dcf0d23f9348 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.157971 Jul 26 05:42:08.153716 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3756/7571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:07 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:09.174958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:09.175503 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:09.183221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:09.183692 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:09.184476 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:09.184934 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:09.318357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:09.326542 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-876aa3c3-ff71-48bd-92e3-38b85ed27d9b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.155532 Jul 26 05:42:09.327111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3816/7572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:09 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:10.346910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:10.347536 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:10.355803 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:10.356261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:10.357037 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:10.357481 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:10.502663 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:10.510590 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-13c47a5e-8f23-4ee5-b3c5-106198acadcf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.167703 Jul 26 05:42:10.511159 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3757/7573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:10 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:11.532150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:11.532780 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:11.540824 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:11.541293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:11.542210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:11.542674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:11.677777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:11.685749 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8a864d53-c064-41b0-b240-a22e92e1d0e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.157305 Jul 26 05:42:11.686412 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3817/7574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:11 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:12.707412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:12.708005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:12.715693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:12.716143 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:12.716906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:12.717343 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:12.857644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:12.865328 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eefd3937-f1c6-4e03-871c-39fa84a4d3f4 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.161837 Jul 26 05:42:12.865903 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3758/7575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:12 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:13.886955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:13.887485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:13.894406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:13.894866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:13.895635 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:13.896084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:14.025983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:14.033481 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a5bbdbf7-2ce2-44ef-8259-e3e4ab72eea6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.150677 Jul 26 05:42:14.034049 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3818/7576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:13 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:15.056083 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:15.056642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:15.063566 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:15.064019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:15.064791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:15.065221 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:15.199484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:15.207212 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9df2bd99-9655-4996-b9e6-38f37c59027e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.155918 Jul 26 05:42:15.207783 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3759/7577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:15 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:16.229426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:16.230264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:16.237302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:16.237775 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:16.238585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:16.239041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:16.375423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:16.383818 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-524ad0d6-f504-4b7d-98d1-c0f2908d56df tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.158912 Jul 26 05:42:16.384386 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3819/7578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:16 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:17.405208 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:17.405825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:17.413317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:17.413917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:17.414738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:17.415189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:17.555225 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:17.563243 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db94b3e2-839c-4560-8934-b9ee6de57a26 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.161910 Jul 26 05:42:17.563840 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3760/7579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:17 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:18.586707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:18.587266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:18.594210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:18.594674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:18.595450 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:18.595916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:18.728050 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:18.735874 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e0d193a7-c0e4-4a0e-822d-1369a474417e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1693 microversion: 2.1 time: 0.154278 Jul 26 05:42:18.736444 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3820/7580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:18 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:19.756984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:19.757645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:19.765302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:19.765759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:19.766630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:19.767069 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:19.914137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:19.922614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-09f02485-dfc6-4989-b0de-c11bbb24f1a5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1692 microversion: 2.1 time: 0.169515 Jul 26 05:42:19.930215 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3761/7581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:19 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:20.043469 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "name": "network-vif-unplugged", "status": "completed", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:20.056639 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:20.057108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:20.074235 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] Creating event network-vif-unplugged:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h1-848886-16 Jul 26 05:42:20.080686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:42:20.094060 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a741645e-f24c-434c-a201-b1d8eff125d3 req-1d5e08a0-4847-4c7d-91c3-a644fbf5d130 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121051 Jul 26 05:42:20.094877 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3821/7582] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:42:20.944828 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:20.945458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:20.953073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:20.953523 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:20.954346 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:20.954778 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:21.097610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:21.105312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3867f3e2-594c-4224-8f9a-2d31cad69589 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1692 microversion: 2.1 time: 0.164970 Jul 26 05:42:21.105893 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3762/7583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:20 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:22.116493 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:22.126511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:22.126791 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:22.127200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:22.127402 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:22.135285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:22.135751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:22.136539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:22.136986 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:22.139441 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] Creating event network-changed:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h1-848886-16 Jul 26 05:42:22.144818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-848886-16', 'n-h1-848886-16'} {{(pid=119488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 05:42:22.156424 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-61002184-1c73-4f3c-9663-3415040de36d req-1a85634f-00da-486e-b7d6-62c15c469d67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044524 Jul 26 05:42:22.157031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3822/7584] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:42:22.388853 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:22.397414 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01a23822-b7bd-47dd-b437-71dbd872ef5c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1690 microversion: 2.1 time: 0.274215 Jul 26 05:42:22.398021 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3763/7585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:22 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:42:23.421255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:23.421969 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:23.428616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.429232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.430036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.430522 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.564708 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:23.572894 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cbfe2b75-3e43-4daf-9cba-13c7e641c3eb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.156969 Jul 26 05:42:23.573472 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3823/7586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:23 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:23.594214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:23.594740 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:23.601652 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.602217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.602878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.603318 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.666494 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-578cc600-a3a6-4e9a-83e4-473fe8363529 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action" status: 204 len: 0 microversion: 2.1 time: 0.076021 Jul 26 05:42:23.667170 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3764/7587] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:42:23 2022] POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:42:23.675814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:23.676508 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:23.683789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.684409 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.685285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.685747 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.856691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:23.864306 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d0a6813-d97d-4bc3-abd6-3248120ebf52 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.192668 Jul 26 05:42:23.864883 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3824/7588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:23 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:42:23.886095 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:23.886843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:23.893153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.893613 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:23.894619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:23.895293 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:24.129494 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:24.137532 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b4c2953d-2bb2-4e75-bcec-8f3b40462411 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.255590 Jul 26 05:42:24.137901 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3765/7589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:23 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1687 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:25.159569 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:25.160110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:25.167761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:25.168235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:25.169268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:25.169737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:25.300624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:25.309009 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-aae04b7b-1051-40ce-857e-e463f256c680 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.153427 Jul 26 05:42:25.309582 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3825/7590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:25 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:25.754948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-97371bc0-5852-4181-81ef-2227c0c8fb56 req-a4663c0b-edce-46bd-bb5b-f80f05fc79d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:25.766756 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97371bc0-5852-4181-81ef-2227c0c8fb56 req-a4663c0b-edce-46bd-bb5b-f80f05fc79d4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:25.767206 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-97371bc0-5852-4181-81ef-2227c0c8fb56 req-a4663c0b-edce-46bd-bb5b-f80f05fc79d4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:25.780400 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-97371bc0-5852-4181-81ef-2227c0c8fb56 req-a4663c0b-edce-46bd-bb5b-f80f05fc79d4 service nova] Creating event network-vif-plugged:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h1-848886-16 Jul 26 05:42:25.784944 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-97371bc0-5852-4181-81ef-2227c0c8fb56 req-a4663c0b-edce-46bd-bb5b-f80f05fc79d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Jul 26 05:42:25.785979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3766/7591] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:42:47.490449 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=28 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:47.491948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:47.539012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:47.541461 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:47.547812 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:47.548271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:47.549045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:47.549496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:47.605019 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-acdbbeec-01f9-4737-9502-3111c964fadb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action" status: 200 len: 24581 microversion: 2.1 time: 0.119910 Jul 26 05:42:47.605567 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3826/7592] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:42:47 2022] POST /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0/action => generated 24581 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:42:54.983310 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-275b3a01-2d7b-48d5-a2c6-72c52fe8e936 req-1a93aa5f-3c98-4b0a-85b9-63ebb532360a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:54.987550 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=24 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:54.988909 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:42:54.994783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:54.995370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:55.004230 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-275b3a01-2d7b-48d5-a2c6-72c52fe8e936 req-1a93aa5f-3c98-4b0a-85b9-63ebb532360a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:55.004696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-275b3a01-2d7b-48d5-a2c6-72c52fe8e936 req-1a93aa5f-3c98-4b0a-85b9-63ebb532360a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:55.007958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:55.008647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:55.009435 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:55.009878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:55.018600 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-275b3a01-2d7b-48d5-a2c6-72c52fe8e936 req-1a93aa5f-3c98-4b0a-85b9-63ebb532360a service nova] Creating event network-changed:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h1-848886-16 Jul 26 05:42:55.023962 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-275b3a01-2d7b-48d5-a2c6-72c52fe8e936 req-1a93aa5f-3c98-4b0a-85b9-63ebb532360a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Jul 26 05:42:55.024836 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3827/7593] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:42:55.039781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:42:55.134842 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-24777ebb-6187-4ec9-b1ad-b8ef34d72bc6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 204 len: 0 microversion: 2.1 time: 0.157848 Jul 26 05:42:55.140430 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3767/7594] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:42:54 2022] DELETE /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:42:55.148470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:55.149349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:55.156464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:55.157014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:55.158067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:55.158626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:55.315140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:55.323370 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ba2611cf-d6c0-49bb-8eff-39a3ce77a07c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1685 microversion: 2.1 time: 0.181247 Jul 26 05:42:55.323946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3828/7595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:55 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:56.345765 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:56.346524 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:56.353972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:56.354455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:56.355238 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:56.355687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:56.495827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:42:56.503560 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6f60ee5-49ad-47d0-804a-52a206541b0e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 200 len: 1685 microversion: 2.1 time: 0.162104 Jul 26 05:42:56.504129 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3768/7596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:56 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:42:56.976632 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3e0c4066-8a34-4c31-ba97-48401918a77c req-d43985f3-cb81-4f6d-9393-7b7b6e648ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38230fce-8ac4-4a91-aa2e-aeb29b5c57d0", "name": "network-vif-deleted", "tag": "4f6d843a-2f56-4b78-8c70-a1b96ce62470"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:42:56.991187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3e0c4066-8a34-4c31-ba97-48401918a77c req-d43985f3-cb81-4f6d-9393-7b7b6e648ad6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:56.991829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3e0c4066-8a34-4c31-ba97-48401918a77c req-d43985f3-cb81-4f6d-9393-7b7b6e648ad6 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:57.003227 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3e0c4066-8a34-4c31-ba97-48401918a77c req-d43985f3-cb81-4f6d-9393-7b7b6e648ad6 service nova] Creating event network-vif-deleted:4f6d843a-2f56-4b78-8c70-a1b96ce62470 for instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 on n-h1-848886-16 Jul 26 05:42:57.008359 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3e0c4066-8a34-4c31-ba97-48401918a77c req-d43985f3-cb81-4f6d-9393-7b7b6e648ad6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Jul 26 05:42:57.009290 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3829/7597] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:42:57.526458 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:42:57.527000 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:42:57.533976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:57.534467 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:57.535244 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:42:57.535686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:42:57.550038 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] HTTP exception thrown: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Request method failure captured: Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 HTTP/1.1 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi332VtQZD93xWXH5yDHXwv_vgiFQ4cRLJIEdusKojpZxInc4RJ3vhF4NMqYabg5ys2Flme4_Pg_irpL1X6P1YVuD4d9xhdfZQNVIXRxtH1WhmvRHLtvycCadNVW0wB4-RNVwIS8thDgc0Vo-sJZ3eJYfXAh1y6CGv49fkHeMM_2i_FrE Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 39704e668d824d4abc2363a4357d76cb Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '38230fce-8ac4-4a91-aa2e-aeb29b5c57d0'} Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:42:57.551718 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Returning 404 to user: Instance 38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80fdbfd9-40af-4dba-b61c-ce09398758b2 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0" status: 404 len: 111 microversion: 2.1 time: 0.030840 Jul 26 05:42:57.557452 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3769/7598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:42:57 2022] GET /compute/v2.1/servers/38230fce-8ac4-4a91-aa2e-aeb29b5c57d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:43:00.914517 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4861e1dd-2a54-42e9-b063-0169c98f565a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '.version_select at 0x7f38bac5d940>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:00.937309 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4861e1dd-2a54-42e9-b063-0169c98f565a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-479264071" status: 202 len: 0 microversion: 2.1 time: 0.028320 Jul 26 05:43:00.937899 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3830/7599] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 05:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-479264071 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:43:00.965672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e6de71dc-1377-4be7-b1c4-24eb2a27b219 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: .version_select at 0x7f38b49b35e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-242441265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF75IyGitpbCfWmCTmb0Lamv+10JXvgZNS5OlHIsuVK6DA2B9oYSkw5aREqmo+x3JI1q2mhWLJXl/fUg0D8v/NLDyGAS148/RDNWfg9NR4rb2TkOJcO+9wDeJezg5Ot38g=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:00.984809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e6de71dc-1377-4be7-b1c4-24eb2a27b219 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:43:00.989056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-e6de71dc-1377-4be7-b1c4-24eb2a27b219 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:43:01.013434 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e6de71dc-1377-4be7-b1c4-24eb2a27b219 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051752 Jul 26 05:43:01.014277 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3770/7600] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:43:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:43:06.416878 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1509722210", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "162b73a9-f93f-4c35-a6c2-5f0680e84e6f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-242441265", "security_groups": [{"name": "tempest-secgroup-smoke-816830561"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:06.532611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] validate_networks() for [('162b73a9-f93f-4c35-a6c2-5f0680e84e6f', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:43:06.996388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=14 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:07.347566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:43:07.348123 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:43:07.348618 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:43:07.349041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:43:07.354402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:43:07.363786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:07.364260 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:07.365274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:07.365576 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:07.385228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:43:07.392237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:43:07.409402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:43:07.413492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:43:07.464581 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2f4b9567-cad6-45d5-8173-2d8545f01023 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.052981 Jul 26 05:43:07.466375 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3831/7601] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:43:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:43:07.478725 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9e69a10-cf9d-4679-8c8e-4873a7eb576c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:07.479976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9e69a10-cf9d-4679-8c8e-4873a7eb576c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:07.541373 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:07.567453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9e69a10-cf9d-4679-8c8e-4873a7eb576c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:07.574874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9e69a10-cf9d-4679-8c8e-4873a7eb576c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1266 microversion: 2.1 time: 0.102007 Jul 26 05:43:07.575441 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3771/7602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:07 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:08.598430 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:08.599148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:08.606407 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:08.606891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:08.607671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:08.608222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:08.715616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:08.724201 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9b0f0b72-a490-4320-a022-50ebe0237087 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1326 microversion: 2.1 time: 0.130469 Jul 26 05:43:08.726017 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3832/7603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:08 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:09.747056 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:09.747658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:09.761614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:09.762377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:09.763183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:09.763654 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:09.908979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:09.917429 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-54a3d066-02f7-4dc5-83d1-7564fb9cf09a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.174270 Jul 26 05:43:09.918024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3772/7604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:09 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:10.162578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-519207a6-ebc9-44fd-be3b-3cc833260937 req-2345ad1a-bd9c-436e-bfab-2bcdd1c9796b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d", "tag": "bf71c84c-58c3-4b1d-ad4c-b2200522aaf1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:10.176651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-519207a6-ebc9-44fd-be3b-3cc833260937 req-2345ad1a-bd9c-436e-bfab-2bcdd1c9796b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:10.178112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-519207a6-ebc9-44fd-be3b-3cc833260937 req-2345ad1a-bd9c-436e-bfab-2bcdd1c9796b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:10.208678 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-519207a6-ebc9-44fd-be3b-3cc833260937 req-2345ad1a-bd9c-436e-bfab-2bcdd1c9796b service nova] Creating event network-changed:bf71c84c-58c3-4b1d-ad4c-b2200522aaf1 for instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d on n-h1-848886-16 Jul 26 05:43:10.214052 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-519207a6-ebc9-44fd-be3b-3cc833260937 req-2345ad1a-bd9c-436e-bfab-2bcdd1c9796b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058280 Jul 26 05:43:10.214804 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3833/7605] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:43:10.939468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:10.940102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:10.947668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:10.948116 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:10.948870 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:10.949308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:11.083365 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:11.091639 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-219326cc-ffc1-419f-9e4c-550cc0d6aa94 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.156154 Jul 26 05:43:11.092210 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3773/7606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:10 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:12.112436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:12.113158 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:12.121237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:12.121769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:12.122603 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:12.123067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:12.258482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:12.266064 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c15984ce-0a81-4016-a28c-639d1c94156d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.157922 Jul 26 05:43:12.266754 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3834/7607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:12 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:13.286960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:13.287707 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:13.294836 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:13.295295 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:13.296064 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:13.296537 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:13.438141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:13.447153 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fef8a8bb-2116-42d4-9ae2-e99b22237421 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.164184 Jul 26 05:43:13.447740 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3774/7608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:13 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:14.467908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:14.468525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:14.476255 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:14.476719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:14.477492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:14.477938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:14.612397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:14.619968 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-709e1e35-a59f-4ddb-a77d-609f284a0184 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.156046 Jul 26 05:43:14.620533 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3835/7609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:14 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:15.641161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:15.641792 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:15.648964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:15.649415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:15.650189 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:15.650631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:15.784992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:15.792860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-75f547b6-7cdc-4ca4-901b-6ef7da2de30d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.155951 Jul 26 05:43:15.793428 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3775/7610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:15 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:15.987609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-518337f3-cf57-4f55-9edc-b94fb3e6f531 req-63f55766-2d0f-4b44-ad5f-9d6c3aa3ae38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d", "name": "network-vif-plugged", "status": "completed", "tag": "bf71c84c-58c3-4b1d-ad4c-b2200522aaf1"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:15.998899 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-518337f3-cf57-4f55-9edc-b94fb3e6f531 req-63f55766-2d0f-4b44-ad5f-9d6c3aa3ae38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:15.999367 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-518337f3-cf57-4f55-9edc-b94fb3e6f531 req-63f55766-2d0f-4b44-ad5f-9d6c3aa3ae38 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:16.011908 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-518337f3-cf57-4f55-9edc-b94fb3e6f531 req-63f55766-2d0f-4b44-ad5f-9d6c3aa3ae38 service nova] Creating event network-vif-plugged:bf71c84c-58c3-4b1d-ad4c-b2200522aaf1 for instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d on n-h1-848886-16 Jul 26 05:43:16.016862 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-518337f3-cf57-4f55-9edc-b94fb3e6f531 req-63f55766-2d0f-4b44-ad5f-9d6c3aa3ae38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Jul 26 05:43:16.017643 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3836/7611] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:43:16.814015 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:16.814669 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:16.821754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:16.822254 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:16.823019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:16.823471 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:16.957429 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:16.965814 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-229f8fdf-32dc-46b8-b5c6-c209e7c25405 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1391 microversion: 2.1 time: 0.155742 Jul 26 05:43:16.967148 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3776/7612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:16 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:17.984574 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:17.985511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:17.990348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:17.991989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:17.993483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:18.000846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:18.001315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:18.002100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:18.002581 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:18.149531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:18.158169 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd98cf23-5461-4552-83b5-daa956031fb5 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1563 microversion: 2.1 time: 0.175324 Jul 26 05:43:18.158881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3837/7613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:17 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:18.182274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:18.182935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:18.185383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:18.193403 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:18.194314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:18.194809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:18.195257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:18.334787 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:18.342480 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d9b31d22-04da-442e-969b-fec91236894e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1563 microversion: 2.1 time: 0.164952 Jul 26 05:43:18.343052 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3777/7614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:18 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:20.301557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:20.302965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:20.304620 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2d3ef480-1882-4cf4-8191-c9ee1a1a8225 req-9190d45d-78f3-48a2-9047-a330b6029cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d", "tag": "bf71c84c-58c3-4b1d-ad4c-b2200522aaf1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:20.309983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:20.310355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:20.311170 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:20.311633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:20.316449 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2d3ef480-1882-4cf4-8191-c9ee1a1a8225 req-9190d45d-78f3-48a2-9047-a330b6029cc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:20.316906 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2d3ef480-1882-4cf4-8191-c9ee1a1a8225 req-9190d45d-78f3-48a2-9047-a330b6029cc0 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:20.330035 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2d3ef480-1882-4cf4-8191-c9ee1a1a8225 req-9190d45d-78f3-48a2-9047-a330b6029cc0 service nova] Creating event network-changed:bf71c84c-58c3-4b1d-ad4c-b2200522aaf1 for instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d on n-h1-848886-16 Jul 26 05:43:20.336745 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2d3ef480-1882-4cf4-8191-c9ee1a1a8225 req-9190d45d-78f3-48a2-9047-a330b6029cc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040030 Jul 26 05:43:20.337637 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3778/7615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:43:20.540113 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:20.549533 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c560e071-b219-475f-80c5-6d392e44bc78 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1563 microversion: 2.1 time: 0.254871 Jul 26 05:43:20.550145 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3838/7616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:20 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:41.794640 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:41.795398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=38 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:41.800146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:41.802830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:41.810470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:41.810927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:41.811694 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:41.812141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:41.868374 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a429daa2-dd08-4455-98d4-b8dbec13157c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action" status: 200 len: 24572 microversion: 2.1 time: 0.075913 Jul 26 05:43:41.869255 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3779/7617] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:43:41 2022] POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:43:52.882351 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-41cf6a0b-c94a-40ed-99a1-f1807c33548e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:43:52.884844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:52.885683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=36 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:52.891320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41cf6a0b-c94a-40ed-99a1-f1807c33548e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:52.891789 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-41cf6a0b-c94a-40ed-99a1-f1807c33548e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:52.914539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-41cf6a0b-c94a-40ed-99a1-f1807c33548e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Going to try to stop instance {{(pid=119488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 05:43:52.956799 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-41cf6a0b-c94a-40ed-99a1-f1807c33548e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action" status: 202 len: 0 microversion: 2.1 time: 0.077959 Jul 26 05:43:52.957549 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3839/7618] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:43:52 2022] POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:43:52.966413 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:52.967212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:52.970084 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:52.970747 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:43:52.977877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:52.978358 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:52.979131 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:52.979603 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:53.120668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:53.128246 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d800dda-4208-426f-b7c6-149b10e0cf7a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.166092 Jul 26 05:43:53.128811 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3780/7619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:52 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:54.150009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:54.150661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:54.158297 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:54.158761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:54.159534 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:54.161168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:54.296582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:54.305049 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a2a5c2e4-83df-49ae-8733-622819ec29fd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.159411 Jul 26 05:43:54.305625 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3840/7620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:54 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:55.327080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:55.327729 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:55.335949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:55.336409 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:55.337187 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:55.337638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:55.475248 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:55.482896 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-dc307537-b2c6-47ac-905e-1f5d121b7627 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.159807 Jul 26 05:43:55.483466 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3781/7621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:55 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:56.504702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:56.505987 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:56.512980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:56.513441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:56.514241 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:56.514696 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:56.646385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:56.653956 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-51aa51e4-753b-4223-88c7-7d1aef0bba64 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.153285 Jul 26 05:43:56.654560 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3841/7622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:56 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:57.675854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:57.676423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:57.683646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:57.684113 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:57.684887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:57.685332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:57.822557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:57.830298 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9c2921e1-08f8-4d69-8bab-48f7b23003dc tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.158498 Jul 26 05:43:57.830869 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3782/7623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:57 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:43:58.852911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:43:58.853458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:43:58.860411 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:58.860873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:58.861646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:43:58.862100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:43:58.996644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:43:59.004415 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-dca8cd20-52ed-47a1-9cb8-101289b2812f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.156239 Jul 26 05:43:59.005056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3842/7624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:43:58 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:00.026366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:00.026911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:00.033937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:00.034428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:00.035201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:00.035644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:00.167876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:00.177469 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a11fd7c7-3636-4bd5-8868-5c9c6422bf0c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.154464 Jul 26 05:44:00.177914 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3783/7625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:00 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:01.198875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:01.199511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:01.206585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:01.207062 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:01.207851 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:01.208327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:01.345588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:01.353278 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-300bf598-a3a5-4641-b858-568797e4249a tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.158386 Jul 26 05:44:01.353855 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3843/7626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:01 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:02.374544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:02.375162 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:02.382455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:02.382918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:02.383697 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:02.384150 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:02.517953 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:02.526352 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-103e043c-09b2-40e0-96d9-ba3dd84ea401 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1692 microversion: 2.1 time: 0.155790 Jul 26 05:44:02.526922 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3784/7627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:02 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:03.547738 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:03.548370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:03.556045 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:03.556513 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:03.557298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:03.557755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:03.690778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:03.699021 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a43adf23-add2-48ab-88d3-14ea87928b88 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1669 microversion: 2.1 time: 0.155530 Jul 26 05:44:03.699597 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3844/7628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:03 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:04.794060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:04.796299 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:04.803749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:04.804209 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:04.804990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:04.805433 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:04.859113 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e9f2ae3f-1ac6-454d-ae0a-a3ed4242c11b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action" status: 200 len: 38366 microversion: 2.1 time: 0.069170 Jul 26 05:44:04.859808 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3785/7629] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:44:04 2022] POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action => generated 38366 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:44:04.872383 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-764015b9-0371-4bbd-bce6-26bd6f5b7084 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:04.879423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-764015b9-0371-4bbd-bce6-26bd6f5b7084 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:04.880228 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-764015b9-0371-4bbd-bce6-26bd6f5b7084 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:04.901833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-764015b9-0371-4bbd-bce6-26bd6f5b7084 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Going to try to start instance {{(pid=119488) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 05:44:04.944008 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-764015b9-0371-4bbd-bce6-26bd6f5b7084 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action" status: 202 len: 0 microversion: 2.1 time: 0.075382 Jul 26 05:44:04.944652 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3845/7630] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:44:04 2022] POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:44:04.953517 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:04.954236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:04.962016 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:04.962658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:04.963431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:04.963878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:05.105984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:05.114824 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf7e6672-0115-4407-9c5b-27b95a8f84e7 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1678 microversion: 2.1 time: 0.164591 Jul 26 05:44:05.115525 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3786/7631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:04 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:06.138195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:06.138813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:06.145040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:06.146565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:06.146932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:06.147385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:06.286426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:06.294503 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-76735943-dfa5-4a53-9615-91b17eaca94b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1682 microversion: 2.1 time: 0.161503 Jul 26 05:44:06.295087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3846/7632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:06 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:32.492970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:32.495201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:32.498309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=14 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:32.498961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=40 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:32.505959 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:32.506961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:32.507846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:32.508285 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:32.560869 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a30da465-0923-462c-960a-52dd34a7fddf tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action" status: 200 len: 62932 microversion: 2.1 time: 0.071800 Jul 26 05:44:32.561509 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3787/7633] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:44:32 2022] POST /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d/action => generated 62932 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:44:39.969811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:39.970355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:39.972328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-4b20914c-a2b4-487c-91c2-21f10502c53a req-63ac1cf2-b2f7-4c9f-a664-b473a0cb3e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d", "tag": "bf71c84c-58c3-4b1d-ad4c-b2200522aaf1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:39.973047 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=16 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:39.974402 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:39.981416 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:39.982076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:39.982977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:39.983500 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:39.989440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b20914c-a2b4-487c-91c2-21f10502c53a req-63ac1cf2-b2f7-4c9f-a664-b473a0cb3e27 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:39.989440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-4b20914c-a2b4-487c-91c2-21f10502c53a req-63ac1cf2-b2f7-4c9f-a664-b473a0cb3e27 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:40.003391 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-4b20914c-a2b4-487c-91c2-21f10502c53a req-63ac1cf2-b2f7-4c9f-a664-b473a0cb3e27 service nova] Creating event network-changed:bf71c84c-58c3-4b1d-ad4c-b2200522aaf1 for instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d on n-h1-848886-16 Jul 26 05:44:40.010404 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-4b20914c-a2b4-487c-91c2-21f10502c53a req-63ac1cf2-b2f7-4c9f-a664-b473a0cb3e27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041648 Jul 26 05:44:40.011208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3788/7634] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:44:40.012664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Going to try to terminate instance {{(pid=119488) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:44:40.110517 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7f642d09-0c62-4227-ab73-f04f18e153f6 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 204 len: 0 microversion: 2.1 time: 0.144287 Jul 26 05:44:40.114739 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3847/7635] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:44:39 2022] DELETE /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:44:40.121860 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:40.122788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:40.129326 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:40.129789 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:40.130584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:40.131085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:40.277119 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:40.285111 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-acf57c06-ac1d-4ee6-9b6e-417e3991bb4c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1688 microversion: 2.1 time: 0.168355 Jul 26 05:44:40.285681 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3789/7636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:40 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:41.308624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:41.309462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:41.316510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:41.316972 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:41.317762 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:41.318237 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:41.455221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:41.462999 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bcbd7643-ed01-4daa-8f0e-4dd65c4ee4e8 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1688 microversion: 2.1 time: 0.158682 Jul 26 05:44:41.463588 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3848/7637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:41 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:42.435602 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-2cc9cb18-1d05-4749-b106-96aef47042b5 req-fccda3c2-dda4-45f3-aa7c-4064ec851465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d", "name": "network-vif-deleted", "tag": "bf71c84c-58c3-4b1d-ad4c-b2200522aaf1"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:42.447454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2cc9cb18-1d05-4749-b106-96aef47042b5 req-fccda3c2-dda4-45f3-aa7c-4064ec851465 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:42.447898 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-2cc9cb18-1d05-4749-b106-96aef47042b5 req-fccda3c2-dda4-45f3-aa7c-4064ec851465 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:42.460564 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-2cc9cb18-1d05-4749-b106-96aef47042b5 req-fccda3c2-dda4-45f3-aa7c-4064ec851465 service nova] Creating event network-vif-deleted:bf71c84c-58c3-4b1d-ad4c-b2200522aaf1 for instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d on n-h1-848886-16 Jul 26 05:44:42.465360 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-2cc9cb18-1d05-4749-b106-96aef47042b5 req-fccda3c2-dda4-45f3-aa7c-4064ec851465 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Jul 26 05:44:42.465958 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3790/7638] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:44:42.485136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:42.485989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:42.493268 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:42.493730 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:42.494537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:42.494989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:42.569623 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:42.577303 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1ffdd4a0-2cd9-4373-8a34-e6c9a60b974c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 200 len: 1351 microversion: 2.1 time: 0.096190 Jul 26 05:44:42.577815 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3849/7639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:42 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:43.600516 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:43.601245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:43.607636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:43.608090 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:43.608861 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:43.609305 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:43.623312 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] HTTP exception thrown: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Request method failure captured: Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d HTTP/1.1 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi332VtQZD93xWXH5yDHXwv_vgiFQ4cRLJIEdusKojpZxInc4RJ3vhF4NMqYabg5ys2Flme4_Pg_irpL1X6P1YVuD4d9xhdfZQNVIXRxtH1WhmvRHLtvycCadNVW0wB4-RNVwIS8thDgc0Vo-sJZ3eJYfXAh1y6CGv49fkHeMM_2i_FrE Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: 39704e668d824d4abc2363a4357d76cb Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d'} Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:44:43.624926 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Returning 404 to user: Instance fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b5ad031a-24bc-481b-8bc6-7eaa5f108358 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d" status: 404 len: 111 microversion: 2.1 time: 0.031089 Jul 26 05:44:43.629672 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3791/7640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:43 2022] GET /compute/v2.1/servers/fe61d8ce-9a7a-4a94-b0e1-d8ff2cc5569d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:44:46.764246 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fbc70ab-a562-43a7-8ba6-4e4e37073148 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '.version_select at 0x7f38b441e670>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:46.787363 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2fbc70ab-a562-43a7-8ba6-4e4e37073148 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242441265" status: 202 len: 0 microversion: 2.1 time: 0.027209 Jul 26 05:44:46.788103 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3850/7641] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Jul 26 05:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242441265 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:44:46.822897 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9b89932c-3543-4ede-9fee-794a88ba3cf3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: .version_select at 0x7f38b5255940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2092507274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe01hEZWOqyz8+Gw7GJALNs04nH/wC1ouFFN1P18S8Zu/O5K53XsbRwWenJQu2msr/7LR7kTcrKppszyleG57yq1ehqUR9hMwrXw2ry4ZtyLHqlUwOD0pnypsI0Ob3Z8Q=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:46.841311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9b89932c-3543-4ede-9fee-794a88ba3cf3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:44:46.846539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-9b89932c-3543-4ede-9fee-794a88ba3cf3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:44:46.871327 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9b89932c-3543-4ede-9fee-794a88ba3cf3 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053591 Jul 26 05:44:46.871927 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3792/7642] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:44:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:44:52.638557 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1094729238", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "networks": [{"uuid": "39bd9d13-f585-4e07-b271-9bcfa31efdfe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2092507274", "security_groups": [{"name": "tempest-secgroup-smoke-1854279829"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:52.654104 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:52.800217 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] validate_networks() for [('39bd9d13-f585-4e07-b271-9bcfa31efdfe', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:44:53.203385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:44:53.203852 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:44:53.204341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:44:53.204766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:44:53.205194 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:44:53.214283 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:53.214750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:53.215565 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:53.216020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:53.233009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:44:53.238299 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Getting quotas for user 39704e668d824d4abc2363a4357d76cb and project 76a3ca858c3e4fbf8bbcefa50400b373. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:44:53.251939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:44:53.254245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:44:53.301432 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-31c6c86c-36d7-4619-9146-eb7614b7471c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.667364 Jul 26 05:44:53.302491 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3851/7643] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:44:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:44:53.313833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f0ba6eac-1f9f-4d2e-88bd-25cabbd52569 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:53.314506 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f0ba6eac-1f9f-4d2e-88bd-25cabbd52569 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:53.384312 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f0ba6eac-1f9f-4d2e-88bd-25cabbd52569 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:53.391694 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f0ba6eac-1f9f-4d2e-88bd-25cabbd52569 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1267 microversion: 2.1 time: 0.082659 Jul 26 05:44:53.392267 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3793/7644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:53 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:44:54.414302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:54.414944 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:54.435596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:54.436462 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:54.437567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:54.439282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:54.561970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:54.574930 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4db09967-be24-4026-8082-b42f67601896 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1327 microversion: 2.1 time: 0.165197 Jul 26 05:44:54.575840 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3852/7645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:54 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:55.597032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:55.597646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:55.599749 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:44:55.609533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:55.610771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:55.612315 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:55.613363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:55.784904 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:55.798176 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-df789dfc-55e9-433c-8e3f-ba11b6fb3e4d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.205015 Jul 26 05:44:55.798800 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3794/7646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:55 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:56.025784 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-dcc8d925-094a-4f00-899d-15ebb438fc08 req-515bbc77-8eca-4bf9-8773-066839bcc965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5", "tag": "4bea7cb6-788a-4f15-a86a-e60b276a0ba5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:44:56.038211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dcc8d925-094a-4f00-899d-15ebb438fc08 req-515bbc77-8eca-4bf9-8773-066839bcc965 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:56.039401 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-dcc8d925-094a-4f00-899d-15ebb438fc08 req-515bbc77-8eca-4bf9-8773-066839bcc965 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:56.052715 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-dcc8d925-094a-4f00-899d-15ebb438fc08 req-515bbc77-8eca-4bf9-8773-066839bcc965 service nova] Creating event network-changed:4bea7cb6-788a-4f15-a86a-e60b276a0ba5 for instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 on n-h1-848886-16 Jul 26 05:44:56.059144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-dcc8d925-094a-4f00-899d-15ebb438fc08 req-515bbc77-8eca-4bf9-8773-066839bcc965 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037815 Jul 26 05:44:56.060076 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3853/7647] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:44:56.820405 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:56.821645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:56.828632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:56.829085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:56.829854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:56.830328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:56.962109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:56.969665 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-fc85b0dc-9ecf-4f81-907f-1495575028cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.153863 Jul 26 05:44:56.970237 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3795/7648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:56 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:57.993433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:57.994168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:58.000757 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:58.001220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:58.001999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:58.002484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:58.138058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:58.145879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f392c6f5-4569-4d98-a5c1-303c431e54e9 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.158417 Jul 26 05:44:58.146599 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3854/7649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:57 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:44:59.168337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:44:59.168903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:44:59.175806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:59.176263 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:59.177021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:44:59.177462 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:44:59.315748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:44:59.324421 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-39c4295f-9887-4fc6-9719-ff0bb9b8a160 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.161140 Jul 26 05:44:59.324995 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3796/7650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:44:59 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:00.344929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:00.345584 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:00.353463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:00.353930 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:00.354750 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:00.355203 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:00.488345 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:00.496974 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0cba4a58-1d84-4f48-8be4-289d4c9bfe14 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.155916 Jul 26 05:45:00.497559 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3855/7651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:00 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:01.518440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:01.518992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:01.526432 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:01.526893 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:01.527664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:01.528108 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:01.660682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:01.669129 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-78477385-fe4d-4d75-a3ea-494bec7de51e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.154895 Jul 26 05:45:01.669701 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3797/7652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:01 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:02.598546 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-6e46df7b-8b43-4a49-b380-849ea3c1aab5 req-3492c104-4c5e-4821-a29c-19112e6822e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5", "name": "network-vif-plugged", "status": "completed", "tag": "4bea7cb6-788a-4f15-a86a-e60b276a0ba5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:02.609472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6e46df7b-8b43-4a49-b380-849ea3c1aab5 req-3492c104-4c5e-4821-a29c-19112e6822e4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:02.610264 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-6e46df7b-8b43-4a49-b380-849ea3c1aab5 req-3492c104-4c5e-4821-a29c-19112e6822e4 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:02.622115 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-6e46df7b-8b43-4a49-b380-849ea3c1aab5 req-3492c104-4c5e-4821-a29c-19112e6822e4 service nova] Creating event network-vif-plugged:4bea7cb6-788a-4f15-a86a-e60b276a0ba5 for instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 on n-h1-848886-16 Jul 26 05:45:02.627146 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-6e46df7b-8b43-4a49-b380-849ea3c1aab5 req-3492c104-4c5e-4821-a29c-19112e6822e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032671 Jul 26 05:45:02.627985 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3856/7653] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:45:02.690383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:02.690918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:02.693607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:02.701186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:02.701649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:02.702465 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:02.702913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:02.844159 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:02.851844 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-81f9f67c-ef21-4129-9dc0-3495d9f4a031 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1393 microversion: 2.1 time: 0.165562 Jul 26 05:45:02.852419 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3798/7654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:02 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:03.870566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:03.871370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:03.876592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:03.877305 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:03.885146 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:03.885619 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:03.886453 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:03.886921 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:04.022454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:04.030913 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-692b159f-e7f8-42a4-a32c-b2a72dc2ee13 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1565 microversion: 2.1 time: 0.161381 Jul 26 05:45:04.031483 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3857/7655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:03 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:04.051120 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:04.051744 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:04.053706 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=6 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:04.060006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:04.060472 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:04.061251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:04.061701 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:04.195611 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:04.203304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0067bb5e-4e13-4d8a-b9a1-e4c133c842cb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1565 microversion: 2.1 time: 0.156100 Jul 26 05:45:04.203878 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3799/7656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:04 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:06.177813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:06.178537 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:06.187351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-b71cf1ed-1e71-4d4d-ae0c-4150ee93299f req-65da619b-e5fc-4832-b9fd-e107fee31817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5", "tag": "4bea7cb6-788a-4f15-a86a-e60b276a0ba5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:06.191076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:06.191658 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:06.192475 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:06.192955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:06.198883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b71cf1ed-1e71-4d4d-ae0c-4150ee93299f req-65da619b-e5fc-4832-b9fd-e107fee31817 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:06.199333 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-b71cf1ed-1e71-4d4d-ae0c-4150ee93299f req-65da619b-e5fc-4832-b9fd-e107fee31817 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:06.211720 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-b71cf1ed-1e71-4d4d-ae0c-4150ee93299f req-65da619b-e5fc-4832-b9fd-e107fee31817 service nova] Creating event network-changed:4bea7cb6-788a-4f15-a86a-e60b276a0ba5 for instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 on n-h1-848886-16 Jul 26 05:45:06.217688 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-b71cf1ed-1e71-4d4d-ae0c-4150ee93299f req-65da619b-e5fc-4832-b9fd-e107fee31817 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Jul 26 05:45:06.219040 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3800/7657] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:45:06.420612 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:06.429273 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fee1de38-401a-4dc4-8e32-2ec3cd7e9ee0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1565 microversion: 2.1 time: 0.254874 Jul 26 05:45:06.429867 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3858/7658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:06 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:29.716313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:29.718542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:29.721470 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=5 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:29.722109 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=38 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:29.729450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:29.729900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:29.730709 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:29.731148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:29.785591 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9bdad53a-3210-4278-ab76-fa08a2b8dbce tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action" status: 200 len: 24566 microversion: 2.1 time: 0.073433 Jul 26 05:45:29.786313 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3801/7659] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:45:29 2022] POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:45:36.205752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:36.206378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:36.208657 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:36.209423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=36 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:45:36.215814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:36.216276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:36.217049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:36.217499 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:36.242799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lazy-loading 'flavor' on Instance uuid 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:45:36.308359 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1edcc28-3ec3-489c-bcac-d2ff5f9f232c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action" status: 202 len: 0 microversion: 2.1 time: 0.106468 Jul 26 05:45:36.309022 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3859/7660] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:45:36 2022] POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:45:36.317974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:36.318726 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:36.325950 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:36.326437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:36.327212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:36.327681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:36.557968 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:36.565582 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3d3be80f-d786-4972-8f3e-ab055af3b8c0 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1692 microversion: 2.1 time: 0.252119 Jul 26 05:45:36.566147 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3802/7661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:36 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1692 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:37.589887 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:37.590577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:37.596942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:37.597438 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:37.598251 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:37.598707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:37.783040 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:37.790593 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9d55736d-2abb-479e-b2dc-c225770ef01f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1675 microversion: 2.1 time: 0.206695 Jul 26 05:45:37.791168 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3860/7662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:37 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:38.893547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:38.895801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:38.903979 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:38.904428 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:38.905184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:38.905624 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:38.956308 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-cf1002c6-e99c-4935-8bd4-224cd4162123 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action" status: 200 len: 35603 microversion: 2.1 time: 0.066583 Jul 26 05:45:38.957219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3803/7663] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:45:38 2022] POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action => generated 35603 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:45:38.971909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:38.972479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:38.980313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:38.980781 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:38.981566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:38.982021 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:39.047806 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f25b2c9f-1f27-41d0-8ffb-88c54cece39f tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action" status: 202 len: 0 microversion: 2.1 time: 0.081000 Jul 26 05:45:39.051498 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3861/7664] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:45:38 2022] POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:45:39.057647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:39.058379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:39.065742 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:39.066180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:39.066962 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:39.067410 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:39.210024 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:39.218668 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-63656b62-f200-4756-84f6-330d991446bd tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1681 microversion: 2.1 time: 0.165331 Jul 26 05:45:39.219252 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3804/7665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:39 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:40.242056 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:40.242813 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:40.249121 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:40.249591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:40.250415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:40.250877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:40.389327 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:40.396901 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d81766e1-edee-431b-9c45-9e2a3d8d2904 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1681 microversion: 2.1 time: 0.160556 Jul 26 05:45:40.397486 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3862/7666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:40 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:41.418609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:41.419246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:41.426267 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:41.426721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:41.427491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:41.427929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:41.560347 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:41.568224 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c3c26895-98f1-461c-a6e8-b13693c59f81 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1684 microversion: 2.1 time: 0.153896 Jul 26 05:45:41.568783 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3805/7667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:41 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:41.670932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:41.673136 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:41.680131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:41.680591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:41.681361 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:41.681810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:41.722687 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-50dfbc48-ed87-48d7-99c4-5b7eba637c2e tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action" status: 200 len: 35603 microversion: 2.1 time: 0.055816 Jul 26 05:45:41.723359 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3863/7668] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:45:41 2022] POST /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5/action => generated 35603 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:45:42.765046 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:42.765547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:42.773486 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:42.773952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:42.774857 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:42.775226 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:42.803354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:45:42.824850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-07b8a44f-fa09-499e-a4ec-941890df6d08 req-96332769-a726-4475-bf23-fa2828b4c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5", "tag": "4bea7cb6-788a-4f15-a86a-e60b276a0ba5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:42.840343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-07b8a44f-fa09-499e-a4ec-941890df6d08 req-96332769-a726-4475-bf23-fa2828b4c3a3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:42.841570 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-07b8a44f-fa09-499e-a4ec-941890df6d08 req-96332769-a726-4475-bf23-fa2828b4c3a3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:42.854144 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-07b8a44f-fa09-499e-a4ec-941890df6d08 req-96332769-a726-4475-bf23-fa2828b4c3a3 service nova] Creating event network-changed:4bea7cb6-788a-4f15-a86a-e60b276a0ba5 for instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 on n-h1-848886-16 Jul 26 05:45:42.860862 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-07b8a44f-fa09-499e-a4ec-941890df6d08 req-96332769-a726-4475-bf23-fa2828b4c3a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100693 Jul 26 05:45:42.861660 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3864/7669] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:45:42.892623 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f6d2a156-a376-4f5a-a11c-4655380944bb tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 204 len: 0 microversion: 2.1 time: 0.135912 Jul 26 05:45:42.893219 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3806/7670] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:45:42 2022] DELETE /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:45:42.904067 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:42.905092 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:42.912856 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:42.914381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:42.915585 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:42.916148 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:43.052221 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:43.060339 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d34c7b66-dba9-47f0-a01e-35304c3afa3d tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1690 microversion: 2.1 time: 0.161322 Jul 26 05:45:43.061059 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3865/7671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:42 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:44.083739 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:44.084361 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:44.092022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:44.092482 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:44.093255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:44.093702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:44.232682 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:44.240362 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-80637e8c-031d-4c56-a02f-a28a4d13734b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1690 microversion: 2.1 time: 0.160998 Jul 26 05:45:44.240941 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3807/7672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:44 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:45.264470 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:45.265231 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:45.273144 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:45.273615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:45.274437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:45.274900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:45.386043 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39704e668d824d4abc2363a4357d76cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a3ca858c3e4fbf8bbcefa50400b373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:45:45.387255 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-dc3a0d3b-3b14-47dc-8dbd-48a231e6ef00 req-7912f25d-54d4-4b36-a714-5f1a2e3265e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5", "name": "network-vif-deleted", "tag": "4bea7cb6-788a-4f15-a86a-e60b276a0ba5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:45:45.394657 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b4b09c12-fca6-4172-9f59-a8deec9a2c08 tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 200 len: 1503 microversion: 2.1 time: 0.134598 Jul 26 05:45:45.395649 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3866/7673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:45 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 1503 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:45:45.400712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dc3a0d3b-3b14-47dc-8dbd-48a231e6ef00 req-7912f25d-54d4-4b36-a714-5f1a2e3265e9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:45.401192 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-dc3a0d3b-3b14-47dc-8dbd-48a231e6ef00 req-7912f25d-54d4-4b36-a714-5f1a2e3265e9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:45.413359 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-dc3a0d3b-3b14-47dc-8dbd-48a231e6ef00 req-7912f25d-54d4-4b36-a714-5f1a2e3265e9 service nova] Creating event network-vif-deleted:4bea7cb6-788a-4f15-a86a-e60b276a0ba5 for instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 on n-h1-848886-16 Jul 26 05:45:45.418512 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-dc3a0d3b-3b14-47dc-8dbd-48a231e6ef00 req-7912f25d-54d4-4b36-a714-5f1a2e3265e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035052 Jul 26 05:45:45.419110 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3808/7674] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:45:46.417086 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:46.418072 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] [instance: 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:45:46.428589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:46.429793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:46.430814 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:45:46.431413 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:45:46.447159 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] HTTP exception thrown: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Request method failure captured: Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 HTTP/1.1 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi332VtQZD93xWXH5yDHXwv_vgiFQ4cRLJIEdusKojpZxInc4RJ3vhF4NMqYabg5ys2Flme4_Pg_irpL1X6P1YVuD4d9xhdfZQNVIXRxtH1WhmvRHLtvycCadNVW0wB4-RNVwIS8thDgc0Vo-sJZ3eJYfXAh1y6CGv49fkHeMM_2i_FrE Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76a3ca858c3e4fbf8bbcefa50400b373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: 76a3ca858c3e4fbf8bbcefa50400b373 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872672892 Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: 39704e668d824d4abc2363a4357d76cb Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872672892-project Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5'} Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:45:46.448956 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Returning 404 to user: Instance 2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d40d359b-5fb4-4d09-bcc4-da4aa7bbef8b tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5" status: 404 len: 111 microversion: 2.1 time: 0.037305 Jul 26 05:45:46.456960 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3867/7675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:45:46 2022] GET /compute/v2.1/servers/2c85f7e5-2a72-41b4-bb3a-0f03d70c28d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:45:49.902757 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f2ef6b55-9229-4f4f-b445-52404b13b59c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] Calling method '.version_select at 0x7f38b5f01d30>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:45:49.924815 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f2ef6b55-9229-4f4f-b445-52404b13b59c tempest-TestNetworkAdvancedServerOps-1872672892 tempest-TestNetworkAdvancedServerOps-1872672892-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2092507274" status: 202 len: 0 microversion: 2.1 time: 0.028513 Jul 26 05:45:49.925756 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3809/7676] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Jul 26 05:45:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2092507274 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:46:00.941201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=18 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:00.941941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:01.108767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7c2bfd2e-f273-44ed-ace6-42b00b5e259e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'create', calling method: .version_select at 0x7f38b57f71f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-257174733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfkQSp5Tm67QGs2EpyThXb3lUkOFI5+4R3kQDuxBGWyjA/olfxcHuqmPuAURWN8ROvosOtRtsjPyuGDBn5CJ/HCtHKGprkjHe3cjvMHuk8yjcioS3rKdhIB4fl5qqLHiQ=="}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:46:01.124909 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7c2bfd2e-f273-44ed-ace6-42b00b5e259e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for project a731b3e3815647dcba5b1144d769d0b0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:46:01.130516 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-7c2bfd2e-f273-44ed-ace6-42b00b5e259e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for user eb07ec3fdf4c4427b90a608eb9b85293 and project a731b3e3815647dcba5b1144d769d0b0. Resources: {'key_pairs'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:46:01.156462 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7c2bfd2e-f273-44ed-ace6-42b00b5e259e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.220633 Jul 26 05:46:01.157068 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3868/7677] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:46:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:46:02.267800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1938015264", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-257174733", "security_groups": [{"name": "tempest-secgroup-smoke-1025391521"}], "networks": [{"uuid": "d0930402-f1f7-41ed-aad8-6e3e7646cbc3"}]}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:46:02.278751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:02.279427 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:02.388275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.network.neutron [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] validate_networks() for [('d0930402-f1f7-41ed-aad8-6e3e7646cbc3', None, None, None, None, None)] {{(pid=119487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:46:02.891175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Flavor limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:46:02.891595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Image limits 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:46:02.892093 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Flavor pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:46:02.892498 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Image pref 0:0:0 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:46:02.892907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.virt.hardware [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:46:02.901935 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:02.902421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:02.903214 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:02.903649 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:02.925488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for project a731b3e3815647dcba5b1144d769d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:46:02.931345 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for user eb07ec3fdf4c4427b90a608eb9b85293 and project a731b3e3815647dcba5b1144d769d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:46:02.943667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Going to run 1 instances... {{(pid=119487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:46:02.947098 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:46:02.991419 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [938d2e31-82e7-412e-a2e6-082361793615] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:46:04.000282 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [938d2e31-82e7-412e-a2e6-082361793615] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 60660. Jul 26 05:46:04.005658 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0315b3c3-6d1a-4ceb-95ea-9380723b421f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.741830 Jul 26 05:46:04.006857 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3810/7678] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:46:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:46:04.019097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cb11977-55c2-426f-8705-1405785edc5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:04.020150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5cb11977-55c2-426f-8705-1405785edc5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:04.076659 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5cb11977-55c2-426f-8705-1405785edc5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:04.083604 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5cb11977-55c2-426f-8705-1405785edc5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1246 microversion: 2.1 time: 0.069399 Jul 26 05:46:04.085012 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3869/7679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:04 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:46:05.106175 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-5b3e510e-c1c9-41cf-a1ee-9125da88862d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:05.106876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-5b3e510e-c1c9-41cf-a1ee-9125da88862d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:05.165450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-5b3e510e-c1c9-41cf-a1ee-9125da88862d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:05.172829 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-5b3e510e-c1c9-41cf-a1ee-9125da88862d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1246 microversion: 2.1 time: 0.071684 Jul 26 05:46:05.173623 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3811/7680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:05 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:06.194133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f96c5196-8d84-46bb-83e6-8815532ecc59 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:06.194818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f96c5196-8d84-46bb-83e6-8815532ecc59 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:06.252765 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f96c5196-8d84-46bb-83e6-8815532ecc59 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:06.259822 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f96c5196-8d84-46bb-83e6-8815532ecc59 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1246 microversion: 2.1 time: 0.069856 Jul 26 05:46:06.260626 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3870/7681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:06 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:07.282077 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c67e9ad7-5a0b-421f-b35f-3e1d3db9c251 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:07.282717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c67e9ad7-5a0b-421f-b35f-3e1d3db9c251 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:07.344783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c67e9ad7-5a0b-421f-b35f-3e1d3db9c251 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:07.353453 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c67e9ad7-5a0b-421f-b35f-3e1d3db9c251 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1246 microversion: 2.1 time: 0.075229 Jul 26 05:46:07.354250 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3812/7682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:07 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:08.375287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:08.375910 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:08.383515 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:08.383980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:08.384752 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:08.385204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:08.448027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:08.455597 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20aad721-cc26-4816-a806-3efb1e4c96f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1250 microversion: 2.1 time: 0.084223 Jul 26 05:46:08.456408 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3871/7683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:08 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:09.478072 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:09.479022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:09.487004 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:09.487575 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:09.488355 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:09.488795 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:09.553172 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:09.560889 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2da9620-9273-4daf-9249-77ce469a11ec tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1304 microversion: 2.1 time: 0.087789 Jul 26 05:46:09.561693 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3813/7684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:09 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:10.355410 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-a2e8ebd4-a318-45cf-9a7c-d0843c7a253a req-55a9f49d-d7d3-47ed-bdad-13430fc13c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:46:10.368120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2e8ebd4-a318-45cf-9a7c-d0843c7a253a req-55a9f49d-d7d3-47ed-bdad-13430fc13c6c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:10.369390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-a2e8ebd4-a318-45cf-9a7c-d0843c7a253a req-55a9f49d-d7d3-47ed-bdad-13430fc13c6c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:10.389635 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-a2e8ebd4-a318-45cf-9a7c-d0843c7a253a req-55a9f49d-d7d3-47ed-bdad-13430fc13c6c service nova] Creating event network-changed:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h1-848886-16 Jul 26 05:46:10.394747 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-a2e8ebd4-a318-45cf-9a7c-d0843c7a253a req-55a9f49d-d7d3-47ed-bdad-13430fc13c6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048535 Jul 26 05:46:10.395369 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3872/7685] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:46:10.583450 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:10.584733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:10.591615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:10.592161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:10.592948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:10.593394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:10.766360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:10.773777 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-59938815-679c-4d8e-a8eb-e92b44dadf38 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1372 microversion: 2.1 time: 0.194369 Jul 26 05:46:10.774407 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3814/7686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:10 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:11.797105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:11.797903 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:11.804496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:11.805149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:11.805942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:11.806427 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:12.024712 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:12.032249 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0fdad384-767b-46e3-8682-a38958553f33 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1372 microversion: 2.1 time: 0.240530 Jul 26 05:46:12.032827 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3873/7687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:11 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:13.054738 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:13.055351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:13.058071 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:13.063666 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:13.064114 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:13.064876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:13.065332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:13.199544 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:13.208141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ca0ce077-baa9-467d-99e6-ab3f75623626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1372 microversion: 2.1 time: 0.158142 Jul 26 05:46:13.208718 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3815/7688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:13 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:14.229763 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:14.230419 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:14.237364 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:14.237832 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:14.238651 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:14.239112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:14.374465 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:14.382596 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-226dfcb4-c713-4684-a333-f90a5e47773e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1372 microversion: 2.1 time: 0.156774 Jul 26 05:46:14.383188 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3874/7689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:14 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:15.049073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-422921c5-c5e7-4c5d-b45a-9dce411c8939 req-b1230d32-5ed4-4de1-a0f2-d985d1584afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "name": "network-vif-plugged", "status": "completed", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:46:15.062564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-422921c5-c5e7-4c5d-b45a-9dce411c8939 req-b1230d32-5ed4-4de1-a0f2-d985d1584afe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:15.063009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-422921c5-c5e7-4c5d-b45a-9dce411c8939 req-b1230d32-5ed4-4de1-a0f2-d985d1584afe service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:15.073263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-422921c5-c5e7-4c5d-b45a-9dce411c8939 req-b1230d32-5ed4-4de1-a0f2-d985d1584afe service nova] Creating event network-vif-plugged:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h1-848886-16 Jul 26 05:46:15.078276 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-422921c5-c5e7-4c5d-b45a-9dce411c8939 req-b1230d32-5ed4-4de1-a0f2-d985d1584afe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095970 Jul 26 05:46:15.078937 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3816/7690] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:46:15.403620 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:15.404143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:15.411150 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:15.411644 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:15.412743 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:15.413200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:15.544688 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:15.552255 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d23520b9-4454-4b34-bf7d-af561a55f34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1372 microversion: 2.1 time: 0.152677 Jul 26 05:46:15.553853 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3875/7691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:15 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:16.576158 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:16.576850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:16.583154 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:16.583623 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:16.584415 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:16.584848 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:16.716431 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:16.723985 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8e632b8c-c1a8-4ac2-87fb-58a41a354cbb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1555 microversion: 2.1 time: 0.152934 Jul 26 05:46:16.725024 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3817/7692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:16 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:16.744563 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:46:16.745189 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:46:16.747198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:16.753254 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:16.753719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:16.754566 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:16.755031 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:16.888880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:46:16.897429 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d74fef07-a956-490a-b954-1b948657f279 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1555 microversion: 2.1 time: 0.156729 Jul 26 05:46:16.898006 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3876/7693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:46:16 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:46:18.923253 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-f83b3384-3a4e-4c3a-a0e2-1374245715eb req-50288162-7352-4e9a-922c-c2a3be7febb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:46:18.929118 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=10 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:46:18.935999 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f83b3384-3a4e-4c3a-a0e2-1374245715eb req-50288162-7352-4e9a-922c-c2a3be7febb3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:46:18.936551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-f83b3384-3a4e-4c3a-a0e2-1374245715eb req-50288162-7352-4e9a-922c-c2a3be7febb3 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:46:18.949173 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-f83b3384-3a4e-4c3a-a0e2-1374245715eb req-50288162-7352-4e9a-922c-c2a3be7febb3 service nova] Creating event network-changed:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h1-848886-16 Jul 26 05:46:18.954268 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-f83b3384-3a4e-4c3a-a0e2-1374245715eb req-50288162-7352-4e9a-922c-c2a3be7febb3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034732 Jul 26 05:46:18.954949 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3818/7694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:47:53.188760 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:47:53.189343 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:47:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:48:03.032019 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:48:03.032871 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:48:14.251913 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:14.252746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=32 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:14.256984 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:14.257542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:14.264723 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:14.265195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:14.265983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:14.266472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:14.290866 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.objects.instance [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lazy-loading 'flavor' on Instance uuid c3d9470a-ad1b-4db0-9775-3f6139497b18 {{(pid=119488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:48:14.470051 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-409a9bdf-d036-4e5d-b6e4-9dfe925e8a5d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18/action" status: 202 len: 0 microversion: 2.1 time: 0.219987 Jul 26 05:48:14.470725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3877/7695] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:48:14 2022] POST /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:48:14.477995 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:48:14.478831 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:48:14.479380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:14.480298 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=30 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:14.485038 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:14.485772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:14.493903 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:14.494386 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:14.495153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:14.495589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:14.634944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:14.642633 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-220e449b-f3e0-4296-8ada-1e6378daf3e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.166405 Jul 26 05:48:14.643208 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3819/7696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:14 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:15.665538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:15.666298 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:15.673846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:15.674354 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:15.675149 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:15.675609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:15.807846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:15.815486 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-73160a81-a918-4b74-831f-ef7c5821d780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.155346 Jul 26 05:48:15.816059 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3878/7697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:15 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:16.837351 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:16.838002 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:16.847686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:16.848146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:16.848937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:16.849419 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:16.857089 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 60790. Jul 26 05:48:16.857831 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 60792. Jul 26 05:48:16.984227 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:16.992718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3816a80b-4d30-48f0-91b4-83d5963fe449 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.159654 Jul 26 05:48:16.993512 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3820/7698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:16 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:18.013892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:18.014542 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:18.022082 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:18.022573 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:18.023348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:18.023799 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:18.162436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:18.171015 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8866ae57-418b-4427-9881-e3803d8d2987 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.160972 Jul 26 05:48:18.171608 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3879/7699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:18 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:19.193617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:19.194438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:19.201388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:19.201846 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:19.202660 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:19.203101 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:19.339278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:19.346939 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-511e4d57-2865-41af-b72b-dde619330ff3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.157822 Jul 26 05:48:19.347513 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3821/7700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:19 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:20.369616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:20.370270 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:20.377235 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:20.377707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:20.378533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:20.378998 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:20.513386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:20.521583 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5cf9e506-beb6-4347-a686-b9af72145bfa tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.156229 Jul 26 05:48:20.522348 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3880/7701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:20 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:21.544085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:21.544700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:21.551683 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:21.552135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:21.553773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:21.554237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:21.686502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:21.695144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-daa999a6-24c8-40dd-bc8a-df3469aab30c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.155270 Jul 26 05:48:21.695718 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3822/7702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:21 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:22.717435 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:22.717993 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:22.724320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:22.724793 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:22.726365 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:22.726830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:22.947788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:22.955404 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65312053-c3f6-4a73-b5b0-8bde8775a6ed tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.242426 Jul 26 05:48:22.955980 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3881/7703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:22 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:23.977447 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:23.978058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:23.985022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:23.985489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:23.986257 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:23.986698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:24.125094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:24.133479 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69ce3744-9657-47ae-a38a-fd29f2c80553 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.160091 Jul 26 05:48:24.134049 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3823/7704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:23 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:25.155680 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:25.156222 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:25.163931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:25.164400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:25.165185 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:25.165672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:25.296487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:25.304801 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8ced7b5a-8e55-43fe-a9da-9ee96fcd3ab3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1701 microversion: 2.1 time: 0.153145 Jul 26 05:48:25.305376 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3882/7705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:25 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:26.326240 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:26.326850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:26.333833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:26.334936 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:26.335793 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:26.336236 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:26.466196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:26.473785 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c4022248-0fdb-4cc5-b784-50260881afa0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1701 microversion: 2.1 time: 0.151537 Jul 26 05:48:26.474380 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3824/7706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:26 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:27.497285 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:27.498633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:27.508007 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:27.508841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:27.509648 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:27.510102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:27.717227 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:27.728541 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fecf25b-b481-40e3-b15b-998ec9cd4fc5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.235548 Jul 26 05:48:27.744224 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3883/7707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:27 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:28.752210 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:28.753614 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:28.762773 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:28.763711 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:28.765275 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:28.765945 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:28.906881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:28.916135 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3c016d9a-197a-4377-a489-244aacf58d34 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.167889 Jul 26 05:48:28.917829 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3825/7708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:28 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:29.510219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3b177d36-3162-411f-b197-97e057d239eb req-5f312069-aa41-4c5b-a55d-464cb8013a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "name": "network-vif-plugged", "status": "completed", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:29.532484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b177d36-3162-411f-b197-97e057d239eb req-5f312069-aa41-4c5b-a55d-464cb8013a9c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:29.533209 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b177d36-3162-411f-b197-97e057d239eb req-5f312069-aa41-4c5b-a55d-464cb8013a9c service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:29.546616 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3b177d36-3162-411f-b197-97e057d239eb req-5f312069-aa41-4c5b-a55d-464cb8013a9c service nova] Creating event network-vif-plugged:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h1-848886-16 Jul 26 05:48:29.554222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3b177d36-3162-411f-b197-97e057d239eb req-5f312069-aa41-4c5b-a55d-464cb8013a9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050020 Jul 26 05:48:29.555202 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3884/7709] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:48:29.947766 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:29.948412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:29.956329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:29.957212 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:29.958251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:29.958886 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:30.118944 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:30.131616 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-90d48dd8-55d8-425a-a69d-aab3883da4c7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.188372 Jul 26 05:48:30.149262 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3826/7710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:29 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:31.158012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:31.158882 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:31.166593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:31.167336 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:31.168423 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:31.169065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:31.354028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:31.363010 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-782f2afa-2960-488b-be28-d98744d73635 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.210323 Jul 26 05:48:31.363956 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3885/7711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:31 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:32.385963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:32.386753 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:32.393932 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:32.394416 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:32.395461 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:32.395905 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:32.560479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:32.569711 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e3009ba4-bbad-4ee5-83eb-0ce11ddf18fc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.186577 Jul 26 05:48:32.582964 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3827/7712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:32 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:33.592540 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:33.593382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:33.600845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:33.601439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:33.602955 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:33.604232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:33.770014 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:33.780317 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c961e7e8-7268-481e-9260-775b89d5e7f5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.191633 Jul 26 05:48:33.780910 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3886/7713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:33 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:34.803677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:34.804306 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:34.811830 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:34.812292 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:34.813085 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:34.813661 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:34.971769 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:34.985220 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-341ee111-8f83-4a17-8fd5-ce529119feb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.185424 Jul 26 05:48:34.986140 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3828/7714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:34 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:36.009020 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:36.009646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:36.016929 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:36.017399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:36.018207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:36.018668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:36.165454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:36.173452 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-79eb48cc-8d78-4b5c-961e-7b5785927ef0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1696 microversion: 2.1 time: 0.168453 Jul 26 05:48:36.174037 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3887/7715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:36 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:37.195448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:37.196060 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:37.203094 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:37.203545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:37.204336 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:37.204772 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:37.340353 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:37.347860 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ea06737e-ea15-49ff-83a7-03d8a9feeb5a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1678 microversion: 2.1 time: 0.156603 Jul 26 05:48:37.348438 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3829/7716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:37 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:38.370049 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:38.370611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:38.377442 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.377900 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.379098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.380088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.524436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:38.532444 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e9a20533-22dd-4245-be6a-a1c776c9dc48 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1681 microversion: 2.1 time: 0.166464 Jul 26 05:48:38.533019 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3888/7717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:38 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:38.554876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:38.555455 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:38.562441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.562899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.563662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.564103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.655039 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-efbd0e10-4747-4eba-99e2-5842bb2e3616 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18/action" status: 202 len: 0 microversion: 2.1 time: 0.104489 Jul 26 05:48:38.655579 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3830/7718] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:48:38 2022] POST /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:48:38.664315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:38.664946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:38.671372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.671842 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.672624 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:38.673074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:38.820390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:38.827989 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e60f5263-19fd-4829-b661-f9d513d3e922 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1629 microversion: 2.1 time: 0.167969 Jul 26 05:48:38.828572 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3889/7719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:38 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1629 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:39.526952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-93b95c6f-0771-40e7-855d-c81ec4f09a30 req-c7086dc8-f694-46ea-b23d-d0d5cdeef98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:39.540917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-93b95c6f-0771-40e7-855d-c81ec4f09a30 req-c7086dc8-f694-46ea-b23d-d0d5cdeef98a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:39.542040 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-93b95c6f-0771-40e7-855d-c81ec4f09a30 req-c7086dc8-f694-46ea-b23d-d0d5cdeef98a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:39.554748 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.server_external_events [req-93b95c6f-0771-40e7-855d-c81ec4f09a30 req-c7086dc8-f694-46ea-b23d-d0d5cdeef98a service nova] Unable to find a host for instance c3d9470a-ad1b-4db0-9775-3f6139497b18. Dropping event network-vif-unplugged {{(pid=119487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 05:48:39.555909 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-93b95c6f-0771-40e7-855d-c81ec4f09a30 req-c7086dc8-f694-46ea-b23d-d0d5cdeef98a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033769 Jul 26 05:48:39.557523 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3831/7720] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 05:48:39.849002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:39.850512 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:39.857531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:39.857995 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:39.858804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:39.859257 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:40.000862 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:40.008903 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-bce78c32-c7e6-4557-afd9-6d2e8baab22d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.163832 Jul 26 05:48:40.009483 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3890/7721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:39 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:41.030184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:41.030800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:41.038288 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:41.038781 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:41.039551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:41.039991 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:41.236294 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-7959e24e-73a6-4f38-81de-ea9b4136cac9 req-388e1b50-adec-4259-bc01-baff562bb9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:41.248883 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7959e24e-73a6-4f38-81de-ea9b4136cac9 req-388e1b50-adec-4259-bc01-baff562bb9fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:41.249627 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-7959e24e-73a6-4f38-81de-ea9b4136cac9 req-388e1b50-adec-4259-bc01-baff562bb9fb service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:41.263225 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-7959e24e-73a6-4f38-81de-ea9b4136cac9 req-388e1b50-adec-4259-bc01-baff562bb9fb service nova] Creating event network-changed:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h2-848886-16 Jul 26 05:48:41.270067 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-7959e24e-73a6-4f38-81de-ea9b4136cac9 req-388e1b50-adec-4259-bc01-baff562bb9fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036693 Jul 26 05:48:41.271253 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3891/7722] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:48:41.276975 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:41.285480 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5c8e7d1-0ecd-4129-a87c-57b38a47bbf7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.259155 Jul 26 05:48:41.286323 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3832/7723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:41 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:42.311370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:42.313175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:42.323330 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:42.323884 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:42.324785 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:42.325458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:42.478129 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:42.481858 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:42.488214 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3087012e-52d3-4b0a-8e42-8bd03f319b88 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.183577 Jul 26 05:48:42.488987 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3892/7724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:42 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:43.510217 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:43.510825 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:43.517881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:43.518366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:43.519140 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:43.519581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:43.675122 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:43.686007 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ee9766f2-edff-41ac-8e7b-8cb552661d01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.179690 Jul 26 05:48:43.701614 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3833/7725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:43 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:44.710444 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:44.712156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:44.718652 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=33 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:44.721404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:44.721908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:44.722938 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:44.723412 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:44.878865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:44.887433 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ee6573c1-d410-4bd2-a3ce-83af05b0bc8e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.182653 Jul 26 05:48:44.888031 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3893/7726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:44 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:48:45.909080 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:45.909696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:45.914584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=33 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:45.919425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:45.919901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:45.920689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:45.921183 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:45.967668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:48:46.100659 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:46.108386 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1552e728-3599-4d29-8b2b-58900e6c7168 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.203189 Jul 26 05:48:46.108960 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3834/7727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:45 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:47.131478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:47.132818 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:47.141417 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:47.141880 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:47.143316 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:47.143776 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:47.295991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:47.303641 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d4e87830-76af-4c39-ab28-4ce5824499a3 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.176987 Jul 26 05:48:47.304792 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3894/7728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:47 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:48.326006 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:48.326664 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:48.332951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:48.333394 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:48.334179 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:48.334625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:48.497818 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:48.506781 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2caac5be-98a7-4cba-a64a-521fb15332b8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.184979 Jul 26 05:48:48.508206 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3835/7729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:48 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:49.529478 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:49.530428 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:49.538616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:49.539526 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:49.540592 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:49.541429 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:49.732992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:49.740904 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3c66f60b-c664-4df3-9b7a-eb0e0bbef42c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.215359 Jul 26 05:48:49.742185 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3895/7730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:49 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:50.763698 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:50.764332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:50.771271 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:50.771714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:50.772910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:50.773367 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:50.905264 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:50.914025 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-de49f5a6-e4b4-4cfa-99bb-d6013cea44ef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.153598 Jul 26 05:48:50.914528 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3836/7731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:50 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:51.936198 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:51.936830 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:51.943145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:51.943617 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:51.944457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:51.945548 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:52.075940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:52.083537 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-4cdffcc8-183f-40d8-8f2a-c2a7213c1607 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.151519 Jul 26 05:48:52.084111 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3896/7732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:51 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:53.105003 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:53.105542 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:53.112479 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:53.112946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:53.113717 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:53.114170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:53.246369 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:53.254025 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f4088bfc-42a3-4a1f-9fab-494fea7d0a01 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.153536 Jul 26 05:48:53.254636 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3837/7733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:53 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:54.274538 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:54.275271 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:54.282140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:54.282656 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:54.283426 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:54.283875 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:54.421340 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:54.428809 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-993f4284-23eb-4009-b994-a027cad2c5b2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.158405 Jul 26 05:48:54.429371 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3897/7734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:54 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:55.451247 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:55.451859 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:55.458831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:55.459279 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:55.460034 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:55.460464 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:55.598826 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:55.607614 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-473609bf-250d-4928-8c62-633a09f6278e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.160219 Jul 26 05:48:55.608211 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3838/7735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:55 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:56.629666 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:56.630350 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:56.637510 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:56.637981 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:56.638816 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:56.639276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:56.771967 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:56.779879 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-349669f1-2002-4fe4-b4a9-04680d00e3dc tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.154109 Jul 26 05:48:56.780451 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3898/7736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:56 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:57.463801 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-e8b987ee-a95a-4d2c-a53f-4881c9c65a25 req-efaa0e3e-85e5-433e-806e-34f267398073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "name": "network-vif-plugged", "status": "completed", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:48:57.474311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e8b987ee-a95a-4d2c-a53f-4881c9c65a25 req-efaa0e3e-85e5-433e-806e-34f267398073 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:57.474783 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-e8b987ee-a95a-4d2c-a53f-4881c9c65a25 req-efaa0e3e-85e5-433e-806e-34f267398073 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:57.486490 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-e8b987ee-a95a-4d2c-a53f-4881c9c65a25 req-efaa0e3e-85e5-433e-806e-34f267398073 service nova] Creating event network-vif-plugged:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h2-848886-16 Jul 26 05:48:57.491895 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-e8b987ee-a95a-4d2c-a53f-4881c9c65a25 req-efaa0e3e-85e5-433e-806e-34f267398073 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031828 Jul 26 05:48:57.492519 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3839/7737] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:48:57.802815 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:57.803441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:57.811147 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:57.811615 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:57.812396 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:57.812848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:57.948024 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:57.955579 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b923ca5-699c-42c8-b00e-996bd168b872 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.156827 Jul 26 05:48:57.956081 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3899/7738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:57 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:48:58.979454 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:48:58.980164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:48:58.986913 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:58.987459 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:58.988246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:48:58.988687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:48:59.127940 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:48:59.136832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-113521d9-481d-48e5-81a3-9d778209b3a0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1687 microversion: 2.1 time: 0.163457 Jul 26 05:48:59.137247 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3840/7739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:48:58 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:49:00.158457 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:49:00.158999 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:49:00.167229 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:49:00.167689 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:49:00.168463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:49:00.168911 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:49:00.303436 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:49:00.311269 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7fd25e0c-0ea7-4cdd-b2c6-33e44140f481 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1674 microversion: 2.1 time: 0.156734 Jul 26 05:49:00.311857 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3900/7740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:49:00 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:50:45.971695 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=13 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:50:45.972557 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=37 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:50:45.976918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:50:45.977075 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:50:45.983437 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:50:45.984330 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:50:45.984905 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=15 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:50:45.985667 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=48 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:50:45.990671 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:45.991121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:45.991910 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:45.992352 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:46.019378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:50:46.055994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ca0134bf-a037-45d6-b462-e3629be5db56 req-865d38f9-b147-459b-8968-54f2f8e6cfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:50:46.066109 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca0134bf-a037-45d6-b462-e3629be5db56 req-865d38f9-b147-459b-8968-54f2f8e6cfb8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:46.066610 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ca0134bf-a037-45d6-b462-e3629be5db56 req-865d38f9-b147-459b-8968-54f2f8e6cfb8 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:46.078954 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ca0134bf-a037-45d6-b462-e3629be5db56 req-865d38f9-b147-459b-8968-54f2f8e6cfb8 service nova] Creating event network-changed:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h2-848886-16 Jul 26 05:50:46.084187 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ca0134bf-a037-45d6-b462-e3629be5db56 req-865d38f9-b147-459b-8968-54f2f8e6cfb8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118237 Jul 26 05:50:46.084798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3901/7741] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:50:46.122807 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-16171053-6055-4354-9733-4e946e41a349 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 204 len: 0 microversion: 2.1 time: 0.159579 Jul 26 05:50:46.123634 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3841/7742] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:50:45 2022] DELETE /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:50:46.133525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:50:46.134286 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:50:46.143025 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:46.143829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:46.144647 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:46.145112 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:46.336963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:50:46.345173 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-939e974f-2ee1-48d6-8bb6-0cc9e8df7d97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.217129 Jul 26 05:50:46.345752 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3902/7743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:50:46 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:50:47.367302 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:50:47.368009 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:50:47.375121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:47.375578 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:47.376354 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:47.376799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:47.644879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:50:47.652718 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d72a11e2-905e-488e-acd2-aaaa312ca640 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 200 len: 1680 microversion: 2.1 time: 0.289689 Jul 26 05:50:47.653306 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3842/7744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:50:47 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:50:48.189531 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32830. Jul 26 05:50:48.197845 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32832. Jul 26 05:50:48.257010 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3bcefe54-83c5-4839-8189-7904ec7e5c00 req-fee0acce-0224-41c4-85cb-16bb2de96628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d9470a-ad1b-4db0-9775-3f6139497b18", "name": "network-vif-deleted", "tag": "c4ad5d8a-4722-4d8a-89f6-a1e5953482a5"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:50:48.268641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3bcefe54-83c5-4839-8189-7904ec7e5c00 req-fee0acce-0224-41c4-85cb-16bb2de96628 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:48.269108 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3bcefe54-83c5-4839-8189-7904ec7e5c00 req-fee0acce-0224-41c4-85cb-16bb2de96628 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:48.281240 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3bcefe54-83c5-4839-8189-7904ec7e5c00 req-fee0acce-0224-41c4-85cb-16bb2de96628 service nova] Creating event network-vif-deleted:c4ad5d8a-4722-4d8a-89f6-a1e5953482a5 for instance c3d9470a-ad1b-4db0-9775-3f6139497b18 on n-h2-848886-16 Jul 26 05:50:48.286474 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3bcefe54-83c5-4839-8189-7904ec7e5c00 req-fee0acce-0224-41c4-85cb-16bb2de96628 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112705 Jul 26 05:50:48.287094 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3903/7745] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:50:48.675632 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:50:48.676245 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: c3d9470a-ad1b-4db0-9775-3f6139497b18] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:50:48.683527 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:48.683901 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:48.684668 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:50:48.685110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:50:48.698680 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] HTTP exception thrown: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Request method failure captured: Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 HTTP/1.1 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33-TDtRATlgSaOT97Ekrou43RTgdZv69cYLaAvZTYsDUxH-STDAL1gMp9vZO9ipwz-8Bx388Jj06ORg9kVQk1e8WKuzZrDesnd1tsODLesdSAumrZhPbsFmvSxylaGfDIvcThAmB2ZbCsRPrPGeEjQwhJ9XGdvJJx39JCUsiioTzPEI Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a731b3e3815647dcba5b1144d769d0b0 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestShelveInstance-222913963 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestShelveInstance-222913963 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a731b3e3815647dcba5b1144d769d0b0 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestShelveInstance-222913963 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestShelveInstance-222913963-project Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: eb07ec3fdf4c4427b90a608eb9b85293 Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestShelveInstance-222913963-project Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'c3d9470a-ad1b-4db0-9775-3f6139497b18'} Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:50:48.700296 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Returning 404 to user: Instance c3d9470a-ad1b-4db0-9775-3f6139497b18 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8e902384-04b3-47c5-899f-cab79f53cbb1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18" status: 404 len: 111 microversion: 2.1 time: 0.030075 Jul 26 05:50:48.705284 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3843/7746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:50:48 2022] GET /compute/v2.1/servers/c3d9470a-ad1b-4db0-9775-3f6139497b18 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:50:48.866865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1b6adf53-b57c-4c5f-a29b-2dad26296594 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '.version_select at 0x7f38b50a4430>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:50:48.872631 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b6adf53-b57c-4c5f-a29b-2dad26296594 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [9cddab06-3356-469c-8a5c-5a060558a200] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:50:49.880751 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b6adf53-b57c-4c5f-a29b-2dad26296594 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [9cddab06-3356-469c-8a5c-5a060558a200] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32840. Jul 26 05:50:49.906254 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1b6adf53-b57c-4c5f-a29b-2dad26296594 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-257174733" status: 202 len: 0 microversion: 2.1 time: 1.043935 Jul 26 05:50:49.906845 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3904/7747] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 26 05:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-257174733 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:50:49.931590 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2a2b5335-49a9-4a0c-8ced-e1fd62ad8a45 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'create', calling method: .version_select at 0x7f38b5bd9550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1940637321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJydHvf+B75Xya4/MWXbmoYGy9daI3Eocf/eDW0A6pOgJBJeSmEMFHU0nasYZnaAy8L5k3zN+y2h8vcZDSYIfjuJErtGZ2Jyd2MAXWdbEjtgvAfAPPVRcWMmAePIiaHeeQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:50:49.949340 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2a2b5335-49a9-4a0c-8ced-e1fd62ad8a45 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for project a731b3e3815647dcba5b1144d769d0b0. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:50:49.955272 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-2a2b5335-49a9-4a0c-8ced-e1fd62ad8a45 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for user eb07ec3fdf4c4427b90a608eb9b85293 and project a731b3e3815647dcba5b1144d769d0b0. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:50:49.982107 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2a2b5335-49a9-4a0c-8ced-e1fd62ad8a45 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054499 Jul 26 05:50:49.982745 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3844/7748] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:50:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:51:06.267965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:06.268804 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:06.273159 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1346830597", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1940637321", "security_groups": [{"name": "tempest-secgroup-smoke-2073572304"}], "networks": [{"uuid": "d0930402-f1f7-41ed-aad8-6e3e7646cbc3"}], "block_device_mapping_v2": [{"uuid": "dd37a44e-7bb7-47e6-be9b-b6847608caec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:51:06.387385 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] validate_networks() for [('d0930402-f1f7-41ed-aad8-6e3e7646cbc3', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:51:06.801233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:51:06.801678 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:51:06.802197 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:51:06.802633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:51:06.803097 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:51:06.812626 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:06.813099 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:06.813919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:06.814405 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:06.832187 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for project a731b3e3815647dcba5b1144d769d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:51:06.837925 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Getting quotas for user eb07ec3fdf4c4427b90a608eb9b85293 and project a731b3e3815647dcba5b1144d769d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:51:06.897055 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:51:06.899274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd37a44e-7bb7-47e6-be9b-b6847608caec',volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:51:07.022491 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [458ba3fd-c98e-435b-a229-9130343269b3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:51:08.030201 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [458ba3fd-c98e-435b-a229-9130343269b3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33002. Jul 26 05:51:08.034102 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0df5f718-7f6a-4ee6-b69c-7ce25fe05c85 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.767936 Jul 26 05:51:08.034798 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3905/7749] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:51:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:51:08.043837 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:08.044618 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:08.045335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:08.050100 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-91b5f40b-f8ac-4ecb-87cf-9eab59c0fb0b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:08.050843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-91b5f40b-f8ac-4ecb-87cf-9eab59c0fb0b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:08.108552 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-91b5f40b-f8ac-4ecb-87cf-9eab59c0fb0b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:08.115323 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-91b5f40b-f8ac-4ecb-87cf-9eab59c0fb0b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1089 microversion: 2.1 time: 0.073561 Jul 26 05:51:08.115880 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3845/7750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:08 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:09.136746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-170093ee-fc17-4cd5-b5a2-15464cb1aae6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:09.137406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-170093ee-fc17-4cd5-b5a2-15464cb1aae6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:09.196742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-170093ee-fc17-4cd5-b5a2-15464cb1aae6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:09.204466 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-170093ee-fc17-4cd5-b5a2-15464cb1aae6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1089 microversion: 2.1 time: 0.072606 Jul 26 05:51:09.205032 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3906/7751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:09 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:10.225675 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-eb7f2cec-5de6-4a58-b52d-62c2c954edef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:10.226587 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-eb7f2cec-5de6-4a58-b52d-62c2c954edef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:10.292630 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-eb7f2cec-5de6-4a58-b52d-62c2c954edef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:10.299950 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-eb7f2cec-5de6-4a58-b52d-62c2c954edef tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1089 microversion: 2.1 time: 0.078535 Jul 26 05:51:10.300546 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3846/7752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:10 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:11.321224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8560e0cd-0b62-40b7-90d7-a0837aa3cebb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:11.321844 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8560e0cd-0b62-40b7-90d7-a0837aa3cebb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:11.375906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8560e0cd-0b62-40b7-90d7-a0837aa3cebb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:11.382568 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8560e0cd-0b62-40b7-90d7-a0837aa3cebb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1089 microversion: 2.1 time: 0.065194 Jul 26 05:51:11.383137 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3907/7753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:11 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:12.403619 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:12.404237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:12.411338 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:12.411800 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:12.412646 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:12.413102 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:12.481070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:12.488932 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-1707f4aa-1f16-4bd0-b4eb-18d05a7f6044 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1139 microversion: 2.1 time: 0.089517 Jul 26 05:51:12.489534 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3847/7754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:12 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:13.512052 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:13.513520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:13.523877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:13.524552 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:13.525949 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:13.526773 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:13.627501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:13.635248 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2ee78a36-d332-4dc6-bd0d-e2ee58257a70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1205 microversion: 2.1 time: 0.128074 Jul 26 05:51:13.635835 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3908/7755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:13 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1205 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:14.155328 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:51:14.155880 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:51:14.494642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-d60d5a36-8512-4e6e-9c45-0de62d97922b req-95dc47f2-d76c-4942-94bb-90533cdf5e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:51:14.517549 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d60d5a36-8512-4e6e-9c45-0de62d97922b req-95dc47f2-d76c-4942-94bb-90533cdf5e33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:14.518222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-d60d5a36-8512-4e6e-9c45-0de62d97922b req-95dc47f2-d76c-4942-94bb-90533cdf5e33 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:14.531563 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-d60d5a36-8512-4e6e-9c45-0de62d97922b req-95dc47f2-d76c-4942-94bb-90533cdf5e33 service nova] Creating event network-changed:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:51:14.540478 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-d60d5a36-8512-4e6e-9c45-0de62d97922b req-95dc47f2-d76c-4942-94bb-90533cdf5e33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054212 Jul 26 05:51:14.541760 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3848/7756] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:51:14.657302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:14.657941 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:14.665682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:14.666195 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:14.667009 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:14.668000 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:14.920779 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:14.929091 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-e46a2dac-3e2a-404b-8e48-fd24d7249745 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1273 microversion: 2.1 time: 0.275893 Jul 26 05:51:14.930182 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3909/7757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:14 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:51:15.953731 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:15.954487 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:15.960872 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:15.961332 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:15.962111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:15.962582 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:16.102509 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:16.111077 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77cd9cac-7f5c-416a-b933-d3ba84897ce1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1273 microversion: 2.1 time: 0.163413 Jul 26 05:51:16.111739 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3849/7758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:15 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:17.131992 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:17.132714 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:17.135572 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:17.141509 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:17.142133 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:17.143088 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:17.143663 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:17.285394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:17.295410 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-93546b91-e4f9-438c-9c8e-2acb718ccb64 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1273 microversion: 2.1 time: 0.167352 Jul 26 05:51:17.296258 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3910/7759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:17 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:18.317400 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:18.318025 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:18.325167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:18.325625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:18.326422 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:18.326873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:18.456952 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:18.465221 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a2234bd9-2d72-4ea1-8b61-ced732442ba0 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.151529 Jul 26 05:51:18.465789 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3850/7760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:18 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:19.486637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:19.487269 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:19.493583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:19.494054 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:19.494865 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:19.495320 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:19.625946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:19.633601 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9f403e80-fbdd-48cd-a165-8ead2135681c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.150888 Jul 26 05:51:19.634185 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3911/7761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:19 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:20.656359 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:20.656891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:20.659700 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=4 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:20.665180 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:20.665638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:20.666417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:20.666854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:20.805278 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:20.812954 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-69e42fa0-e632-4408-940f-6b6e85939626 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.161552 Jul 26 05:51:20.813526 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3851/7762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:20 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:21.833982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:21.834740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:21.837456 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=10 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:51:21.844006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:21.844506 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:21.845291 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:21.845746 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:21.981174 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:21.988656 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cfd3fddd-6646-4d90-b86c-4ee050e4be36 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.158598 Jul 26 05:51:21.989230 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3912/7763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:21 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:23.008456 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:23.009073 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:23.016958 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:23.017417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:23.018200 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:23.018644 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:23.151314 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:23.159211 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-6b250de7-38dc-4a1d-887d-b202d0857415 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.154654 Jul 26 05:51:23.159813 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3852/7764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:23 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:24.179857 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:24.180525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:24.193578 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:24.194215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:24.195017 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:24.195479 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:24.327877 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:24.335726 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ed24d10d-ad7e-41b3-a391-bd706185b926 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.159847 Jul 26 05:51:24.336299 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3913/7765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:24 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:25.356689 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:25.357329 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:25.364311 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:25.364763 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:25.365520 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:25.365961 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:25.495631 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:25.503876 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-43cb2dff-1598-4b18-969a-e8a30013aa0e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.151406 Jul 26 05:51:25.504451 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3853/7766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:25 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:26.524958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:26.525586 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:26.533439 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:26.533901 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:26.534715 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:26.535177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:26.671891 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:26.679745 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f72d404f-702e-49f9-b86c-09d1f88dfd2f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.158720 Jul 26 05:51:26.680327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3914/7767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:26 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:27.701274 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:27.701876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:27.708888 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:27.709339 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:27.710096 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:27.710559 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:27.846762 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:27.854457 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-db1cc381-7b59-4d1e-82a1-3f2a5a60a001 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.157656 Jul 26 05:51:27.855025 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3854/7768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:27 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:28.319917 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2a3dc48e-bd44-4931-bdd4-6ec78f073202 req-af402f7e-c61e-47fa-baac-29b8b280ee87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "name": "network-vif-plugged", "status": "completed", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:51:28.330742 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2a3dc48e-bd44-4931-bdd4-6ec78f073202 req-af402f7e-c61e-47fa-baac-29b8b280ee87 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:28.331210 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2a3dc48e-bd44-4931-bdd4-6ec78f073202 req-af402f7e-c61e-47fa-baac-29b8b280ee87 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:28.346068 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2a3dc48e-bd44-4931-bdd4-6ec78f073202 req-af402f7e-c61e-47fa-baac-29b8b280ee87 service nova] Creating event network-vif-plugged:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:51:28.351112 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2a3dc48e-bd44-4931-bdd4-6ec78f073202 req-af402f7e-c61e-47fa-baac-29b8b280ee87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087274 Jul 26 05:51:28.351718 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3915/7769] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:51:28.875922 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:28.876533 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:28.883584 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:28.884039 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:28.884805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:28.885243 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:29.017303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:29.024872 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8f2d1334-8afc-474c-b4a8-78ba92537aff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1261 microversion: 2.1 time: 0.153561 Jul 26 05:51:29.025440 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3855/7770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:28 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:30.047224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:30.047936 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:30.054525 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:30.054991 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:30.055767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:30.056224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:30.194015 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:30.202553 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a56edffb-e1f1-42ad-9485-6c5a687d25eb tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1444 microversion: 2.1 time: 0.161058 Jul 26 05:51:30.203122 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3916/7771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:30 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:30.223463 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:51:30.227181 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:51:30.235012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:30.235466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:30.236237 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:30.236677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:30.373156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:51:30.380877 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a7cdd903-0082-4bb3-9e09-93dcd7d49bd5 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1444 microversion: 2.1 time: 0.162361 Jul 26 05:51:30.381446 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3856/7772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:51:30 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:51:32.361633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-ab7a7645-716f-4099-957f-03f08e2d8e17 req-2f2e5cc9-b55c-462c-bbfe-f61dc90b9de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:51:32.372568 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ab7a7645-716f-4099-957f-03f08e2d8e17 req-2f2e5cc9-b55c-462c-bbfe-f61dc90b9de2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:51:32.373028 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-ab7a7645-716f-4099-957f-03f08e2d8e17 req-2f2e5cc9-b55c-462c-bbfe-f61dc90b9de2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:51:32.384105 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-ab7a7645-716f-4099-957f-03f08e2d8e17 req-2f2e5cc9-b55c-462c-bbfe-f61dc90b9de2 service nova] Creating event network-changed:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:51:32.389976 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-ab7a7645-716f-4099-957f-03f08e2d8e17 req-2f2e5cc9-b55c-462c-bbfe-f61dc90b9de2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031979 Jul 26 05:51:32.390872 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3917/7773] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:53:03.046183 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:53:03.046780 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:53:29.747079 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:53:29.747979 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:53:29.748547 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=28 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:53:29.749287 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=56 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:53:29.753316 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:53:29.753876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:29.762117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:29.762117 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:29.762785 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:29.763233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:29.790304 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.objects.instance [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lazy-loading 'flavor' on Instance uuid d32cd790-f85c-4355-b239-f924b9a17dd9 {{(pid=119487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:53:29.862378 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8d2d9b2a-00c0-44f8-8b80-b89183cdacf1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.117087 Jul 26 05:53:29.862978 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3857/7774] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:53:29 2022] POST /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:53:29.869810 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 05:53:29.871299 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 05:53:29.872070 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:53:29.873037 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=54 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:53:29.877940 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:29.878846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:29.887065 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:29.887531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:29.888314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:29.888769 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:30.026110 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:30.033706 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-674c14fb-6137-4e1e-963f-c3987c46ebff tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.166125 Jul 26 05:53:30.034297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3918/7775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:29 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:31.056606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:31.057233 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:31.067363 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:31.067821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:31.068589 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:31.069032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:31.074299 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33136. Jul 26 05:53:31.078169 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33134. Jul 26 05:53:31.208035 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:31.216256 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-ed07d77a-985b-4b35-9670-64e816881f58 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.164658 Jul 26 05:53:31.216827 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3858/7776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:31 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:32.238918 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:32.239545 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:32.249968 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:32.250492 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:32.251282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:32.251740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:32.256047 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33142. Jul 26 05:53:32.257039 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33144. Jul 26 05:53:32.394386 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:32.402952 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-87c0c529-f246-450c-aaf7-6a668f74c27c tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.167982 Jul 26 05:53:32.403522 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3919/7777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:32 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:33.424877 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:33.425558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:33.433231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:33.433692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:33.434510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:33.434956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:33.567946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:33.577453 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-346dfd77-aa2c-4174-9cbb-bac0a8568780 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.156667 Jul 26 05:53:33.578027 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3859/7778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:33 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:34.603220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:34.603850 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:34.610942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:34.611414 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:34.612201 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:34.612660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:34.744682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:34.752237 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7d6963bf-af66-4ed7-93a2-a333ea537684 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.153642 Jul 26 05:53:34.752804 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3920/7779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:34 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:35.773811 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:35.774444 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:35.781366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:35.781821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:35.782617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:35.783050 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:35.917164 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:35.924874 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-3cb93b55-a1e7-47a4-8926-4b4d7dfff3c6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.155083 Jul 26 05:53:35.925392 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3860/7780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:35 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:36.947720 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:36.948341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:36.955233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:36.955695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:36.956468 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:36.956919 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:37.091740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:37.099336 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-5464c51f-7cdc-48a9-8812-9bdf05514486 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.156029 Jul 26 05:53:37.099902 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3921/7781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:36 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:38.120622 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:38.121417 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:38.128474 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:38.128927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:38.129687 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:38.130125 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:38.260502 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:38.268144 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a8387938-1ba7-4840-b611-144f39d3aece tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.151436 Jul 26 05:53:38.268710 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3861/7782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:38 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:39.289607 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:39.290261 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:39.297204 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:39.297672 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:39.298502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:39.298961 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:39.432036 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:39.439715 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8c2a86b5-d3f0-4e0a-9991-9d8335b365ea tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.154637 Jul 26 05:53:39.440297 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3922/7783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:39 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:40.461065 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:40.461678 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:40.468960 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:40.469414 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:40.470207 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:40.470650 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:40.607977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:40.615586 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c1ecd0b7-d258-445d-b884-cdfda2b4acb8 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.158609 Jul 26 05:53:40.616861 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3862/7784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:40 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:41.637908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:41.638562 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:41.645671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:41.646141 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:41.646958 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:41.647418 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:41.782533 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:41.790292 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-fc96ae90-edaa-4318-9df7-02b7d57bd6e6 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.156303 Jul 26 05:53:41.790857 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3923/7785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:41 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:53:42.812596 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:42.813231 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:42.820586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:42.821086 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:42.821900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:42.822385 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:42.966805 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:42.974517 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-784e1085-5948-4235-93a0-d3a122d45a0f tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.165967 Jul 26 05:53:42.975082 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3863/7786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:42 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:43.996485 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:43.997107 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:44.004081 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.004541 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.005348 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.005801 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.140006 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:44.148705 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c998991b-e682-458b-aa17-a32a9b145c51 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1570 microversion: 2.1 time: 0.156024 Jul 26 05:53:44.149516 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3924/7787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:43 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:44.170911 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:53:44.171478 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:44.178469 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.179850 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.180627 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.181074 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.256484 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9143849c-9506-4b3c-a607-a253bca61385 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "POST /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.089443 Jul 26 05:53:44.257013 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3864/7788] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:53:44 2022] POST /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:53:44.265355 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:44.265989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:44.272989 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.273464 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.274280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.274735 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.416501 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:44.424243 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ceb38251-3932-4cd9-88c4-c4d50645c3a4 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1518 microversion: 2.1 time: 0.162889 Jul 26 05:53:44.424821 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3925/7789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:44 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:44.871186 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-277443a8-ec7d-4132-a7e9-ab670f536855 req-504b31cb-dc33-48a8-b63e-54de36838772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "name": "network-vif-unplugged", "status": "completed", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:53:44.880758 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-277443a8-ec7d-4132-a7e9-ab670f536855 req-504b31cb-dc33-48a8-b63e-54de36838772 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:44.881335 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-277443a8-ec7d-4132-a7e9-ab670f536855 req-504b31cb-dc33-48a8-b63e-54de36838772 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:44.895161 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.compute.server_external_events [req-277443a8-ec7d-4132-a7e9-ab670f536855 req-504b31cb-dc33-48a8-b63e-54de36838772 service nova] Unable to find a host for instance d32cd790-f85c-4355-b239-f924b9a17dd9. Dropping event network-vif-unplugged {{(pid=119487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 05:53:44.896322 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-277443a8-ec7d-4132-a7e9-ab670f536855 req-504b31cb-dc33-48a8-b63e-54de36838772 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029127 Jul 26 05:53:44.897085 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3865/7790] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 05:53:45.447471 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:45.448100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:45.455120 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:45.455590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:45.456376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:45.456835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:45.598567 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:45.607094 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-34d69504-cbb2-484f-91b7-5e20c84db34a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1520 microversion: 2.1 time: 0.164410 Jul 26 05:53:45.608003 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3926/7791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:45 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:46.633163 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:46.633806 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:46.641005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:46.641466 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:46.642276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:46.642733 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:46.779809 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:46.787927 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-715ee93e-8a25-4bff-ac0c-be67cf5ff0b1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1520 microversion: 2.1 time: 0.158877 Jul 26 05:53:46.789239 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3866/7792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:46 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:47.810950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:47.811682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:47.818718 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:47.819180 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:47.820616 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:47.821063 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:47.961274 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:47.969379 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-68cf535d-c6a2-4b3d-9063-96d66e1bc35a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1520 microversion: 2.1 time: 0.162231 Jul 26 05:53:47.969977 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3927/7793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:47 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:48.992030 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:48.992645 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:48.999719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:49.000110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:49.000917 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:49.001308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:49.135399 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:49.143190 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-b10b55da-143f-4bd8-bef9-25bc62739c6e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1520 microversion: 2.1 time: 0.155813 Jul 26 05:53:49.143766 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3867/7794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:48 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:50.164434 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:50.165243 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:50.172511 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:50.173002 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:50.173792 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:50.174275 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:50.409932 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:50.418522 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-63d746ed-cb33-4095-8de1-ce0e292fbe3a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.257930 Jul 26 05:53:50.419121 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3928/7795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:50 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:51.439876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:51.440488 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:51.447686 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:51.448136 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:51.448899 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:51.449337 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:51.586370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:51.594423 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8dc07e7a-68fd-4418-b5e9-d429c8c1143d tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.158474 Jul 26 05:53:51.594994 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3868/7796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:51 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:52.615670 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:52.616293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:52.624068 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:52.624535 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:52.625346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:52.625829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:52.763032 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:52.770662 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-2fc0c2c9-da70-408e-a055-091dcae7cad2 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.158870 Jul 26 05:53:52.771237 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3929/7797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:52 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:53.792647 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:53.793256 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:53.800242 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:53.800692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:53.801448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:53.801885 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:53.938956 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:53.947263 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-30a62927-b120-4adc-919a-47dbb7100a35 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.157964 Jul 26 05:53:53.947842 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3869/7798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:53 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:54.969346 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:54.969978 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:54.977041 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:54.977755 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:54.978349 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:54.978846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:55.111732 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:55.120007 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-af3993cb-de7d-4d2f-bd21-f7149c09fd37 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.154613 Jul 26 05:53:55.120589 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3930/7799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:54 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:56.140946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:56.141642 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:56.148681 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:56.149141 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:56.150500 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:56.150948 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:56.289027 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:56.296881 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c28f17ec-d946-4e82-8893-2cfa8fa9898b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.159920 Jul 26 05:53:56.297456 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3870/7800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:56 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:57.318404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:57.319034 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:57.326100 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:57.326591 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:57.327372 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:57.327829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:57.455582 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:57.463936 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-efe2aa3c-053d-4fde-aa4b-7c10f96cd066 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.149515 Jul 26 05:53:57.464505 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3931/7801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:57 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:58.484972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:58.485873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:58.493573 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:58.494185 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:58.494974 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:58.495441 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:58.499580 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:53:58.630412 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:58.638141 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-0cbbd675-f082-4a41-a8fd-42ec929e03f1 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.157248 Jul 26 05:53:58.638751 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3871/7802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:58 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:53:59.659496 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:53:59.660145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:53:59.667943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:59.668404 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:59.669188 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:53:59.669637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:53:59.815322 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:53:59.823301 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-43cdd67e-cac6-4bff-8246-b6c9c224e4de tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.167667 Jul 26 05:53:59.823881 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3932/7803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:53:59 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:54:00.845313 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:54:00.846036 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:54:00.848750 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=33 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:54:00.854309 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:00.854780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:00.855565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:00.856012 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:00.979287 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-79c015ae-6ebb-4f87-930e-bf91e2d9df83 req-32dbca27-21f7-4280-a396-6607bf6a22a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "name": "network-vif-plugged", "status": "completed", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:54:00.986855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=31 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:54:00.990906 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-79c015ae-6ebb-4f87-930e-bf91e2d9df83 req-32dbca27-21f7-4280-a396-6607bf6a22a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:00.991370 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-79c015ae-6ebb-4f87-930e-bf91e2d9df83 req-32dbca27-21f7-4280-a396-6607bf6a22a2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:00.998019 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:54:01.003366 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=91 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:54:01.014608 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-87d20170-e3a9-4689-85f7-7a935c91b6c9 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.173151 Jul 26 05:54:01.015145 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3872/7804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:54:00 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:54:01.017023 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-79c015ae-6ebb-4f87-930e-bf91e2d9df83 req-32dbca27-21f7-4280-a396-6607bf6a22a2 service nova] Creating event network-vif-plugged:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:54:01.031056 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-79c015ae-6ebb-4f87-930e-bf91e2d9df83 req-32dbca27-21f7-4280-a396-6607bf6a22a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055872 Jul 26 05:54:01.031811 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3933/7805] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:54:02.035964 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:54:02.036572 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:54:02.043146 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:02.043607 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:02.044357 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:02.044799 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:02.185617 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:54:02.193404 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38705657-88d4-414c-9417-d5d14382dd66 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1576 microversion: 2.1 time: 0.161499 Jul 26 05:54:02.194066 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3873/7806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:54:02 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:54:03.216604 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:54:03.217313 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:54:03.223646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:03.224115 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:03.224895 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:54:03.225357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:54:03.361273 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:54:03.369871 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-9796ca12-2521-488e-bfbc-b69fc515aa70 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1563 microversion: 2.1 time: 0.158689 Jul 26 05:54:03.370510 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3934/7807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:54:03 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:19.704553 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=3 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:19.705963 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=16 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:19.708588 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:19.709740 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=7 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:19.711308 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:19.711876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:19.713970 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d7a7d4d6-5ad4-4dc8-9cd7-3750f13cb210 req-a8dc2e84-3ec7-49f3-83c4-00205eef0b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:19.720684 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:19.721526 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:19.722712 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:19.723812 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:19.724233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d7a7d4d6-5ad4-4dc8-9cd7-3750f13cb210 req-a8dc2e84-3ec7-49f3-83c4-00205eef0b2a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:19.724693 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d7a7d4d6-5ad4-4dc8-9cd7-3750f13cb210 req-a8dc2e84-3ec7-49f3-83c4-00205eef0b2a service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:19.741585 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d7a7d4d6-5ad4-4dc8-9cd7-3750f13cb210 req-a8dc2e84-3ec7-49f3-83c4-00205eef0b2a service nova] Creating event network-changed:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:55:19.748170 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d7a7d4d6-5ad4-4dc8-9cd7-3750f13cb210 req-a8dc2e84-3ec7-49f3-83c4-00205eef0b2a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041574 Jul 26 05:55:19.749242 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3935/7808] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:55:19.764070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:55:19.849892 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7d55c0bb-cf82-4a84-801c-e39e11388e97 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 204 len: 0 microversion: 2.1 time: 0.147267 Jul 26 05:55:19.850852 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3874/7809] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 05:55:19 2022] DELETE /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:55:19.859705 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:19.860794 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:19.868105 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:19.868702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:19.869593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:19.870167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:20.025279 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:20.033462 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ebbee854-25e0-40a9-8ad4-98ea3a91a950 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.177960 Jul 26 05:55:20.034063 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3936/7810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:19 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:55:21.055970 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:21.056728 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:21.064674 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:21.065126 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:21.065902 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:21.066366 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:21.203643 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:21.211936 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-7ee937dd-14e7-4ea9-b1ef-689812d7513b tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1569 microversion: 2.1 time: 0.160782 Jul 26 05:55:21.212522 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3875/7811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:21 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:21.816190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-9dc4d8d7-1d88-42dd-9bc8-09d507c4fb7e req-e97f2deb-7950-40cd-85cf-33ff38e03b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32cd790-f85c-4355-b239-f924b9a17dd9", "name": "network-vif-deleted", "tag": "8a23e847-27f1-4f5d-bd84-4fb77e410f62"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:21.827003 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9dc4d8d7-1d88-42dd-9bc8-09d507c4fb7e req-e97f2deb-7950-40cd-85cf-33ff38e03b17 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:21.827441 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-9dc4d8d7-1d88-42dd-9bc8-09d507c4fb7e req-e97f2deb-7950-40cd-85cf-33ff38e03b17 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:21.840810 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-9dc4d8d7-1d88-42dd-9bc8-09d507c4fb7e req-e97f2deb-7950-40cd-85cf-33ff38e03b17 service nova] Creating event network-vif-deleted:8a23e847-27f1-4f5d-bd84-4fb77e410f62 for instance d32cd790-f85c-4355-b239-f924b9a17dd9 on n-h1-848886-16 Jul 26 05:55:21.845944 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-9dc4d8d7-1d88-42dd-9bc8-09d507c4fb7e req-e97f2deb-7950-40cd-85cf-33ff38e03b17 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033469 Jul 26 05:55:21.846581 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3937/7812] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:55:22.234719 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:22.235377 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:22.243658 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:22.244121 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:22.244977 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:22.245423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:22.313741 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:22.322245 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bc2bc434-f5f0-4e34-86d1-8f93c755075a tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1220 microversion: 2.1 time: 0.091409 Jul 26 05:55:22.322825 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3876/7813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:22 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:23.345060 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:23.345786 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:23.353211 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:23.353686 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:23.354502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:23.354965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:23.419660 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:23.428113 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f286eb9b-6cf8-4806-9c3a-67e3a750dc71 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1220 microversion: 2.1 time: 0.088085 Jul 26 05:55:23.428708 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3938/7814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:23 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:24.449551 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:24.450223 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:24.458655 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:24.459111 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:24.459880 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:24.460319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:24.528047 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:24.535864 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-4b9545cf-304e-4997-a8d7-9d73c6cadfab tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1220 microversion: 2.1 time: 0.090170 Jul 26 05:55:24.536510 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3877/7815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:24 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:25.557472 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:25.558390 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:25.565343 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:25.565823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:25.566646 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:25.567167 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:25.631199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb07ec3fdf4c4427b90a608eb9b85293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a731b3e3815647dcba5b1144d769d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:25.638963 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-d7957e75-556f-4ed1-8ceb-4abf57f4d124 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 200 len: 1220 microversion: 2.1 time: 0.085407 Jul 26 05:55:25.639546 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3939/7816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:25 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:26.660317 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:26.661628 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] [instance: d32cd790-f85c-4355-b239-f924b9a17dd9] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:26.669182 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:26.669638 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:26.670443 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:26.670887 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:26.686128 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] HTTP exception thrown: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Request method failure captured: Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 HTTP/1.1 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi33-TDtRATlgSaOT97Ekrou43RTgdZv69cYLaAvZTYsDUxH-STDAL1gMp9vZO9ipwz-8Bx388Jj06ORg9kVQk1e8WKuzZrDesnd1tsODLesdSAumrZhPbsFmvSxylaGfDIvcThAmB2ZbCsRPrPGeEjQwhJ9XGdvJJx39JCUsiioTzPEI Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a731b3e3815647dcba5b1144d769d0b0 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestShelveInstance-222913963 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a731b3e3815647dcba5b1144d769d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestShelveInstance-222913963 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a731b3e3815647dcba5b1144d769d0b0 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestShelveInstance-222913963 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestShelveInstance-222913963-project Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: eb07ec3fdf4c4427b90a608eb9b85293 Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestShelveInstance-222913963-project Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': 'd32cd790-f85c-4355-b239-f924b9a17dd9'} Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:55:26.687827 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Returning 404 to user: Instance d32cd790-f85c-4355-b239-f924b9a17dd9 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-8b4c6821-9394-4b62-b651-b9ccfebbd18e tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9" status: 404 len: 111 microversion: 2.1 time: 0.032940 Jul 26 05:55:26.692112 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3878/7817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:26 2022] GET /compute/v2.1/servers/d32cd790-f85c-4355-b239-f924b9a17dd9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:55:26.869671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0d9487cd-c127-4a91-a2bf-1b70304d91e7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] Calling method '.version_select at 0x7f38b44a1dc0>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:26.890789 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0d9487cd-c127-4a91-a2bf-1b70304d91e7 tempest-TestShelveInstance-222913963 tempest-TestShelveInstance-222913963-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1940637321" status: 202 len: 0 microversion: 2.1 time: 0.024754 Jul 26 05:55:26.895936 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3940/7818] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Jul 26 05:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1940637321 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:55:44.449907 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:44.450677 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:44.646676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-600f79fd-43b2-4bfc-a1f1-b6c6eb278380 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Action: 'create', calling method: .version_select at 0x7f38b54a2430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1897903219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGRbYxEin0CUXW4knN4SCPGSwtb7x856NKKQrjpsog53V4oYAnm677/WD++M3VEnmSB8arhr4f1p7N31vY4fBEKh79WENGWaHkdqXJazh332sgcNQFt6Cc8d7VWtSE1FQ=="}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:44.664022 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-600f79fd-43b2-4bfc-a1f1-b6c6eb278380 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for project a1ad85b804f1488c92c34f953f09ccff. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:55:44.670360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.quota [None req-600f79fd-43b2-4bfc-a1f1-b6c6eb278380 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for user a2f9dcb0e1304bd0badd794fe40c1284 and project a1ad85b804f1488c92c34f953f09ccff. Resources: {'key_pairs'} {{(pid=119487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:55:44.701049 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-600f79fd-43b2-4bfc-a1f1-b6c6eb278380 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.256274 Jul 26 05:55:44.701666 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3879/7819] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Jul 26 05:55:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:55:45.762916 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=22 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:45.768219 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:45.774379 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-31045880", "imageRef": "33ab09be-5eb6-45a4-ae6c-563cf5c54e5b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1897903219", "security_groups": [{"name": "tempest-secgroup-smoke-1806693898"}], "networks": [{"uuid": "73ae6645-3315-40ac-bbd1-053977045aec"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:46.027683 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] validate_networks() for [('73ae6645-3315-40ac-bbd1-053977045aec', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:55:46.415846 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:55:46.416282 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:55:46.416767 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:55:46.417190 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:55:46.417614 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:55:46.427315 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:46.427864 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:46.428674 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:46.429127 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:46.447295 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for project a1ad85b804f1488c92c34f953f09ccff. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:55:46.452728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for user a2f9dcb0e1304bd0badd794fe40c1284 and project a1ad85b804f1488c92c34f953f09ccff. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:55:46.465700 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:55:46.468019 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33ab09be-5eb6-45a4-ae6c-563cf5c54e5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:55:46.513203 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [458ba3fd-c98e-435b-a229-9130343269b3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:55:47.524310 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [458ba3fd-c98e-435b-a229-9130343269b3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33410. Jul 26 05:55:47.530730 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-3fb7cfa7-7ab6-4b75-9f93-30e67bfe5b1b tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.775715 Jul 26 05:55:47.532406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3941/7820] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:55:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:55:47.543216 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-d6233a26-aa7c-4af4-a456-b0c13b0afa5e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:47.543759 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-d6233a26-aa7c-4af4-a456-b0c13b0afa5e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:47.764673 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-d6233a26-aa7c-4af4-a456-b0c13b0afa5e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:47.773304 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-d6233a26-aa7c-4af4-a456-b0c13b0afa5e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1247 microversion: 2.1 time: 0.233890 Jul 26 05:55:47.773979 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3880/7821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:47 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1247 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:48.799280 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f0775547-9a55-41e9-84ea-de69c080a1eb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:48.799914 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f0775547-9a55-41e9-84ea-de69c080a1eb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:48.855751 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f0775547-9a55-41e9-84ea-de69c080a1eb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:48.862536 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f0775547-9a55-41e9-84ea-de69c080a1eb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1247 microversion: 2.1 time: 0.068067 Jul 26 05:55:48.863093 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3942/7822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:48 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:49.883854 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-bf1185dd-d9bb-493a-a465-b6583050d199 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:49.884476 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-bf1185dd-d9bb-493a-a465-b6583050d199 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:49.944662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-bf1185dd-d9bb-493a-a465-b6583050d199 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:49.951525 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-bf1185dd-d9bb-493a-a465-b6583050d199 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1247 microversion: 2.1 time: 0.072145 Jul 26 05:55:49.952099 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3881/7823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:49 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:50.974977 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:50.976577 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:50.983994 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:50.984454 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:50.985406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:50.985777 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:51.052946 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:51.060649 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-1cf7c6d3-2e3f-4db4-bc78-55be7e3f24e1 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1251 microversion: 2.1 time: 0.091374 Jul 26 05:55:51.061209 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3943/7824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:50 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1251 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:55:52.082891 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:52.087606 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:52.095569 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:52.096029 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:52.096807 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:52.097251 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:52.162782 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:52.171251 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-77dcdd3a-a605-4a97-b55d-e0658a4c8da2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1243 microversion: 2.1 time: 0.092667 Jul 26 05:55:52.172061 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3882/7825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:52 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:53.195168 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:53.195805 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:53.203768 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:53.204238 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:53.205042 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:53.205502 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:53.436226 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:53.444042 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-f8a67e60-7d34-4d9a-b9b5-238ab81e14e0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.254703 Jul 26 05:55:53.454236 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3944/7826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:53 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:54.062499 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-5b7e1e95-5884-4b1f-9403-5002d42dff88 req-0355831d-b005-45e0-aad8-19e4ac4e6d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:54.073070 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5b7e1e95-5884-4b1f-9403-5002d42dff88 req-0355831d-b005-45e0-aad8-19e4ac4e6d7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:54.073667 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-5b7e1e95-5884-4b1f-9403-5002d42dff88 req-0355831d-b005-45e0-aad8-19e4ac4e6d7f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:54.087819 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-5b7e1e95-5884-4b1f-9403-5002d42dff88 req-0355831d-b005-45e0-aad8-19e4ac4e6d7f service nova] Creating event network-changed:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 05:55:54.093159 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-5b7e1e95-5884-4b1f-9403-5002d42dff88 req-0355831d-b005-45e0-aad8-19e4ac4e6d7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116795 Jul 26 05:55:54.093969 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3883/7827] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:55:54.466233 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:54.466912 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:54.473753 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:54.474341 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:54.475140 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:54.475589 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:54.610908 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:54.619401 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-a1da7111-d685-4b70-bc49-68ae4e47b146 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.157099 Jul 26 05:55:54.620039 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3945/7828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:54 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:55.641788 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:55.642564 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:55.650585 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:55.651033 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:55.651997 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:55.652445 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:55.788276 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:55.795876 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-2071722f-072e-40ea-9f21-0f81b2fde437 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.159352 Jul 26 05:55:55.796453 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3884/7829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:55 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:56.819200 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:56.819829 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:56.822551 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:56.827931 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:56.828397 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:56.829177 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:56.829633 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:56.961661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:56.969133 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-20ec91ea-5f31-4141-a310-a848d81d66c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.154415 Jul 26 05:55:56.969702 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3946/7830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:56 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:57.991184 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:57.991814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:57.999082 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:57.999545 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:58.000328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:58.000777 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:58.142949 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:58.151584 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-10ca1259-05c8-4e4e-a3c9-22a388799a59 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.165123 Jul 26 05:55:58.152196 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3885/7831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:57 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:59.172892 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:55:59.173445 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:55:59.176143 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=8 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:55:59.181778 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:59.182276 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:59.183061 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:59.183518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:59.316124 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:55:59.324284 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-703cf665-b2d8-423d-ad7b-f05773c600ed tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.155381 Jul 26 05:55:59.324856 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3947/7832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:55:59 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:55:59.663156 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-53c8efee-76f5-40f3-86b5-f2a3921430d0 req-1b871667-5ffe-4d90-ab8b-aee41f33d914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "name": "network-vif-plugged", "status": "completed", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:55:59.675222 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-53c8efee-76f5-40f3-86b5-f2a3921430d0 req-1b871667-5ffe-4d90-ab8b-aee41f33d914 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:55:59.675833 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-53c8efee-76f5-40f3-86b5-f2a3921430d0 req-1b871667-5ffe-4d90-ab8b-aee41f33d914 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:55:59.688248 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-53c8efee-76f5-40f3-86b5-f2a3921430d0 req-1b871667-5ffe-4d90-ab8b-aee41f33d914 service nova] Creating event network-vif-plugged:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 05:55:59.694065 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-53c8efee-76f5-40f3-86b5-f2a3921430d0 req-1b871667-5ffe-4d90-ab8b-aee41f33d914 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034657 Jul 26 05:55:59.695010 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3886/7833] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:56:00.345737 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:56:00.346406 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:56:00.353609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:00.354084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:00.354939 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:00.355394 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:00.484982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:56:00.493226 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-65b48bac-8d4a-4250-aa67-8a11736eb704 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1373 microversion: 2.1 time: 0.151411 Jul 26 05:56:00.493808 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3948/7834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:56:00 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:56:01.515662 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:56:01.516364 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:56:01.518489 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=8 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:56:01.524579 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:01.525058 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:01.525816 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:01.526283 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:01.665878 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:56:01.673430 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c02b049b-9b4a-4e4d-a949-6fbfbe9d9b31 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1557 microversion: 2.1 time: 0.162378 Jul 26 05:56:01.674000 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3887/7835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:56:01 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:56:01.694681 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:56:01.695307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:56:01.702202 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:01.702671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:01.703463 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:01.703922 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:01.836823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:56:01.844356 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b800eeca-9c75-4bba-b9aa-3f890089b8d2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1557 microversion: 2.1 time: 0.153796 Jul 26 05:56:01.844923 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3949/7836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:56:01 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:56:03.832609 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-011debf7-dded-4fab-91d9-e0b009998b1b req-01a5e8fa-c23a-4c7c-b3f8-b941abb6b72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:56:03.842937 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-011debf7-dded-4fab-91d9-e0b009998b1b req-01a5e8fa-c23a-4c7c-b3f8-b941abb6b72e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:56:03.843388 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-011debf7-dded-4fab-91d9-e0b009998b1b req-01a5e8fa-c23a-4c7c-b3f8-b941abb6b72e service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:56:03.855334 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-011debf7-dded-4fab-91d9-e0b009998b1b req-01a5e8fa-c23a-4c7c-b3f8-b941abb6b72e service nova] Creating event network-changed:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 05:56:03.860620 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-011debf7-dded-4fab-91d9-e0b009998b1b req-01a5e8fa-c23a-4c7c-b3f8-b941abb6b72e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Jul 26 05:56:03.861346 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3888/7837] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:56:14.166481 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:56:14.167175 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:57:53.122497 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:57:53.123057 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 05:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:57:56.371277 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:57:56.372205 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:57:56.372788 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:57:56.373583 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=44 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:57:56.377629 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1996713846"}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:57:56.380027 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:57:56.392377 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:57:56.392855 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:57:56.393637 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:57:56.394090 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:57:56.581557 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-ca833f92-33cd-4ab6-976e-99ebd84cc200 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "POST /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357/action" status: 202 len: 0 microversion: 2.1 time: 0.213112 Jul 26 05:57:56.582406 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3950/7838] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 05:57:56 2022] POST /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 05:58:02.190839 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:58:02.192351 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:58:02.193103 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:02.194900 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=30 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:02.288565 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-26f41b50-67e4-45e3-b4d5-297141d27e58 req-0e1f1672-9c4d-48ed-a3bf-5b6ceefa27cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "name": "network-vif-plugged", "status": "completed", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:02.303690 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-26f41b50-67e4-45e3-b4d5-297141d27e58 req-0e1f1672-9c4d-48ed-a3bf-5b6ceefa27cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:02.304754 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-26f41b50-67e4-45e3-b4d5-297141d27e58 req-0e1f1672-9c4d-48ed-a3bf-5b6ceefa27cd service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:02.318401 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-26f41b50-67e4-45e3-b4d5-297141d27e58 req-0e1f1672-9c4d-48ed-a3bf-5b6ceefa27cd service nova] Creating event network-vif-plugged:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 05:58:02.326813 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-26f41b50-67e4-45e3-b4d5-297141d27e58 req-0e1f1672-9c4d-48ed-a3bf-5b6ceefa27cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138385 Jul 26 05:58:02.327735 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3889/7839] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:58:03.056156 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:58:03.056338 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:58:10.121302 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:10.122102 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:10.127609 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-294587778", "imageRef": "9b56ffe0-b79a-432c-a1d4-464233676805", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1897903219", "security_groups": [{"name": "tempest-secgroup-smoke-1806693898"}], "networks": [{"uuid": "73ae6645-3315-40ac-bbd1-053977045aec"}]}} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:10.148649 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33660. Jul 26 05:58:10.158977 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33662. Jul 26 05:58:10.247220 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.network.neutron [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] validate_networks() for [('73ae6645-3315-40ac-bbd1-053977045aec', None, None, None, None, None)] {{(pid=119488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:58:10.654199 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Flavor limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:58:10.654641 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Image limits 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:58:10.655131 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Flavor pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:58:10.655553 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Image pref 0:0:0 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:58:10.655980 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.virt.hardware [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:58:10.665482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:10.665950 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:10.667497 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:10.667983 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:10.684702 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for project a1ad85b804f1488c92c34f953f09ccff. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:58:10.690985 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.quota [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Getting quotas for user a2f9dcb0e1304bd0badd794fe40c1284 and project a1ad85b804f1488c92c34f953f09ccff. Resources: {'instances', 'ram', 'cores'} {{(pid=119488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:58:10.703986 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Going to run 1 instances... {{(pid=119488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:58:10.706487 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b56ffe0-b79a-432c-a1d4-464233676805',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:58:10.753676 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8e184926-af1c-4955-95ed-5ce170672dce tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.634697 Jul 26 05:58:10.754385 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3951/7840] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Jul 26 05:58:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:58:10.768148 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-584bc135-11fe-4332-9654-934aec6076b4 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:10.768879 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-584bc135-11fe-4332-9654-934aec6076b4 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:10.782740 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6d3e107-7c39-4db2-a4e3-662ee89c3457] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33676. Jul 26 05:58:10.784543 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c368356-f0df-4082-ad34-24ccfe8d33ee] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33678. Jul 26 05:58:10.832510 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-584bc135-11fe-4332-9654-934aec6076b4 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:10.840393 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-584bc135-11fe-4332-9654-934aec6076b4 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1248 microversion: 2.1 time: 0.078588 Jul 26 05:58:10.841261 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3890/7841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:10 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:11.861835 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:11.862611 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:11.870885 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:11.871378 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:11.872191 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:11.872687 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:11.939038 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:11.946975 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-cd3729a5-48f3-4608-bd03-73bd6636cdc2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1306 microversion: 2.1 time: 0.090095 Jul 26 05:58:11.948800 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3952/7842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:11 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:12.211980 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-a31a1def-f8f9-45a6-8bce-41326f68dd12 req-cc3340f8-e19f-49f4-99ae-7947bf840004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:12.230430 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a31a1def-f8f9-45a6-8bce-41326f68dd12 req-cc3340f8-e19f-49f4-99ae-7947bf840004 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:12.231370 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-a31a1def-f8f9-45a6-8bce-41326f68dd12 req-cc3340f8-e19f-49f4-99ae-7947bf840004 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:12.243839 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-a31a1def-f8f9-45a6-8bce-41326f68dd12 req-cc3340f8-e19f-49f4-99ae-7947bf840004 service nova] Creating event network-vif-unplugged:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 05:58:12.252050 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-a31a1def-f8f9-45a6-8bce-41326f68dd12 req-cc3340f8-e19f-49f4-99ae-7947bf840004 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045453 Jul 26 05:58:12.253843 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3891/7843] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:58:12.969749 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:12.970415 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:12.977675 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:12.978649 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:12.980531 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:12.981224 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:13.124599 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:13.134504 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6058ec77-8718-4d63-ac84-1cbf65be3732 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.168510 Jul 26 05:58:13.137354 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3953/7844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:12 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:14.157484 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:14.158099 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:14.165250 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:14.165705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:14.167021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:14.167453 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:14.324984 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:14.332810 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f83e49e3-40fe-4852-8304-c6a3dac3a3f2 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.179688 Jul 26 05:58:14.345478 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3892/7845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:14 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:15.357811 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:15.358590 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:15.365431 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:15.365893 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:15.366695 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:15.367156 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:15.507256 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:15.515528 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-930d3a99-c7ba-41b6-8743-960220d648ea tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.162382 Jul 26 05:58:15.516113 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3954/7846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:15 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:16.537028 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:16.537702 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:16.546137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:16.546625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:16.547425 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:16.547883 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:16.701303 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:16.709079 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-9004e528-55c1-4ba4-9908-c1a1a8836831 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.176279 Jul 26 05:58:16.709655 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3893/7847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:16 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:17.743398 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:17.745382 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:17.753754 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:17.759084 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:17.759833 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:17.760389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:17.929707 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:17.938180 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-320dfb43-cd3e-4893-a187-8c244e747701 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.206486 Jul 26 05:58:17.938857 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3955/7848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:17 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:18.959797 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:18.960438 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:18.968196 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:18.968651 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:18.969440 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:18.969889 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:19.118448 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:19.127364 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e15dd013-d945-4a9c-9290-e5a2648dc746 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.171524 Jul 26 05:58:19.127951 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3894/7849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:18 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:20.148074 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:20.148664 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:20.156266 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:20.156728 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:20.157495 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:20.157965 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:20.326293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:20.334080 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-54326ac4-b930-4af4-a84e-b2d424bae865 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.190045 Jul 26 05:58:20.334690 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3956/7850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:20 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:21.356398 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:21.357007 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:21.359858 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell0:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:21.365460 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:21.365908 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:21.366696 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:21.367135 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:21.497972 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:21.505529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c8c77efe-32e1-4270-8432-b6f3c6f2c018 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.153669 Jul 26 05:58:21.506091 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3895/7851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:21 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:22.527766 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:22.528381 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:22.530284 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:22.530948 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell0:SELECT=6 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:22.538142 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:22.538630 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:22.539408 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:22.539861 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:22.683661 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:22.691668 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-6ab619f9-dde9-4912-933c-1ab5eacb7cac tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.168869 Jul 26 05:58:22.692246 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3957/7852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:22 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:23.331581 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-1ad1936e-d83a-4da6-8b5d-828b37d3a90d req-00c8b496-492a-4d88-97a4-639867a1532b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:23.342556 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ad1936e-d83a-4da6-8b5d-828b37d3a90d req-00c8b496-492a-4d88-97a4-639867a1532b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:23.343008 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-1ad1936e-d83a-4da6-8b5d-828b37d3a90d req-00c8b496-492a-4d88-97a4-639867a1532b service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:23.355222 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-1ad1936e-d83a-4da6-8b5d-828b37d3a90d req-00c8b496-492a-4d88-97a4-639867a1532b service nova] Creating event network-changed:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 05:58:23.361523 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-1ad1936e-d83a-4da6-8b5d-828b37d3a90d req-00c8b496-492a-4d88-97a4-639867a1532b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109306 Jul 26 05:58:23.362439 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3896/7853] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:58:23.714095 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:23.714668 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:23.722249 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:23.722593 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:23.723389 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:23.723843 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:23.865164 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:23.872751 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-7b5cf2f9-28a4-4012-b503-3d92f94b7c8f tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.163640 Jul 26 05:58:23.873327 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3958/7854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:23 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:24.895625 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:24.896328 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:24.903153 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:24.903615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:24.904380 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:24.904821 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:25.041319 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:25.048870 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-a5698225-0a82-4390-abc6-13bee9f19157 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.158399 Jul 26 05:58:25.049434 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3897/7855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:24 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:26.070240 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:26.070796 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:26.078245 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:26.078711 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:26.079488 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:26.079943 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:26.216388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:26.224148 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-b20a5a0a-2c21-4aac-ae6e-646f04e4a801 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.158020 Jul 26 05:58:26.224718 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3959/7856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:26 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:27.246876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:27.247491 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:27.254831 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:27.255356 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:27.256201 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:27.256721 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:27.392676 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:27.400403 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-326908e0-5b13-4f27-a95a-65bd3b841004 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.159398 Jul 26 05:58:27.401172 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3898/7857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:27 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:28.421733 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:28.422437 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:28.429400 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:28.429873 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:28.430719 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:28.431232 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:28.571458 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:28.579788 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-0a1558c4-31e7-445a-8c9b-85d54e219d49 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.161988 Jul 26 05:58:28.580369 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3960/7858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:28 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:29.600610 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:29.601258 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:29.608421 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:29.608884 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:29.609656 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:29.610110 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:29.747014 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:29.754581 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c22d9bee-974e-46a9-93a3-1438f867b2af tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.157875 Jul 26 05:58:29.755159 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3899/7859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:29 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:30.352357 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-19699368-4cfe-4e56-a5ae-813a957f2b12 req-1821aa74-388a-4737-b9d7-bf6eacc22113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "name": "network-vif-plugged", "status": "completed", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:30.364344 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-19699368-4cfe-4e56-a5ae-813a957f2b12 req-1821aa74-388a-4737-b9d7-bf6eacc22113 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:30.364810 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-19699368-4cfe-4e56-a5ae-813a957f2b12 req-1821aa74-388a-4737-b9d7-bf6eacc22113 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:30.376683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-19699368-4cfe-4e56-a5ae-813a957f2b12 req-1821aa74-388a-4737-b9d7-bf6eacc22113 service nova] Creating event network-vif-plugged:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 05:58:30.381625 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-19699368-4cfe-4e56-a5ae-813a957f2b12 req-1821aa74-388a-4737-b9d7-bf6eacc22113 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Jul 26 05:58:30.382550 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3961/7860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:58:30.776005 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:30.776615 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:30.783593 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:30.783990 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:30.784751 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:30.785188 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:30.922167 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:30.929852 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-f72cd8dc-3e55-4eae-a534-96fd40dba60a tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1374 microversion: 2.1 time: 0.157969 Jul 26 05:58:30.930468 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3900/7861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:30 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:31.952926 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:31.953662 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:31.961483 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:31.961952 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:31.962841 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:31.963399 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:32.108309 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:32.116020 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-c232b222-dbaf-4514-b83b-6ad0f0cbe3dc tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1558 microversion: 2.1 time: 0.168276 Jul 26 05:58:32.116530 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3962/7862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:31 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:32.136771 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:58:32.137379 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:58:32.144330 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:32.144780 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:32.145539 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:32.145976 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:32.282436 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:58:32.284761 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=59 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:58:32.291986 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-15600888-0dbf-4925-a896-95202f9428c0 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1558 microversion: 2.1 time: 0.159131 Jul 26 05:58:32.292554 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3901/7863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 05:58:32 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:58:33.899823 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-e61b8ade-e381-4368-8ace-53be223278d4 req-cbd6bb2c-1a2e-47a9-ae65-ac2a5f496ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:58:33.910293 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e61b8ade-e381-4368-8ace-53be223278d4 req-cbd6bb2c-1a2e-47a9-ae65-ac2a5f496ca9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:58:33.910761 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-e61b8ade-e381-4368-8ace-53be223278d4 req-cbd6bb2c-1a2e-47a9-ae65-ac2a5f496ca9 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:58:33.922100 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-e61b8ade-e381-4368-8ace-53be223278d4 req-cbd6bb2c-1a2e-47a9-ae65-ac2a5f496ca9 service nova] Creating event network-changed:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 05:58:33.927125 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-e61b8ade-e381-4368-8ace-53be223278d4 req-cbd6bb2c-1a2e-47a9-ae65-ac2a5f496ca9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Jul 26 05:58:33.927725 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3963/7864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 05:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:59:34.174706 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:59:34.175277 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 05:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:00:47.131927 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=28 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:00:47.132636 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:00:47.200586 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-553947859"}} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:00:47.203091 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:00:47.209246 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:00:47.209705 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:00:47.210503 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:00:47.210951 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:00:47.407954 n-d-848886-16 devstack@n-api.service[119487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [7537cf1f-55c0-4120-aaff-17b74cd44af9] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 06:00:48.415263 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [7537cf1f-55c0-4120-aaff-17b74cd44af9] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33820. Jul 26 06:00:48.422673 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-c20a6cec-3b08-447f-a91e-938aab32cd76 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "POST /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb/action" status: 202 len: 0 microversion: 2.1 time: 1.292884 Jul 26 06:00:48.423327 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3902/7865] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Jul 26 06:00:47 2022] POST /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb/action => generated 0 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 06:00:55.240357 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 06:00:55.241508 n-d-848886-16 devstack@n-api.service[119488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 06:00:55.242145 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:00:55.243098 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=66 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:00:55.249118 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-2fc3b3b4-6e7e-4956-81d7-dab5bba8fbbd req-b44c7934-178e-4563-a4ae-4037ebdc1e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "name": "network-vif-plugged", "status": "completed", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:00:55.261596 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2fc3b3b4-6e7e-4956-81d7-dab5bba8fbbd req-b44c7934-178e-4563-a4ae-4037ebdc1e3d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:00:55.262058 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-2fc3b3b4-6e7e-4956-81d7-dab5bba8fbbd req-b44c7934-178e-4563-a4ae-4037ebdc1e3d service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:00:55.273770 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-2fc3b3b4-6e7e-4956-81d7-dab5bba8fbbd req-b44c7934-178e-4563-a4ae-4037ebdc1e3d service nova] Creating event network-vif-plugged:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 06:00:55.278895 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-2fc3b3b4-6e7e-4956-81d7-dab5bba8fbbd req-b44c7934-178e-4563-a4ae-4037ebdc1e3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Jul 26 06:00:55.279492 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3964/7866] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 06:01:07.496392 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_api:SELECT=2 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:01:07.497423 n-d-848886-16 devstack@n-api.service[119487]: DEBUG dbcounter [-] [119487] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:01:07.502692 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:07.502848 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-3b24668d-1936-4612-bb4f-e459fa89061f req-9c284a99-9b72-4f93-94f2-d489dbfbca56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:01:07.503437 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:07.511484 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_cell1:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:01:07.511843 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:07.512314 n-d-848886-16 devstack@n-api.service[119488]: DEBUG dbcounter [-] [119488] Writing DB stats nova_api:SELECT=2 {{(pid=119488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 06:01:07.512670 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:07.513693 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:07.514540 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:07.522105 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [522cf598-8996-42ef-9643-99625f0800d2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 34000. Jul 26 06:01:07.531803 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] [83eac877-a0c8-4fcf-84f3-88b5eabb1099] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 34002. Jul 26 06:01:07.538518 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b24668d-1936-4612-bb4f-e459fa89061f req-9c284a99-9b72-4f93-94f2-d489dbfbca56 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:07.538982 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-3b24668d-1936-4612-bb4f-e459fa89061f req-9c284a99-9b72-4f93-94f2-d489dbfbca56 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:07.546021 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 06:01:07.551797 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-3b24668d-1936-4612-bb4f-e459fa89061f req-9c284a99-9b72-4f93-94f2-d489dbfbca56 service nova] Creating event network-changed:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 06:01:07.557683 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-3b24668d-1936-4612-bb4f-e459fa89061f req-9c284a99-9b72-4f93-94f2-d489dbfbca56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060111 Jul 26 06:01:07.558493 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3965/7867] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 06:01:07.644529 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-e159af33-b27a-463d-8ab5-b071d6d73be3 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 204 len: 0 microversion: 2.1 time: 0.150032 Jul 26 06:01:07.645328 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3903/7868] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 06:01:07 2022] DELETE /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 06:01:07.654433 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:07.655155 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:07.661529 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:07.662001 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:07.663076 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:07.663539 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:07.864482 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 06:01:07.872222 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-40376c89-6e87-4c93-abc0-6225dcf2f7bb tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1683 microversion: 2.1 time: 0.222282 Jul 26 06:01:07.872800 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3966/7869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:07 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1683 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 06:01:08.894198 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:08.894929 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:08.902679 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:08.903137 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:08.903918 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:08.904360 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:09.137475 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 06:01:09.145146 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-37d9e67b-bfa9-493f-a31f-ddbe5155c95d tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 200 len: 1683 microversion: 2.1 time: 0.255122 Jul 26 06:01:09.145713 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3904/7870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:08 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 1683 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 06:01:09.359207 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-224a5da5-5603-4bf8-801d-0799d8fcdff4 req-65ea1dfb-210e-47b1-a50c-f004ca85bbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "name": "network-vif-unplugged", "status": "completed", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:01:09.373505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-224a5da5-5603-4bf8-801d-0799d8fcdff4 req-65ea1dfb-210e-47b1-a50c-f004ca85bbd2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:09.374215 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-224a5da5-5603-4bf8-801d-0799d8fcdff4 req-65ea1dfb-210e-47b1-a50c-f004ca85bbd2 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:09.388462 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-224a5da5-5603-4bf8-801d-0799d8fcdff4 req-65ea1dfb-210e-47b1-a50c-f004ca85bbd2 service nova] Creating event network-vif-unplugged:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 06:01:09.394081 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-224a5da5-5603-4bf8-801d-0799d8fcdff4 req-65ea1dfb-210e-47b1-a50c-f004ca85bbd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040442 Jul 26 06:01:09.394923 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3967/7871] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 06:01:09.763558 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [req-7ef9c785-2b01-4086-a7d7-11ae002005ec req-3a316e5e-ade1-4c09-98c7-19295b316ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcdd148-a854-4dc8-9544-35324c7eeafb", "name": "network-vif-deleted", "tag": "de4dd48d-1ad0-4bb5-875a-c59fdea0dead"}]} {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:01:09.773032 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7ef9c785-2b01-4086-a7d7-11ae002005ec req-3a316e5e-ade1-4c09-98c7-19295b316ce5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:09.773637 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [req-7ef9c785-2b01-4086-a7d7-11ae002005ec req-3a316e5e-ade1-4c09-98c7-19295b316ce5 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:09.785877 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.compute.server_external_events [req-7ef9c785-2b01-4086-a7d7-11ae002005ec req-3a316e5e-ade1-4c09-98c7-19295b316ce5 service nova] Creating event network-vif-deleted:de4dd48d-1ad0-4bb5-875a-c59fdea0dead for instance 7bcdd148-a854-4dc8-9544-35324c7eeafb on n-h2-848886-16 Jul 26 06:01:09.792121 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [req-7ef9c785-2b01-4086-a7d7-11ae002005ec req-3a316e5e-ade1-4c09-98c7-19295b316ce5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083840 Jul 26 06:01:09.792725 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3905/7872] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 06:01:10.169376 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:10.170307 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 7bcdd148-a854-4dc8-9544-35324c7eeafb] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:10.178012 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:10.178963 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:10.180175 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:10.181165 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:10.198691 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.wsgi [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] HTTP exception thrown: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Request method failure captured: Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: request: GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb HTTP/1.1 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Accept: application/json Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Accept-Encoding: identity Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Connection: close Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Content-Length: 0 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Content-Type: application/json Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Host: 10.222.0.43 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: Openstack-System-Scope: None Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: User-Agent: python-urllib3/1.26.10 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Auth-Token: gAAAAABi34Hb05TBTTp5ePgThmP4RxlP3yw4TpHkkr4O3Y_fuhaDdfXf3uPGGHZHVFlYil9WVQhBx5JlaADhRu7oIlj_bm0yPFwdjtn8XzwCpM5aeJPIrH7y4WyPVLejDP_ftKTcrWg_ZzG-4s4HnsZyLGASIqWm7-v9jJm9jLHyg6vcOBe3XL0 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Id: None Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Domain-Name: None Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Identity-Status: Confirmed Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Is-Admin-Project: True Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Id: default Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Domain-Name: Default Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Id: a1ad85b804f1488c92c34f953f09ccff Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Project-Name: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Role: member,reader Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Roles: member,reader Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Id: a1ad85b804f1488c92c34f953f09ccff Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-Tenant-Name: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-User: tempest-TestSnapshotPattern-766372929-project Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Id: default Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-User-Domain-Name: Default Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-User-Id: a2f9dcb0e1304bd0badd794fe40c1284 Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: X-User-Name: tempest-TestSnapshotPattern-766372929-project Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: method: > Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: exception: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: action_args: {'id': '7bcdd148-a854-4dc8-9544-35324c7eeafb'} Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 06:01:10.200362 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: ERROR nova.api.openstack.wsgi Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Returning 404 to user: Instance 7bcdd148-a854-4dc8-9544-35324c7eeafb could not be found. {{(pid=119488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-8d70effe-9f7d-4183-967c-4d2e81ae4f07 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb" status: 404 len: 111 microversion: 2.1 time: 0.039268 Jul 26 06:01:10.205942 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3968/7873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:10 2022] GET /compute/v2.1/servers/7bcdd148-a854-4dc8-9544-35324c7eeafb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 06:01:11.852784 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:11.853378 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:11.855682 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-fb29be7e-5a23-4a5d-9085-b978512781e9 req-c88b5948-5669-436b-b246-61bcf7641877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:01:11.863714 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:11.864170 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:11.864943 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:11.865383 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:11.867845 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fb29be7e-5a23-4a5d-9085-b978512781e9 req-c88b5948-5669-436b-b246-61bcf7641877 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:11.868505 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-fb29be7e-5a23-4a5d-9085-b978512781e9 req-c88b5948-5669-436b-b246-61bcf7641877 service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:11.880109 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-fb29be7e-5a23-4a5d-9085-b978512781e9 req-c88b5948-5669-436b-b246-61bcf7641877 service nova] Creating event network-changed:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 06:01:11.885875 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-fb29be7e-5a23-4a5d-9085-b978512781e9 req-c88b5948-5669-436b-b246-61bcf7641877 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033571 Jul 26 06:01:11.886946 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3969/7874] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 06:01:11.896404 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Going to try to terminate instance {{(pid=119487) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 06:01:11.977454 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-38a46965-a8e9-4746-8ec8-c9b0d4cf94cd tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 204 len: 0 microversion: 2.1 time: 0.129750 Jul 26 06:01:11.978044 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3906/7875] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Jul 26 06:01:11 2022] DELETE /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 06:01:11.987530 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:11.988239 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.compute.api [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119488) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:11.995691 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:11.996421 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:11.997218 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:11.997671 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:12.162559 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.policy [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119488) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 06:01:12.170344 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-16c8745e-b3d9-4e5b-b992-0dabf915a2df tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1682 microversion: 2.1 time: 0.187153 Jul 26 06:01:12.170915 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3970/7876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:11 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 06:01:13.130867 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:01:13.131359 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:01:13.192873 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:13.193595 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:13.202876 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:13.203325 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:13.204092 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:13.204530 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:13.206747 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:01:13.206901 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:01:13.273814 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.policy [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f9dcb0e1304bd0badd794fe40c1284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ad85b804f1488c92c34f953f09ccff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119487) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 06:01:13.282832 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-99e4ce85-1fbf-4473-baf2-f65c4f00762e tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 200 len: 1495 microversion: 2.1 time: 0.095160 Jul 26 06:01:13.284006 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3907/7877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:13 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 1495 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 06:01:13.900520 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [req-d881e089-d0d7-4689-93e0-6e1a8175eed8 req-317f4d6d-8dca-4b91-9ce6-32050d0f1a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762bca1-ca5d-4efd-afb0-d1a24dbf5357", "name": "network-vif-deleted", "tag": "5bf6c86f-cef6-49c0-9806-99f737a5e9e2"}]} {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 06:01:13.911388 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d881e089-d0d7-4689-93e0-6e1a8175eed8 req-317f4d6d-8dca-4b91-9ce6-32050d0f1a9f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:13.911839 n-d-848886-16 devstack@n-api.service[119488]: DEBUG oslo_concurrency.lockutils [req-d881e089-d0d7-4689-93e0-6e1a8175eed8 req-317f4d6d-8dca-4b91-9ce6-32050d0f1a9f service nova] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:13.922560 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.compute.server_external_events [req-d881e089-d0d7-4689-93e0-6e1a8175eed8 req-317f4d6d-8dca-4b91-9ce6-32050d0f1a9f service nova] Creating event network-vif-deleted:5bf6c86f-cef6-49c0-9806-99f737a5e9e2 for instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 on n-h1-848886-16 Jul 26 06:01:13.927397 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [req-d881e089-d0d7-4689-93e0-6e1a8175eed8 req-317f4d6d-8dca-4b91-9ce6-32050d0f1a9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Jul 26 06:01:13.928056 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3971/7878] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jul 26 06:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 06:01:14.304261 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '>' {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:14.304881 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.compute.api [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] [instance: 8762bca1-ca5d-4efd-afb0-d1a24dbf5357] Fetching instance by UUID {{(pid=119487) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 06:01:14.312736 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:14.313195 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:14.313971 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 06:01:14.314468 n-d-848886-16 devstack@n-api.service[119487]: DEBUG oslo_concurrency.lockutils [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Lock "3697a559-3b1c-45d0-8c70-03664cf0eccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 06:01:14.329047 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.wsgi [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] HTTP exception thrown: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Request method failure captured: Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: request: GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 HTTP/1.1 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Accept: application/json Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Accept-Encoding: identity Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Connection: close Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Content-Length: 0 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Content-Type: application/json Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Host: 10.222.0.43 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: Openstack-System-Scope: None Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: User-Agent: python-urllib3/1.26.10 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Auth-Token: gAAAAABi34Hb05TBTTp5ePgThmP4RxlP3yw4TpHkkr4O3Y_fuhaDdfXf3uPGGHZHVFlYil9WVQhBx5JlaADhRu7oIlj_bm0yPFwdjtn8XzwCpM5aeJPIrH7y4WyPVLejDP_ftKTcrWg_ZzG-4s4HnsZyLGASIqWm7-v9jJm9jLHyg6vcOBe3XL0 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Id: None Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Domain-Name: None Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Identity-Status: Confirmed Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Is-Admin-Project: True Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Id: default Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Domain-Name: Default Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Id: a1ad85b804f1488c92c34f953f09ccff Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Project-Name: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Role: member,reader Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Roles: member,reader Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1ad85b804f1488c92c34f953f09ccff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Id: a1ad85b804f1488c92c34f953f09ccff Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-Tenant-Name: tempest-TestSnapshotPattern-766372929 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-User: tempest-TestSnapshotPattern-766372929-project Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Id: default Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-User-Domain-Name: Default Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-User-Id: a2f9dcb0e1304bd0badd794fe40c1284 Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: X-User-Name: tempest-TestSnapshotPattern-766372929-project Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: method: > Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: exception: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: action_args: {'id': '8762bca1-ca5d-4efd-afb0-d1a24dbf5357'} Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: {{(pid=119487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 06:01:14.330992 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: ERROR nova.api.openstack.wsgi Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: DEBUG nova.api.openstack.wsgi [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Returning 404 to user: Instance 8762bca1-ca5d-4efd-afb0-d1a24dbf5357 could not be found. {{(pid=119487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: INFO nova.api.openstack.requestlog [None req-01b951f7-98cb-4a46-bc54-ea933d9316d5 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357" status: 404 len: 111 microversion: 2.1 time: 0.032244 Jul 26 06:01:14.335946 n-d-848886-16 devstack@n-api.service[119487]: [pid: 119487|app: 0|req: 3908/7879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Jul 26 06:01:14 2022] GET /compute/v2.1/servers/8762bca1-ca5d-4efd-afb0-d1a24dbf5357 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 06:01:14.499928 n-d-848886-16 devstack@n-api.service[119488]: DEBUG nova.api.openstack.wsgi [None req-125ea1c5-5401-486e-bbd9-0f9d1691be46 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] Calling method '.version_select at 0x7f38b43ddc10>' {{(pid=119488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 06:01:14.522573 n-d-848886-16 devstack@n-api.service[119488]: INFO nova.api.openstack.requestlog [None req-125ea1c5-5401-486e-bbd9-0f9d1691be46 tempest-TestSnapshotPattern-766372929 tempest-TestSnapshotPattern-766372929-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1897903219" status: 202 len: 0 microversion: 2.1 time: 0.027843 Jul 26 06:01:14.523087 n-d-848886-16 devstack@n-api.service[119488]: [pid: 119488|app: 0|req: 3972/7880] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Jul 26 06:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1897903219 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 06:01:23.064763 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:01:23.065326 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:02:54.183102 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:02:54.183734 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:04:33.142221 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:04:33.142790 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:04:33.217456 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:04:33.217643 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:04:43.073429 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:04:43.073980 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:06:14.191265 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:06:14.191880 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:06:35.507872 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:06:35.508573 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:06:37.634592 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:06:37.635182 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:07:53.150433 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:07:53.151115 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:07:53.224780 n-d-848886-16 devstack@n-api.service[119488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:07:53.224964 n-d-848886-16 devstack@n-api.service[119488]: Tue Jul 26 06:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:08:03.082368 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:08:03.082931 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 06:09:34.199654 n-d-848886-16 devstack@n-api.service[119487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 06:09:34.200264 n-d-848886-16 devstack@n-api.service[119487]: Tue Jul 26 06:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!